It's funny, as I was reading the original post, I was thinking (tick) colour sounds good (tick) matching set (tick) fits the Santa budget... and yep that's the way I would shop... being a woman... except that if a male work mate bought me something from Victoria's Secret a few things would zoom through my head when I opened it: my boyfriend would totally freak out if another guy bought me anything from Victoria's Secret, second was it a sleezy joke, and third, was there a hidden meaning, did I give a come on signal? And what happens next?
It also depends how well you guys know each other and if you had to open the presents in front of all the other staff.
It would be worse - but more obvious - if the gift was a thong or see-through something, but yeah, I agree with Frenchy on this one... I would feel uncomfortable next time we spoke.
However, and this might make no sense to a man, if I just got the fuzzy slippers, I'd probably be downright insulted, though, lol. Like it was saying 'frumpy present for a frumpy gal.'
Depending on the office politics where you work, it's natural to be a little cautious... I guess the safe way is to run it by your wife first.