Uhh, I should make some pithy comment, but I can't think of one just now. I just know there's a "Glenn or Glenda" joke in there somewhere.
*sigh* You can wear his stuff... My husband is much thinner than I am (I'm not fat, but not that thin). My kids both take after him which sometimes makes me feel fat - LOL. But I'll never be able to wear his pants. And his feet are longer than mine, so the shoes are out too. I could do the shirts though!