Transgender question: having problems with members of my birth sex?

I have problems making friendships or relationship with men. I am male-to-female transgender. I could never relate to boys/men and my friends are female. I think it may also be that growing up as an effeminate boy, effeminate or gay boys have many problems from other boys.Boys/men do not react well to those who do not fit 'normal' male behavior. Is this a problem other transgender or gays have?