I don't know man, I'm 5'5" on a good day, and I've dated girls both shorter and significantly taller than me. My girlfriend now is shorter by maybe two inches and honestly I like it so much more. Being with a taller girl was weird for me - not because society said so or because I felt emasculated... It was just physically less comfortable. Really simple stuff like holding hands became kind of awkward. And yeah sexual stuff too. Being with someone almost my height but a little shorter has opened up a lot of opportunities in that department.
I agree that the social stigma is stupid. And I wouldn't dismiss a partner solely based on her height, but with that said I think I prefer shorter girls because for me that arrangement is more practical.