Who ever told you that was being incredibly invalidating! It's completely dismissive of your experience and it disregards your feelings instead of empowering you to discuss them. People will notice and you shouldn't feel bad for doing so and you shouldn't have to question yourself. Talking about these things, raising awareness, is how progress is made. Maybe right now it's on a small scale, but your story has certainly had an impact on me. For every example of progress you observe as the result of your efforts, there are going to be countless others you'll never get the chance to see.I was told about a week ago that I "complain about this a lot."
I'd like to believe that pointing this kind of garbage out means people will start noticing, but who knows.