The thing that attracted me to computing as a career rather than just a hobby was how at home I felt among programmers. They were about the only people who got all my jokes, and were having conversations about things I too was interested in. I can see that driving away anyone who doesn't share the culture, but I would be very sad to see it go.
If in some parallel universe all programmers cared about indie music, craft beer, Pinterest, and potty training woes, I might not want anything to change. But if marginalized people said they felt excluded because they don't looooove glitter, I hope I would be decent enough to shut up about craft projects for five seconds and try to find common ground.
My region's annual linux convention has a list of craft beers that will be available that's much longer than the list of events. I made a point of not saying that we shouldn't alter our behavior to be more inclusive, just that I'd be sad if the only common ground we could assume is knowing how to write software. It'd be a small price to pay for progress, maybe, but it would be a price I would regret paying.