I don't have a kid, and the legal hours means you spend every minute of the day accompanied by the noise. The legal standard is "you have to be able to sleep".
The problem with "when you can't take it' is honestly that it is just sound and I can always just smile and deal with it no matter how long or how annoying it is. I can deal with someone playing a stereo outside my room from sun up to sun down, constant music through my day, I've done it before, it's not like it does any real damage or I absolutely am incapacitated by it.
I agree with you, the moment I can not be in an apartment or have the choice to be in a place where stereo's and loud music in general are banned I will be.