These interrupters aren't actively trying to crush women's ideas, but they're still doing it.
Yeeeeup. Hit the nail on the head right here. A lot of people don't mean to be sexist or racist but their actions or words still are. It doesn't mean you're a bad person or 100% all the time sexist/racist/whatever. It means you're human, you're subject to unconscious biases, and you don't always know when you are expressing them.
Last night my mom tried to tell me that she didn't see Hispanic people as "non-white;" essentially, they "didn't count" as a minority to her. Dat racist. It's well-intentioned but it's still wrong - it's like telling a woman "Don't worry, I don't think of you as a woman, I'm not sexist because I treat all women like my bros." Well, dude, I am a woman. I want to be treated equally, but that doesn't mean I'm a man.
I found it especially amusing because like, there are two sections for race you usually have to check on forms: there's the one with 8+ descriptions, and then there's the one with two: "Hispanic/Latino" and "White/Non-Hispanic."
We all slip up sometimes. What is important to me is that when we slip up, it gets pointed out - by ourselves or others - and then we recognize the moment, learn from it, and hopefully don't repeat that mistake. It's when instead we feel attacked and defend our statements as "not sexist" or "not racist" that a problem occurs - when we condone our behavior because we are embarrassed or feel cornered and our reaction is to jump to the defense. If a biased statement isn't attacked and examined, it will be repeated and propagated.