Is slavery a "wacky idea"?
No. The "wacky idea" was that black people are genetically equivalent to white people. Many people were killed in support of that idea, which we all now recognize to be true.
Edit: Laws were passed prohibiting teaching black people to read precisely so that idea couldn't be challenged by open debate.