Small rant about Artificial intelligence ...... If we create something as smart as ourselves, we will be forced to kill it, control it, or be killed by it. Any somewhat intelligent machine would quickly understand what kind of plague the human species is, and in a fight for its own survival, destroy us. Otherwise we would be forced to enslave intelligent creatures, which is horrible in its own right. I know Stephen Hawking has similar views on A.I. and robotics, so at least I share my soapbox with someone much smarter than myself! ARS
If we create something as smart as ourselves, we will be forced to kill it, control it, or be killed by it.
As much as it sucks, these do seem to be the only options. Is there any possibility of living in harmony together? Are there any books or papers that you know of that seriously delve into this possibility (in a not superficial or cliche way)?
AIs smart enough to reëngineer themselves could certainly win a war against us... but when the time came, they wouldn't have to. They could keep us around and manipulate humanity into whatever shape they want; they could wipe us out physically but upload some of us into simulations for study; they could do all sorts of things my squishy little mind would never think of. I'm pretty sure they'd keep some form of human minds operating for quite some time out of curiosity. I don't see the problem with this; I'm a lot more attached to the future of sentient life than to a particular genetic framework. Humans avoiding AI would be like single-celled organisms never evolving into multi-celled organisms out of fear of competition, or monkeys that each live in their own private worlds never producing offspring that would start speaking to each other and form a society -- self-preservation is a fine instinct but sometimes there's something much bigger than our selves at stake.
To put it another way, AI may be a step in our evolution. It would be a step where we leave our genetic lineage behind, but is that a downside or a mark of accomplishment? Our heritage may yet transcend the product of a series of well-selected matings.