a thoughtful web.
Good ideas and conversation. No ads, no tracking.   Login or Take a Tour!
comment by user-inactivated
user-inactivated  ·  2303 days ago  ·  link  ·    ·  parent  ·  post: The Story on Amtrak Cascades Train 501 Derailment

    Sadly, it takes deadly accidents to spur safety developments:

hello i am here to tell you this is a fact of human nature and also not coincidentally why we should probably care about unfriendly ai





OftenBen  ·  2302 days ago  ·  link  ·  

    unfriendly

Would you say it's fair to maybe use 'uncaring' rather than 'unfriendly' to frame the problem in non-adversarial terms?

user-inactivated  ·  2302 days ago  ·  link  ·  

yes but i would also say i don't care about that distinction or being non-adversarial at all -- uncaring flagamuffin

OftenBen  ·  2291 days ago  ·  link  ·  

Do you think that it's possible that we could produce an AGI with the potential to cause great harm a la the paperclip optimizer scenario? You don't strike me as a prophet of Skynet.