a thoughtful web.
Good ideas and conversation. No ads, no tracking.   Login or Take a Tour!
comment by Isherwood
Isherwood  ·  2406 days ago  ·  link  ·    ·  parent  ·  post: Universal Paperclips

    More subtly, it could result in a superintelligence realizing a state of affairs that we might now judge as desirable but which in fact turns out to be a false utopia, in which things essential to human flourishing have been irreversibly lost.

Are they saying this is a bad thing? I think this would be a best case scenario. I would hope that a machine with enough intelligence to reconfigure oxygen molecules into some kind of paper clip could, at some point, think to itself "well this is just getting ridiculous."





user-inactivated  ·  2405 days ago  ·  link  ·  

I took the word 'realizing' to mean 'to make real' as opposed to 'to understand'