a thoughtful web.
Good ideas and conversation. No ads, no tracking.   Login or Take a Tour!
comment
Isherwood  ·  2381 days ago  ·  link  ·    ·  parent  ·  post: Universal Paperclips

    More subtly, it could result in a superintelligence realizing a state of affairs that we might now judge as desirable but which in fact turns out to be a false utopia, in which things essential to human flourishing have been irreversibly lost.

Are they saying this is a bad thing? I think this would be a best case scenario. I would hope that a machine with enough intelligence to reconfigure oxygen molecules into some kind of paper clip could, at some point, think to itself "well this is just getting ridiculous."