a thoughtful web.
Share good ideas and conversation.   Login or Take a Tour!
comment by rezzeJ
rezzeJ  ·  511 days ago  ·  link  ·    ·  parent  ·  post: OpenAI‚Äôs new multitalented AI writes, translates, and slanders

To be fair, as stated on the page you linked, that example was generated on a version of the model trained on only 117 million parameters. That's 7% of the data set that feeds the full version.

The full version has not been publicly released. And examples from it are more impressive.

kleinbl00  ·  511 days ago  ·  link  ·  

It's just another fucking Markov bot. The beauty of Markov chains is they don't have to understand what the fuck they're chaining - they are generating probabilistic outcomes from noise. That's why they look like speech but are total fucking gibberish:

yet we use this shit to hassle citizens at concerts.

Everyone loves to lose their fucking minds over the flying-car future of chatbots that amusingly generate garbage as if it's somehow better than lorem ipsum and it's not. It's useful for fooling other machines into thinking they're observing a human.

StyleGAN, for example, can't tell the difference between wrinkles and glasses except in the context of "this line continues that line" and "this contrast continues that contrast." It does not have a model for "glasses." It has a model for "face" and can be taught a model for anything else, but that model only looks good when you prune the shit that looks bad:

"All models are wrong, but some are useful." The basic problem here is that the wrongness of the model has been underweighted by every breathless tech journalist in search of overweighting its usefulness and every model is fine so long as you aren't reliant on it working.

They're running our economy right now, by the way. 65% of the trades in the public markets are Markov bots that think Harriet Tubman was "the first woman to cross the US-Mexico border to escape slavery on foot." Yeah - the keywords are in there. Slavery, border, work. But the specifics are garbage.

This was the principle argument Sherry Turkle made in Alone Together: humans will bend over backwards to assign humanity to robots. We so want to pareidolia our way to robot overlords that nine times out of ten we give no fucks if the new god is chickenwire and carpet.