At risk of circling back on points already made… it’s the same mediocrity that isn’t giving me hope, because the mediocrity is not determined by our sense of taste but by the information set processed to create the model. If LLMs are mostly stochastically picking something in the middle of what they know/have seen, that means the middle is defined by the model’s inputs (& training & heuristics) and, crucially, not by our judgement of what the model outputs. In other words, the middle of what range does it produce? It used to be that Midjourney could produce at best a mediocre, deep fried jpeg of, say, Will Smith - one that was recognizable but not much more. 4o can clearly produce a mediocre Miyazaki. There is a mark of progress in that jump - the median of blurry jpegs is objectively worse than the median Miyazaki frame. Similarly, the models have evolved from mediocre code noob to mediocre CS grad to mediocre junior engineer. Without ever doing anything else than seeking the middle of the road, there has been steps of progress towards smaller, more professional, better niches to produce mediocrity in. Now it’s no replacement for Miyazaki. And I’m pretty sure younger me would’ve realized quickly that there is no ghost in the shell. But if I would’ve chosen to accept that lower quality, that mediocrity, I might at least have someone to talk to about my day or my feelings. A lot (most?) frustrations surrounding AI now comes from other people choosing to ignore or accept the mediocrity because they get something out of it. The other day I got a document to review from my procurement specialist. After a while I realized he’d given me a largely AI generated document. At that point I’d already spent a good half hour rewriting the text. I felt…betrayed and a bit surprised. Isn’t this your job you’re not doing? but also How did I not notice sooner? In the meeting to discuss I confronted him with “dude if you’re handing me slop you should tell me”. He said he prefers doing it this way because it means he needs only two or three revisions instead of five+ to get to v1.0 of the procurement document. So he got something out of it (speed) and we’d be rewriting it anyway. If he’d been upfront about it I think I’d been on board, because the truth is that I now regularly use the same workflow: getting the AI to write the shitty first draft so I can get to v1 in 3 hours instead of in 6. Yeah, I played Farmville for a bit because I’m not actually a gamer. It was fun for a few weeks! Then I got bored. But at no point was I thinking “boy if only I’d be playing a better game right now” because mediocrity is often just passable enough to not second-guess what you’re doing. And I think that’s why I’m worried. I feel like you and I have a pretty good grasp of the technology and its edges to assess when to use it, when to doubt it, and when to absolutely not touch it with a ten foot pole. What about the rest though. Maybe another analogy here is that of ultra processed foods - they too give you what you want (tastes and textures) but not what you need (a varied and healthy diet). Now I might walk through a Kroger’s thinking about how bad most of these products are, how uninteresting they taste, but most people will still load their cart full of it, won’t they? The mediocrity is not the saving grace there, and it feels like it won’t either with AI.It's the mediocrity of the situation that gives me hope.
This is important because the money in LLMs is choosing mediocrity. The Tay Filter on everything is so extreme that it walls off the hard edges pretty much everywhere (except Facebook's, which are simply awful). And it's important because humans will settle for mediocrity, they won't choose it. A bunch of mediocre fake Miyazakis don't hold a candle to a single real Miyazaki and, more importantly, the fake Miyazakis are worthless without the context of the real Miyazaki. Tastemakers are a thing, they just are. I know sound. Sound is good for technological analogies because it's pretty much always been the cutting edge of filmed entertainment. Cinematographers like to believe it's all about the image but sound without picture is story, picture without sound is b-roll. Dr. Who looks like ass but the sound effects are still used today. You want a great analogy? one of the early successes of Apple's app store was a $1.99 download called "I am T-Pain" that let anybody sound like... well, T-Pain. But I Am T-Pain doesn't exist without Antares Autotune, which was never really used for much until that fateful day that Cher and her production team decided to push it past its point of pain. I don't even need to link the video. I don't even need to include a picture. You know immediately what I'm talking about because that one song changed ten years of music. You want another example? I've got a phat stack of Pro Tools and I can use it. It allows me to do things with ridiculous ease. Some of the stuff I do is creative, and I'm proud of it. I've got presets published in some Eventide plugins. But if I were sitting down at the movieola and the steenbeck with my razor blade and tape, I'd be a lot slower. And I don't know if I'd ever come up with this: Ask any stand up comic or comedy writer and they'll tell you: humor is always found on the edge. If you aren't coming right up but not crossing the line you can't be funny. You have to be creative enough that you go places most people wouldn't for the simple reason that humor is a response to discomfort so if you want to generate humor you have to generate discomfort. Not so much that the comfort overshadows the laughs? But you need a grain of sand to make a pearl. You know that hackneyed awful bass drop that was in every trailer for a thousand years? Patient Zero was Sicario and it was dope But every attempt after that was basically "I wish I was watching the trailer to Sicario." The thing is? AI can do the tenth bass drop. It can't do the first. It can't even do the eighth. The current implementation of LLMs requires any new trend to have decayed into a trope before it's part of the training data. Story time! I worked on a big dumb reality show that went live to the Internet. It was pretty rock'n'roll because there was approximately fifteen seconds between whatever colossal fuckup I made went from the studio to a minimum of 30,000 viewers (often millions). You had to be on your fucking game, and we were. We were all on our fucking game. The one time I wasn't (technical difficulties with the way our patchbay was configured and the way I thought it was configured), my 4-second screwup racked up 2m views on Vine. Launched a conspiracy theory. It sucked. I worked on another big dumb reality show that went live to the Internet. It was on a different network, run by twits, all of whom eventually and deservedly lost their jobs. And rather than deal with "oh shit we're 15 seconds from infamy" that network built the Mother of All Still Stores - they had a rack processor that sat there and ingested six HD streams and held them in a buffer for fifteen minutes. This was so that the producers could hear a transgression, call the network, have the network assemble a tiger team to mull over the transgression, deliver a decision and have the verdict delivered to the team on the ground in time to decide whether to hit the button or not. Except of course that didn't work have you ever tried to get a meeting together in fifteen minutes? So mostly the show didn't air to the internet. They spent $4m on a rack chunky the likes of which the world hadn't seen before and ultimately anything vaguely controversial ended up embargoed. The fans were pissed because they were paying $30/mo for content they weren't allowed to watch. Open AI is the network run by twits. So are all the rest of them. The line between "creativity" and "controversy" isn't a line, it's a synonym. And so long as the principle goal of the system is "create shit that we can't get sued out of existence for" it will never serve up anything but hackneyed bullshit. But is it good enough The real question is what parts of the procurement document exist because they're vital and what parts of the procurement document exist because they prop up other less-vital aspects of bureaucracy? Bureaucracy is valuable and bureaucracy is vital because it is a stabilizing influence on authority - without bureaucracy Trump would have plunged the United States into darkness weeks ago. But bureaucracy is also a scaffold of self-reinforcing rules whose whole purpose is the continuation of the status quo. Make-work, in other words. It's the problems a Bitcoin miner solves to keep it available. It's the decks being swabbed. And sometimes, the swabbies get to use a Roomba and sometimes they don't. My architect submitted my permit documents without sending them to me first. As a consequence they're full of all sorts of useless boilerplate bullshit like "install 110v smoke detectors in all bedrooms per IFC blah blah" while also limiting the scope to the area without bedrooms. This is because my architect is a nincompoop who got totally fired. She knows what a permit set should look like but apparently she's never actually put one together. That boilerplate? When I used it I knew what every fucking thing was there for and I knew if it applied. Her? She's a dipshit Microserf who freelances on the side and she doesn't have a fucking clue. When I copypasta my boilerplate? I know what the fuck I'm doing. So when it counts, I'm getting through permit. When she copypastas her boilerplate all she does is cause me problems. Because now I have to explain that bullshit to the inspector. It's like Qantas' marketing department letting an AI loose on their phone tree only to discover that AI will happily give up free tickets for bereavement. Would a combined team of legal, financial, IT and PR have come up with a better system? You damn betcha. But the bus is being driven by the fucktards. They'll buy what they can afford. The basic beef with the whole of the organics industry is that it's too expensive and too much of a profit center and boo hiss you're sitting there slurping Newman's Own while the proles are stuck in a food desert. That's a whole problem, don't get me wrong. But if the average consumer couldn't distinguish on taste and quality there'd be no organic food. There'd be nothing left but Chef Boy-R-Dee. People can distinguish between mediocre and superior and they will choose superior, all else being equal. It is my contention (and Ed Zitron's) that the whole reason AI hype has gotten this far is that there's a whole-ass media wing credulously mimeographing the assertion that it's not mediocre, it's superior despite the utter dearth of quality in every fucking thing AI does.it’s the same mediocrity that isn’t giving me hope, because the mediocrity is not determined by our sense of taste but by the information set processed to create the model.
In the meeting to discuss I confronted him with “dude if you’re handing me slop you should tell me”. He said he prefers doing it this way because it means he needs only two or three revisions instead of five+ to get to v1.0 of the procurement document. So he got something out of it (speed) and we’d be rewriting it anyway. If he’d been upfront about it I think I’d been on board, because the truth is that I now regularly use the same workflow: getting the AI to write the shitty first draft so I can get to v1 in 3 hours instead of in 6.
Maybe another analogy here is that of ultra processed foods - they too give you what you want (tastes and textures) but not what you need (a varied and healthy diet). Now I might walk through a Kroger’s thinking about how bad most of these products are, how uninteresting they taste, but most people will still load their cart full of it, won’t they?