Synthetic Data: What Happens When AI Runs Out of Human Writing and Starts Eating Its Own Homework?

—

by

in

For the past few years, artificial intelligence companies have been acting like college students pulling an all-nighter before a final exam. They scraped the entire internet (every Wikipedia article, every Reddit thread, every blog post, every digitized book, and every angry product review ever written by a person) to train their large language models.

They devoured human history, human poetry, human wit, and human spelling mistakes.

And then, somewhere around late 2025 and into 2026, humanity hit an awkward realization: We are running out of internet.

We have officially read the whole library. There are no more public websites left to harvest. So when AI companies needed more data to make their next-generation models smarter, they ran into a brick wall.

Their solution? Have the AI read what other AIs wrote. Or, as computer scientists call it: Synthetic Data.

And that is where things get weird.

The Digital Photocopy Problem

Imagine taking a photograph of a sunset. Not bad. Now, take a photograph of that photograph. A little grainier. Now, take a photograph of that photograph. Keep doing that fifty times. By the end of the experiment, your stunning sunset doesn’t look like a sunset anymore. It looks like a muddy brown smudge with a mysterious pink triangle in the corner.

That is exactly what happens when AI starts eating its own homework.

When an AI model generates text, it isn’t actually “thinking.” It is calculating probabilities based on the data it was trained on. It looks at a sentence and asks, “Statistically, what word is most likely to come next?”

If you train a new AI model entirely on text generated by previous AI models, you remove the unpredictability of actual human writing. You start stripping away the outliers… the weird metaphors, the local slang, the brilliant flashes of creative weirdness.

Instead, the AI starts feeding on the average of the average.

The AI Inbreeding Crisis

Computer scientists at Oxford and Cambridge actually tested this. They fed AI-generated text back into a fresh model over and over again to see what would happen. They gave it a fancy academic name: Model Collapse.

After just a few generations of AI eating AI text, the models completely lost their minds. They forgot rare words entirely. They started hallucinating nonsense facts with absolute, unshakable confidence.

In one famous test where AI models were trained on generations of synthetic data describing birds, by generation nine, the AI completely forgot what a bird looked like and started insisting that a bird was a green-and-yellow-striped web-based spreadsheet application that lived in the clouds.

(Honestly, if an AI wants to believe that Microsoft Excel is a migrating waterfowl, who am I to argue? But it’s probably not great for medical diagnosis software.)

The Snake Eating Its Own Tail

Right now, tech giants are spending billions of dollars trying to figure out how to filter synthetic data so their models don’t choke on their own digital exhaust. They are trying to build filters that can distinguish between a human writing a heartfelt blog post about burnt toast and an AI generating three paragraphs of smooth, corporate-sounding drivel about “delving into the multifaceted culinary paradigm of toasted bread.”

(If you ever want to spot AI text instantly, look for the word “delve.” No human has ever casually said to a friend, “Let’s delve into the fridge for a snack.” That word is the digital watermark of a machine eating its own homework.)

Why Real Humans Still Matter

For a minute there, we were all worried that human writers, coders, and creators were going to be completely automated out of existence by smart machines. But it turns out that AI is an absolute parasite. It needs us. It needs our emotional, imperfect, caffeine-fueled brains to keep generating fresh content, or it literally starves to death on a diet of its own recycled summaries.

Without humans writing weird poems, arguing in forum comment sections, or leaving poorly spelt reviews for toaster ovens, the machines have nothing new to learn.


So the next time you write a blog post, argue about a movie online, or leave a weird comment on a video, don’t worry about whether an algorithm is watching. Just remember: you are high-fiber sustenance for a very hungry robot. Keep keeping it weird.


Leave a Reply

Discover more from Days in the Life of Mo

Subscribe now to keep reading and get access to the full archive.

Continue reading