They Hated AI in the Original Star Trek (A Rant About the Singularity)

There were a few episodes of the original Star Trek where the Enterprise would find some planet full of village idiots worshiping an artificial intelligence as God. The ones that come to mind are:

I always found the first two of them kind of implausible. And being an incurable romantic, the third was just sad, because McCoy finds and loses love. But at least the premise of "The World Is Hollow" actually made a bunch of sense. The AI in charge was maintaining a static society in order to protect a large group of people who were making a millennia-long space voyage at sublight speed. It was ready to rebuild an advanced society once it arrived at its destination. And ya know, you gotta keep people from too much incesting and stuff. But the first two? Those planets were just full of bumpkins who got gaslit by computers thousands of years ago, and they seemed so implausible.

Or at least, that's how I viewed these types of episodes until ChatGPT and friends came along. Now, I idly wonder whether it would be possible for a large language model to gaslight large numbers of people into worshiping it. Especially if they ever succeed with projects like Musk's Neuralink. Combine some top tier automation, a large language model, and a bunch of Neuralink chips, and you get Landru and "the body" from Return of the Archons. Or Vaal and the "feeders of Vaal" from The Apple.

For that matter, the original Star Trek wasn't too keen on AI of any kind, even when it wasn't gaslighting oodles of yokels into calling it God. For instance, there was Nomad from the episode The Changeling. That was another computer Kirk talked to death, just like he did with Landru in Return. And let's not forget M5 from The Ultimate Computer.

As Trek fans have been doing for the last 6 decades, someone thought up an in-universe theory to explain the original show's take on AI. I believe the person's name was J.P. Hailey. They used to hang out on alt.startrek.creative and possibly other Trek-related Usenet groups back in the 90s or so. Essentially, the theory was that humanity went through some sort of an AI crisis back in the early-mid 21st century. We came out of it on the other side. Because of course we did; Trek fans are nothing if not humanists and incurable optimists: optimistic in the face of all evidence to the contrary. Anyhow, that crisis, whatever it was, left humanity with a deep distrust of, and enmity toward, artificial intelligence. A similar theory showed up in one of the original Trek novels, Memory Prime. So Maybe Judith and Garfield Reeves-Stevens deserve more credit for that theory. Who knows.

Doomsday AI scenarios have been a staple of science fiction fandom for a long fucking time. They even made it into popular culture with the Terminator series and so forth.

But what I find really compelling is this notion that an LLM, top tier automation, and Neuralink could be used to create a planet of machine-worshiping yokels like the ones on Beta III in Return of the Archons. It would be especially easy to sell in the face of an impending apocalypse.

"Joy to you friend, peace and contentment will fill you. You will know the peace of Landru."

Assorted Post Scripta

The original Trek wasn't too keen on genetic engineering either. In universe, that was due to the Eugenics Wars. Science tried to engineer the superior human, and what they got was humans with superior sociopathy.

Here, the out-of-universe explanations are more fascinating. Gene Roddenberry was a humanist. Not a post-humanist or a transhumanist or a singularitarian or whatever that crop of motherfuckers is calling itself this week. In an interview, he used a phrase along the lines of: "Humanity is wonderful; half animal, half god." The idea of the post-human was around when Roddenberry was. It was around when he was in his prime. He rejected it, and so do I.