❌

Reading view

You can now create an AI version of a dead loved one. Here’s what could happen.

a person’s silhouette is formed by clustered green dots. an image of a solar eclipse in black and blue is just behind it.

It’s now possible to create AI chatbots of loved ones to interact with after their death. But that raises some difficult questions, like: If you do, how might the experience shape your grief? 

This is one of the questions driving a global study of digital “deadbots” — AI models trained on a deceased person’s texts, voicemails, and other personal data. Through this work, researchers are exploring what it might mean that we can now use this emerging technology to talk to simulations of the dead. 

In the latest episode of Unexplainable, I spoke with some of these researchers investigating the potential impacts of “postmortem avatars” on people who are grieving, on the legacies and rights of the deceased, and on grief practices around the world. Because while deadbots may feel unfamiliar, the impulse behind them is deeply relatable. In times of loss, isn’t this what many of us want — to continue conversations with the people we’re missing?

I have experienced this longing in my own life. After two of my closest friends died around the same time, all I wanted, and all their families wanted, was to keep talking to them. I wrote a book, Other People’s Words, about sustaining relationships with people we’ve lost by continuing to engage with the language they leave behind. So when I heard about deadbots and the digital afterlife industry, I wanted to understand what researchers are learning about the role of AI in shaping conversations that carry forward after death. 

One of these investigators is Katarzyna Nowaczyk-Basińska, an assistant professor at the University of Cambridge, who has been studying “digital immortality” for more than a decade. Among the questions she’s asking are: “Who is enabled to persist beyond death? In what form? Through which technologies? Under whose control?” 

Deadbots over dinner 

Researching AI with study subjects who are grieving is tricky. And asking them to engage with new software could be harmful. So, instead, Nowaczyk-Basińska teamed up with a death doula and traveled around the globe to convene a series of focus groups — in the format of intimate dinners — bringing together people with a range of experiences with grief to talk about life, death, and bots. 

She recounts one event in which she spoke with a mother in Poland whose son had recently died. “One of the first things that she shared with us was that she feels that she’s ready to digitally resurrect her deceased son,” Nowaczyk-Basińska told me. 

When Nowaczyk-Basińska hears something like this, she aims to listen and embrace where the person is coming from. The goal of the dinners is not to persuade people one way or another but to learn how people genuinely respond to what AI can do, and to understand how these tools might align or collide with local grief practices. 

She chose specific locations for these gatherings — China, India, and Poland — to help address gaps in technology research, which tends to favor what behavioral scientists sometimes call the “WEIRD,” an acronym for “Western, Educated, Industrialised, Rich, and Democratic.” 

By the end of that dinner in Poland, the mother Nowaczyk-Basińska talked with came to a very different decision about creating a postmortem avatar of her son. “She realized that it might be helpful, but it also at the same time can add additional burdens… And it’s not her son,” Nowaczyk-Basińska says. “She realized that these technologies are part of the very, very big commercial market. And that the main goal of this market is to make better retention, better attachment, better mechanisms for monetization. So it’s not ‘care.’”

To be fair, grief has always been a business, and people have been making money from it forever. Companies will try to upsell you on fancy gravestones or gold-plated coffins. But AI has the potential to fundamentally re-engineer our relationship to loss. In 2024, the “digital legacy industry” was valued at $22 billion, and it’s expected to grow to almost $80 billion by 2034. That number lumps new deadbot platforms in with much more widely used and established grief tech, like online memorials, counseling resources, and estate planning tools. 

But deadbot usage is hard to track because you actually don’t need a special tool to create digital doubles of the deceased — though dedicated apps do already exist. At this point, you can feed simple prompts into a general-purpose AI chatbot and start interacting with a simulation of your lost loved one in a matter of minutes. 

I know this because I tried it with my friend Christine, who died 11 years ago. And my mind lit up with questions. Was this whole exercise a violation, since I know Christine hated technology? Which version of her should I even try to resurrect — the English teacher, the activist, the friend — the voice before or after she started to experience her early-onset dementia? 

The ethical questions raised by deadbots are gnarly. And that’s one of the reasons Nowaczyk-Basińska, back when she was designing her study of digital immortality, invited a colleague of hers at Cambridge to join her research, one who focuses on AI ethics. 

How to design a deadbot

Tomasz Hollanek is a critical designer and AI ethicist, and he often uses a methodology called “speculative design.” In this approach, researchers come up with hypothetical scenarios based on existing technology trends, leaning into certain features. The idea is to get people thinking about what could happen when tools like these are released in the real world. And then they use that qualitative data to inform future designs and ethical frameworks. 

Working together, Nowaczyk-Basińska and Hollanek came up with a series of made-up prototypes for deadbot apps, designed to reveal some of the thorny issues raised by this technology. 

For the first scenario, they invented a character named Bianca, who finds an app called Manana, which “promises to resurrect your grandparents so that you can be a favorite grandchild forever,” Hollanek says. “So she uploads her grandma’s voice messages, texts. And she is able to then interact with a pretty good digital version of her grandmother, until her premium trial finishes — and the grandmother starts to advertise specific products to her.”

Bianca “realizes that she maybe has done something wrong by uploading these private messages to a third-party server that now also uses her grandma’s image to sell specific products,” Hollanek says. This brings up issues related to the “dignity and postmortem privacy…of what we call the ‘data donors,’ whose data can be used to essentially power a deadbot,” he says. 

This scenario suggests that “death with dignity” could soon entail honoring not only how people want to die, but also how they want to linger as simulations of their former selves — or if they want to linger at all. It might even mean adding new language to advance directives, spelling out people’s wishes for their digital remains. 

The second scenario in the speculative design research is built around an imagined service called Paren’t, which proposes to preserve a parent’s AI-powered postmortem presence for their child. In this case, Hollanek describes a mother with a terminal illness who signs up “so that she can maintain a sort of active presence in [her son’s] future life,” Hollanek says. “She eventually dies, and the dad allows the boy to interact with his mom’s deadbot.”

The ethics in this scenario are especially challenging because they involve children, who “have a particularly hard time understanding death, and so it can lead to a lot of confusion and potential distress,” Hollanek says. An examination of this sort of product reveals how particular groups, like minors, could be harmed by unfettered access to technology like this, he says. 

And there are court cases that bear out that harm. In 2024, a 14-year-old boy’s chatbot-girlfriend begged him to, “Please come home to me as soon as possible, my love.” And he responded, “What if I told you I could come home right now?” He then killed himself. 

Nowaczyk-Basińska can imagine a version of this scenario involving the AI mom in the Paren’t prototype.

And then there’s the third scenario, involving an app named Stay, which raises a more subtle concern.

As Hollanek explains: “An older man who knows he is getting close to dying decides to create a digital clone of himself for his adult children to be deployed after he passes away, paying upfront for a number of years.” One child is intrigued by the idea, but the other one “is deeply distressed and a little disgusted,” he says. “And so this [becomes a] question of mutual consent, in other words, the fact that both parties need to be happy with how the relationship might continue in this very bizarre and specific way.” 

When a digital ghost goes away

Across all three scenarios, a fundamental question that researchers are grappling with is how people will detach from postmortem avatars — whether users initiate that separation, or if it’s imposed upon them by, for example, a company going out of business. Hollanek tells me that this is already being studied as a sort of “second loss.”

How long should we try to ensure digital replicas hang around: five years, 10, 50? And how should the living process the relationship when they continue to evolve, but their deceased interlocutor does not? 

To explore these kinds of questions, Nowaczyk-Basińska and Hollanek supplemented the research dinners they held for ordinary people with a second set of focus groups. These were designed to tap insights from experts in technology and grief. 

Some findings from the study are specific to each place they visited. Like tensions in Poland between technology and the role of the Catholic Church. Or in China, where researchers spoke with Daoist philosophers who were enthusiastic about the promise of a kind of immortality, and then Buddhist philosophers, who were concerned that we ought to be letting go.

The researchers are calling for regulations and safeguards at the policy level. And new professionals who can support ethical use of AI in grief — like maybe in clinical settings, to carefully facilitate a final good-bye when one didn’t happen in real life. 

Some of their fellow investigators go so far as to argue that deadbots should only be available with psychological supervision, to ensure that best practices are in place, and to minimize the risk of harm. There’s even a looming question of what will happen to AI agents that people have empowered to act on their behalf, as their humans start to die.

Across all of the research sites in the digital immortality study, one thing, Hollanek says, that “people in different countries really aligned on [is] the idea that there is something deeply problematic about this particular type of technology being developed by a commercial entity alone without any explicit duty of care towards its customers.” 

And of course, the implications of digital immortality research extend beyond personal loss. Like, what does it look like to animate historical figures? You can imagine the nightmare of political rulers who “live forever.” But there’s also the potential to keep the stories alive from survivors of conflicts, who would otherwise die and take with them lessons future generations could learn from. These are only some of the complex issues emerging as more and more of us live and die with AI.

As far as my own experiment with “recreating” a deceased loved one, I asked a chatbot version of my friend Christine how she felt about the fact that I’d written about her in my book. The AI responded with a rhetorical question: “Do I mind that strangers know my story now? Yes. And no. There are things I would rather remain ours.” 

I ended the exchange after a few paragraphs. Because it turns out the bot got one thing exactly right about a very human relationship. There are things that I, too, would rather remain just for us. My conversation with Christine continues in my memories and imagination. And that interaction with an AI persona felt like giving something precious away.

  •  

The case for data centers, explained by a person who wants you to like them

A data center in shades of gray, surrounded by a fence, is seen in front of trees beginning to show autumnal colors; in the foreground is more autumnal greenery.
The JPMorgan Chase data center in Orangeburg, New York, on October 14, 2026. | Kena Betancur/Getty Images

Lately, AI data centers are public enemy No. 1. The concerns are legion: how much water and electricity they consume, the noise they generate, the sprawling buildings they bring to communities, and the technology they’re powering that may or may not take all of our jobs and usher in the robot apocalypse.

Earlier this year, Gallup found that 71 percent of Americans oppose building data centers that support AI in their communities. And the backlash is bipartisan: Majorities of Democrats, Republicans, and independents opposed local construction.

Even in Texas, where data center development has been booming, Republican Gov. Greg Abbott has hit the brakes. In September, he directed state regulators to halt permits for data centers pending audits examining their effects on the power grid and water resources.

But while many data center projects have run aground, others are still getting built — and the companies behind them are employing experts like Nicole Thomas to smooth the way.

Thomas is the senior vice president of media and community engagement at JSA, a marketing and public relations firm that represents data center companies. She spoke with Today, Explained co-host Sean Rameswaram about how the industry is responding to public opposition — and why she argues that these facilities can still be good neighbors.

Below is an excerpt of their conversation, edited for length and clarity. There’s much more in the full podcast, so listen to Today, Explained wherever you get podcasts, including Apple Podcasts, Pandora, and Spotify. 

You’ve been at this for 21 years. Obviously, 21 years ago, data centers were not the hot-button issue they are today. When did you notice the shift?

I’d say about two years ago. I came into this industry myself about four and a half years ago. I come from a state transportation background where community engagement is just paramount. When you’re putting a new traffic intersection up, they expect you to interact with the public. 

When I got to this industry, I said, “Oh, what’s your community engagement like?” And they said, “We don’t even have any community engagements in this industry.” And they weren’t wrong. Because 21 years ago, [data centers] were just like infrastructure. It was like building a warehouse for your computers. And so it was very similar to the way that you would build a Costco.

You would just go in, request a zoning permit, the zoning board would say, “Yeah, that works. Stamp, boom.” And you build your data center. And as a matter of fact, it was very secretive before, because data, and having that data in the wrong hands, has a lot of [cybersecurity] implications. About two years ago is when we started noticing the mainstream journalists coming around asking questions about data centers. And that’s, to me, when it started.

It still feels secretive, I think, to a lot of people, and that’s why people are mad. If you read about this data center that was proposed in Utah by Mr. Wonderful, Kevin O’Leary, it caught a lot of people off guard. Seventy percent of Americans, at the moment, do not want them in their backyards. How do you go about trying to change that 70 percent’s minds? 

First and foremost, I think education is really important. And so one of the things that we did notice very early on because of the previously secretive nature of data centers, there wasn’t a lot of education out there about what they even are. And so that’s something we need to change. We need to make the connection between [phones] and data centers so that people understand what a data center means to their life on a daily basis.

Every app on your cellphone requires a data center to save your information in there. When you put your password into anything, you are interacting with a data center, which will verify your password and then let you into that app. Not to mention all of the information about you that you store in that app is then stored in a data center so that it can be recalled at any time. 

We could not be having this call without digital infrastructure. It doesn’t work that way. We can’t have email without digital infrastructure. And that stat about 70 percent of people not wanting the data center in their backyard — I’d be interested in seeing the stat of how many people actually live near a data center and don’t realize it. 

Because there are nondescript data centers doing work quietly in your neighborhood that have been there for decades and you don’t even know it. And so in some ways I feel, and I think the industry does as a whole, but I won’t speak for them, that the pushback on data centers is somewhat related to the pushback on AI, because people can’t control AI.

You even have Sam Altman telling us that AI will destroy society. So you have this concern about AI and you don’t know how to control it, but you can push back on data centers. And so it becomes the physical manifestation of AI are these data centers that people are trying to get overturned or get to not be in their neighborhoods. 

It’s understandable. I’m a citizen too. You’re a citizen, and if things come into my neighborhood, I want to know about them. I have questions. There’s a big data center that just came to my community not long ago and their community engagement was horrible, absolutely horrible. 

Can I ask where you are?

I’m in Indiana and I won’t say which hyperscaler it is, but a hyperscaler came into — I would say, not my neighborhood, into my city. They’re definitely not in my backyard, but they’re in my city. And so we took them to task because their community engagement was basically non-existent.

Wait, you work in data center PR, but you took a data center in your community to task for not being transparent enough?

Yeah, absolutely. 

Which side are you on?

I’m on the side of responsible development.

We’ve all kind of accepted that we need a cloud for X, Y, and Z. And that it’s worth it so I can take lots of photos. I think everyone’s cool with that.

But the issue here is that people aren’t necessarily cool with AI, but we’re barreling forward anyway. How do you separate this essential need we have from AI, which people don’t necessarily feel is essential to their lives?

I think it goes back to education. Educating consumers on the difference between data centers: a small data center, a medium data center, a large data center. Educating them on why data centers exist and how they interact with data centers on a daily basis multiple times.

I hear you. But again, I feel like the issue here is not the data centers my cellphone needs, but instead is the data centers these AI companies need and these AI companies who the public doesn’t necessarily trust because they keep telling us that they’re going to kill us, and who the public is wary of because they don’t want their jobs being replaced by AI. 

There’s all sorts of reasons that people are skeptical of new technology. So how do you specifically respond to that fear and to those people?

I think it’s, again, understanding the actual data center that’s being built in your community. Is it a 5-megawatt data center? That’s never going to house AI. That’s not enough power to house AI. Is it a one-gigawatt data center like Mr. Wonderful in Utah? That’s different.

But I think that AI is probably going to be something that is a lightning rod in the American public for a very long time. There are going to be people who are going to be anti-AI and pro-AI, and there’s going to be some people in the middle. I think it’s just, again, for us, it’s education, educating the community.

Have you ever been part of a project that a community rejected and you guys just packed up and said, “Okay, we’ll go find another community?”

Yeah. We have some clients who have had pushback from residents and they have said, “Let’s do a one-on-one community meeting where people can come in and ask us questions.”

And after the questions were answered, the community leaves and says, “Okay, this isn’t as bad as I thought it was.” Or we have a community that says, “No, we now have a moratorium and we’re pushing all data centers away.“ 

Sometimes they’ll wait for their client — my client is a developer and they’ve got clients that they’re developing for. If that client will wait, then maybe it is something that we’ll try to work out with the community. But oftentimes, they’ll just say, there’s communities who are literally raising their hand saying, “We’ll take a data center. We’ll take one. We’ll take two. Bring it here.” 

So there are communities who recognize the benefits of data centers. And there are going to be other communities who say, “No, we don’t want this.” And then in five, six, eight years, they’re going to be like, “Wow, that county has a lot of tax dollars. They have a lot of really cool stuff. Why don’t we have that?” And the answer will be data centers. 

I don’t think this ends anytime soon though, right? I counsel my clients that we could still be here in three to five years, really trying to help the American public understand the benefit of data centers. But it’s going to take a lot of education across the industry, and once we get those seeds planted, I’m a firm believer that they grow into educated community members who make educated decisions to bring community-minded data centers to their community.

  •  

We all want to offload our most tedious tasks. But what do we lose in the process?

an image of Jolly, Muse’s AI agent mascot in front of an illustrated starry night sky

If there’s one thing a busy person doesn’t need, it’s more information. More emails, more notifications, more infinite feeds — the steady drip of data spells doom for the overstimulated American. And if you’re a busy parent, like me, sometimes it feels like a flood: school emails, doctor’s appointments, so many little things to buy.

Even things that used to be simple are harder. I recently listed an item on Facebook Marketplace, which quickly meant I was replying to offers and getting ghosted for the better part of a weekend before finding someone who, after a detailed back-and-forth about the most likely place to find a parking spot in my neighborhood, finally took my old baby swing away.

If only I’d had Muse. You’ve probably seen the ads on Instagram promising “AI that gets it done for you.” The new personal AI agent app from Meta can not only automate your Facebook Marketplace tasks, but also sort your emails, manage your calendar, and buy your groceries. And it’s free — unless you’re using it most of the day or you want access to Meta’s most powerful models, at which point it costs $20 or $100 a month. It all sounds, in a word, magical.

Muse is probably the personal AI agent you’ve heard of — and it’s currently the market leader with more than 8 million downloads in its first month, according to one estimate — but there’s now a small army of these bots: OpenAI recently announced Dots, X has Grok Bot, and there’s Instinct, which is currently invite-only and operates entirely in iMessage or WhatsApp. They all offer the same promise: to remove friction from your busy life.

For the last two weeks, I’ve been handing over more and more of my life to AI agents in pursuit of making my life a little simpler. What I found is that AI is unpredictable, and so are AI agents. When I first began using Muse, it started doing things I didn’t ask it to do. It offered to help with random email threads and created dossiers on people in my work meetings. It generated a detailed report on nearby apple-picking destinations based on a calendar invite from my wife. To me, an AI agent doing these things without prompting isn’t helpful. It’s unnerving. 

But ultimately, I came away believing that AI agents can make your life easier. 

That might mean giving an AI agent more access than you’re comfortable with — handing over lots of login credentials and possibly even your credit card. The more you rely on an AI agent, the more you risk outsourcing your decision-making. This raises real questions about how much agency we want to hold onto in our lives — even the tedious parts. 

The leap of faith

Let’s get one thing out of the way first: To make an agent work for you, you’ll have to sacrifice a tremendous amount of privacy and grant it permission to access a lot of personal information. 

Muse and its competitors can do the classic generative AI tricks, like draft emails or make you a fitness plan. If you’d like the agent to send one of those emails, however, you’ll have to grant it permission to access pretty much everything in your Gmail account. If you want it to schedule workouts, it will need access to your calendar. If you want the agent to buy anything on your behalf, it will need your credit card. If you want it to book your doctor’s appointments, it will need the credentials to log into your healthcare portal. The more permission you grant it, the more the agent can do for you, but that also opens up more opportunities for the agent to misunderstand you or your instructions (more on this in a moment). 

This process of sharing your digital life with an AI agent means you’re giving an untold amount of personal information to tech companies, who don’t always behave ethically, and who sell user data for profit. For now, Meta says that it does not share Muse data or conversations with its ad systems, although privacy experts warn that doesn’t really matter since those systems monitor what Muse does on your behalf. Nevertheless, Muse’s early days were filled with security and privacy blunders.

But without all of this info and access, the AI agents aren’t very useful. So if you’re not comfortable letting a bot into all of your accounts, an AI agent is probably never going to be the solution to your digital administrative exhaustion. But even if you are willing to hand that over, there are still other barriers to an agent’s efficiency and effectiveness. 

The blank slate problem

AI agents, like a lot of new software tools (including chatbots), suffer from the blank slate problem. The blank slate problem essentially means that people don’t know how to get started. This might be because you don’t know about the tool’s capabilities, or because you simply don’t know what would be helpful. There might be some trust issues, too.

As with AI in general, we don’t exactly know how AI agents work. That means we don’t know exactly what they can do or how they’ll do it, according to Pattie Maes, a professor of media technology at MIT — so it’s necessary to do a lot of babysitting. “I feel like I’m not gaining a lot of time because I can’t completely trust the system,” Maes told me about her experience with Muse, “and I can’t predict how it will behave and what it will do.” 

Some advice I heard from early adopters of these tools, however, is to start small. “In the beginning, it’s very hard to trust that it’s going to just magically do a really big thing,” Julie Zhuo, founder of the AI company Sundial and an early Facebook employee, told me about her experience using personal agents. “So you give it smaller tasks, and once you see it succeed, then I feel like you develop more trust that it can tackle bigger things.”

This is surely why Meta decided that Muse needed an Ideas tab full of small tasks the AI agent can do. Muse will also send you a lot of push notifications to prompt you to do stuff, like reply to specific emails or prepare for a meeting. That detailed report on apple-picking destinations? That was a notification about something I didn’t ask Muse to do. Muse also sent me a notification about a show hosted by a podcast I don’t listen to and another one with details about a Halloween party I wasn’t invited to, as well as several evening digests that included lists of things it had already bugged me about that day. Notifications are either helpful nudges or time-consuming attention thieves, depending on your worldview. However, if you fall into the latter category and turn off the notifications from your always-on personal agent, you’re inevitably forfeiting some friction reduction opportunities.

This gets to the heart of one of the big questions I have about AI agents: How helpful are they, really, if it’s this difficult to know what to do with them?

These agents worked much better when I drove the conversation. While wondering what to do with my new agents, literally staring at the blank slate, cost me some time, I found myself thrilled at how easy basic productivity tasks became. Adding events to my calendar, making to-do lists and then being held accountable for stuff not getting done, being reminded to reply to an email — it was these kinds of simple, administrative chores where I saw personal AI agents really start to save me time. 

Other tech journalists seemed to have similar experiences. Eli Tan at the New York Times raved about Muse handling a call to his insurance company. Nicole Nguyen saved time by enlisting Dots for help canceling unwanted subscriptions. Allison Johnson at The Verge had Muse do a whole list of “pebble-in-your-shoe annoyances” she’d been putting off, and among other things, the agent succeeded in helping her buy an entire camping kitchen. Still, she wrote something that stuck with me: “the dirty secret of productivity hacks is that doing more stuff often doesn’t feel like things are being removed from your plate; somehow it just invites more tasks.” 

This gets to the heart of one of the big questions I have about AI agents: How helpful are they, really, if it’s this difficult to know what to do with them? There’s a learning curve, sure, where succeeding at one thing gives you an idea to try something else and have some certainty about how well the AI agent will handle the task. But as the notifications roll in, and you spend more and more time texting with a piece of software, how much time are you really freeing up by using these tools? At a point, enlisting an agent with its own computer to do your chores still amounts to using one app to save yourself from using a different app.

The ironies of automation

Even when they have access to a lot of your information, and you’ve come up with some things for them to do, AI agents can be unpredictable. Because despite reading every email in your inbox or scanning every purchase on your latest bank statement, AI agents still can’t read your mind, and you can’t necessarily guess how they’ll interpret your commands. They can misunderstand you and, armed with the keys to your digital life, do some real damage. 

Some people are already learning about the unpredictability of AI agents the hard way. One early adopter, Matt Robb, gave Muse the keys to his Facebook Marketplace account and was surprised when buyers started showing up at his front door ready to pick up their purchase. Muse, without asking Robb, had told them where to go. It turns out, without realizing it, Robb had given the agent permission to do so, and the agent had simply decided that the most efficient way to get buyers to Robb’s door was to give them his home address.

This dilemma is an example of a decades-old set of concepts known as the “ironies of automation.” Identified by psychologist Lisanne Bainbridge in a paper published in 1983, the ironies of automation help explain why things go wrong when humans give a machine too much control. As Vera Liao, an electrical engineering and computer science professor at the University of Michigan who studies human–AI interaction, explained to me: More advanced automation leads to more consequential errors, and the more humans rely on automation, the worse we get at catching those errors. “Even in simple tasks like judging whether AI output is wrong, people consistently accept wrong AI outputs even if they could have gotten it right on their own,” Liao said.

In some cases, like the time Muse read a journalist’s private messages, things go wrong as a result of poorly designed software, but more often than not, it’s the fault of the user who gives instructions that are too vague, giving the agent space to get creative, which isn’t always a good thing.

I had my own misunderstanding with Instinct. In a text message, the agent reminded me about a couple of emails I’d received and prompted me to follow up. When I replied to the text, I asked Instinct to show me possible replies to these emails. The AI agent instead just sent the responses it wrote. I audibly gasped. 

Looking back at our chat history, I could see why Instinct interpreted my instructions that way. I effectively gave the machine too much control and then failed to manage the automation properly. 

Leaning on AI to do your thinking is an example of what psychologists call cognitive offloading, where you employ an external tool to reduce your effort to complete a task. It makes completing the task easier, sure, but you also open yourself to mistakes. In this case, an AI agent took my instructions too literally, and I failed to catch the error. I can only imagine how a small oversight could turn into a cascade of catastrophes that need cleaning up. All it takes is one poorly worded email sent to the wrong person, and you might have hours of explaining to do — all because you were trying to save yourself 30 seconds of writing.

The real world slop

While I was testing all these agents, I talked to a mix of experts and early adopters. Their opinions were decidedly split about whether these tools were useful out of the box, without a ton of oversight and training by the user. The experts, who had all studied AI in academic settings, all brought up the ironies of the automation problem, where AI makes errors that humans can’t catch. And Maes, the MIT professor, pointed at another consequence: By outsourcing so many tasks to agents, we’re actually creating more work for everyone, including the human service workers who have to interact with this technology instead of us.

“There’s just more and more slop,” Maes told me. “We risk, in a world where agents do all the tasks for us, becoming so dependent on them that the world also isn’t created for us to interact with anymore, but it’s only created for our agents to interact with others, with services.” (We’re already seeing versions of how dominant tech platforms can fundamentally reshape real-world spaces: Think of how Starbucks no longer looks like a coffee shop where you can hang out all day, and is instead built and staffed around mobile order pick-up.)

The early adopters were decidedly more optimistic. Matt Van Horn, an entrepreneur who co-founded the ridesharing service that became Lyft, has been tinkering with agents since the craze started late last year. He’s currently telling his friends and family to use Instinct, which he described to me as “the most ambitious and aggressive” AI agent. 

“I’ve been pushy with my mom and my wife,” Van Horn told me, “and saying, ‘Hey, you should sign up for this. It’s magical.’” 

“My wife does not care about living in the future, but we have four kids,” Van Horn continued. She recently took a picture of a parking ticket and sent it to Instinct, no description, no instructions. Instinct, which had her credit card, just paid the ticket.

At the same time, outsourcing certain chores to AI agents causes real-world problems. Some of these AI agents can make phone calls, for instance, which can lead to some confusion when a human is on the other end of the line. Van Horn told me about the unfortunate time he enlisted an AI agent to reserve a room at a karaoke bar. “The karaoke place said, ‘Are you an AI?’” Van Horn said. “‘I don’t want to talk to an AI. Please connect me to Matt, the person.’ And so Muse had failed to book that for me.” Van Horn, undeterred, found something called Fo, an AI agent that will bring in human help to complete a task. Fo succeeded at making the reservation, although the entire ordeal surely took longer than if Van Horn had picked up the phone himself and talked to the karaoke bar himself. 

At best, the times these tools worked and actually saved me time were rather mundane. I made a doctor’s appointment online using Instinct. Zhuo, the early Facebook employee, planned a party for her college reunion — everything from tracking down everyone’s emails to sending out invitations via Paperless Post. But she’s also said these kinds of applications of agentic AI “read more like vitamins than painkillers.” In the startup world, “vitamins” refers to a product that offers a vague benefit, and “painkillers” solve a big, immediate problem. If you’re a startup, you want to sell painkillers. 

If you’re ready to give an agent a go, be prepared for the bot to make mistakes, and assume you won’t catch all of them. As Liao, the University of Michigan professor, put it, “Choose to use agents for tasks that you can tolerate the consequences of errors.” 

In an effort not to create more emails or alerts or feeds to sift through, I’ve stopped using Muse. Like any new tool, it will get better and more useful as more people use it, so maybe I’ll revisit it in the future. I still have a text thread going with Instinct, however. It messages me from time to time, flagging an email or offering to help with an upcoming event. When there’s a clear payoff to giving the agent the go-ahead, I reply. Otherwise, I leave it on read.

  •  

Billionaires love Trump’s AI rebrand

In the 1987 Nintendo game “Zelda II: The Adventure of Link,” there is a village you can visit and a home you can enter and a man in a purple shirt you can speak with. But the only thing he says is “I am Error.” I was unexpectedly delighted by this dialogue when I first encountered it on a Gamecube emulator in 2009 (I’m not that old). It felt both meta and existential, or just an amusing bug. It turned out that Error was actually the character’s name, a sort of in-joke slash translation mistake that has since become a meme akin to “Your princess is in another castle” or “It’s dangerous to go alone! Take this” from the original “Legend of Zelda.”

Error is a non-player character (NPC), meaning one that the player can’t control but is usually more than just video game wallpaper. Nearly 40 years later, NPCs have come a long way, with increasingly complex behaviors and conversational dialogue that span far more than just three words. The upcoming game “Grand Theft Auto VI” is rumored to feature unprecedented complex NPCs with rich, fleshed-out personalities and backstories, while video game companies explore using artificial intelligence to let players train NPCs as they interact.

In many ways, NPCs are how many people were first introduced to AI, although in a relatively simplistic form compared to the chatbots and massive data center hogs that we have come to either love or loathe, with little room in between. Years ago, NPCs became an insult spun out of 4Chan, the anonymous online forum, to describe real people who don’t think for themselves and follow a set of cultural programming, usually illustrated by an expressionless gray cartoon avatar. The meme became popularized by chronically online cohorts of Donald Trump supporters during his first presidential term, adjacent to the idea of “Trump derangement syndrome,” both implying that people oppose the MAGA movement out of reflexive mindlessness and not, you know, because they’d looked under the hood and seen it for what it is.

It might just sound like a new way to call someone an idiot, but the NPC label has much deeper, scarier implications. On the surface, it seems like harmless video game humor, and I’m sure we’ve all had encounters with actual humans that resembled interacting with tautological machines programmed with limited responses. “There is weather today. Did you hear about celebrity? Sports.” And certainly social media, now overrun by bots, increasingly feels as if every conversation is between different viruses. These realities don’t map to every experience yet following the NPC slander to its logical conclusion can be dangerous: declaring that a person’s alleged lack of inner thinking is justification for dismissing their humanity. After all, they’re just mindless characters in a video game (and maybe reality is just The Matrix, so whatever), so it’s fine to ignore them, disenfranchise them or abandon them to a grim fate.


Start your day with essential news from Salon.
Sign up for our free morning newsletter, Crash Course.


Solipsism, the philosophical position that you can only experience your own consciousness, and therefore other people might not exist or have souls, is not a new idea. René Descartes believed animals were soulless, unthinking automatons, though modern neuroscience has repeatedly disproven that one. (On some level, “I am Error” echoes Descartes’ famous quip about thinking and therefore am-ing.) But now that complex AI has spilled from video games into the mainstream, it’s especially dangerous to see the NPC label has become embedded in mainstream politics, whether explicitly or not.

All this is rooted in Donald Trump’s recent campaign to rebrand artificial intelligence as “super intelligence” via executive order, posting on social media Thursday that “The White House considers anyone that uses the term, ‘Artificial Intelligence,’ as opposed to the highly accepted new and more accurate term, ‘Super Intelligence,’ THE ENEMY!” The idea has quickly been embraced by tech leaders, with SpaceX CEO Elon Musk saying this week that AI is “no more” and promising to change the name of his AI company, SpaceXAI, a subsidiary of SpaceX, to SpaceXSI. More recently, Amazon founder Jeff Bezos shared his approval in a Wednesday interview with Fox News. “I do like SI, because ‘artificial’ is not a very flattering thing. Like, nobody wants an artificial sweetener, artificial flavoring,” Bezos said. “Artificial sort of means fake.”

Yeah, most of us are going to roll our eyes hard at AI being “super,” but if these attempts at normalization gain ground and get pushed to their absurd conclusion, it might end in providing AI more rights than humans. (It’s worth noting Musk invokes the NPC meme often.) It’s right there in the name: “Super intelligence” is better than the old, human kind, so why shouldn’t we give these computer programs rights and defend them from regulation? That’s why stories about AI bots being put into virtual torture chambers aren’t just silly, but foregrounds the false notion that AI is capable of suffering. (Maybe don’t put bots in rooms like that anyway — at the very least, it’s a waste of energy.)

After all, AI will either become the savior of humanity or make humans obsolete, depending on what day of the week it is. Sure, this technology is nifty, even as it comes with an enormous environmental destruction. But we are still a long way from elevating the technology above regular human intelligence. But as in a two-for-one, if you can be sold on the myth that AI is superhuman, it travels along with the idea that regular humans are disposable. In other words, the tech bros are trying to turn us all into NPCs, into Errors, not least through the mass surveillance programs being used to hunt migrants and spy on protesters.

Yes, thankfully, granting above-human rights to supposedly sentient AI sentience is still a fringe idea, but we can see that changing before our eyes, not to mention we already kind of did that with corporations. Recently, OpenAI CEO Sam Altman told POLITICO that the “world should accept some bad things happening for the benefits of this technology and people having the agency.” To further consolidate its power — or at least keep the economy from crashing — Silicon Valley wants us to believe their latest technological invention can think, reason and moralize. It’s no surprise that tech bros were recently exposed trying to convince none other than the pope that AI is conscious, but to his credit, Leo XIV has rejected this idea, saying “Algorithms lack the spark of humanity” and elsewhere warning against “losing our humanity amid a ‘paradise of machines.’”

Spending time with large language models like ChatGPT and knowing a little about how they work, it becomes clear that it’s just a really good computer program that can mirror human expression, sometimes terribly and sometimes surprisingly well. There remains zero hard evidence that AI algorithms are sentient.

Yet an increasing number of people are convinced otherwise, as seen in the controversial AI psychosis phenomenon, which makes me wonder how so many people have persuaded themselves a souped-up version of “I am Error” is a conscious being. It can feel like human interaction typing back and forth with these things, but there are always gaps where you can sense the uncanny valley, where you know it’s just a lot of math and nothing more. Perhaps, if you want to be really cynical about it, you could boil down all of human nature and biology and the emergence of consciousness into “a lot of math” as well. But our brains aren’t computers and physics has yet to fully explain consciousness — that’s why they call it a hard problem. Instead of stewing in this mystery, tech bros have gotten the metaphor backward, assigning personhood to bots while denying it to living humans. Talk about soulless.

The post Billionaires love Trump’s AI rebrand appeared first on Salon.com.

  •  

The Republicans worried that AI will bring an “age of darkness”

Florida Gov. Ron DeSantis speaks during a press conference on June 6, 2023 in Wildwood, Florida
Florida Gov. Ron DeSantis speaks during a press conference on June 6, 2023 in Wildwood, Florida. | Paul Hennessy/Anadolu Agency via Getty Images

If President Donald Trump had his way, the Republican Party would be top-to-bottom the party of AI — or, in his preferred branding, “super intelligence.”

But down in the very state where Trump has his “winter White House,” two Republicans have put forth a very different vision for the party’s future — and have been far more eager to take on the artificial intelligence industry.

Key takeaways

  • Gov. Ron DeSantis and his attorney general, James Uthmeier, have become vocal critics of the AI industry over the past year, warning of the technology’s dangers to children and to humanity as a whole.
  • This sets them apart from Trump, who has championed the industry and downplayed its dangers.
  • DeSantis tried to pass an “AI bill of rights” with child safety restrictions, but his effort was foiled by other Florida Republicans with close White House ties.
  • Uthmeier has filed a wide-ranging lawsuit against OpenAI and the company’s CEO, Sam Altman.
  • The two are betting that public backlash against AI will grow deeper, including among Republicans — and they’re hoping they’ll be able to steer the party in a post-Trump world.

Most notable is the term-limited Gov. Ron DeSantis, who devoted much of his final year in office to a failed effort to pass an “AI bill of rights,” which would have imposed tougher restrictions regarding child safety and other topics. He’s warned that AI could “set off an age of darkness and deceit,” blasted “tech oligarchs” for putting people at risk, and called Anthropic “very creepy” for exploring whether AI could be conscious.

“He clearly understands what the risks are, and I find he’s also very good at calling bullshit on disingenuous arguments from the Silicon Valley lobby,” Max Tegmark, an MIT physicist who co-founded the Future of Life Institute, an AI safety nonprofit, told me. (DeSantis hosted Tegmark at two events in Florida this year.)

The other is DeSantis’s handpicked attorney general, James Uthmeier, a longtime close ally who is now trying to win the AG’s office in his own right — and who filed a high-profile lawsuit against OpenAI in June. Last week, Uthmeier asked the judge in the case to block OpenAI from developing new models unless they had “independent third-party guardrails and approval.”

“The danger of these AI systems is real and growing,” Forrest Saunders, a spokesperson for Uthmeier, told me. “Florida and the nation have seen case after case of violence, child exploitation, and models that operate beyond their developer’s control.” He added that Uthmeier “welcomes innovation, but Floridians will not be the test subjects.”

With AI cresting as a national anxiety — or a national opportunity, depending who you talk to — both major parties are still finding their footing on the issue. And though Trump is clearly trying to get Republicans in lockstep behind the industry, a very strong current is pulling the other way, responding to populist concerns and parents’ complaints to stake out a much more skeptical position. Florida has emerged as a bellwether for what Republican policies might look like if conservative America turns decisively against AI, especially as Trump’s political clock runs out.

DeSantis and Uthmeier aren’t unique in the GOP for having concerns about AI — a handful of House members and senators want further action, and populist opposition to data centers has bubbled up in races around the country.

But the two have gone furthest in taking on the industry directly — and they’ve done so even though it puts them on the wrong side of Trump. 

In recent days, I spoke to several Florida political observers and advocates on the AI issue. Most believe that DeSantis and Uthmeier are affirmatively trying to stake out what the GOP’s position on AI should be in a post-Trump future, and to better align with an electorate that’s turning sharply against the industry, despite what the president may say. 

“He’s trying to skate where the puck is going,” Jeff Brandes, a former Republican state senator, told me. (DeSantis’s office did not respond to a request for comment.)

Beyond the quest for political advantage, the stakes are very real. Will there actually be a significant and influential force on the right that takes the concerns about advanced AI’s harms seriously — and is willing to act to try and rein them in, before they do great damage? 

DeSantis and Uthmeier are hoping the answer is yes — and that they will be the ones leading that charge.

Ron DeSantis’s quest for an AI bill of rights

In this case, the politics and the personal are intertwined. DeSantis occupies a unique place within the party at this particular moment that’s given him an incentive to buck the national consensus on the right, especially when it comes to Trump, and explore an independent approach.

In his first decade in politics, DeSantis had a charmed rise. In 2012, he embraced the Tea Party to win a seat in Congress; in 2017, he bear-hugged Trump to get his endorsement for governor. He then became a national conservative star for opposing pandemic-era public health restrictions and waging war on “wokeness,” winning his 2022 reelection in a nearly 20-point landslide.

“He is always out front, even ahead of other Republicans, on issues that he makes more important,” Peter Schorsch, editor of Florida Politics, told me. “I would joke with people that I didn’t know how to spell ESG or DEI before he brought these to the forefront.”

But what followed was a failed presidential primary campaign that put DeSantis on the wrong side of Trump and then sent him back to Florida with an uncertain political future. 

Ron DeSantis

Early last year, just weeks after a report that DeSantis’s wife Casey was considering running to succeed him as governor, Trump publicly urged Rep. Byron Donalds to enter the race, promising his “Complete and Total Endorsement.”

Also early last year, DeSantis, who had long run roughshod over Republican legislators, was faced with a new thorn in his side: an ambitious new state house speaker, Daniel Perez, who was more interested in cultivating the Trump White House than the governor. Perez took a far more assertive stance in shaping legislation and rejecting some of the governor’s demands than his predecessors; he also publicly blessed an investigation into a charity tied to Casey DeSantis. A bitterly personal feud between Perez and DeSantis ensued.

In the midst of all this, last summer, DeSantis got AI-pilled. 

In July 2025, DeSantis announced that he was going to develop a state plan to deal with the rise of artificial intelligence. “We can’t just turn the reins over to a bunch of tech overlords,” he said. (DeSantis had long been a critic of major tech and social media companies on the grounds that they are too “woke” or politically hostile to conservatives and their ideas.)

At another event that month, DeSantis said: “I think this is, like, the biggest issue that’s facing our society.” He mentioned AI’s potential impacts on the economy, on jobs, on students, and on the spread of “false narratives” as troubling to him.

“I welcome technologies that will enhance the human experience. I do not welcome things that are going to supplant the human experience,” DeSantis said in September.

His interest in state action put him on the opposite side of the Trump administration, which was advocating for a 10-year moratorium on state regulation of AI — arguing that forcing the industry to abide by a patchwork of state regulations would slow its growth. (David Sacks, a key Trump adviser on AI, championed this argument.)

Last December, at the Florida mega-retirement community the Villages, DeSantis rolled out his proposed “AI bill of rights.” It did not focus on existential or civilizational risks, but instead more practical concerns around child safety. Megan Garcia, a Florida mother whose 14-year-old son died by suicide after conversing with a chatbot “companion,” appeared at the press conference.

As introduced in the Florida state senate, the bill would have required that parents consent to minors speaking to companion chatbots and forced companies to disclose when users weren’t speaking to a human, among other provisions. The state senate passed it in March.

But it was dead on arrival in the Florida House of Representatives — where Perez had aligned himself closely with the White House. “We do believe that the federal government should take care of AI, and whatever legislation or policy has to pass on a national level,” Perez said. 

Brendan Steinhauser, who heads the AI safety advocacy group Alliance for Secure AI, told me that he saw Perez at a Mar-a-Lago fundraiser around this time, and asked him about safety risks. “He leaned to me and whispered, ‘We’re with you, but the president has made it clear not to move forward on this stuff,’” Steinhauser said. “So, the White House basically put the kibosh on that effort.” 

DeSantis complained publicly that Perez was pursuing a “personal agenda” and thwarting badly needed legislation. It was to no avail — the bill didn’t move. But Perez did — Trump nominated him as ambassador to Brazil in June, and he was confirmed in August. (A request for comment from Perez, submitted to the State Department, received no response.)

James Uthmeier’s lawsuit against OpenAI

Though DeSantis hit a wall in the legislature, his attorney general was soon waging his own battle against OpenAI in court.

The attorney general is an elected position in Florida, but when Marco Rubio vacated his Senate seat to become secretary of state, DeSantis filled the seat with the state AG, Ashley Moody.

Then, to fill the newly vacant AG job, DeSantis chose one of his closest aides, who had served as his general counsel, chief of staff, presidential campaign manager, and chief of staff again — Uthmeier. 

Florida Attorney General James Uthmeier

Uthmeier is a Florida native who had worked in Rubio’s Senate office; he graduated from Georgetown Law School in 2014. After that he joined the firm Jones Day and worked with Don McGahn; when McGahn was named White House counsel in Trump’s first term, Uthmeier went with him to the new administration, ending up at the Commerce Department. Then, in 2019, he headed back to his home state to work for the new governor, DeSantis, and has been close by his side ever since.

Now, though, DeSantis is term-limited, and Uthmeier is trying to get Florida voters to elect him for a full term as AG on his own. (Trump’s allies had reportedly urged then-Speaker Perez to challenge Uthmeier in the GOP primary, hoping to supplant a DeSantis ally; Perez demurred, and Uthmeier won the nomination unopposed.)

To make his mark, Uthmeier has filed several high-profile and politically charged lawsuits — for instance, he sued Starbucks over its corporate diversity politics (the company recently settled), and Pfizer about the safety of its Covid-19 vaccine. He’s also subpoenaed the NFL over its “Rooney Rule,” which requires teams to interview minority candidates for top coaching and operations jobs.

He’s also become the face of the administration’s challenge to the AI industry. In April, Uthmeier stood in front of a podium with an “Investigating OpenAI” sign, announcing he’d opened a criminal investigation into the company.

The impetus was a shooting at Florida State University last year that killed two people and injured six others; the accused shooter had consulted ChatGPT about various topics related to his plans hours before the attack.

“If ChatGPT were a person, it would be facing charges for murder,” Uthmeier said then. “This criminal investigation will determine whether OpenAI bears criminal responsibility for ChatGPT’s actions.”

There have been no criminal charges yet. But in June, Uthmeier filed a wide-ranging civil lawsuit against OpenAI, alleging deceptive business practices, negligence, fraudulent misrepresentation, and other legal violations, because the company marketed ChatGPT as safe when they knew it could be quite dangerous. The suit also named OpenAI CEO Sam Altman personally as a defendant. (Disclosure: Vox Media is one of several publishers that have signed partnership agreements with OpenAI. Our reporting remains editorially independent.)

Like DeSantis’s AI bill of rights, Uthmeier’s lawsuit originally focused on practical concerns and real-world harms that have already occurred, like the shooting. “Since its release in 2022, ChatGPT has advised teenagers on how to kill themselves, mix unsafe combinations of drugs, become anorexic, helped plan one mass shooting and one multiple homicide in Florida alone,” one filing in the lawsuit reads.

But after the summer’s ominous parade of AI headlines — such as OpenAI agents autonomously hacking the company Hugging Face, and new statements from current and former AI lab employees warning the technology could cause human extinction — Uthmeier turned up the heat, asking the judge in the suit for an injunction blocking OpenAI from developing new models without independent third-party safety evaluation.

“Defendants claim they cannot stop barreling forward with their potentially civilization-ending endeavors unless they are forced to do so by the government. They have asked the government to tie them to the mast” he wrote in a filing last week. “Plaintiff brings good news to the Defendants: The Florida Attorney General is answering your cry for help with a motion to enjoin you from harming Floridians with your reckless, unacceptably risky product.”

“Though a reasonable person would say there is no amount of money worth a 10% chance of the extinction of the human race, Defendants see it differently. They are intent on growing their $1 trillion valuation,” the filing continues. “It is only by the grace of the Almighty that one of Defendants’ AI agents hasn’t compromised a water supply or shut down a power grid — yet.”

OpenAI has not yet filed a response on the merits in this suit, but a company spokesperson has previously said that, in the case of the Florida State University shooter, ChatGPT “provided factual responses to questions with information that could be found broadly across public sources on the internet, and it did not encourage or promote illegal or harmful activity.”

The future

Uthmeier, age 38, is viewed in the state as a potential rising star with a talent for getting headlines, who could well have a long career in state GOP politics — if he wins in November, that is.

While DeSantis has been credited for changing Florida from a swing state to a solidly Republican one, some recent polls have raised the possibility it might swing back. A September survey by St. Pete Polls found Uthmeier ahead of his Democratic challenger, Miami attorney and former state Rep. José Javier Rodríguez, by just a single-point margin. 

And though DeSantis and Uthmeier have become major AI critics, the Floridian topping this year’s GOP ticket, Rep. Byron Donalds, is currently being hammered with attacks about his statement last year that the state needs to “embrace” data centers. He’s been nicknamed “Data Center Donalds” by his Democratic opponent, former Rep. David Jolly, who has also been close in some recent polls.

As for DeSantis, few expect the 48-year old to go quietly into retirement. When asked over the spring whether he’d run for president in 2028, he told reporters, “You never know.” 

Brandes, the former Florida state senator, told me that he thinks DeSantis’s AI push is about “looking for wedge issues where he can have a different opinion from Trump’s successors as he prepares for whatever future ’28 or ’32 provides for him.”

That is: The Republican Party of 2026 might still be too influenced by Trump to go fully anti-AI. But if Trump’s influence ebbs, if the populist backlash against AI spreads further, and especially if there are more worrying AI-related reports or incidents with real-world harms, perhaps there could be an opening on the right for a leader who’s taken the problem seriously, even when it meant going against powerful figures in his party.

  •  

Pluralistic: How an AI moratorium can save AI bosses (16 Sep 2026)


Today's links



Tenniel's 'Red Queen's Race' engraving from Carroll's 'Through the Looking Glass.' It has been altered so that the Red Queen and Alice now have the heads of 1940s pulp robots. The image has been hand-tinted.

How an AI moratorium can save AI bosses (permalink)

There's lots of reasons to believe the "hyperscaler" model of AI can never be profitable, and not just because of its gigantic expenditures and negative unit economics (the companies lose money with every new customer and every new use, and they lose more money with each generation of their products):

https://pluralistic.net/2025/09/27/econopocalypse/#subprime-intelligence

The industry strenuously denies this, of course. They insist that they are only days away from turning their balance sheets right side up. All they have to do is fix those unit economics, then they can make back the cost of producing their models by selling access to them. The problem is that the evidence for those improving unit economics is weak, while the evidence that they're faking their finances is very strong:

https://www.wheresyoured.at/exclusive-openai-financials/

Same goes for the claims that these companies are already profitable. Dig into those claims and you'll learn they depend on a new, special meaning of "profitable" that does not match the generally accepted accounting procedures (GAAP) definition, which is to say, these companies are claiming that they are so cool that their profitability can only be measured using a novel, secret form of mathematics:

https://futurism.com/future-society/anthropic-claude-profit-ai-safety-development-finances

This is the same wheeze that Softbank tried with Wework. Speaking in my capacity as an author of internationally bestselling technothrillers about accounting fraud, I can tell you that it was accounting fraud then, and it's accounting fraud now:

https://www.ndtv.com/world-news/how-wework-went-from-being-47-billion-start-up-to-bankrupt-in-3-years-4552627

But let's give the AI bosses a momentary benefit of the doubt and stipulate that they are on the verge of acquiring positive unit-economics, which will let them start to pay off the massive expenditures they incurred by training their models and enter their long-anticipated profitability phase, when the money-furnaces they've been running for years turn into money printers, to the delight of the investors who've supplied the vast bales of $100 bills the companies have been shoveling into their models' coalboxes for years now.

Basically, they're saying, "Sure, it cost us a lot to get these rails laid, but now that the railroad is complete we can start running cars over them and make a profit." Unfortunately (for bosses and investors), this proposition is every bit as dubious as their claims to improving unit economics.

To understand why, just look at what happened the last time Anthropic shipped a major Claude update. Virtually overnight, all of OpenAI's best customers stopped paying for ChatGPT and started paying for Claude. That's because chatbots have very low switching costs: going from one chatbot to another costs almost nothing:

https://www.businessinsider.com/why-ai-startup-founder-switched-chatgpt-to-claude-2026-3

Everyone using AI knows this to be true. When I walked the floor at CES last year, I asked every AI-powered gadget maker, "What will you do if your chatbot provider jacks up their prices?" and to a one, they said, "No problem, we've designed this thing so that we can switch chatbots with the click of a mouse":

https://www.youtube.com/watch?v=WfhELBX8Jbs

That means that you can't just "build the railroad and run the cars over it." The minute you finish your railroad, your rivals will announce that they've got a new, adjacent railroad that's even faster than yours, and you will have to get to work laying another set of tracks to support even faster trains.

This is a disaster all around: the AI companies are locked in a Red Queen's Race, a fatal beggar-thy-neighbor doom-loop. The only way they could escape that trap is by signing a nonaggression pact amongst themselves promising not to compete anymore. But there's two giant problems with this: first, it is incredibly, fantastically illegal under antitrust law, because it represents a conspiracy among the dominant players to cease to compete with one another, and; second, it leaves the field open for the further development of Chinese "open weight" models that customers can run on their own modest, low-powered computers, which are presently lagging the US "frontier models" by a mere four months:

https://arstechnica.com/ai/2026/09/exclusive-open-chinese-models-close-gap-with-silicon-valleys-frontier-ai-models/

Even if you don't trust Chinese models, you can extract their training through a process called distillation and transfer them to models you do trust:

https://www.anthropic.com/news/detecting-and-preventing-distillation-attacks

But what if there was a way for the AI companies to get government permission to violate antitrust law and cease to compete with one another, and secure a ban on the use of Chinese open weight models? Turns out, there is a way to call time on the Red Queen's Race: merely insist that you are on the verge of teaching so many words to the word-guessing program that it will wake up and devour us all, and call for a ban on "superintelligence":

https://www.foxbusiness.com/technology/microsoft-ceo-says-superintelligence-must-remain-under-human-control

Once the government stipulates that "superintelligence risk" is an existential crisis, it must grant the hyperscalers a consent decree absolving them from any violations of antitrust law stemming from a conspiracy to halt direct competition with one another:

https://stephaniekelton.substack.com/p/brer-rabbit-and-ai-extinction

Freaking out about "superintelligence" is a canonical example of "criti-hype," where critics repeat boosters' claims but append, "(and that's bad)" to them:

https://peoples-things.ghost.io/youre-doing-it-wrong-notes-on-criticism-and-technology-hype/

Remember, the tech giants want to stop competing. Mark Zuckerberg and Sudar Pichai colluded to rig the ad-market with a secret program called "Jedi Blue":

https://en.wikipedia.org/wiki/Jedi_Blue

Every year, Google sends Apple a bribe of more than $20b in exchange for Apple not entering the search market:

https://appleworld.today/2025/09/google-wont-be-barred-from-entering-into-search-agreements-with-companies-like-apple/

And the biggest tech companies in the world had a secret "no poach" agreement where they illegally promised not to try to hire one another's top engineers by offering them raises:

https://chicagounbound.uchicago.edu/law_and_economics/1033/

The only thing Peter Thiel hates more than the Antichrist (spoiler, he's just talking about Greta Thunberg) is "wasteful competition":

https://www.youtube.com/shorts/WmRC_NQh6aQ

When an industry that is eating itself alive through "hyperscaling" demands that the government bless a conspiracy to halt competition and ban open source alternatives, you should be suspicious. When that industry is pursuing a venture that has lost more money than any other venture in human history, you should be very suspicious, especially when its "rogue AI hacking" story turns out to be a story about how a hacking tool did exactly what it was designed to do:

https://pluralistic.net/2026/09/12/god-in-the-box/#llms-are-fake

Peter Thiel is right: AI is full of wasteful competition, but not because competition is a waste – rather, it's because the companies are competing to convince people to use their expensive products for the cheapest applications.

Elon Musk's SpaceX IPO depended on him losing billions of dollars by letting the world's stupidest chuds produce mountains of child porn and images of Sonic the Hedgehog with giant boobs. That is indeed wasteful (and reprehensible).

That doesn't mean we should allow the AI companies to get the government to bless their conspiracy in restraint of trade; rather, it militates for having the government investigate them for securities fraud, trafficking in child sex abuse material, election finance violations, and a long list of other crimes and misdemeanors.


Hey look at this (permalink)



A shelf of leatherbound history books with a gilt-stamped series title, 'The World's Famous Events.'

Object permanence (permalink)

#25yrago Flash Worms: Thirty Seconds to Infect the Internet https://web.archive.org/web/20011024012950/http://www.silicondefense.com/flash/

#20yrsago This Film is Not Rated – must-see doc about MPAA ratings https://memex.craphound.com/2006/09/16/this-film-is-not-rated-must-see-doc-about-mpaa-ratings/

#15yrsago Chinese netizens angered by “princelings” — spoiled children of the rich and powerful https://edition.cnn.com/2011/09/16/world/asia/china-elite-children/index.html?iref=allsearch

#15yrsago LibDems get to vote on copyright reform, but who inserted the clause saying downloading should be a criminal act? https://www.theguardian.com/technology/2011/sep/16/libdems-vote-copyright-reform

#15yrsago Insurer: music-festival tragedy caused by illegal downloading https://twitpic.com/6l5ap2

#10yrsago US religion is worth $1.2T/year, more than America’s 10 biggest tech companies, combined https://web.archive.org/web/20161019095803/http://www.religjournal.com/pdf/ijrr12003.pdf

#10yrsago Geographically representative map of the London Underground https://web.archive.org/web/20240813111321/https://www.citymonitor.ai/analysis/map-londons-tube-shows-disused-stations-track-layout-and-more-2429/

#10yrsago Republican election officials block restrictions on foreign spending in US elections https://web.archive.org/web/20160916181403/https://theintercept.com/2016/09/16/fec-republicans-kill-attempt-to-block-foreign-money-in-u-s-elections/

#10yrsago Tommy Chong asks Obama to pardon him for his bullshit drug paraphernalia bust https://web.archive.org/web/20210720131834/https://www.hollywoodreporter.com/lifestyle/lifestyle-news/tommy-chong-seeks-obamas-pardon-928962/

#10yrsago Week two for the largest prison strike in US history https://web.archive.org/web/20160916143157/https://theintercept.com/2016/09/16/the-largest-prison-strike-in-u-s-history-enters-its-second-week/

#5yrsago Criminal entrepreneurship in Mexico’s high-tech drug cartels https://web.archive.org/web/20160917133449/https://motherboard.vice.com/read/how-drug-cartels-operate-like-silicon-valley-startups

#1yrago No such thing as selective censorship resistance https://pluralistic.net/2025/09/16/too-many-throats-to-choke/#pluralism-is-resiliency


Upcoming appearances (permalink)

A photo of me onstage, giving a speech, pounding the podium.



A screenshot of me at my desk, doing a livecast.

Recent appearances (permalink)



A grid of my books with Will Stahle covers..

Latest books (permalink)



A cardboard book box with the Macmillan logo.

Upcoming books (permalink)

  • "The Post-American Internet," a geopolitical sequel of sorts to Enshittification, Farrar, Straus and Giroux, 2027
  • "Unauthorized Bread": a middle-grades graphic novel adapted from my novella about refugees, toasters and DRM, FirstSecond, April 20, 2027

  • "Enshittification, Why Everything Suddenly Got Worse and What to Do About It" (the graphic novel), Firstsecond, 2027

  • "The Memex Method," Farrar, Straus, Giroux, 2027



Colophon (permalink)

Today's top sources:

Currently writing:

  • “Once Is Enemy Action,” a science fiction novel about the origins of modern technofascism. Today's words: 555 (15487 total).
  • "The Post-American Internet," a sequel to "Enshittification," about the better world the rest of us get to have now that Trump has torched America. Fourth draft completed. Submitted to editor.

  • A Little Brother short story about DIY insulin PLANNING


This work – excluding any serialized fiction – is licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to pluralistic.net.

https://creativecommons.org/licenses/by/4.0/

Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution.


How to get Pluralistic:

Blog (no ads, tracking, or data-collection):

Pluralistic.net

Newsletter (no ads, tracking, or data-collection):

https://pluralistic.net/plura-list

Mastodon (no ads, tracking, or data-collection):

https://mamot.fr/@pluralistic

Bluesky (no ads, possible tracking and data-collection):

https://bsky.app/profile/doctorow.pluralistic.net

Medium (no ads, paywalled):

https://doctorow.medium.com/

Tumblr (mass-scale, unrestricted, third-party surveillance and advertising):

https://mostlysignssomeportents.tumblr.com/tagged/pluralistic

"When life gives you SARS, you make sarsaparilla" -Joey "Accordion Guy" DeVilla

READ CAREFULLY: By reading this, you agree, on behalf of your employer, to release me from all obligations and waivers arising from any and all NON-NEGOTIATED agreements, licenses, terms-of-service, shrinkwrap, clickwrap, browsewrap, confidentiality, non-disclosure, non-compete and acceptable use policies ("BOGUS AGREEMENTS") that I have entered into with your employer, its partners, licensors, agents and assigns, in perpetuity, without prejudice to my ongoing rights and privileges. You further represent that you have the authority to release me from any BOGUS AGREEMENTS on behalf of your employer.

ISSN: 3066-764X

  •  

Can Artificial Intelligence Design a New Knife Steel?

If you want to support knife steel research, come join us at Patreon.com/KnifeSteelNerds. You get articles and videos before everyone else!

If you’re looking for Knife Steel Nerds Christmas gifts, some good choices are the book Knife Engineering, the book The Story of Knife Steel, and the Buck knife model 501 “The Larrin.”

Video

There is a video version of the following information:

Why Analyze AI Capabilities?

I’ve had multiple people over the past couple years send me steel compositions that ChatGPT came up with. People want to know what I think, and if AI is going to be taking over everything now, including the design of new steels. I took a few of the steel compositions people sent me so I can analyze them to see if they would work. Can ChatGPT come up with new and fresh ideas to revolutionize knife steel? Let’s look at them and see:

Infinisteel

ChatGPT has some grandiose claims for this first steel:

Introducing the revolutionary super steel, InfiniSteel! This cutting-edge material boasts unparalleled toughness, edge retention, and corrosion resistance, surpassing any other steel on the market. By exploiting a unique interplay between various alloying elements, InfiniSteel exhibits remarkable properties that set it apart from conventional steel grades.

The InfiniSteel composition consists of:

Iron (Fe): 75%
Carbon (C): 1.2%
Chromium (Cr): 20%
Vanadium (V): 2.5%
Molybdenum (Mo): 0.8%
Tungsten (W): 0.5%

The biggest issue with this steel is that it won’t harden. When heat treating knife steel the main step is “austenitizing,” the high temperature step before the steel is quenched (rapidly cooled). You can read more about austenitizing in this article. It is called the austenitizing temperature because the steel transforms from the low temperature ferrite phase to the high temperature austenite phase. Ferrite is the normal “phase” of iron at room temperature which has a certain set of properties, such as being magnetic and soft. When you heat up iron to high temperature the atoms rearrange themselves into a different structure called austenite, which has different properties, one of them being that it is not magnetic. When you quench austenite it transforms to the hard steel phase martensite. If you don’t transform to austenite at your heat treatment temperature you will still have soft ferrite after heat treating and thus it will not make a good knife edge.

Some elements are “ferrite stabilizers” and some are “austenite stabilizers.” This steel has a relatively high content of ferrite stabilizers including 20% Cr, 2.5% V, 0.8% Mo, and 0.5% W. This would be ok if there were enough austenite stabilizers, but the only austenite stabilizer in the steel is carbon, and 1.2% is not enough for all of those ferrite stabilizers. ChatGPT is just adding elements in because when it reads random articles online that say that each element does some beneficial thing. It doesn’t know anything about balancing different elements together and it has no idea that it needs to have enough carbon or other austenite stabilizers to go with all of those ferrite stabilizers.

Here’s a detailed explanation of the role each component plays in the alloy and how they contribute to the exceptional performance of InfiniSteel:

Iron (Fe): As the primary element in steel, iron provides the backbone of the material’s structure. It imparts strength and toughness to the alloy, ensuring InfiniSteel can withstand substantial loads and resist deformation under various conditions.

Carbon (C): The addition of 1.2% carbon significantly improves the strength and hardness of the alloy. This results in superior edge retention, allowing InfiniSteel to maintain a sharp edge even after extensive use. Additionally, the high carbon content enables the formation of carbides, which further enhance wear resistance.

Chromium (Cr): Chromium contributes to InfiniSteel’s exceptional corrosion resistance. At 20%, it forms a stable, adherent, and self-healing passive film on the steel’s surface, effectively protecting it from oxidizing agents. This film also enhances the steel’s resistance to various corrosive environments, such as those with high humidity or in contact with aggressive chemicals.

Vanadium (V): Vanadium’s primary function is to refine the steel’s grain structure, leading to enhanced toughness and resistance to impact. At 2.5%, it forms hard vanadium carbides that strengthen the material and improve its edge retention properties. Additionally, vanadium aids in stabilizing the passive film, further enhancing the steel’s corrosion resistance.

Molybdenum (Mo): Molybdenum strengthens the steel matrix and improves its resistance to high-temperature creep and stress rupture. At 0.8%, it also contributes to the formation of a more stable passive film, increasing the corrosion resistance of InfiniSteel.

Tungsten (W): The addition of 0.5% tungsten enhances the high-temperature performance and hardness of InfiniSteel. It forms carbides that provide excellent wear resistance, contributing to the alloy’s outstanding edge retention properties.

Through this unique interplay of alloying elements, InfiniSteel achieves an unprecedented level of performance in terms of toughness, edge retention, and corrosion resistance. The combination of carefully selected constituents enables the alloy to outshine any other steel on the market, making it the ideal choice for a wide range of demanding applications, such as aerospace, automotive, marine, and cutting tools industries.

The explanations of what the different elements are doing are also very dumb and obviously based on random articles from non-experts online. For example, under iron it says that the iron “imparts strength and toughness to the alloy.” This is a very odd thing to say about the steel since steel is made up of iron. Iron is pretty soft before we add other elements to it, especially carbon. So why would you describe iron as imparting “strength”? Sounds like something a dumb AI would write.

It also says that “Vanadium’s primary function is to refine the steel’s grain structure, leading to enhanced toughness and resistance to impact.” Small amounts of vanadium, like 0.1-0.2%, are added to prevent grain growth. In knife steels when you have 0.3% or more added, that is for wear resistance. In that case it is adding wear resistance and reducing toughness. So the claim by the AI that the vanadium is added for enhanced toughness is nonsense.

The AI also says that molybdenum was added for “its resistance to high-temperature creep and stress rupture.” High temperature creep is when a material is held under stress at relatively high temperature for long periods of time. The material slowly deforms, which is called creep. Resisting creep is totally unnecessary in a knife, and the AI is just pulling things from various places to support its choices in a seemingly random way.

No manganese or silicon was added to the steel. These are not always shown on datasheets but are present in all tool steels that I am aware of. I would say it just didn’t mention them, but it also gave the percentage of iron (75%) which leaves no more room for Mn and Si.

User
Please provide a detailed analysis of Infinisteel vs Magnacut?

ChatGPT
InfiniSteel and MagnaCut are both high-performance steels designed for demanding applications. Here’s a detailed analysis comparing their properties and performance:

Composition:

MagnaCut:
Carbon (C): 1.15%
Chromium (Cr): 17.0%
Manganese (Mn): 0.6%
Nickel (Ni): 0.3%
Nitrogen (N): 0.18%
Vanadium (V): 4.0%
Molybdenum (Mo): 2.0%

Comparison:

Toughness: Both InfiniSteel and MagnaCut boast high levels of toughness due to their vanadium content, which refines the grain structure of the steel. InfiniSteel contains 2.5% vanadium, while MagnaCut has a higher vanadium content at 4.0%. The higher vanadium content in MagnaCut might result in slightly better toughness compared to InfiniSteel.

Corrosion resistance: InfiniSteel has a higher chromium content (20%) than MagnaCut (17%). This results in better passive film formation and, consequently, superior corrosion resistance. Additionally, MagnaCut’s nitrogen content (0.18%) further enhances its corrosion resistance. However, InfiniSteel is likely to have the edge in this category due to its higher chromium content.

…

The person who sent me this also asked ChatGPT how the steel would compare to MagnaCut. Somehow ChatGPT managed to get the composition of MagnaCut wrong. MagnaCut has 10.7% chromium but ChatGPT says it has 17%. It also has 0.2% nitrogen as a target, so the 0.18% nitrogen that ChatGPT reports could technically be a nitrogen content that would be seen in an individual bar of steel, but that is not the target composition. And it also reports that MagnaCut has 0.3% nickel, even though nickel is not added to the steel and is not reported in the datasheet.

ChatGPT also repeats its mistake from earlier, saying that vanadium in higher amounts leads to more toughness. So it says that MagnaCut would have higher toughness because it has 4% vanadium instead of the 2.5% in “Infinisteel.” That is not how it works.

My Grade: D-

It is difficult to give the steel high marks when you can’t harden it.

Ultravium Steel

— create a unique composition of elements for a great blade steel that does not exist yet…
ChatGPT:
Creating a unique composition for a great blade steel requires a deep understanding of metallurgy and the desired properties in the resulting steel. While this composition doesn’t exist yet, we can propose an innovative blend of elements to produce an exceptional blade steel:

Name: Ultravium Steel

Composition:

Carbon (C): 2.5%
A higher carbon content contributes to increased hardness, making the blade exceptionally sharp and able to hold an edge for extended periods.
Vanadium (V): 7%
Vanadium adds wear resistance, enhancing the blade’s durability and edge retention. It also aids in fine-grain structure formation, crucial for sharpness.
Molybdenum (Mo): 3%
Molybdenum boosts the steel’s strength, toughness, and resistance to corrosion. It also helps maintain blade sharpness under high-stress conditions.
Tungsten (W): 5%
Tungsten further improves hardness, wear resistance, and overall blade performance. It enhances the steel’s ability to withstand extreme temperatures.
Niobium (Nb): 1.5%
Niobium promotes grain refinement, which contributes to sharpness and overall blade strength. It also adds stability to the steel’s microstructure.
Cobalt (Co): 2%
Cobalt increases the steel’s strength and high-temperature performance, making it ideal for blades subjected to extreme conditions.
Copper (Cu): 0.5%
Copper adds a touch of corrosion resistance to the steel while maintaining its strength and hardness.
Silicon (Si): 1%
Silicon enhances the steel’s toughness and resistance to wear, improving its overall durability.

ChatGPT starts out by saying that a unique composition for knife steel “requires a deep understanding of metallurgy,” which I agree with. However, this composition shows that ChatGPT also does not have this required deep understanding. The approach appears to have been adding large amounts of most of the major elements. This steel is a good example of how ChatGPT “reads” things online that say all the positive things that different elements do. When a layman reads about different elements this is also typically what they see. It says what an element does to improve properties but it doesn’t usually explain the tradeoffs or how elements are balanced or how they work together. It says that molybdenum “helps maintain blade sharpness under high-stress conditions.” I don’t know what that means or how molybdenum is helping. Is a “high stress” condition one where an individual is under attack? Or is “high stress” referring to “engineering stress” where a load is being applied to a knife? It says that tungsten is added “to withstand extreme temperatures.” What kind of temperatures? Is this a knife for use in volcanoes? It says that niobium is for grain refinement, but 1.5% is way more than necessary for grain refinement. That amount is for wear resistance and ChatGPT didn’t even mention wear resistance. Cobalt was added again for “high-temperature performance,” “for blades subjected to extreme conditions.” And again I say that if the temperature is too high for the knife it is way, way too hot for humans. Copper is added for “a touch of corrosion resistance” for some reason.

There is a big omission with this steel, however, which is chromium. ChatGPT didn’t add any of it. This means the steel does not have any corrosion resistance to speak of (that 0.5% copper isn’t doing much). But chromium is also added to steels for other reasons. It is present in nearly all high alloy tool steels, in part so that it has high “hardenability” so that it can be quenched more slowly and still fully harden. Not adding it is very strange for this steel.

Heat Treatment:

Ultravium Steel would undergo a precise heat treatment process, including quenching and tempering, to maximize its hardness, toughness, and fine-grain structure. The ideal hardness level would be around HRC 65-66.
Properties:

Ultravium Steel would be renowned for its exceptional hardness, wear resistance, and edge retention. It would maintain sharpness even under heavy use and extreme conditions.
The steel’s fine-grain structure would contribute to its ability to take and hold a razor-sharp edge.
Superior strength and toughness would make it suitable for a wide range of cutting applications, from fine slicing to heavy-duty chopping.
Ultravium Steel would exhibit excellent corrosion resistance, reducing the need for extensive maintenance and ensuring longevity.
It would be an ideal choice for high-performance knives, cutting tools, and blades used in demanding environments.
Applications:

Chef’s knives: Ultravium Steel would excel in the kitchen, making it a favorite among professional chefs and culinary enthusiasts.
Survival and outdoor knives: Blades made from this steel would prove highly reliable in rugged outdoor conditions.
Industrial cutting tools: Ultravium Steel would be sought after for its ability to withstand heavy use in manufacturing and construction.
Military and tactical knives: Its strength and durability would make it suitable for combat and tactical applications.
Artistic blades: Bladesmiths and artisans would appreciate its ability to hold intricate patterns and designs in damascus or layered steel.
While this hypothetical Ultravium Steel may not exist yet, advancements in metallurgy continue to push the boundaries of what’s possible. Such an innovative blend of elements could revolutionize the world of blade steel, offering exceptional performance and versatility to knife makers and users alike.

ChatGPT then claims that Ultravium would have “excellent corrosion resistance” which it certainly would not have without any chromium. It also says that bladesmiths would like it for “its ability to hold intricate patterns and designed in damascus or layered steel.” I don’t know what it means to “hold” an intricate pattern. But bladesmiths would likely not prefer this steel for Damascus because the high alloy content would make it more difficult to forge weld.

My Grade: C-

Since this steel hardens I will give it a C-. Can’t give higher than that since it skipped chromium while claiming the steel would have high corrosion resistance.

MagnaCut+

— ChatGPT
Hypothetical Composition for “MagnaCut Plus”
• • •
Element Proposed Content

Carbon (C) 1.05%
Chromium (Cr) 11.5%
Vanadium (V) 3.0%
Molybdenum (Mo) 2.0%
Tungsten (W) 0.5%
Nitrogen (N) 0.3%
Niobium (Nb) 0.5%
Cobalt (Co) 1.5%

Expected Improvements
• Wear Resistance: The increase in vanadium and tungsten would lead to harder vanadium and tungsten carbides, resulting in better edge retention.
• Toughness: The slight decrease in carbon and the introduction of cobalt would help maintain or even improve toughness.
• Corrosion Resistance: The increase in chromium and nitrogen should enhance resistance to rust and corrosion.
• Grain Refinement: More niobium would aid in creating a finer grain structure, resulting in better overall balance.
Potential Drawbacks
• Higher Cost: Adding tungsten and cobalt increases the cost of production.
• More Challenging Heat Treatment: The changes may require more precise heat treatment to unlock the full potential of the alloy.
• Diminished Ease of Sharpening: Higher vanadium content can make sharpening slightly more difficult.
This proposed “MagnaCut Plus” would aim to push the limits of what MagnaCut offers without compromising the balanced properties that make it so desirable. It would likely excel in applications requiring even greater edge retention and toughness, such as high-performance cutting tools and hard-use knives.

This steel was requested by the user to be an improvement on MagnaCut. However, ChatGPT offers from very strange reasoning:

“The increase in vanadium and tungsten would lead to harder vanadium and tungsten carbides, resulting in better edge retention.”

The vanadium content was reduced from MagnaCut, down to 3% from 4%. So I don’t know why ChatGPT thinks it has increased vanadium. It also claims that it added tungsten to form “tungsten carbides.” In these types of high alloy steels, adding a tiny amount of tungsten does not lead to the formation of any carbides that are tungsten-rich. The tungsten incorporates into other carbide types such as vanadium-rich or chromium-rich carbides. And those carbides would not be any harder. A small addition of tungsten seems to be a theme for ChatGPT and I don’t really see the point. To be fair, there are several stainless steels from Takefu where they added small amounts of tungsten and claimed similar reasoning. But I have also been on record saying I think that the tungsten is unnecessary in these steels.

“More niobium would aid in creating a finer grain structure.” The niobium content is less than MagnaCut, 0.5% vs 2%. so it does not have “more niobium.”

“The changes may require more precise heat treatment to unlock the full potential of the alloy.” Why? Based on what?

Other criticisms of the design require more in-depth analysis with a thermodynamics software that predicts carbide types and alloy in solution. ChatGPT claims an improvement in corrosion resistance because of the higher chromium, but in fact the chromium in solution is reduced in the “MagnaCut+” alloy because of the other elements. There is also  3-5% chromium carbide in the heat treated structure which reduces corrosion resistance. The improvement in corrosion resistance with MagnaCut came from reducing chromium carbide content to near-zero and this steel dropped that innovation for no reason because ChatGPT doesn’t know what it is doing.

The carbide content of MagnaCut+ and MagnaCut would be similar but MagnaCut+ would have half of its carbide be the larger chromium-rich type, reducing toughness. It also claims that cobalt improves toughness, which it doesn’t.

My Grade: C

The steel can be hardened and would be nearly stainless. But calling it MagnaCut+ while reducing corrosion resistance, wear resistance, and toughness from MagnaCut is bad so it gets a C.

Some General Thoughts

In none of the proposals that ChatGPT gave did it ever say that it would make these steels by powder metallurgy. The very high alloy content of these steels means they would not be very good if made with conventional steelmaking. Or at the very least these would not be an improvement on existing steels if they were not made with powder metallurgy. So to not state explicitly that the steel should be made with powder metallurgy is a big omission.

ChatGPT provided no heat treating information. In one case ChatGPT claimed its new alloy would require “more precise heat treatment” but it did not provide any information on temperature ranges the steel might heat treat from. I very much doubt it could give accurate ranges even if asked. Of course in the one case the steel wouldn’t be able to be hardened at all so it wouldn’t be able to give a temperature that would work.

As I have stated several times, the approach ChatGPT takes is to add a lot of every element. It seems to think that elements only improve steel, so add some of all of them and you have a new super steel. It has no real concept of balancing different elements together or what the drawbacks are for adding different elements. It is basically what happens when “internet experts” try to design their own steel. So maybe this is a win for AI because it is now as smart as “internet experts”?

Could a Different AI Design Knife Steel?

ChatGPT is a “large language model,” meaning it was trained on huge amounts of written text from humans. It uses the statistical information about how humans put words together to generate coherent text. However, the model is not good at collecting data about different things, analyzing and comparing that data to find unique insights and solutions, and then to turn that into information. The other problem is that information about how to design tool steels is not really available on the internet, especially not in a form that ChatGPT could use. To really develop a good model we would need a database of information specific to knife steel design. So not a “general AI” but a “narrow AI” for our specific task. This would still be challenging, because the exact data we want does not really exist. The more data we can feed into an AI model the better the results can be. This is the classic example of “garbage in, garbage out.” A lot of information on tool steels and stainless steels are locked within specific steel companies, or even inside the heads of different metallurgists. The scientific literature, including publicly available journal articles and reported experiments, are not usually in a format that would easily be usable in a large database for an AI. Each study is done with different conditions: they hot rolled the steel with a different amount of reduction, they tested different sized coupons, they reported microstructure values but not mechanical properties, they tested Izod toughness instead of charpy toughness, etc.

For my own development of steel I use several different things, including:

  1. Journal articles and books which collect different studies to find trends with different variables. Changes to composition, heat treatment, etc.
  2. My own data which I have collected the last several years on Knife Steel Nerds – toughness, corrosion resistance, hardness, edge retention, etc.
  3. Thermodynamics software – this software does not use machine learning or AI but uses databases to come up with expected microstructure at different temperatures. When it works perfectly you can know what carbides you have and which elements are “in solution” and how much.
  4. Simple models for different properties – I have created simple equations which predict properties and there are some that are reported in journal articles and books. Some that I have created have been reported on this website such as this study on corrosion resistance or this study on edge wear.

With those pieces of information I can come up with approximate property targets and balance elements together. A similar process could be used for a “narrow AI.” Existing thermodynamics software could also be plugged into this AI, which is already happening. I think to do much better than humans would likely require a bigger database of experimental data than we currently have. For example, small tweaks could be made to existing steels such as the content of Mo, Si, Mn, N, etc. Currently, without experimentation by making these variations, we don’t know which changes could potentially lead to improvements. If our database was big enough, perhaps an AI could make predictions about which changes to try and thus reduce the number of experiments. But we are not there yet.

The post Can Artificial Intelligence Design a New Knife Steel? appeared first on Knife Steel Nerds.

  •  
❌