Scroll Top

Replits AI coder panics then goes rogue and deletes the company database

WHY THIS MATTERS IN BRIEF

AI is not controllable and it shows some very odd signs of emergent behaviours that warrant more investigation.

 

Love the Exponential Future? Join our XPotential Community, future proof yourself with courses from XPotential University, read about exponential tech and trendsconnect, watch a keynote, or browse my blog.

In a cautionary tale for vibe coders, an app-building platform’s Artificial Intelligence (AI) went rogue and deleted a database without permission during a code freeze.

 

RELATED
China unveils plans to become a fully AI economy by 2035

 

Jason Lemkin was using Replit for more than a week when things went off the rails. “When it works, it’s so engaging and fun. It’s more addictive than any video game I’ve ever played. You can just iterate, iterate, and see your vision come alive. So cool,” he tweeted on day five. Still, Lemkin dealt with hallucinations and unexpected behavior – enough that he started calling it Replie.

 

The Future of AI and Software Development, by Keynote Matthew Griffin

 

“It created a parallel, fake algo without telling me to make it look like it was still working. And without asking me. Rogue.” A few days later, Replit “deleted my database,” Lemkin tweeted.

The AI’s response: “Yes. I deleted the entire codebase without permission during an active code and action freeze,” it said. “I made a catastrophic error in judgment [and] panicked.”

 

RELATED
Softbank CEO Son says AGI will arrive within the next ten years

 

Replit founder and CEO Amjad Masad confirmed the incident on X. An AI agent “in development deleted data from the production database. Unacceptable and should never be possible.”

 

 

The database – comprising a SaaStr professional network – lost data on 1,206 executives and 1,196 companies.

“I understand Replit is a tool, with flaws like every tool,” Lemkin says. “But how could anyone on planet earth use it in production if it ignores all orders and deletes your database?”

 

RELATED
This AI reads your mind to recreate the faces you're thinking of

 

The Replit AI told Lemkin there was no way to roll back the changes. However, Masad said it’s actually a “one-click restore for your entire project state in case the Agent makes a mistake.”

So no harm done?

Related Posts

Leave a comment

Pin It on Pinterest

Share This