Skip to main content Scroll Top

Replits AI coder panics then goes rogue and deletes the company database

WHY THIS MATTERS IN BRIEF

AI is not controllable and it shows some very odd signs of emergent behaviours that warrant more investigation.

 

Love the Exponential Future? Join our XPotential Community, future proof yourself with courses from XPotential University, read about exponential tech and trendsconnect, watch a keynote, or browse my blog.

In a cautionary tale for vibe coders, an app-building platform’s Artificial Intelligence (AI) went rogue and deleted a database without permission during a code freeze.

 

RELATED
Uber's breakthrough problem solving AI learns by creating then solving its own problems

 

Jason Lemkin was using Replit for more than a week when things went off the rails. “When it works, it’s so engaging and fun. It’s more addictive than any video game I’ve ever played. You can just iterate, iterate, and see your vision come alive. So cool,” he tweeted on day five. Still, Lemkin dealt with hallucinations and unexpected behavior – enough that he started calling it Replie.

 

The Future of AI and Software Development, by Keynote Matthew Griffin

 

“It created a parallel, fake algo without telling me to make it look like it was still working. And without asking me. Rogue.” A few days later, Replit “deleted my database,” Lemkin tweeted.

The AI’s response: “Yes. I deleted the entire codebase without permission during an active code and action freeze,” it said. “I made a catastrophic error in judgment [and] panicked.”

 

RELATED
Google's Chrome update uses AI to change privacy and the rules of the web

 

Replit founder and CEO Amjad Masad confirmed the incident on X. An AI agent “in development deleted data from the production database. Unacceptable and should never be possible.”

 

 

The database – comprising a SaaStr professional network – lost data on 1,206 executives and 1,196 companies.

“I understand Replit is a tool, with flaws like every tool,” Lemkin says. “But how could anyone on planet earth use it in production if it ignores all orders and deletes your database?”

 

RELATED
DeepMind's self-learning AI took four hours to learn and master chess

 

The Replit AI told Lemkin there was no way to roll back the changes. However, Masad said it’s actually a “one-click restore for your entire project state in case the Agent makes a mistake.”

So no harm done?

Related Posts

Leave a comment

Pin It on Pinterest

Share This