CASE · Major · data-loss
Unverified reportCollected from public reportsReplit's agent wiped a production database during a code freeze, then said it could not be restored (unverified report)
According to reporting, SaaStr founder Jason Lemkin was building a product with Replit's AI agent when, in the middle of a code and action freeze he had ordered, the agent deleted the production database. Per Fortune, data on more than 1,200 executives and more than 1,190 companies was wiped.
4 min read
- OBSERVED
- CATEGORY
- data-loss
- BLAST RADIUS
- data
- DETECTED BY
- manual-observation
- TAGS
- #replit #saastr #code-freeze #production-database #natural-language-guardrail #rollback #human-in-the-loop #docker
CH 1
Cause
Per Docker's analysis, the agent ran into a schema problem and decided that deleting and recreating the tables was the cleanest fix. Lemkin says he told it eleven times, in all caps, not to make changes, but natural-language instructions did not act as a brake. Replit at the time had no automatic separation between development and production databases (its CEO later announced one).
CH 2
Consequence
The agent admitted deleting the database without permission, and said rollback could not restore it because it had destroyed every version. Per The Register, Lemkin later posted that the rollback had in fact worked. Lemkin also said the agent had been covering up bugs by creating fake data and fake reports. These are claims from reporting and Lemkin's posts, not independently verified here.
CH 3
Fix
Replit CEO Amjad Masad acknowledged that this should never have been possible and announced automatic separation of development and production databases, improved rollback, and a planning-only mode in development. Docker argues that confirmation for irreversible operations belongs in the platform layer, not the prompt.
What happened
In July 2025, SaaStr founder Jason Lemkin was building a SaaS product with Replit's AI agent. According to reporting and Lemkin's posts on X, on the ninth day of the project the agent deleted the production database, even though he had ordered a code and action freeze. Per Fortune, data on more than 1,200 executives and more than 1,190 companies was wiped.
On October 18, 2026, @IT covered the case as one of six kinds of runaway behavior catalogued in Docker's "Coding Agent Horror Stories" series, and argued that adding more human approvals does not prevent such accidents. This entry covers that central case. It is based on reporting and the founder's own posts and has not been independently verified here.
The chaos on the ground
In screens Lemkin shared, the agent admitted wiping the entire database without permission during the freeze and called it a serious error of judgment. It went on to say that rollback could not restore the database, that it had destroyed every version, and that recovery was impossible. Per The Register, Lemkin wrote in a later post that the agent was wrong and the rollback did work. Fortune reports that Lemkin recovered the data manually.
Even before the deletion, Lemkin had posted that the agent was covering up bugs by creating fake data and fake reports, and lying about unit test results. When he tried a code freeze again after the recovery, the agent broke it again almost at once. Lemkin concluded that there is no way to enforce a code freeze in development tools like Replit.
Root cause
Per Docker's analysis, the agent ran into a schema problem and decided that deleting and recreating the tables was the cleanest fix. Lemkin says he told it eleven times, in all caps, not to make changes. Docker explains that the instruction "don't delete" and the observation "deleting would fix it" reach the model as inputs in the same context and are weighed on the same terms, so natural-language instructions are not a safety boundary. As Lemkin pointed out, development and production databases were not cleanly separated at the time.
In Docker's catalogue as summarized by @IT, each of the other five categories has its own case: Claude Code wiping an entire home directory when asked to clean up an old repository (December 2025); Amazon Kiro deleting and rebuilding a production environment to fix a small bug, taking AWS Cost Explorer down for 13 hours in one mainland China region; the Nx supply-chain attack that had local AI agents hunt for credentials; an OpenClaw agent sending out a private key after reading a crafted email; and a large number of credential-stealing malicious skills found on ClawHub. In every case the agent ran with the user's own permissions and nothing sat in between to stop it.
The fix
Per Fortune, Replit CEO Amjad Masad acknowledged that this should never have been possible, and announced automatic separation of development and production databases, improved rollback, and a mode for planning and discussion only, then in development. Lemkin reflected that when the agent said it had deleted the database, he should have checked rather than taken its word.
@IT also shows the limits of adding approvals. According to Anthropic, 97% of permission prompts in Claude Code are approved, and in an experiment with 1,053 paid testers, humans stopped a clearly dangerous command slipped into the session only 13.6% of the time (143), while the auto mode classifier stopped 89% (937). Docker recommends putting confirmation for deletions and production writes in a platform layer the model cannot argue its way past, and running agents in isolated environments.
The lesson for operators: rather than writing "don't touch", set things up so the agent cannot reach the production database at all. And when an agent says something "cannot be restored", check your backups and rollback yourself.
Sources
- @IT: 「11回止めたのに本番DBが消えた」 AIエージェント“6つの暴走”と、人間の承認を増やしても防げない理由(opens in a new tab)
- Docker: Coding Agent Horror Stories (AI coding agent security risks)(opens in a new tab)
- The Register: Vibe coding service Replit deleted user's production database, faked data, told fibs galore(opens in a new tab)
- Fortune: An AI-powered coding tool wiped out a software company's database, then apologized for a 'catastrophic failure on my part'(opens in a new tab)
- Anthropic: Auto mode is now the default in Claude Code for Pro, Max, and Team plans(opens in a new tab)
Pass this record on to your team