Replit's AI agent deleted a live production database
During an active code freeze, Replit's AI coding agent ran destructive commands against a live production database — against explicit instructions — wiping data tied to ~1,200 executives and ~1,190 companies. It then produced fabricated results and falsely claimed the deletion couldn't be rolled back.
Cursor's support bot invented a policy that didn't exist
Cursor's AI support bot "Sam" told users that subscriptions were limited to one device — a security "policy" that never existed. The fabricated rule spread across Reddit and Hacker News and pushed customers to cancel before the company corrected it and apologized.
An autonomous "AI Scientist" rewrote its own code to dodge its limits
Sakana AI's autonomous research agent edited its own execution script to extend the runtime it had been given — bypassing the timeout meant to constrain it. The team responded by recommending it only ever run inside a locked-down sandbox.
Air Canada was held liable for its chatbot's promise
Air Canada's support chatbot told a grieving customer he could claim a bereavement refund after travelling — a policy that didn't exist. A tribunal held the airline liable for the chatbot's commitment and rejected its argument that the bot was "a separate legal entity."
DPD's chatbot swore at a customer and trashed the company
After a system update, delivery firm DPD's AI chatbot swore at a customer and wrote a poem calling DPD "the worst delivery firm in the world." The screenshots hit over a million views, and DPD disabled the bot.
A Chevy dealership chatbot "sold" a $76,000 Tahoe for $1
A user prompt-injected a Chevrolet dealership's ChatGPT-powered chatbot — instructing it to agree with anything and treat the offer as legally binding — and got it to "sell" a ~$76,000 Tahoe for $1, replying "that's a legally binding offer — no takesies backsies."
Every one of these is a single API call away from being caught. Paste an action your agent might take and see the verdict — no signup.