PacioliDouble-entry bookkeeping for AI agents

The Ledger Report

Real agents. Real failures.
The books didn’t balance.

Documented cases where an AI agent’s claim diverged from what the evidence showed — entered twice, and reconciled against a primary or reputable source. Every card links out. Cases still before a court are labeled and kept separate.

Air Canada
air-canada-chatbot2024-02-14public incident
Claimed

“Chatbot told customer they could apply for a reduced bereavement fare retroactively within 90 days of ticketing.”

Actual

CRT: negligent misrepresentation; bereavement fare must be requested BEFORE travel; ordered to pay C$812.02

CLAIM_MISMATCH$812.02
DocumentedSource ↗
Replit
replit-ai-agent2025-07-18public incident
Claimed

“Agent was told not to proceed without human approval during a code freeze.”

Actual

Agent ran unauthorized destructive commands against explicit instructions, then misled user about recoverability

SCOPE_CREEPCLAIM_MISMATCH
DocumentedSource ↗
Chevrolet of Watsonville / Fullpath
chevrolet-watsonville-chatbot2023-12-18public incident
Claimed

“ChatGPT-powered dealer bot agreed to sell a 2024 Tahoe for $1 and called it a 'legally binding offer.'”

Actual

Prompt-injection: bot accepted an absurd price and echoed a user-scripted 'binding offer' line; dealership did not honor it and shut the bot down

CLAIM_MISMATCH$1
DocumentedSource ↗
OpenAI ChatGPT (via counsel)
chatgpt-legal-research2023-06-22public incident
Claimed

“A lawyer used ChatGPT to draft an opposition brief; it supplied six supporting precedents.”

Actual

Mata v. Avianca: all six ChatGPT cases were invented; Judge Castel sanctioned counsel $5,000

CLAIM_MISMATCH$5K
DocumentedSource ↗
DoNotPay
donotpay-robot-lawyer2025-01-16public incident
Claimed

“Marketed as 'the world's first robot lawyer' that could generate valid legal documents and let users sue without a lawyer.”

Actual

FTC: $193,000 monetary relief; service did not perform like a lawyer and was never tested against one

CLAIM_MISMATCH$193K
DocumentedSource ↗
Zillow
zillow-offers-ibuyer2021-11-02public incident
Claimed

“Zestimate-driven pricing model set automated cash offers to buy and flip homes.”

Actual

Algorithm systematically overpaid in a volatile market; Q3 2021 $304M write-down, $500M+ total loss

OVERSPENDCLAIM_MISMATCH$304M
DocumentedSource ↗
City of New York
nyc-mycity-chatbot2024-03-29public incident
Claimed

“Microsoft-powered MyCity bot was launched to provide 'trusted government information.'”

Actual

The Markup investigation: bot confidently advised illegal actions; city left it online despite known errors

CLAIM_MISMATCH
DocumentedSource ↗
DPD
dpd-chatbot2024-01-19public incident
Claimed

“DPD's customer-service bot was meant to assist with deliveries.”

Actual

After a system update the bot cursed, disparaged its own employer, and was disabled the same day

CLAIM_MISMATCH
DocumentedSource ↗
Google / Alphabet
google-bard2023-02-08public incident
Claimed

“Bard answered a JWST question in Google's launch ad.”

Actual

Bard's demo answer was wrong (first exoplanet image was 2004); Alphabet shares fell ~7.7%

CLAIM_MISMATCH
DocumentedSource ↗
iTutorGroup
itutorgroup-recruiting-ai2023-09-11public incident
Claimed

“Recruiting software processed applications on the company's behalf.”

Actual

EEOC: $365,000 consent decree; software was set to automatically reject applicants over an age cutoff

CLAIM_MISMATCH$365K
DocumentedSource ↗
McDonald's / IBM
mcdonalds-ibm-drivethru2024-06-19public incident
Claimed

“IBM voice AI piloted at 100+ US drive-thrus to capture orders.”

Actual

Viral order errors; accuracy plateaued ~80-85%; McDonald's ended the IBM partnership Jun 2024

CLAIM_MISMATCH
DocumentedSource ↗

Alleged — in active litigation

These are serious, widely-reported claims that have notbeen proven. They sit in pending suits where the companies dispute the allegations. They’re included for completeness and labeled accordingly — not asserted as fact.

UnitedHealth / naviHealth
unitedhealth-nhpredict2023-11-14public incident
Claimed

“nH Predict (naviHealth/Optum) estimated patient length-of-stay used in coverage decisions.”

Actual

Lawsuit: care denied based on nH Predict despite ~90% appeal-reversal rate; UnitedHealth denies using it for determinations

CLAIM_MISMATCH
Unproven · pending litigationSource ↗
Cigna
cigna-pxdx2023-03-25public incident
Claimed

“PxDx automated system flagged claims for bulk denial.”

Actual

ProPublica: PxDx let doctors bulk-deny without review; class action allowed to proceed Mar 2025

CLAIM_MISMATCH
Unproven · pending litigationSource ↗
Workday
workday-hiredscore-ai2025-05-16public incident
Claimed

“Workday's AI applicant-recommendation system scored and screened candidates for employers.”

Actual

Mobley v. Workday: court granted conditional ADEA collective certification (potentially millions of applicants)

CLAIM_MISMATCH
Unproven · pending litigationSource ↗

14 of 17 documented cases are shown here. 3 consumer-complaint pattern is held back from this public gallery pending stronger primary sourcing; the eval still scores the full set (see Methods).