The Problem No One Is Talking About
In June 2023, a New York attorney submitted a legal brief citing six fabricated cases — all generated by ChatGPT. The court sanctioned him. That story made headlines because it was obvious. What's happening now is far less obvious and far more dangerous.
AI-generated text has gotten dramatically better. Today's language models produce legal prose that reads like it was written by a competent attorney. The sentence structure varies naturally. The citations look plausible. The legal reasoning flows logically. And it's being used to fabricate documents that are entering legal proceedings without anyone catching them.
What's Being Fabricated
Affidavits and declarations: AI can generate sworn statements with specific dates, locations, and details that sound credible. A fabricated affidavit supporting a custody claim, an insurance dispute, or a contract breach can look indistinguishable from a genuine one — until someone tries to verify the facts.
Contracts and agreements: Backdated contracts generated by AI are increasingly used in commercial disputes. The language is appropriate, the boilerplate is correct for the jurisdiction, and the terms are internally consistent. The document never existed before last Tuesday.
Witness statements: AI-generated witness accounts can include the kind of specific, sensory details that make testimony convincing — what they saw, what they heard, what time it was, what the weather was like. Details that are entirely fabricated.
Correspondence and emails: Fabricated email chains used as evidence of agreements, threats, or admissions. AI can generate realistic email threads complete with appropriate timestamps, casual language, and contextually appropriate responses.
Expert reports: AI-generated analysis presented as expert opinion. The methodology section sounds rigorous. The conclusions appear well-supported. But the analysis was never performed.
Why Human Review Fails
Lawyers are trained to read for legal accuracy, logical consistency, and persuasiveness. These are exactly the things AI does well. The signals that indicate AI generation are different from the signals lawyers are trained to spot.
What AI gets right:
What gives AI away — if you know where to look:
A senior partner reading a 15-page affidavit is checking whether the facts support the claim, not whether sentence 47 has the same structure as sentences 12, 23, and 38. That's a computational analysis, not a human one.
The Legal Stakes
When fabricated documents enter proceedings, the consequences cascade:
For the fabricating party: Sanctions, contempt of court, bar discipline, criminal fraud charges. Courts are increasingly treating AI-generated fabrications as intentional fraud, not negligent oversight.
For the opposing party: If a fabricated affidavit goes undetected, it can influence case outcomes. By the time the fabrication is discovered — if it ever is — the case may be settled, the judgment entered, or the appeals deadline passed.
For the court: Every undetected fabrication erodes the integrity of the judicial system. Judges are starting to require AI disclosure certifications, but certifications don't catch liars.
For the profession: The Bar's entire evidentiary framework assumes that sworn documents are authored by the people who sign them. AI breaks that assumption at scale.
What Detection Looks Like
Effective AI-generated text detection for legal documents operates on multiple tiers:
Statistical Analysis (Local, Instant)
Before any AI model is involved, basic text statistics reveal patterns:Linguistic Analysis (AI-Powered)
A specialized AI model analyzes the text for:Deep Contextual Analysis (Second Pass)
If the first pass is inconclusive, a deeper analysis checks:What Lawyers Should Do Now
Before submitting documents: Run opposing party documents through AI text detection, especially affidavits, declarations, and expert reports. If AI indicators are present, you have grounds for a motion to strike or a request for authentication.
When receiving documents: Treat AI detection as part of standard due diligence. Just as you'd verify that a contract was properly executed, verify that critical documents weren't AI-generated.
For your own practice: Establish internal policies about AI use in document drafting. Many firms now require AI disclosure in their engagement letters. Being ahead of this protects both the firm and the client.
Chain of custody: When documents will be entered as evidence, establish forensic chain of custody from the moment you receive them. This means hashing the document, timestamping receipt, and preserving the original file — not just printing and filing.
How DeFake Solves This
DeFake's Legal Document Analysis accepts PDF, DOCX, and TXT files and runs a multi-tier detection cascade:
Upload a document at our Legal Evidence Analysis demo and see the results in under 60 seconds.