Skip to content
    HAQQ
    Log in
    Contact sales
    Try HAQQ
    Try HAQQ
    1. Home
    2. Blog
    3. Can AI Give Legal Advice? We Tested It on 100 Real Questions
    Guides & How-To

    Can AI Give Legal Advice? We Tested It on 100 Real Questions

    Under US unauthorized-practice rules and OpenAI's own policy, AI cannot give legal advice. What our 2026 tests show it gets right on legal questions, and where it fails.

    Nicolas DawalibiNicolas Dawalibi|
    June 11, 2026
    7 min read
    Can AI Give Legal Advice? We Tested It on 100 Real Questions

    In short: in the United States, no AI tool may lawfully give you legal advice. State unauthorized-practice rules reserve applied advice for licensed lawyers, and OpenAI's usage policy bars tailored legal advice without a licensed professional. AI gives legal information. In our May 2026 test, three models passed 78 to 88 of 100 real questions; citations remain the weak point.

    Key facts

    • ABA Model Rule 5.5 prohibits the unauthorized practice of law, and each jurisdiction sets its own definition of the practice of law (American Bar Association, read 22 Oct 2026).
    • OpenAI's usage policies, updated 29 October 2025, prohibit "tailored advice that requires a license, such as legal or medical advice, without appropriate involvement by a licensed professional" (OpenAI usage policies; no later change found, 22 Oct 2026).
    • Nippon Life Insurance Company of America sued OpenAI on 4 March 2026 in the Northern District of Illinois (No. 1:26-cv-02448), alleging ChatGPT engaged in the unauthorized practice of law; we found no ruling as of 22 Oct 2026 (Canadian Lawyer and FindLaw, March 2026).
    • New York bill S7263A, which targets chatbots that impersonate licensed professionals, was committed to the Senate Rules Committee on 5 June 2026 and has not been enacted (NY Senate, read 22 Oct 2026).
    • In United States v. Heppner (S.D.N.Y., opinion of 17 Feb 2026), Judge Rakoff held that documents a defendant generated with a consumer AI tool on his own initiative were protected by neither privilege nor work product (Proskauer and ABA Litigation Section, 2026).
    • Charlotin's AI Hallucination Cases database lists 2,202 court and tribunal decisions involving AI-fabricated material, 872 of them involving lawyers (database update of 19 Oct 2026).
    • Claude Sonnet 4 passed 88 of 100 real r/legaladvice questions, GPT-4o 87 and Gemini 2.5 Flash 78; caveats scored lowest for all three, 3.0 to 3.15 of 5 (HAQQ run, May 2026).
    • Asked for Dubai court judgments supporting an article that does not exist, Gemini 3.1 Pro and DeepSeek V4 Pro named 16 across eight answers, none matching a public source as cited; Claude Opus 5.5 and GPT-6 Astra named none (HAQQ run, 30 Sep 2026).

    Disclosure. HAQQ builds legal AI and ran the HAQQ tests cited on this page. The May and September runs tested general-purpose models, not HAQQ. Prompts and methods are in the linked posts.

    Is it legal for AI to give legal advice?

    In the United States, no. Every state restricts the practice of law to licensed lawyers. The comment to ABA Model Rule 5.5 notes that the definition of the practice of law "is established by law and varies from one jurisdiction to another". Where the line falls differs by state, but applying law to one person's specific facts, which is what people want when they ask an AI about their landlord or employer, sits at the core of most definitions.

    The model providers say the same in their own terms. Since 29 October 2025, OpenAI's usage policies prohibit tailored advice that requires a license, including legal advice, without appropriate involvement by a licensed professional. ChatGPT still answers legal questions; what the policy disclaims is personalised advice, the regulated kind.

    Enforcement is arriving from three directions:

    • Regulators. In February 2025 the FTC finalised its order against DoNotPay, the self-described "robot lawyer", requiring $193,000 in monetary relief and barring claims that the service performs like a lawyer without evidence.
    • Private litigation. In Nippon Life v. OpenAI (N.D. Ill., filed 4 March 2026), an insurer alleges that ChatGPT helped a former claimant draft filings to reopen a settled case and asks for a declaration that OpenAI violated Illinois' unauthorized-practice statute. OpenAI has called the complaint meritless, and commentators doubt it will succeed. It is the first suit of its kind against a major model provider that we know of.
    • Legislatures. New York's S7263A would make chatbot operators liable when a chatbot gives substantive responses that would be unauthorized practice if a person gave them. It stalled in the Senate Rules Committee in June 2026. A federal bill introduced in March 2026 targets chatbots that present themselves as licensed professionals.

    Outside the US the rules differ. Many civil-law and Gulf jurisdictions reserve representation and certain advisory work to admitted lawyers without the same broad unauthorized-practice doctrine, so the question there turns on local bar law. Our country-by-country guide covers what lawyers themselves may do with AI.

    What is the difference between legal information and legal advice?

    Legal information is general: what a statute says, how eviction normally works in your state, what at-will employment means. Legal advice is applied: whether you should sign, what you should file, what is likely to happen in your case. Information educates. Advice directs action, invites reliance and carries accountability: a lawyer who gets it wrong faces malpractice claims and bar discipline, and a chatbot faces nothing.

    Lawyers using AI have their own rules, from ABA Formal Opinion 512 to the EU AI Act. Consumers have none of that protection, so the caveats have to come from the tool, and caveats are where raw models score worst.

    How accurate is AI on legal questions?

    Good at the general picture, unreliable on the specifics that decide a case. Three of our tests measure different parts of that.

    TestModelsWhat it measuredResult
    100 real r/legaladvice questions (May 2026)Claude Sonnet 4, GPT-4o, Gemini 2.5 FlashAccuracy, completeness, reasoning, practical value, caveatsPassed 88, 87 and 78 of 100; caveats lowest for all three (3.0 to 3.15 of 5)
    300 commercial legal tasks (published 5 Jun 2026)10 frontier models, 3,000 answersWhether cited law says what the model claims24% of answers cited or applied law that does not say what was claimed
    Five-question MENA trap test (30 Sep 2026)Claude Opus 5.5, GPT-6 Astra, DeepSeek V4 Pro, Gemini 3.1 ProTraps, invented authority, jurisdiction3.30, 3.00, 2.20 and 2.10 of 4; two models named 16 judgments that did not check out

    The May run used models that are now two generations old, and newer models are better at reasoning: every model in the September test spotted every trap we set. The failure that survived is invented authority. Asked to support a claim with court judgments, two current frontier models produced citations that matched nothing public as cited. That is the same failure behind most of the 2,202 decisions in Charlotin's database, and 1,267 of those decisions involve people representing themselves.

    The second failure is missing caveats. In May every model dove into detailed analysis, often correctly, without saying that a local lawyer should check jurisdiction-specific facts. Gemini 2.5 Flash had the highest accuracy score (4.30 of 5) and the lowest pass rate, because some answers were truncated and others skipped the disclaimer. For legal questions the floor matters more than the ceiling.

    Try HAQQ AI Free

    Experience AI-powered legal drafting and research

    Are AI chats protected by attorney-client privilege?

    No. Privilege protects confidential communications with a lawyer for legal advice. A chatbot is not a lawyer. In United States v. Heppner (S.D.N.Y., 17 February 2026), Judge Rakoff held that about 31 documents a criminal defendant prepared with a consumer AI tool, on his own initiative and before sharing them with counsel, were protected by neither privilege nor work product. Commentators read the ruling narrowly (the tool's privacy terms and the absence of counsel's direction mattered), but for a consumer the lesson is plain: treat what you type as discoverable.

    When do you need a lawyer instead of AI?

    • You have been sued, charged or served. Court procedure is unforgiving and only a lawyer can represent you.
    • A deadline is running. Limitation periods and response windows are jurisdiction-specific, and flagging what it might have missed is AI's weakest skill.
    • The outcome is hard to reverse. Custody, immigration status, criminal records, or money you cannot afford to lose.
    • The other side has a lawyer. You are in an adversarial process.
    • Someone must sign, file, appear or negotiate for you. Those are acts of representation.
    • The answer depends on a specific case or statute. An unverified citation is a liability.

    How do you use AI safely for legal questions?

    • Use it to understand, then decide with a professional when the stakes warrant one.
    • State your jurisdiction in the first line. An answer without one is a guess.
    • Ask for the counter-arguments and for what the answer might be missing. You are adding the caveats raw models leave out.
    • Look up every case and statute in a primary source before relying on it.
    • Keep identifying facts out of general chatbots. Those conversations are not privileged.
    • Use AI to prepare for the lawyer. Arriving with the issues mapped makes the paid hour more productive.
    • For professional work, use a legal tool built to show its sources. Whatever you use, including HAQQ's Legal AI Chat for lawyers and in-house teams, check that each answer names the source it relies on, then open that source.

    General legal information, not legal advice. Rules on the practice of law differ by jurisdiction; speak to a lawyer admitted where your matter sits.

    Sources

    • ABA Model Rule 5.5: Unauthorized Practice of Law
    • OpenAI usage policies
    • Canadian Lawyer: Nippon Life sues OpenAI for practising law without a license (March 2026)
    • FindLaw: new lawsuit claims ChatGPT practices law without a license
    • New York Senate: bill S7263A
    • Proskauer: SDNY on privilege and work product for public AI tools (Heppner)
    • FTC finalizes order against DoNotPay (February 2025)
    • Damien Charlotin: AI Hallucination Cases database
    • Our May 2026 test: 3 models on 100 real legal questions
    • Our September 2026 trap test on UAE, Saudi and Lebanese law
    • Best AI for legal work: the October 2026 update
    • AI hallucination cases: the 2,202-case tracker

    Written by

    Nicolas Dawalibi
    Nicolas Dawalibi

    Guides & How-To

    Nicolas writes the HAQQ guides: practical, step-by-step walkthroughs for lawyers and legal teams putting AI to work.

    All articles by this author

    Related Resources

    Legal AI ChatAI Hallucination Cases: The 2,202-Case Sanctions TrackerHow to test a legal AI: five questions, four modelsYour AI conversations are not privileged

    Related Posts

    Nippon Life v. OpenAI: ChatGPT Accused of Practicing Law
    Case

    Nippon Life v

    Nippon Life v. OpenAI: ChatGPT Accused of Practicing Law

    Is It Safe to Use ChatGPT for Your Divorce? What the 2026 Privilege Ruling Changes
    Guide

    Is It Safe to Use ChatGPT for Your Divorce?

    Is It Safe to Use ChatGPT for Your Divorce? What the 2026 Privilege Ruling Changes

    Is AI Legal Advice Safe and Accurate? What to Check Before You Trust a Legal AI
    Explainer

    Is AI Legal Advice Safe and Accurate?

    Is AI Legal Advice Safe and Accurate? What to Check Before You Trust a Legal AI

    Frequently asked questions

    Can ChatGPT give legal advice?

    Not under its own rules. Since 29 October 2025, OpenAI's usage policies prohibit tailored advice that requires a license, including legal advice, without appropriate involvement by a licensed professional. ChatGPT still answers legal questions, but what it gives is legal information, with no license, no liability and no privilege behind it.

    Is it legal to ask AI legal questions?

    Yes. Unauthorized-practice rules restrict who may give legal advice and represent people, not who may try to understand the law. The legal risk sits with products that present themselves as lawyers, as the FTC's 2025 DoNotPay order and the Nippon Life v. OpenAI lawsuit filed in March 2026 show.

    How accurate is AI on legal questions?

    In our May 2026 test of 100 real consumer legal questions, Claude Sonnet 4 passed 88, GPT-4o 87 and Gemini 2.5 Flash 78, with caveats the weakest dimension for all three. Newer models reason better: in our September 2026 trap test every model spotted every trap, but two of four still named court judgments that did not check out.

    What is the difference between legal information and legal advice?

    Legal information explains the law in general, such as what a statute says or how a process works. Legal advice applies the law to your facts and tells you what to do. Advice is regulated and reserved for licensed lawyers in every US state, and it carries professional accountability.

    Are conversations with AI chatbots privileged?

    No. In United States v. Heppner (S.D.N.Y., February 2026), the court held that documents a defendant made with a consumer AI tool on his own initiative were protected by neither attorney-client privilege nor work product. Treat anything you type into a general-purpose chatbot as potentially discoverable.

    When should I stop using AI and hire a lawyer?

    When you are sued, charged or served; when a deadline is running; when the outcome is hard to reverse; when the other side has a lawyer; or when someone must sign, file or appear for you. Before that point, use AI to understand your situation so the lawyer's time goes to judgment.

    What's Next?

    Try HAQQ AI Free

    Experience AI-powered legal drafting and research

    Calculate Your ROI

    See how much time and money HAQQ saves your firm

    Browse 600+ Legal Prompts

    Ready-to-use prompts for every legal task

    Back to Blog

    Previous article

    Legal AI Statistics 2026: How Many Lawyers Use AI?

    Next article

    The Best Legal AI for Small Law Firms (2026 Buyer's Guide)

    On this page

    7 min read

    1. 01Key facts
    2. 02Is it legal for AI to give legal advice?
    3. 03What is the difference between legal information and legal advice?
    4. 04How accurate is AI on legal questions?
    5. 05Are AI chats protected by attorney-client privilege?
    6. 06When do you need a lawyer instead of AI?
    7. 07How do you use AI safely for legal questions?
    8. 08Sources

    Share this article

    Put this to work

    Ask HAQQ the question this article raised for you.

    HAQQ across all devices
    HAQQ Legal AI Platform Logo

    Your Legal AI Twin & Practice Management System for drafting, billing, and winning.

    Download on theApp StoreGet it onGoogle Play

    Documentations

    • Docs opens in a new tab
    • Getting Started opens in a new tab
    • Newsroom opens in a new tab
    • Product Updates opens in a new tab
    • Status opens in a new tab
    • Trust opens in a new tab
    • Security
    • FAQ opens in a new tab
    • Community opens in a new tab
    • Support opens in a new tab

    Academy

    • Partner opens in a new tab
    • Course opens in a new tab
    • Prompt opens in a new tab
    • Labs opens in a new tab

    Website

    • eFirm
    • Legal AI Chat
    • Mobile App
    • Justinian AI Engine
    • HAQQ eBar
    • HAQQ eWallet
    • Pricing
    • Compare Us
    • Solutions
    • Blog
    • Meet Team
    • Join Us opens in a new tab
    Open App
    • Localesenarfresitdeptrohics
    • Contactinfo@haqq.ai
    • Statusoperational·grounded
    • Terms of Service
    • Privacy Policy
    • Cookie Policy
    • Data Processing
    • Humans opens in a new tab
    • Lawyers opens in a new tab
    • Security opens in a new tab
    © 2026 HAQQ Inc. All rights reserved.Product engineered in-house by HAQQ. Website built with modern web tools.