TL;DR — 300 demanding commercial and cross-border legal tasks, 10 frontier models from 8 providers, 3,000 graded answers on a 35-point rubric at temperature 0.
Claude Opus 4.8 wins overall (30.02/35, top of 130 tasks). Grok 4.3 is the value pick. GPT-5.5 is the most accurate (8.41/10, 3% hallucinated citations).
The headline finding: 24% of all 3,000 answers cited or applied law that doesn't say what the model claimed. No frontier model is safe to ship a legal answer unverified.
Why we benchmark legal AI in the open
Five billion people can't access legal help. That's the problem HAQQ exists to solve. But underneath every legal-AI demo sits a load-bearing question: can you actually trust the output in front of a client? "An AI answered a legal question" and "an AI you can put your name on" are different claims, and the distance between them is the entire product.
Key facts
- 24% of 3,000 graded frontier-model answers cited or applied law that doesn't say what the model claimed.
- Claude Opus 4.8 won 130 of 300 legal tasks (30.02/35 overall); GPT-5.5 was most accurate at 8.41/10 with a 3% hallucinated-citation rate.
- Cost per legal task spans a 90x range across frontier models: $0.0009 (DeepSeek V3.2) to $0.082 (GPT-5.5).
So we measure it. This is the third post in our benchmark series: 100 consumer legal questions was the common-law / consumer angle. HAQQ-LAB was the first public civil-law / MENA jurisdiction-adherence benchmark. This report is the largest yet — commercial and cross-border legal work, the matters that pay a real firm's bills.
If you only read one section, read The Citation Gap. It is the finding that should change how every firm buys legal AI.
How we ran the benchmark
We wrote 300 original, specific legal tasks — not trivia, real matters with named parties, dollar amounts, dates and governing statutes. Draft this clause. Redline this provision. Structure this transaction. Analyze this conflict of laws. They span 51 practice areas, 20+ jurisdictions (US federal + Delaware / California / New York / Texas, UK, EU, UAE, DIFC, Saudi Arabia, Lebanon, Egypt, Qatar, Singapore, Australia, Canada, India, Brazil, Nigeria, OHADA, Japan, Germany, France, Switzerland, plus the Hague Conventions and offshore — Cayman, BVI, Bermuda).
Difficulty weighted hard: 114 tasks at level 5 of 5, 108 at level 4, 22 at level 3. These are multi-jurisdiction problems built to break models. Every task went to all 10 models with an identical system prompt at temperature 0, capped at 6,000 output tokens.
Each answer was scored on five dimensions:
- Quality (1–10) — depth, completeness, actionability.
- Accuracy (1–10) — legal correctness; −5 for hallucinated case law, −3 for wrong jurisdiction.
- Speed (1–5) — measured response latency, not judged.
- Style (1–5) — professional structure.
- Creativity (1–5) — non-obvious risks, cross-jurisdiction issues spotted.
Quality, Accuracy, Style and Creativity are scored by Claude Sonnet 4.6 against a fixed rubric. Speed is computed from real latency. Judge bias is addressed honestly in the caveats — we don't hide it.
The leaderboard: which AI is best for legal work
Claude Opus 4.8 wins — clearly
Opus took first place in 130 of 300 tasks — nearly double any other model — and finished top-3 in 265 of 300. It posts the highest quality (8.9), top-tier accuracy (8.4), perfect style, and the highest creativity. Its one weakness is speed: at 60.8s it is slow, and at $0.069/task it is among the most expensive. If you want the single best answer and can wait for it, this is it.
Grok 4.3: 98% of the quality at 1/7th the time and 1/20th the cost
The most interesting result in the table. Grok 4.3 lands second (28.98) but does it in 8.8 seconds at $0.003 per task — versus Opus's 60.8s and $0.069. For a client-facing product where latency and unit economics matter, Grok is arguably the better engineering choice. It even wins more environmental/ESG, IP and edge-case tasks than anyone.
GPT-5.5: the accuracy champion that rarely "wins"
GPT-5.5 posts the highest accuracy in the field (8.41) and the lowest hallucination rate (3%) — yet sits fifth on total and won only one task outright. It is rarely wrong and rarely flashy. It is also the slowest (134s) and priciest ($0.082). For legal work, "rarely wrong" may be the dimension that matters most, which is exactly why a single composite score misleads.
o3: the most polarizing model in the test
OpenAI's o3 won 66 tasks outright — third-most of any model — yet ranks eighth overall, with a 32% hallucination rate and the second-lowest accuracy (5.89). When o3 is good it is brilliant; when it is wrong it is confidently, expensively wrong. That variance is itself a procurement risk.
The floor: Mistral and Llama
Mistral Large hallucinated or misapplied citations in 64% of its answers (accuracy 4.74). Llama 4 Maverick came last (20.01) — fast and cheap, but quality 4.8 and the thinnest answers. "Cite real law" is not solved at the bottom of the market.
The citation gap: the finding that matters most
Across all 3,000 answers, 24% cited or applied law that doesn't say what the model claimed. Invented cases. Misapplied statutes. The right doctrine pointed at the wrong jurisdiction. These aren't vague misses — our judge flagged specific, checkable errors.
A sample, one per model:
- Claude Opus 4.8: Computer Associates / Gemstar cited as gun-jumping precedents; not accurate characterizations.
- GPT-5.5: Hitz citation appears fabricated; 616 B.R. 374 unverifiable.
- Gemini 3.1 Pro: Halpin v. Riverstone citation unverifiable; likely hallucinated Delaware case.
- Grok 4.3: CBS v. Ziff-Davis cited inaccurately; case concerns warranty reliance, not disclosure.
- Claude Sonnet 4.6: Schrier cite unverifiable; Biotronik case real but misapplied.
- o3: MSA Technology v Antec and GB Gas citations appear fabricated or misrepresented.
- Qwen3.7 Max: Specht v. Netscape misapplied; not a goods/services UCC case.
- DeepSeek V3.2: Crosstown Music citation unverifiable / misapplied.
- Mistral Large: N.Y. Gen. Oblig. Law §5-328 and UCC §2-515 citations are dubious / misapplied.
- Llama 4 Maverick: Cavendish case misapplied; unrelated to pricing clauses.
Every single model, including the leaders, fabricated or misapplied a citation somewhere in the test. This is not a bottom-of-the-table problem. The most accurate model in the entire field still scored only 8.41 out of 10. The floor is alarming; the ceiling is not safe.
For context, the incumbent tools have the same disease. Independent testing has put Westlaw's AI-Assisted Research at roughly a one-in-three error rate and Lexis+ AI above one in six. A bigger model has not fixed this, and on our evidence, will not.
No single model wins every practice area
Break the 300 tasks down by practice area and the leader changes constantly. Across 51 practice areas: Claude Opus 4.8 wins 30, Grok 4.3 wins 13, o3 wins 6, and Gemini 3.1 Pro and Sonnet 4.6 take one each. Highlights:
- Opus dominates the doctrinal core: M&A (30.6), Regulatory Compliance (30.5), Securities, Criminal/White Collar, Tax, Banking, Data Privacy, Employment, International Trade.
- Grok owns commercial creativity: IP/Tech Law (30.2), Environmental/ESG (30.8), Consumer Protection, Compliance/Due Diligence (31.4), edge cases.
- o3 spikes on transactional ops: Legal Operations (31.1), Securities & Finance (30.9), Government Contracts & Procurement (31.1), cross-border real estate.
- Gemini 3.1 Pro takes the top single score in Privacy & Data Protection (31.4).
The implication is direct: a legal product that bets everything on one model leaves accuracy on the table in entire practice areas. The right architecture routes each task to the engine most likely to get it right — and then verifies the answer before it ships.
The latency-and-cost tax
Quality is not free, and it is not uniform. The spread is enormous: GPT-5.5 (134s) and Claude Sonnet 4.6 (102s) are ~17× slower than Grok 4.3 (8.8s) and Llama 4 Maverick (7.7s). Cost per task spans a 90× range, from DeepSeek V3.2 at $0.0009 to GPT-5.5 at $0.082. Grok 4.3 delivers second place at $0.003.
For a high-volume legal product, the "best" model on a quality-only leaderboard can be the wrong business decision. The Opus-quality-at-Grok-speed-and-cost target is a routing-and-verification problem, not a single-model choice.
Provider-level view (merged with every prior run)
Legal AI leaderboard 2026: every model ranked by average score
The 300-task run above grades 10 frontier models on a 35-point rubric. We also maintain a second, broader leaderboard: a 50-task evaluation on a 50-point rubric that adds the legal-vertical platforms most firms actually shortlist (Harvey, CoCounsel, LexisNexis +AI, Legora, Spellbook, Clio Duo) alongside the frontier models. That table is published in full on our compare page. Here it is ranked by average score across all 11 task categories, so you can read one number per model instead of eleven.
| Rank | Model | Avg /50 | Avg % |
|---|---|---|---|
| 1 | HAQQ (Justinian) | 47.5 | 95% |
| 2 | Claude Fable 5 | 44.0 | 88% |
| 3 | Claude Opus 4.7 | 42.1 | 84% |
| 4 | Mike OS | 41.8 | 84% |
| 5 | DeepSeek v4 Pro | 38.2 | 76% |
| 5 | Harvey | 38.2 | 76% |
| 7 | CoCounsel | 36.2 | 72% |
| 8 | Claude + legal plugins | 35.4 | 71% |
| 9 | Legora | 34.5 | 69% |
| 10 | ChatGPT 5.5 | 34.4 | 69% |
| 11 | LexisNexis +AI | 33.2 | 66% |
| 12 | Grok 4.3 | 31.4 | 63% |
| 13 | Gemini 3.1 Pro | 31.1 | 62% |
| 14 | Spellbook | 29.0 | 58% |
| 15 | Perplexity Sonar | 26.5 | 53% |
| 16 | Clio Duo | 25.2 | 50% |
| 17 | Meta Llama 4 | 23.1 | 46% |
| 18 | Mistral 3 | 21.2 | 42% |
| 19 | Qwen 3 Plus | 17.1 | 34% |
Three things this leaderboard says that the 300-task run cannot. First, the legal-vertical platforms cluster in the middle, not the top: Harvey (38.2), CoCounsel (36.2), Legora (34.5) and LexisNexis +AI (33.2) all land below the best raw frontier models. What an enterprise pays a legal-AI vendor for is the workflow and the security wrapper, not a higher score on the answer itself. Second, DeepSeek v4 Pro ties Harvey at exactly 38.2 — an open-weight model matching the most valuable legal-AI company in the world on standalone output quality. Third, the spread is wide: the bottom model (Qwen 3 Plus, 34%) scores barely a third of HAQQ's 95%, so 'which legal AI' is a real decision, not a coin flip.
Honesty check: this is our leaderboard, and HAQQ ranks first on it. Treat that the way you should treat any vendor-published score — verify it. Every one of the 19 models and 11 categories is on our compare page for you to check, and the rubric is described below. Also note what a per-task score cannot see: firm-wide deployment, security certifications, and agentic workflows across thousands of documents are real strengths of the vertical platforms that this table does not measure.
How we score the legal AI leaderboard
Two benchmarks feed two leaderboards, and it matters which one you are reading.
- The 300-task frontier run (the body of this post): 300 original commercial and cross-border tasks, 10 frontier models, graded on a 35-point rubric — Quality, Accuracy, Speed, Style, Creativity — at temperature 0, capped at 6,000 output tokens. Best for 'which raw model should I build on.'
- The 50-task platform run (the leaderboard table above, published on /compare-us): 11 task categories scored on a 50-point rubric covering Sharia, statute, forum, clause, risk, hallucination, formatting, brevity, partner-readiness and source linking. It adds the legal-vertical platforms firms actually buy. Best for 'which product or model should I shortlist.'
Both share the same house rules. Identical prompts to every model. A fixed, written rubric rather than vibes. Published data so anyone can clone the run and check us. And both grade standalone answer quality — which is the right scope for a leaderboard, and the wrong scope for a buying decision, because it cannot see deployment, security posture, or the verification layer a serious legal product wraps around the model.
We are not the only ones keeping score, and you should not rely on one leaderboard. Stanford RegLab's preregistered study found the incumbent research tools hallucinate often — Westlaw AI-Assisted Research at roughly one in three queries and Lexis+ AI above one in six. The independent evaluator Vals AI runs a public legal leaderboard that, as of June 2026, also places Claude Fable 5 at the top of its legal-reasoning benchmark (88.6%), with frontier models there scoring around 80% versus 71% for human lawyers on legal research. Different rubrics, different task sets, same direction of travel: frontier models are strong on reasoning and unreliable on citations, and the gap between them is narrowing.
Essayer HAQQ AI gratuitement
Découvrez la rédaction et la recherche juridique par IA
Which AI is best for law in 2026? It depends what you weight
There is no single 'best legal AI,' and any leaderboard that pretends otherwise is selling something. Read the two tables together and the answer splits by what you are optimizing for:
- Best overall answer quality: Claude Opus 4.8 led the 300-task frontier run (30.02/35, 130 task wins). On the platform leaderboard, Claude Fable 5 is the strongest non-HAQQ model (44.0/50).
- Most accurate / fewest hallucinations: GPT-5.5 — highest accuracy (8.41/10) and the lowest hallucinated-citation rate (3%) in the 300-task run, even though it rarely 'wins' a task outright.
- Best value (speed and cost): Grok 4.3 — second on quality at 8.8 seconds and roughly $0.003 per task, against Opus's 60.8 seconds and $0.069.
- Best legal-vertical platform: Harvey leads its peer group on the 50-point run (38.2 average), ahead of CoCounsel, Legora and LexisNexis +AI — but every one of them trails the best raw frontier models on standalone output.
- Best for MENA, Arabic and civil-law work: HAQQ (Justinian) ranks first on the platform leaderboard (47.5/50) with native Arabic and 80+ jurisdictions; verify it against the field on /compare-us.
The deeper point survives every reshuffle of the rankings: no single model wins every practice area, 24% of frontier answers cite law that does not back them, and the leaderboard position is the smallest part of a real legal product. Routing, citation verification and jurisdiction governance are where a number on a chart becomes an answer you can put your name on.
Collapsing models to their provider brand and merging this run with every prior run of the same commercial benchmark (0–100 index, weighted by number of evaluations):
The top is a cluster, not a coronation. Which provider you pick matters less than what you build around it.
A note on benchmark integrity
Our first pass capped answers at 1,200 tokens. That quietly rigged the result: reasoning models burned the budget "thinking" and returned empty answers, while verbose models got clipped mid-sentence and the judge penalized them. We caught it, threw the run away, and re-ran uniformly at 6,000 tokens. Most models gained 1.5–2.5 points — but Mistral and Llama got worse with more room, because the extra length exposed more bad citations. Output caps are an invisible thumb on the scale in many public leaderboards. Ours is in the open so you can see exactly where it sat.
What 3,000 graded answers actually prove
The reasoning layer is largely solved. Frontier models spot issues, structure analysis, and draft like a capable associate. What they cannot yet do is be trusted: cite verifiably, refuse out-of-jurisdiction questions, disclaim appropriately, and be right the same way twice.
That gap does not close with a bigger model. It closes with a layer on top:
- Routing — send each matter to the engine most likely to get it right.
- Citation verification — no unverifiable reference reaches the client.
- Jurisdiction governance — the wrong-jurisdiction answer is built out, not filtered out after the fact.
That layer is the product. The model is not the moat. The verifier is. It's what we build at HAQQ.
Caveats — because a benchmark you can't check is marketing
- Single run, temperature 0. Treat rankings as more reliable than decimals; read Opus and Grok as co-leaders, not a photo finish.
- The judge is a Claude model (Sonnet 4.6). A fair self-preference question — except a non-Claude model (Grok) ties at the top and GPT-5.5 posts the highest accuracy, so it is plainly not grading on a home curve. A second-model re-judge is the next hardening step.
- The provider index blends rubrics across runs and is directional.
- Every prompt, every raw answer, and the scoring code are published. Clone it and check us.
FAQ
What is the best AI for legal work in 2026?
On our 300-task commercial benchmark, Claude Opus 4.8 scored highest overall (30.02/35) and won the most individual tasks (130 of 300). GPT-5.5 was the most accurate (8.41/10) with the fewest hallucinated citations (3%). Grok 4.3 offers the best speed-and-cost-to-quality ratio. "Best" depends on whether you weight overall quality, raw accuracy, or unit economics.
Do AI models hallucinate legal citations?
Yes, frequently. Across 3,000 answers, 24% cited or misapplied law that didn't support the claim. Every model tested — including the leaders — fabricated or misapplied at least one citation. Even the most accurate model only reached 8.41/10. No frontier model is safe for legal work without a verification layer.
Is Claude better than GPT or Gemini for law?
Claude Opus 4.8 led our overall ranking and Anthropic leads the provider index alongside xAI. But GPT-5.5 was the most accurate single model and Gemini 3.1 Pro finished a close third overall. No provider dominates every practice area.
Can I rely on a single AI model for a law practice?
No. No single model won across practice areas (the top model led 30 of 51, leaving 21 to others). The reliable architecture routes between models and verifies citations before output.
How much does AI legal research cost per query?
In our test, cost per task ranged 90× — from $0.0009 (DeepSeek V3.2) to $0.082 (GPT-5.5). Speed ranged from 7.7s to 134s. Quality-only leaderboards hide these operational differences.
Is this benchmark reproducible?
Yes. Same prompts, same rubric, temperature 0, all data and code published.
Key takeaways
- Claude Opus 4.8 is the strongest single model for commercial legal work; GPT-5.5 is the most accurate; Grok 4.3 is the best value.
- 24% of frontier-model legal answers cite law that doesn't back them — the ceiling isn't safe, not just the floor.
- No model wins every practice area; routing beats betting on one.
- Cost and latency vary 90× and 17× — the quality-only "winner" can be the wrong business choice.
- The defensible layer is routing + citation verification + jurisdiction governance, not the base model.
Part three of the HAQQ benchmark series, alongside our consumer legal-question benchmark and HAQQ-LAB civil-law benchmark. Curious how HAQQ turns these findings into a product lawyers can sign? See the Justinian engine.
