MENA Legal AI Benchmark: Scope and Method
Which jurisdictions, languages and task types the HAQQ MENA legal evaluation covers, how answer keys are built from primary sources, and where source coverage is still thin. Results follow the next run.
FAQ
Which jurisdictions does the HAQQ MENA legal evaluation cover?
Eleven: Lebanon, the UAE, Iraq, Egypt, Oman, Jordan, Qatar, Kuwait, Syria, Saudi Arabia and Bahrain, in Arabic and English. Coverage is uneven today, and the post lists the jurisdictions where source coverage is thin.
How are the answer keys built?
Each key starts from a primary source, meaning the statute, decree or gazette text itself, and records the instrument and article a correct answer must cite, the points it must cover and, for traps, that declining is correct. A lawyer checks the key before it is used.
Which jurisdictions have thin source coverage?
Saudi Arabia, Bahrain, Iraq and Syria. Expect fewer items, or none, for these until the sources are verified. The list will be updated when that changes.
Are results published?
Not in this post. Results follow the next run, with the scope and method described here, and any change to either will be stated alongside them.