Other open roles
Legal Rubric & Ground Truth Auditor (Licensed Attorney)
Referral link. You pay nothing; we may earn a fee.
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Mercor. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
About the Role
Mercor is seeking experienced licensed attorneys to audit rubrics and ground-truth answers for a legal research dataset used to evaluate advanced AI systems. You will review existing legal research questions, verify the accuracy of model answers, and refine grading rubrics so the dataset reflects current law and sound legal reasoning. This is a short-term, fully remote engagement.
What You'll Do
- Audit grading rubrics for accuracy, completeness, consistency, and clarity.
- Verify ground-truth answers against controlling statutes, regulations, and case law.
- Identify legal errors, outdated authority, missing issues, and ambiguous grading criteria.
- Rewrite or correct ground-truth answers and rubric items where needed.
- Provide concise, structured written feedback on each item reviewed.
You're a Good Fit If You
- Juris Doctor (JD) and active U.S. bar admission in good standing.
- 5+ years of legal practice.
- Substantive experience in at least one of the practice areas above.
- Strong legal research, analysis, and writing skills.
- High attention to detail and the ability to apply consistent judgment.
- Experience across multiple listed practice areas.
- Judicial clerkship, appellate, government, or law firm research experience.
- Prior experience reviewing or grading legal work product, or with AI / legal-tech evaluation projects.
Role Highlights
Pay & Payout
Independent contractor engagement, fully remote. Mercor pays weekly via Stripe or Wise.
Common Questions
Opens Mercor in a new tab. You pay nothing; we may earn a referral fee.
Get similar jobs every week
About Mercor for this role
We track 421 open Mercor roles on AI Work Expert. Across 641 hourly listings, the typical Mercor rate runs from $60 to $85 an hour; this role lists $120-$140/h. Our reliability rating for Mercor is very reliable, with an onboarding time of 1-3 weeks (interview + assessment + trial).
Similar roles
More model evaluation work you may qualify for.
US Contract Attorney — Transactional
Mercor is partnering with a leading AI lab to train frontier models on high-quality legal reasoning data. This is an evergreen talent pool for experienced US Transactional attorney
US Contract Attorney — Litigation
Mercor is partnering with a leading AI lab to train frontier models on high-quality legal reasoning data. This is an evergreen talent pool for experienced US Litigation attorneys —
US Contract Attorney — In-House Counsel
Mercor is partnering with a leading AI lab to train frontier models on high-quality legal reasoning data. This is an evergreen talent pool for experienced US In-House Counsel — by