Other open roles

View all opportunities

Legal Rubric & Ground Truth Auditor (Licensed Attorney)

$140
per hour
Contractor Remote Last verified 10 Nov 2026
Listed on Mercor ↗
mercor.com
Apply

Referral link. You pay nothing; we may earn a fee.

Affiliate disclosure

Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Mercor. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →

About the Role

Mercor is seeking experienced licensed attorneys to audit rubrics and ground-truth answers for a legal research dataset used to evaluate advanced AI systems. You will review existing legal research questions, verify the accuracy of model answers, and refine grading rubrics so the dataset reflects current law and sound legal reasoning. This is a short-term, fully remote engagement.

What You'll Do

  • Audit grading rubrics for accuracy, completeness, consistency, and clarity.
  • Verify ground-truth answers against controlling statutes, regulations, and case law.
  • Identify legal errors, outdated authority, missing issues, and ambiguous grading criteria.
  • Rewrite or correct ground-truth answers and rubric items where needed.
  • Provide concise, structured written feedback on each item reviewed.

You're a Good Fit If You

  • Juris Doctor (JD) and active U.S. bar admission in good standing.
  • 5+ years of legal practice.
  • Substantive experience in at least one of the practice areas above.
  • Strong legal research, analysis, and writing skills.
  • High attention to detail and the ability to apply consistent judgment.
  • Experience across multiple listed practice areas.
  • Judicial clerkship, appellate, government, or law firm research experience.
  • Prior experience reviewing or grading legal work product, or with AI / legal-tech evaluation projects.

Role Highlights

Pay (stated by Mercor)
$120-$140/h
Contract
Contractor
Location
Remote
Category
Model evaluation
Posted
6 days ago
Job ID
WE-8394

Pay & Payout

Independent contractor engagement, fully remote. Mercor pays weekly via Stripe or Wise.

Common Questions

Mercor has a reliability rating of very reliable based on the listings we track, with an onboarding time of 1-3 weeks (interview + assessment + trial). See our full Mercor review for the details behind that rating.

Applying takes you to Mercor's own website, where the application is completed. We are not a recruiter or employer and do not process applications directly - we may be recorded as the referring source.

$120-$140/h - Independent contractor engagement, fully remote. Mercor pays weekly via Stripe or Wise.

Audit grading rubrics for accuracy, completeness, consistency, and clarity. Verify ground-truth answers against controlling statutes, regulations, and case law. Identify legal errors, outdated authority, missing issues, and ambiguous grading criteria.

Apply on Mercor

Opens Mercor in a new tab. You pay nothing; we may earn a referral fee.

Get similar jobs every week

What are you interested in?
Model evaluation

We only use your email to send job alerts. Read our Privacy Policy.

$120-$140/h
Referral link · you pay nothing
Apply on Mercor

About Mercor for this role

We track 421 open Mercor roles on AI Work Expert. Across 641 hourly listings, the typical Mercor rate runs from $60 to $85 an hour; this role lists $120-$140/h. Our reliability rating for Mercor is very reliable, with an onboarding time of 1-3 weeks (interview + assessment + trial).