Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Mercor. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
About the Role
Mercor is recruiting detail-oriented graders for a fast-turnaround sprint assessing JSON-formatted AI model outputs against defined rubrics for a leading AI research organization, without the assistance of AI tools.
What You'll Do
Read and understand written task descriptions and rubrics
Parse JSON-based model outputs and grade contents against the rubrics provided
Apply rubric criteria with attention to detail and consistency
You're a Good Fit If You
Comfortable reading and interpreting JSON files
Prior Mercor rubric/evaluation experience is a plus; US-based
Available 20-40 hours/week with a desktop or laptop (no Chromebooks)
Independent contractor engagement; short sprint with possible extension. Mercor pays weekly via Stripe or Wise.
Common Questions
Mercor has a reliability rating of very reliable based on the listings we track, with an onboarding time of 1-3 weeks (interview + assessment + trial). See our full Mercor review for the details behind that rating.
Applying takes you to Mercor's own website, where the application is completed. We are not a recruiter or employer and do not process applications directly - we may be recorded as the referring source.
$50-$175/h - Independent contractor engagement; short sprint with possible extension. Mercor pays weekly via Stripe or Wise.
Read and understand written task descriptions and rubrics Parse JSON-based model outputs and grade contents against the rubrics provided Apply rubric criteria with attention to detail and consistency
