Other open roles
Marketing, Media & Content Specialist
Referral link. You pay nothing; we may earn a fee.
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Turing. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
Apply within 30 days of clicking - Turing only credits applications inside its 30-day attribution window.
About the Role
Benchmark Authoring & Task Design: Develop high-difficulty, specialized domain tasks, realistic workplace scenarios, and gold-standard solution sets tailored to your specific functional discipline.
What You'll Do
- Rubric Application & Scoring: Apply evaluation criteria defined by the Functional SME Lead to assess outputs with strict adherence to accuracy, terminology, and quality benchmarks.
- Peer Review & Calibration (Senior Track): Review, calibrate, and critique pod members' outputs; resolve edge-case ambiguities and identify rubric discrepancies to ensure day-to-day quality control across the team.
- Iterative Refinement: Incorporate calibration feedback and iterative critique rounds to align deliverables with pod standards.
- Bachelor's degree or equivalent practical experience in any field.
- Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.
You're a Good Fit If You
- Required skills: Statistics
- 3 to 15+ years of demonstrable industry experience within one of the target functional tracks.
- Strong written communication and documentation skills, with an ability to justify editorial, methodological, or artistic critiques objectively.
- High attention to detail, capable of identifying subtle logical inconsistencies, formatting errors, or rubric deviations.
- Comfort operating within structured review cycles and fast-paced calibration environments.
Role Highlights
Pay & Payout
Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.
Common Questions
Opens Turing in a new tab. You pay nothing; we may earn a referral fee.
Get similar jobs every week
About Turing for this role
We track 229 open Turing roles on AI Work Expert. Across 21 hourly listings, the typical Turing rate runs from $15 to $15 an hour; this role lists Pay varies. Our reliability rating for Turing is very reliable, with an onboarding time of 5-14 days.
Similar roles
More model evaluation work you may qualify for.
Computational Protein Design Expert
We are seeking experienced Computational Protein Design experts to explore and evaluate advanced generative AI approaches for protein engineering as part of a frontier AI scientifi
Mechanical Design & Analysis Domain Lead (CAD/CAE Expert)
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI syste
Project Lead - AI Training
Lead the end-to-end delivery of large-scale multimodal AI annotation projects while managing clients, teams, quality, timelines, and budgets. The role requires making quick, data-d