Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Turing. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
Apply within 30 days of clicking - Turing only credits applications inside its 30-day attribution window.
About the Role
Serve as the subject-matter expert for complex quality decisions in AI annotation projects. You will guide QA Leads, resolve ambiguous cases, lead calibration efforts, and use audit insights to improve guidelines, training, and overall data quality.
What You'll Do
Convert complex client guidelines into clear internal instructions.
Validate project setup before production begins.
Mentor and calibrate QA Leads and annotation teams.
Lead calibration sessions and maintain reviewer consistency.
Resolve escalated or ambiguous cases and document decisions.
Lead pilot teams testing new task templates.
Identify high-performing reviewers for accelerated review workflows.
Analyze audit results and recommend guideline or training improvements.
You're a Good Fit If You
Required skills: Quality Management
4–6 years of overall experience, including 2+ years leading QA reviewers.
Strong experience auditing work against detailed guidelines.
Excellent judgment and decision-making skills for complex cases.
Strong communication and documentation skills.
Experience in annotation, data labeling, AI training data, or multimodal projects is preferred.
Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.
Common Questions
Turing has a reliability rating of very reliable based on the listings we track, with an onboarding time of 5-14 days. See our full Turing review for the details behind that rating.
Applying takes you to Turing's own website, where the application is completed. We are not a recruiter or employer and do not process applications directly - we may be recorded as the referring source.
Pay varies - Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.
Convert complex client guidelines into clear internal instructions. Validate project setup before production begins. Mentor and calibrate QA Leads and annotation teams.
