Other open roles
Domain Contributor - Evaluation Specialist
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by micro1. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
About the Role
micro1 is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.
What You'll Do
- Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
- Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
- Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
- Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
- Apply detailed task guidelines and evaluation rubrics consistently to each submission.
- Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.
You're a Good Fit If You
- Required skills: Domain depth, Source verification, Reasoning clarity, Evaluation expertise
- Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
- Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
- Advanced research skills with a track record of verifying complex claims against authoritative sources.
- Exceptional written and verbal communication skills to articulate findings and feedback.
- Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
- Background in adversarial or “stomp the model” task design is advantageous.
- Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.
Role Highlights
Pay & Payout
Engaged directly through micro1. Apply via the link below - micro1 handles onboarding and payment.
Common Questions
Opens micro1 in a new tab. You pay nothing; we may earn a referral fee.
Get similar jobs every week
About micro1 for this role
We track 368 open micro1 roles on AI Work Expert. Across 535 hourly listings, the typical micro1 rate runs from $50 to $90 an hour; this role lists $30-$60/h. Our reliability rating for micro1 is reliable, with an onboarding time of 1-3 days.
Similar roles
More data annotation work you may qualify for.
Senior Technical Documentation, Parts and Annotation Specialist
micro1 is engaging Senior Technical Documentation, Parts and Annotation Specialists to contribute their deep domain expertise to a customer's innovative project. In this role, you'
Generalist
micro1 is seeking AI Generalist Experts to contribute to a customer project focused on improving next-generation AI systems. In this role, you'll apply your professional experience
English Voice Recording
Opportunity Snapshot Pay: $20 - 70/hour Project kickoff: Monday, October 19th You’ll need: A quiet room with no background noise, a reliable internet connection, and a smartphone o