Other open roles
Senior Software Engineer - AI Evaluation / Coding Agents ($100-150/hr)
Referral link. You pay nothing; we may earn a fee.
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Turing. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
Apply within 30 days of clicking - Turing only credits applications inside its 30-day attribution window.
About the Role
Freelance · Remote · North America (only) We’re looking for experienced, hands-on software engineers to help evaluate and improve AI coding models. Rather than primarily building production applications, you’ll work with coding agents across real-world repositories and assess the quality of their work. You’ll review generated code and agent behavior, determine whether solutions are technically correct, identify failure modes, and create the evaluation signals and feedback used to improve model performance.
What You'll Do
- Compensation: $100-$150/hour, please provide a specific hourly rate expectation
- Availability: 20-40 hours/week, with at least 6 hours of Pacific Time overlap/day
- Type: Independent contractor
- Duration: Approximately 3 months
- Start: As soon as possible
- Design, refine, and iterate on rubrics and evaluation criteria for preference data
- Review and label data with a high quality bar, catching subtle issues others might overlook
- Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows
You're a Good Fit If You
- Required skills: Python
- 5+ years of hands-on software engineering experience
- Strong proficiency in Python, TypeScript/JavaScript, Go, or another major production language
- Experience working in substantial real-world codebases
- Strong code-review skills and technical judgment
- Ability to clearly explain why an implementation is correct, incorrect, or could be improved
- Strong written communication
- Experience using modern LLMs or AI coding tools
Role Highlights
Pay & Payout
Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.
Common Questions
Opens Turing in a new tab. You pay nothing; we may earn a referral fee.
Get similar jobs every week
About Turing for this role
We track 229 open Turing roles on AI Work Expert. Across 21 hourly listings, the typical Turing rate runs from $15 to $15 an hour; this role lists Pay varies. Our reliability rating for Turing is very reliable, with an onboarding time of 5-14 days.
Similar roles
More coding work you may qualify for.
Tooling Engineer
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI syste
Tooling Engineer
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI syste
Senior DevOps Engineer (Cloud Infrastructure, CI/CD, LLMOps)
Our client is a global technology company specializing in cloud infrastructure, AI operations, and enterprise technology solutions. Supporting organizations worldwide, the company