Other open roles

View all opportunities

Top GitHub Contributors – Agentic Review Project

per hour
Contractor Remote Last verified 10 Nov 2026
Listed on Turing ↗
turing.com
Apply

Referral link. You pay nothing; we may earn a fee.

Affiliate disclosure

Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Turing. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →

Apply within 30 days of clicking - Turing only credits applications inside its 30-day attribution window.

About the Role

About Us Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.

What You'll Do

  • Task Design and Development: Design challenging, real-world problems that serve as the foundation for a model. Problems should be constructed to target specific core capability loss failures identified in a leading model.
  • Content Generation: Integrate the problems into an Agentic development environment, preparing all necessary components using Python, which include: Detailed Instructions and an overview of the required task.
  • A Golden solution that follows the instructions.
  • The necessary Environment, including datasets, Python libraries, and metadata.
  • A Test notebook containing unit tests that solutions must pass.
  • Evaluation and Analysis: Evaluate the cross model’s performance on the tasks.
  • Headroom Identification: Identify tasks where target model fails to pass all tests, specifically classifying the failure as a logical reasoning failure.
  • Loss Extraction: Analyze the agent’s steps (Agent Trajectory) to observe and extract core capability loss patterns from the model.

You're a Good Fit If You

  • Required skills: rust
  • Highly-skilled GitHub contributors.
  • Applicants must have strong expertise in either data science, ML, coding, or a deep quantitative background in frontier STEM.
  • Able to engage reliably for 30+ hrs per week (on weekdays).

Role Highlights

Pay
Pay not listed
Contract
Contractor
Location
Remote
Category
Model evaluation
Posted
8 months ago
Job ID
WE-8428

Pay & Payout

Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.

Common Questions

Turing has a reliability rating of very reliable based on the listings we track, with an onboarding time of 5-14 days. See our full Turing review for the details behind that rating.

Applying takes you to Turing's own website, where the application is completed. We are not a recruiter or employer and do not process applications directly - we may be recorded as the referring source.

Pay varies - Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.

Task Design and Development: Design challenging, real-world problems that serve as the foundation for a model. Problems should be constructed to target specific core capability loss failures identified in a leading model. Content Generation: Integrate the problems into an Agentic development environment, preparing all necessary components using Python, which include: Detailed Instructions and an overview of the required task. A Golden solution that follows the instructions.

Apply on Turing

Opens Turing in a new tab. You pay nothing; we may earn a referral fee.

Get similar jobs every week

What are you interested in?
Model evaluation

We only use your email to send job alerts. Read our Privacy Policy.

Pay not listed
Referral link · you pay nothing
Apply on Turing

About Turing for this role

We track 246 open Turing roles on AI Work Expert. Across 21 hourly listings, the typical Turing rate runs from $15 to $15 an hour; this role lists Pay varies. Our reliability rating for Turing is very reliable, with an onboarding time of 5-14 days.