Other open roles

Senior Software Engineer – LLM Evaluation

per hour

Contractor Remote Last verified 21 Jul 2026

Affiliate disclosure

Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Turing. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →

Apply within 30 days of clicking - Turing only credits applications inside its 30-day attribution window.

About the Role

As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross-functional teams to enhance enterprise-level AI-driven coding solutions. What does day-to-day life look like?

What You'll Do

Working on AI model training initiatives by curating code examples, building solutions, and correcting code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
Evaluate and refine AI-generated code to ensure that it is efficient, scalable, and reliable.
Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.
Build agents that can verify the quality of the code and identify error patterns.
Hypothetize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operation maintenance) and evaluate model capabilities on them
Design verification mechanisms that can automatically verify a solution to a software engineering task.

You're a Good Fit If You

Required skills: JavaScript, JavaScript, Python
Several years of software engineering experience, including 2+ years of continuous full-time experience at a top-tier product company (e.g., Google, Stripe, Amazon, Apple, Meta, Netflix, Microsoft, Datadog, Dropbox, Shopify, PayPal, IBM Research).
Strong expertise in building full-stack applications and deploying scalable, production-grade software using modern languages and tools.
Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
Excellent oral and written communication skills for clear, structured evaluation rationales.

Get ready for Turing

Design a resume for Turing Prepare for the Turing interview

Role Highlights

Pay

Pay varies

Contract

Contractor

Location

Remote

Pay & Payout

Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.

Common Questions

Turing has a reliability rating of very reliable based on the listings we track, with an onboarding time of 5-14 days. See our full Turing review for the details behind that rating.

Applying takes you to Turing's own website, where the application is completed. We are not a recruiter or employer and do not process applications directly - we may be recorded as the referring source.

Pay varies - Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.

Working on AI model training initiatives by curating code examples, building solutions, and correcting code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go. Evaluate and refine AI-generated code to ensure that it is efficient, scalable, and reliable. Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.

Apply on Turing

Opens Turing in a new tab. You pay nothing; we may earn a referral fee.