Other open roles
Context Elicitation & Conversation Evaluation Specialists
Referral link. You pay nothing; we may earn a fee.
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Turing. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
Apply within 30 days of clicking - Turing only credits applications inside its 30-day attribution window.
About the Role
Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies. We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research.
What You'll Do
- Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
- Identify missing context and recommend relevant follow-up questions.
- Evaluate whether additional information would have changed the AI's recommendations.
- Distinguish between critical ("load-bearing") and non-essential information.
- Conduct qualitative reviews and document findings using structured evaluation guidelines.
- Collaborate with research teams to ensure consistent, high-quality assessments..
- Experience eliciting relevant context when clients initially provide incomplete information
- Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors
You're a Good Fit If You
- Required skills: Data Analysis
- Candidates should have at least 3–5 years of direct practicerelevant qualifications and professional experience in at least one of the following areas:
- MSW or equivalent graduate-level qualification in Social Work.
- LCSW, LICSW, LMSW, or equivalent applicable social work license/credential.
- Experience with client assessment, case review, interviewing, counseling, or related social-work practice.
- MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential; or
- PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.
- Experience with counseling, therapy, psychological assessment, interviewing, case review, or other relevant client-facing work.
Role Highlights
Pay & Payout
Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.
Common Questions
Opens Turing in a new tab. You pay nothing; we may earn a referral fee.
Get similar jobs every week
About Turing for this role
We track 229 open Turing roles on AI Work Expert. Across 21 hourly listings, the typical Turing rate runs from $15 to $15 an hour; this role lists Pay varies. Our reliability rating for Turing is very reliable, with an onboarding time of 5-14 days.
Similar roles
More model evaluation work you may qualify for.
Project Lead - AI Training
Lead the end-to-end delivery of large-scale multimodal AI annotation projects while managing clients, teams, quality, timelines, and budgets. The role requires making quick, data-d
AI Benchmark & Red-Teaming Specialist
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI syste
Digital Imaging Specialist/ Digital Artist
Edit, annotate, and modify existing images based on briefs, references, and guidelines.