Other open roles

View all opportunities

Context Elicitation & Conversation Evaluation Specialists - Latam, Southeastern Europe, Asia, Africa

per hour
Contractor Remote Last verified 21 Jul 2026
Affiliate disclosure

Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Turing. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →

Apply within 30 days of clicking - Turing only credits applications inside its 30-day attribution window.

About the Role

We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research. SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality.

What You'll Do

  • Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
  • Identify missing context and recommend relevant follow-up questions.
  • Evaluate whether additional information would have changed the AI's recommendations.
  • Distinguish between critical ("load-bearing") and non-essential information.
  • Conduct qualitative reviews and document findings using structured evaluation guidelines.
  • Collaborate with research teams to ensure consistent, high-quality assessments..
  • Required Qualification:
  • Candidates should have at least 3–5 years of direct practicerelevant qualifications and professional experience in at least one of the following areas:

You're a Good Fit If You

  • Required skills: Business Analysis
  • Experience eliciting relevant context when clients initially provide incomplete information
  • Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors
  • Qualitative coding or structured case review
  • Ability to distinguish between context that is load-bearing for the recommendation and that is merely descriptive/non-informative
  • Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering

Role Highlights

Pay
Pay varies
Contract
Contractor
Location
Remote
Category
Model evaluation
Posted
20 days ago
Job ID
WE-8040

Pay & Payout

Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.

Common Questions

Turing has a reliability rating of very reliable based on the listings we track, with an onboarding time of 5-14 days. See our full Turing review for the details behind that rating.

Applying takes you to Turing's own website, where the application is completed. We are not a recruiter or employer and do not process applications directly - we may be recorded as the referring source.

Pay varies - Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.

Review AI conversations involving real-world interpersonal and everyday decision-making scenarios. Identify missing context and recommend relevant follow-up questions. Evaluate whether additional information would have changed the AI's recommendations.

Apply on Turing

Opens Turing in a new tab. You pay nothing; we may earn a referral fee.

Get similar jobs every week

What are you interested in?
Model evaluation

We only use your email to send job alerts. Read our Privacy Policy.