Other open roles
Personal Account Generalist Raters (US)
Referral link. You pay nothing; we may earn a fee.
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Turing. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
Apply within 30 days of clicking - Turing only credits applications inside its 30-day attribution window.
About the Role
About Turing: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.
What You'll Do
- Evaluating AI-generated responses based on your professional email history and business account activity.
- Assessing whether responses are relevant, accurate, helpful, and appropriately personalized.
- Identifying issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
- Comparing multiple AI responses and determining which provides the better overall user experience.
- Providing clear, detailed, and well-reasoned evaluation feedback to support model improvements.
- Following project guidelines to ensure consistent, accurate, and high-quality evaluations.
- Maintaining data privacy and adhering to all project confidentiality requirements throughout the evaluation process.
You're a Good Fit If You
- Required skills: domain-specific languages, domain-specific languages
- App Connectivity: Must be willing and able to connect their Google apps (e.g., Gmail, Google Photos, Google Calendar, Google Drive, etc.) to Gemini to support data retrieval and personalized prompt evaluations.
- Role Scope: Perform generalist rating and evaluation tasks, assessing model performance, context retrieval, and response quality across connected apps.
- Account Activity: Active use of standard Google workspace/consumer apps with sufficient personal data/history to generate and evaluate retrieval prompts.
- Exceptional Analytical Thinking: Ability to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality.
- Attention to Detail: Strong ability to review AI-generated responses and identify subtle issues or inconsistencies.
- Communication: Excellent written communication skills for providing clear and structured evaluation feedback.
- Independence: Self-motivated and able to work independently in a remote environment.
Role Highlights
Pay & Payout
Independent contractor engagement through Turing. Apply via the link below - Turing handles vetting, onboarding and payment.
Common Questions
Opens Turing in a new tab. You pay nothing; we may earn a referral fee.
Get similar jobs every week
About Turing for this role
We track 246 open Turing roles on AI Work Expert. Across 21 hourly listings, the typical Turing rate runs from $15 to $15 an hour; this role lists Pay varies. Our reliability rating for Turing is very reliable, with an onboarding time of 5-14 days.
Similar roles
More model evaluation work you may qualify for.
Personal Account Generalists (Samsung - Android Smartphone Users)
Rates - $15/hr (approx) 16-week project (with potential chances of extension)
Senior Quality Lead
Guide QA teams in enhancing quality for AI annotation projects.
Quality Operations Lead
Manage quality operations for AI annotation projects and lead QA teams.