Other open roles
AI Writing Evaluator - Generalist
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by Scale AI / Outlier. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
About the Role
Outlier (Scale AI) needs generalist evaluators to compare and edit chatbot responses for everyday questions, judging helpfulness, tone and safety.
What You'll Do
- Rank pairs of chatbot responses
- Edit the better response to a higher standard
- Flag unsafe or policy-breaking content
You're a Good Fit If You
- You write clearly and read carefully
- You have good general knowledge
- You accept that task volume fluctuates
Role Highlights
Pay & Payout
Hourly while tasks are available; availability can drop to zero between projects. Referral links are generated inside your Outlier contributor dashboard.
Apply on Scale AI / OutlierOpens Scale AI / Outlier in a new tab. You pay nothing; we may earn a referral fee.
Similar roles
More writing & feedback work you may qualify for.
Technical Writer - API Docs QA
Rewrite and fact-check auto-generated API documentation for developer-facing accuracy and tone.
Coding & Chatbot Feedback
Label and critique model outputs across coding and conversation tasks; onboarding starter project first.
RLHF Preference Labeler
Compare paired model responses and pick the better one with a one-line justification; high task volume.