Other open roles
Gmail & Google Calendar AI Assistant Evaluator
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by micro1. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
About the Role
micro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life — email, calendars, bookings, and coordination — to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.
What You'll Do
- Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.
- Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.
- Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.
- Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.
- Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.
- Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
- Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.
- Required Skills and Qualifications:
You're a Good Fit If You
- Required skills: Gmail, Google Calendar, AI Usage, Scheduling, Emails, Google Meetings
- Prior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.
- Familiarity with prompt writing and a practical understanding of AI assistant behaviors and limitations.
- Experience grading or reviewing AI outputs for accuracy, helpfulness, and safety.
Role Highlights
Pay & Payout
Engaged directly through micro1. Apply via the link below - micro1 handles onboarding and payment.
Common Questions
Opens micro1 in a new tab. You pay nothing; we may earn a referral fee.
Get similar jobs every week
Similar roles
More model evaluation work you may qualify for.
AI Agent Evaluator
Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Monday, October 12
Everyday AI Agent Tester
Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Monday, October 12
QA & Source Inspection
micro1 is engaging QA & Source Inspection professionals to contribute their expertise to a dynamic customer project spanning aerospace, defense, and marine sectors. In this role,