Other open roles
Intelligence Analyst
Work Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by micro1. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →
About the Role
micro1 is engaging Intelligence Analysts to contribute to a customer-facing project focused on evaluating and advancing artificial intelligence capabilities. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
What You'll Do
- Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
- Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
- Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
- Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
- Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.
- Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
- Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.
You're a Good Fit If You
- Required skills: Analytic rigor, Source handling, Over-refusal detection, All-Source Intelligence Analysis
- Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
- Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
- Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
- Exceptional written and verbal communication skills, with a focus on clarity and precision.
- Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
- Familiarity with structured analytic techniques and intelligence tradecraft standards.
- Previous participation in AI evaluation or model assessment initiatives is a plus.
Role Highlights
Pay & Payout
Engaged directly through micro1. Apply via the link below - micro1 handles onboarding and payment.
Common Questions
Opens micro1 in a new tab. You pay nothing; we may earn a referral fee.
Get similar jobs every week
About micro1 for this role
We track 368 open micro1 roles on AI Work Expert. Across 535 hourly listings, the typical micro1 rate runs from $50 to $90 an hour; this role lists $30-$80/h. Our reliability rating for micro1 is reliable, with an onboarding time of 1-3 days.
Similar roles
More model evaluation work you may qualify for.
Senior Intelligence Analyst – National Security
micro1 is seeking experienced Senior Intelligence Analysts to contribute their expertise to an AI training and evaluation project focused on national security, intelligence analysi
Intelligence Operations & Collection Expert
micro1 is seeking experienced Intelligence Operations & Collection Experts to contribute their specialized knowledge to an AI training and evaluation project focused on intelligenc
Intelligence Agency Officer
micro1 is engaging Intelligence Agency Officers to contribute their specialized skills and insights to a customer's project. In this role, you'll apply your expertise to help train