Role Overview & Full Requirements
Join ZR Talent Group's remote specialist network as a Remote 211 Specialist — AI Research & Domain Evaluation earning $30 - $40/hour. Working asynchronously from anywhere in the US, UK, Canada, Australia, New Zealand, Ireland, or South Africa, you will apply your practical background in domain analysis and structured evaluation to benchmark frontier artificial intelligence models, identify failure modes, and elevate domain-specific accuracy.
Prior experience building machine learning systems is not required—our research partners value authentic practitioner judgment, domain rigor, and clear analytical writing.
Key Responsibilities & Deliverables
- Review sample questions and flag any that don’t sound like what real callers ask.
- Write rubrics that define a correct, complete answer, including the right referrals and next steps for the caller.
- Assess and benchmark model-generated answers against your rubrics, flagging errors, omissions, outdated guidance, and answers that wouldn’t help a real caller.
- Share clear written feedback with the project team, working asynchronously.
Required Qualifications & Technical Criteria
- Experience as a 211 Specialist, Information & Referral Specialist, or Benefits Navigator, answering public questions about government services
- 1+ years of regular, high-volume public contact (phone, chat, or in person)
- Working knowledge of public benefits and community resources
- US-based
- Able to start quickly and commit 10-20 hours/week
- Clear, precise writing
Preferred Experience & Bonus Attributes
- Practical background using crisis intervention or needs assessment
- Experience using community resource databases
- Experience creating guides, scripts, or training materials
- Experience helping a diverse range of callers, including rural and Spanish-speaking communities
Compensation, Remote Eligibility & Schedule
- Compensation Band: $30 - $40/hour
- Work Model: 100% Remote / Work From Home with flexible asynchronous scheduling
- Eligible Remote Locations: United States, Canada, United Kingdom, Australia, New Zealand, Ireland, and South Africa
- Current Openings: 10 active specialist positions
- Hiring Organization: ZR Talent Group
Ready to apply for Remote 211 Specialist — AI Research & Domain Evaluation?
Submit your application directly through our verified recruiting portal.