Role Overview & Full Requirements
We are seeking a detail-oriented Remote AI Agent Evaluator — AI Research & Domain Evaluation ($25 - $45/hour, 100% remote) to join ZR Talent Group. Contributors in this role draw upon real-world mastery of ChatGPT, Muse, AI agents, Attention to Detail to evaluate AI-generated deliverables, construct detailed grading rubrics, and guide post-training model alignment.
Prior experience building machine learning systems is not required—our research partners value authentic practitioner judgment, domain rigor, and clear analytical writing.
Key Responsibilities & Deliverables
- Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms
- Approve or stop the agent at key steps
- Screen record every attempt
- Score each run on completion, quality, control issues, satisfaction, and time
- Share clear written feedback on the agent experience
- Who we’re looking for
- US-based, with a Bachelor’s degree
- Someone who already uses AI in daily life
- 2-3 years of experience, preferably in engineering, business management, or office/operations
- Detail-oriented, great at following instructions and documenting each step
- Clear written communication
- Generalists welcome, domain experts preferred
- No coding or AI background needed
- Why you’ll like it
- Get paid to use the AI tools you already use
- Work entirely from your phone, on your schedule
- Have a direct say in how next-generation AI agents get built and improved
- How the selection process works
- Apply
- Complete the screening questions
- Interview: 15-30 minutes max
- Profile review: if everything looks good, we present you to the client
- Onboarding: our Talent Ops team will contact you to get you started
Required Qualifications & Technical Criteria
- Demonstrated professional or advanced academic background in ChatGPT, Muse, AI agents, Attention to Detail.
- Strong analytical writing and critical evaluation skills in English.
- Self-directed work ethic suited for an asynchronous, 100% remote research environment.
Compensation, Remote Eligibility & Schedule
- Compensation Band: $25 - $45/hour
- Work Model: 100% Remote / Work From Home with flexible asynchronous scheduling
- Eligible Remote Locations: United States, Canada, United Kingdom, Australia, New Zealand, Ireland, and South Africa
- Current Openings: 50 active specialist positions
- Hiring Organization: ZR Talent Group
- Core Skills & Technologies: ChatGPT, Muse, AI agents, Attention to Detail, Following Instructions, Screen Recording
Ready to apply for Remote AI Agent Evaluator — AI Research & Domain Evaluation?
Submit your application directly through our verified recruiting portal.