Remote Senior AI Trainer — AI Research & Domain Evaluation

We are seeking a detail-oriented Remote Senior AI Trainer — AI Research & Domain Evaluation ($14 - $36/hour, 100% remote) to join ZR Talent Group. Contributors in this role draw upon real-world mastery of Video Annotation, Attention to Detail, Data Labeling, Video Annotation Tools to evaluate AI-generated deliverables, construct detailed grading rubrics, and guide post-training model alignment.

Prior experience building machine learning systems is not required—our research partners value authentic practitioner judgment, domain rigor, and clear analytical writing.

Key Responsibilities & Deliverables

• Evaluate the performance of AI chat and search tools under standardized, repeatable conditions.
• Apply detailed grading guidelines to accurately evaluate, rank, and annotate model responses, providing structured feedback that improves model performance.
• Write, refine, and stress-test prompts that probe model capabilities, ensuring coverage of diverse scenarios, edge cases, and user intents.
• Verify consistency and accuracy across evaluations, correcting discrepancies between ratings and the underlying rubric or guidelines.
• Utilize AI training tools and platforms to record findings and submit evaluation datasets in alignment with project standards and milestones.
• Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
• Participate in ongoing quality reviews, incorporating feedback to maintain rigorous training and annotation standards.

Required Qualifications & Technical Criteria

• Exceptional attention to detail and accuracy in reviewing and evaluating model-generated content.
• Strong written and verbal communication skills for effective collaboration, reporting, and timely updates on progress and challenges.
• Demonstrated time management and self-organization abilities for independent, remote project participation.
• Analytical and problem-solving mindset, with a proactive approach to resolving evaluation challenges.

Preferred Experience & Bonus Attributes

• Proven experience with AI model training, RLHF, data labeling, or similar data-centric evaluation projects.
• Working knowledge of AI products and tools, including prompt engineering and understanding of model behaviors and limitations.
• Experience writing evaluation rubrics, grading model outputs, or reviewing AI responses for accuracy, helpfulness, and safety.
• Background in AI training, machine learning data preparation, or LLM-focused projects (strongly preferred).

Compensation, Remote Eligibility & Schedule

• Compensation Band: $14 - $36/hour
• Work Model: 100% Remote / Work From Home with flexible asynchronous scheduling
• Eligible Remote Locations: United States, Canada, United Kingdom, Australia, New Zealand, Ireland, and South Africa
• Current Openings: 50 active specialist positions
• Hiring Organization: ZR Talent Group
• Core Skills & Technologies: Video Annotation, Attention to Detail, Data Labeling, Video Annotation Tools, Time Management