Remote Software Quality Assurance (QA) & Automated Test Engineer | Enterprise AI & Domain Advisory

We are seeking a detail-oriented Remote Software Quality Assurance (QA) & Automated Test Engineer | Enterprise AI & Domain Advisory ($63 - $120/hour, 100% remote) to join ZR Talent Group. Contributors in this role draw upon real-world mastery of software quality assurance, test case design, test execution, defect reporting to evaluate AI-generated deliverables, construct detailed grading rubrics, and guide post-training model alignment.

Prior experience building machine learning systems is not required—our research partners value authentic practitioner judgment, domain rigor, and clear analytical writing.

Key Responsibilities & Deliverables

• Design, execute, and document test cases and scenarios to validate AI outputs against defined requirements.
• Review, annotate, and label data sets to enhance machine learning model training accuracy.
• Evaluate, analyze, and report on model predictions, identifying inconsistencies, errors, or patterns for continuous improvement.
• Collaborate with cross-functional teams to communicate findings, raise questions, and clarify project requirements.
• Contribute to the development and refinement of testing methodologies specific to AI-driven systems.
• Maintain detailed, organized records of evaluations, test results, and feedback through written documentation.
• Provide actionable recommendations to optimize data quality and model performance.

Required Qualifications & Technical Criteria

• Demonstrated professional or advanced academic background in software quality assurance, test case design, test execution, defect reporting.
• Strong analytical writing and critical evaluation skills in English.
• Self-directed work ethic suited for an asynchronous, 100% remote research environment.

Preferred Experience & Bonus Attributes

• Hands-on expertise in software quality assurance, with a strong understanding of test planning and defect reporting.
• Prior experience with data labeling, annotation, reinforcement learning from human feedback (RLHF), or model evaluation.
• Proficiency in English at B2 level or above for effective collaboration and reporting.

Compensation, Remote Eligibility & Schedule

• Compensation Band: $63 - $120/hour
• Work Model: 100% Remote / Work From Home with flexible asynchronous scheduling
• Eligible Remote Locations: United States, Canada, United Kingdom, Australia, New Zealand, Ireland, and South Africa
• Current Openings: 120 active specialist positions
• Hiring Organization: ZR Talent Group
• Core Skills & Technologies: software quality assurance, test case design, test execution, defect reporting, data annotation, data labeling, ai model evaluation, documentation, english communication, cross-functional collaboration