Member of Technical Staff, Coding Research — Enterprise AI Solutions & Strategy

We are seeking a detail-oriented Member of Technical Staff, Coding Research — Enterprise AI Solutions & Strategy ($600,000 - $1,300,000/year, 100% remote) to join ZR Talent Group. Contributors in this role draw upon real-world mastery of LLMs, Coding Evaluation, AI Evaluation, ML Systems to evaluate AI-generated deliverables, construct detailed grading rubrics, and guide post-training model alignment.

Prior experience building machine learning systems is not required—our research partners value authentic practitioner judgment, domain rigor, and clear analytical writing.

Key Responsibilities & Deliverables

• Design and own evaluation frameworks for coding agents, including benchmark specifications, scoring methodologies, rubrics, and quality standards.
• Lead from initial concept through completion research initiatives focused on measuring and improving coding model performance across diverse software engineering tasks.
• Develop high-quality datasets, golden examples, and evaluation protocols that enable reliable assessment of frontier coding systems.
• Analyze model behavior and failure modes, identifying systematic weaknesses and translating findings into actionable improvements for training and evaluation.
• Build tooling and infrastructure that support large-scale experimentation, data generation, review workflows, and evaluation pipelines.
• Establish best practices for coding-agent assessment, ensuring methodological rigor, reproducibility, and measurement quality.
• Partner closely with researchers, engineers, and applied AI teams to design experiments and evaluate emerging model capabilities.
• Contribute to technical reports, benchmark studies, and client-facing research initiatives that communicate model performance and insights.

Required Qualifications & Technical Criteria

• Strong software engineering background with expertise in Python, C++, or comparable programming languages.
• 3+ years of experience in software engineering, machine learning, AI research, evaluation, or related technical disciplines.
• Experience designing, reviewing, or validating technical assessments, benchmarks, coding tasks, or evaluation methodologies.
• Working knowledge of large language models, coding agents, reinforcement learning, model evaluation, or related AI systems.
• Proven ability to build tooling, automate workflows, and improve technical processes through systematic experimentation.
• Strong analytical skills with the ability to investigate model behavior and derive insights from complex technical systems.
• Excellent written and verbal communication skills, including the ability to clearly articulate technical findings to diverse audiences.
• Comfortable operating in fast-moving research environments with significant ambiguity and evolving priorities.
• Preferred
• Experience working on frontier AI systems, coding agents, or model evaluation research.
• Deep interest in understanding how data, evaluations, and feedback mechanisms influence model capabilities.
• Track record of independently driving ambiguous technical or research projects from conception to execution.
• Experience designing benchmarks or datasets for machine learning systems at scale.
• Working knowledge of agentic workflows, tool use, reinforcement learning, or post-training methodologies.
• Publications, open-source contributions, or demonstrated technical leadership in AI, machine learning, or software engineering.
• Compensation & Benefits Notice
• The national pay range for this full-time position is base salary of $200,000 –$260,000 USD. All employees are eligible for equity compensation, and employees may also receive performance-based bonuses, dependent on role and subject to company policies. ZR Talent Group provides a comprehensive benefits package, including up to 100% reimbursement for health-insurance premiums, paid time off, a 401(K) plan with a company match, and additional benefits designed to support a high-performing, remote-first workforce.

Compensation, Remote Eligibility & Schedule

• Compensation Band: $600,000 - $1,300,000/year
• Work Model: 100% Remote / Work From Home with flexible asynchronous scheduling
• Eligible Remote Locations: United States, Canada, United Kingdom, Australia, New Zealand, Ireland, and South Africa
• Current Openings: 1 active specialist position
• Hiring Organization: ZR Talent Group
• Core Skills & Technologies: LLMs, Coding Evaluation, AI Evaluation, ML Systems