Role Overview & Full Requirements
We are seeking a detail-oriented Remote Python & CI/CD Infrastructure Software Engineer — AI Training ($50 - $70/hour, 100% remote) to join ZR Talent Group. Contributors in this role draw upon real-world mastery of CI/CD, Scripting, Python, REST API to evaluate AI-generated deliverables, construct detailed grading rubrics, and guide post-training model alignment.
Prior experience building machine learning systems is not required—our research partners value authentic practitioner judgment, domain rigor, and clear analytical writing.
Key Responsibilities & Deliverables
- Execute structured evaluation assignments that simulate authentic developer activities, including version control, code review, issue tracking, and CI/CD workflow execution utilizing AI-powered tools.
- Assess and grade the technical correctness of outputs, verifying results hands-on within relevant development environments and tools.
- Design, seed, and maintain reproducible test environments—such as code repositories with real commit histories and CI workflows—to ensure reliable and realistic task contexts.
- Configure, document, and troubleshoot integrations and authentication flows across multiple software services, ensuring seamless connectivity.
- Investigate and document undocumented product behaviors through hands-on exploration and systematic testing.
- Participate in calibration sessions to ensure consistent evaluation methods and grading across the contributor group.
Required Qualifications & Technical Criteria
- Demonstrated professional or advanced academic background in CI/CD, Scripting, Python, REST API.
- Strong analytical writing and critical evaluation skills in English.
- Self-directed work ethic suited for an asynchronous, 100% remote research environment.
Preferred Experience & Bonus Attributes
- Minimum of 3 years of professional experience in software engineering, demonstrating strong command of Git/GitHub workflows (pull requests, code review, branching, analyzing diffs, CI log diagnostics).
- Proficient with CI/CD systems—ideally GitHub Actions—including authoring custom workflows and ensuring reproducible build processes.
- Versed in using connectors across Claude and ChatGPT.
- Advanced scripting abilities in Python or Bash, with comfort in automating environment setup and reset tasks; solid understanding of REST APIs, OAuth, and webhook integrations.
- Fluency with major enterprise SaaS platforms such as Slack, Google Workspace, or Microsoft 365; administrative experience in cloud workspaces is advantageous.
- Experience leveraging AI assistants or agent tools in everyday developer tasks; any familiarity with agent tool-calling or the Model Context Protocol (MCP) is a plus.
- Background in technical QA, evaluation, or data annotation—demonstrating consistency in applying rubrics and identifying nuanced edge cases.
- Exceptional attention to detail, disciplined adherence to defined processes, and outstanding written and verbal communication in English.
Compensation, Remote Eligibility & Schedule
- Compensation Band: $50 - $70/hour
- Work Model: 100% Remote / Work From Home with flexible asynchronous scheduling
- Eligible Remote Locations: United States, Canada, United Kingdom, Australia, New Zealand, Ireland, and South Africa
- Current Openings: 4 active specialist positions
- Hiring Organization: ZR Talent Group
- Core Skills & Technologies: CI/CD, Scripting, Python, REST API, QA
Ready to apply for Remote Python & CI/CD Infrastructure Software Engineer — AI Training?
Submit your application directly through our verified recruiting portal.