Senior backend engineer owning high - availability identity and authentication systems. Leading delivery, reliability, technical standards, and talent development for Affirm’s pay - over - time platform.
About the role
- Senior software engineer building AI evaluation pipelines, rubrics, and data-quality systems for a client. Remote contract role open across approved US regions and Canada with PST overlap.
Responsibilities
- Design, refine, and iterate on rubrics, evaluation frameworks, and quality criteria for preference data.
- Review, assess, and label data while identifying subtle inconsistencies, quality issues, and opportunities for improvement.
- Build, maintain, and optimize pipelines and infrastructure supporting data generation, collection, processing, and evaluation workflows.
- Synthesize findings from data analysis and evaluation activities into concise reports, updates, recommendations, and actionable summaries.
- Collaborate with researchers and engineers to translate qualitative judgments into structured, repeatable, and scalable processes.
- Understand, contribute to, and maintain complex software repositories while ensuring code quality, reliability, and performance.
- Identify workflow inefficiencies and implement practical improvements to data quality, evaluation consistency, and engineering processes.
- Complete application screening, an AI-based interview, a coding challenge, a technical and cultural interview, and final candidate evaluation.
Requirements
- At least 5 years of professional software engineering experience with Python, particularly in building and maintaining pipelines and infrastructure, or with TypeScript, JavaScript, or Go.
- Hands-on experience with preference data collection, rubric creation, or developing evaluation criteria.
- Strong understanding of software engineering principles, code quality, debugging, and maintainable system design.
- Excellent written and verbal communication skills, with the ability to explain complex technical concepts clearly and concisely.
- Strong analytical skills and the ability to make consistent, well-reasoned quality judgments.
- Demonstrated ability to explain why a particular solution, example, or implementation meets a high quality standard.
- Comfort working independently in ambiguous environments while prioritizing execution and timely delivery.
- Experience contributing to or navigating large-scale, complex open-source codebases, such as VS Code (preferred).
- Experience building data pipelines, developer infrastructure, or automated evaluation systems (preferred).
- Background in AI model evaluation, preference data workflows, data annotation, or quality assessment (preferred).
- Experience collaborating with AI researchers, machine learning engineers, or multidisciplinary technical teams (preferred).
- Education from a leading university or professional experience at a highly regarded technology company (preferred).
- LinkedIn profile mandatory and must be included in the candidate's resume.
- Must not currently be employed by Microsoft.
- Must be able to commit to the required weekly hours and PST overlap for the full contract duration.
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Backend - focused Software Engineer scaling Micromart’s unattended retail platform. Building reliable systems for payments, fraud prevention, device management, and real - time workflows.
Backend engineer building Node.js and TypeScript edge systems for Micromart’s unattended retail platform. Integrating hardware and operating reliable smart - store software.
Senior Backend Engineer scaling Micromart’s unattended retail platform. Building reliable systems for payments, fraud prevention, devices, and real - time commerce workflows.
SDK Engineer building Supabase’s Python SDK for database, auth, storage, realtime, and edge functions. Maintaining typed sync and async APIs for developers worldwide.
Contract software engineer building Python and AWS cloud - native solutions for an insurance technology team. Improving CI/CD, infrastructure automation, distributed systems, and production reliability.
Senior Java Developer building Java microservices and distributed systems for Just Eat Takeaway.com’s global delivery platform. Owning scalable logistics infrastructure, APIs, AWS deployment, and reliability.
.NET Developer building scalable enterprise applications for an IT services company. Developing APIs, optimizing SQL Server performance, and supporting Azure CI/CD deployments.
Senior Backend Engineer improving Tempo, Grafana Labs’ open - source distributed tracing backend. Owning scalable database systems, APIs, performance, and operational excellence for Grafana observability products.
Kubernetes and HPC Engineer building scalable AI/ML and simulation infrastructure for Capgemini Engineering. Managing Kubernetes, HPC clusters, NVIDIA GPUs, automation, and cloud - native platforms.