MLOps Engineer building production ML infrastructure, pipelines, and monitoring for exacare ai’s post - acute care AI platform. Scaling reliable systems that help healthcare teams make safer placement decisions.
About the role
- Senior MLOps Engineer focusing on applied MLOps for CreatorIQ, bridging data science and production-grade efficiency. Responsible for annotation workflows and cost-efficient model evaluation.
Responsibilities
- Architect Annotation & Measurement Pipelines: Own the design and implementation of human-in-the-loop and auto-annotation workflows. You will set up systems (e.g., Label Studio) to establish tight confidence metrics and rigorous Inter-Annotator Agreement (IAA).
- Drive Cost-Efficiency via Evaluation: Create the ground truth, golden sets, and by-model evaluation criteria that allows us to benchmark models and make informed data science decisions. Your work will directly impact margin by enabling us to deploy the right model for the right task.
- Enforce Applied MLOps Standards: Implement "model-as-a-judge" frameworks, deterministic PII scrubbing, and other best practices within our production pipelines to ensure our model-driven products are robust and compliant.
- Collaborate on Model Strategy: Work closely with our Data Science team to make applied generative decisions that result in stronger product outcomes and cost efficiencies.
- Build & Integrate: Collaborate with engineering to integrate measurement loops into our broader infrastructure (AWS/GCP), ensuring our model lifecycle is automated and observable.
Requirements
- Annotation & Evaluation Expert: You have deep experience setting up annotation workstreams (using tools like Label Studio, Scale AI, or custom solutions) and know how to calculate and improve ground truth quality.
- Applied MLOps Practitioner: You care about execution over policymaking. You have experience implementing model monitoring, versioning, and evaluation loops in a production environment.
- Python Proficiency: You possess strong proficiency in Python, capable of writing the glue code, scripts, and API integrations necessary to bind our models to our application stack.
- Model Optimization Mindset: You understand the trade-offs between model performance, latency, and cost. You are excited about the challenge of proving that a smaller model can do the job of a massive LLM.
- Cloud & Infrastructure Fluency: You are comfortable working within AWS (Sagemaker, S3) and GCP (Vertex AI) environments and can interface effectively with DevOps to deploy your solutions.
- Collaborative Leader: You can act as a force multiplier for our Data Science team, equipping them with the tools and data they need to move faster.
Benefits
- People: work with talented, collaborative, and friendly people who love what they do.
- Guidance: utilize our learning platform to fully get the training and tools you’ll need to become successful here from your first day with us.
- Surprise meal stipends: work from home can’t stop the enjoyment of someone else making a meal for you!
- Work/life harmony: vacation, floating and set holidays, wellness allowance, and paid parental leave.
- Whole Health Package: medical, dental, vision, life, disability insurance, and more.
- Work from home stipend: to assist you in setting up a home office that works for you (or buy a new dog leash - your choice!).
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Engineer building cloud - native data and ML platforms for Hive.co’s event - marketing automation products. Owning pipelines, model infrastructure, and audience - data systems at scale.
Senior Machine Learning Engineer building causal and decision systems for CSC Generation’s AI - native omnichannel retail brands. Deploying machine learning that improves pricing and other commercial decisions.
Director leading agentic AI and machine learning products for Instacart’s grocery technology platform. Building retailer solutions and guiding teams from strategy through production deployment.
New - grad software engineer building Quora’s distributed ML platform, model serving, and developer tooling. Supporting Quora’s global knowledge - sharing product with scalable GPU infrastructure.
Applied Machine Learning Scientist developing Generative AI and predictive ML solutions for TD banking. Evaluating models, managing AI lifecycles, and supporting responsible implementation.
Applied Machine Learning Scientist developing Generative AI and predictive ML solutions at TD, a major North American bank. Supporting model evaluation, deployment, monitoring, and responsible AI governance.
Senior Machine Learning Engineer building conversational AI agents and production ML systems. Helping Numa automate automotive dealership service and sales through evaluation - first tooling and infrastructure.
Senior ML Engineer building production ML, RAG, and agentic AI capabilities for SailPoint’s cloud identity security platform. Driving scalable, customer - focused AI solutions from research to production.
Senior ML Engineer developing debiased pCTR and conversion models for Instacart’s grocery advertising ecosystem. Advancing ranking, retrieval, and sequence modeling across ads surfaces.