Technical lead building safe, evaluable LLM agents and AI infrastructure for OpenLoop’s telehealth platform. Setting architecture, observability, retrieval, and model operations direction.
About the role
- AI Developer designing and delivering intelligent, production-grade AI solutions for clients. Building data foundations and shipping LLM features for various applications in cloud environments.
Responsibilities
- Build the data foundations for AI and ship LLM features like grounded Q&A (RAG), summarization, semantic search, classification, and copilots.
- Set up evaluation and monitoring and use MLOps to safely deploy and maintain models and prompts across cloud environments.
- Focus on relationships, building meaningful client connections, and learning how to manage and inspire others.
- Anticipate the needs of teams and clients and to deliver quality.
Requirements
- Bachelors or Masters degree in Computer Science or similar
- Microsoft Development, Azure/Google Cloud Platform or Amazon Web Services Certifications are preferred
- Knowledge regarding GenAI technologies is highly desirable: LLM models (GPT-4, ChatGPT), Agent Orchestration Frameworks (Semantic Kernel or LangChain ), Vector Databases (Azure AI Search, etc ), Retrieval Augmented Generation, Azure OpenAI Services, AWS Bedrock, Google Vertex AI, Microsoft Copilots, etc.
- Persistence such as RDBMS/NoSQL (MS SQL, Mongo DB) data stores and appropriate use cases
- Rapid-prototyping workflows and development tools
- Containerization, and experience in using Docker and/or Kubernetes
- CI/CD using ADO pipeline or git actions
- Experience with software development tools and defect tracking systems like Azure DevOps
- Database experience (SQL, Mongo DB)
- Working with high level UX principles such as user stories, persona building, prototype/prototype development approaches
- Knowledge of agile software development lifecycles (SDLC) and experience working on projects that follow an Agile Scrum methodology
- Experience with API-based integration development using python ASP.NET, Azure Cloud, Azure Functions and Logic Apps, Angular, React.js, Next.js, Azure Integration Services, LINQ, MS SQL Server, Entity Framework, GitHub, Azure DevOps, Bootstrap, Node.js, Python, OpenAI ChatGPT APIs or Azure OpenAI are required for the role.
Benefits
- Competitive compensation package
- Inclusive benefits
- Flexibility programs
- Comprehensive total rewards package
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior software engineer evaluating AI coding agents such as Codex and Claude Code. Providing rigorous written and video feedback on engineering quality.
Senior software engineer evaluating AI coding agents for G2i. Assessing engineering judgment, explanations, and trustworthiness across Codex, Claude Code, and Cursor.
Senior engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering judgment, reasoning, and interaction quality.
Forward Deployed Engineer building full - stack AI solutions on AWS and Azure for Huron’s consulting clients. Partnering daily with business users to deliver tested features.
Staff AI Security Engineer securing EQ Bank’s enterprise AI, machine learning, and cloud platforms. Building guardrails, controls, automation, and detection capabilities for Canada’s Challenger Bank.
Staff Software Engineer owning OAuth, authorization, and agent delegation systems. Building governed identity infrastructure for Redpanda’s enterprise AI data platform.
Senior software engineer evaluating AI coding agents for G2i’s engineering team. Assessing reasoning, explanations, and engineering judgment in Codex, Claude Code, and Cursor interactions.
Senior software engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering quality.
Senior engineer evaluating Codex, Claude Code, and Cursor interactions for G2i. Providing rigorous written and video feedback on AI - generated engineering work.