Technical lead building safe, evaluable LLM agents and AI infrastructure for OpenLoop’s telehealth platform. Setting architecture, observability, retrieval, and model operations direction.
About the role
- AI Value Governance & Insights Lead at Morgan Stanley focusing on building AI value management capabilities. Driving forecasting and optimization of AI costs and collaborating across teams in a hybrid role.
Responsibilities
- Define and implement data-driven approaches to align AI spend with measurable business outcomes
- Drive AI spend forecasting and financial analytics using advanced analytics and machine learning
- Integrate AI usage telemetry data to standardize tokenomics and usage tracking
- Design the scalable self-service analytics platforms
- Provide local leadership and strategic oversight to a small engineering team
- Collaborate with cross-functional stakeholders to gather requirements
- Proactively evaluate emerging technologies for innovation, efficiency, and cost optimization
- Drive documentation, knowledge sharing, and thought leadership across AI, data engineering, and architecture communities
Requirements
- 10+ years of experience in data analytics, data engineering, data science, or AI related field
- Strong Python expertise for data manipulation and advanced analytics (Pandas, NumPy, SciPy, PySpark)
- Proficiency in SQL and experience with large-scale cloud data platforms (e.g., Snowflake, Databricks, Dataiku)
- Strong understanding of data architecture, data modelling, and data warehousing concepts
- Exposure to AI/LLM tokenomics
- Hands-on experience with data pipelines and processing frameworks (e.g., Apache Spark, Airflow)
- Experience building analytical dashboards (Power BI, Tableau)
- Strong analytical thinking and problem-solving skills
- Knowledge of French and English is required.
Benefits
- Health insurance
- 401(k) matching
- Flexible working hours
- Paid time off
- Remote work options
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior software engineer evaluating AI coding agents such as Codex and Claude Code. Providing rigorous written and video feedback on engineering quality.
Senior software engineer evaluating AI coding agents for G2i. Assessing engineering judgment, explanations, and trustworthiness across Codex, Claude Code, and Cursor.
Senior engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering judgment, reasoning, and interaction quality.
Forward Deployed Engineer building full - stack AI solutions on AWS and Azure for Huron’s consulting clients. Partnering daily with business users to deliver tested features.
Staff AI Security Engineer securing EQ Bank’s enterprise AI, machine learning, and cloud platforms. Building guardrails, controls, automation, and detection capabilities for Canada’s Challenger Bank.
Staff Software Engineer owning OAuth, authorization, and agent delegation systems. Building governed identity infrastructure for Redpanda’s enterprise AI data platform.
Senior software engineer evaluating AI coding agents for G2i’s engineering team. Assessing reasoning, explanations, and engineering judgment in Codex, Claude Code, and Cursor interactions.
Senior software engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering quality.
Senior engineer evaluating Codex, Claude Code, and Cursor interactions for G2i. Providing rigorous written and video feedback on AI - generated engineering work.