Senior Data Scientist – Model Evaluation

Posted 1 hour ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Senior Data Scientist evaluating football ML models for SumerSports’ NFL intelligence platform. Building rigorous testing, comparison, and experimentation tooling for production model quality.

Responsibilities

  • Contribute to model evaluation across football models
  • Drive one or two evaluation threads end-to-end
  • Build and extend tooling to test, compare, and ship models
  • Work with football subject-matter experts to design realistic evaluations
  • Catch silent regressions before models ship
  • Challenge metrics that do not measure their intended outcomes
  • Build an experimentation harness to test ideas quickly

Requirements

  • Strong statistical foundations
  • Knowledge of calibration (reliability and resolution), bootstrapping, and inter-rater reliability
  • Track record contributing to model evaluation on a production ML team
  • Production ML pipeline experience
  • Experience with schema drift, label noise, and leakage
  • Ability to build tooling, not just consume it
  • Self-starter who takes strategic direction and shapes their own path
  • AI-native approach to building skills, loops, and tooling
  • Stays current with research, papers, releases, and new techniques
  • Ability to absorb and become fluent in complex domains

Benefits

  • Competitive Salary and Bonus Plan
  • Comprehensive health insurance plan
  • Retirement savings plan (401k) with company match
  • Remote working environment
  • A flexible, unlimited time off policy
  • Generous paid holiday schedule - 13 in total including Monday after the Super Bowl
  • Annual performance bonus
  • Benefits and/or other applicable incentive compensation plans

Job type

Full Time

Experience level

Senior

Salary

$135,000 - $165,000 per year

Degree requirement

No Education Requirement

Location requirements

RemoteUnited States

Report this job

Found something wrong with the page? Please let us know by submitting a report below.