Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Senior analyst strengthening Khan Academy Kids’ psychometrics and efficacy research. Building KPI dashboards and reporting to improve early-childhood education outcomes.

Responsibilities

  • Lead the technical side of psychometrics and efficacy research for Khan Academy Kids assessments and learning content
  • Serve as the primary technical point of contact for external psychometric research partners
  • Support study design, data sharing, psychometric analyses, and interpretation of findings
  • Extract, clean, and securely share assessment data with research partners on a recurring schedule
  • Analyze item difficulty, score distributions, growth analyses, concurrent validity, and IRT-based scoring
  • Translate research findings into product improvements, including scoring models and assessment discontinuation rules
  • Develop and publish technical documentation, beginning with the technical manual for the PreK assessment
  • Recruit and onboard school and district sites for psychometric and efficacy studies
  • Execute MOUs, align on consent procedures and participant incentives, and coordinate site visits for direct child assessment data collection
  • Partner with legal to draft and negotiate data-sharing agreements
  • Coordinate Khan Academy Kids’ participation in ongoing efficacy studies and contribute to future study design
  • Build and maintain the Khan Academy Kids KPI dashboard with engineering, including App Store Connect and Google Play Console integrations
  • Prepare monthly and quarterly business reviews, periodic target setting, and recurring app performance reporting
  • Handle ad hoc SQL data requests for targeted district outreach and grant reporting
  • Collaborate with product managers, engineers, designers, academic experts, and external research organizations

Requirements

  • An advanced degree (PhD or Master's) in psychometrics, educational measurement, quantitative methods or a related field — or equivalent applied experience
  • Strong grounding in psychometric methods, including item analysis, reliability and validity evidence, growth modeling, and Item Response Theory (IRT)
  • Proficiency with SQL and a statistical programming language (e.g., R or Python) for extracting, cleaning, analyzing, and visualizing data
  • Experience with (or eagerness to learn) business intelligence tools such as Looker, and comfort building dashboards and data pipelines
  • Familiarity with responsible data-sharing practices in education research, including student data privacy considerations (e.g., FERPA, COPPA) and work with pseudonymized and deidentified data
  • Excellent communication skills: able to translate complex psychometric findings into clear implications for product teams, funders, and school partners
  • Strong project-management and organizational skills, with the ability to coordinate multiple external partners, recurring deliverables, and data-sharing schedules with close attention to detail
  • Proven cross-cultural competency skills, demonstrating self-awareness, awareness of others, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization
  • Motivated by Khan Academy’s mission “to provide a free, world-class education for anyone, anywhere”
  • Experience with (or strong interest in) early childhood education and assessment of young learners is a plus

Benefits

  • Competitive salaries
  • Ample paid time off as needed – Your well-being is a priority
  • 8 pre-scheduled Wellness Days in 2026 occurring on a Monday or a Friday for a 3-day weekend boost
  • Remote-first culture - that caters to your time zone, with open flexibility as needed, at times
  • Generous parental leave
  • An exceptional team that trusts you and gives you the freedom to do your best
  • The chance to put your talents towards a deeply meaningful mission and the opportunity to work on high-impact products that are already defining the future of education
  • Opportunities to connect through affinity, ally, and social groups
  • 401(k) + 4% matching
  • Comprehensive insurance, including medical, dental, vision, and life

Job title

Job type

Contract

Experience level

Senior

Salary

$137,871 - $155,105 per year

Degree requirement

Postgraduate Degree

Tech skills

PythonSQL

Location requirements

RemoteUnited States

Report this job

Found something wrong with the page? Please let us know by submitting a report below.