Data Engineer building trusted data pipelines for Crux’s clean-energy capital platform. Automating surveys, reporting datasets, and research queries for Market Intelligence.
Responsibilities
Build and maintain foundational data pipelines for Market Intelligence datasets
Extract, transform, schedule, and monitor survey responses, pricing series, volume and capacity forecasts, and buyer participation data
Automate survey ingestion, cleaning, and joining processes end to end
Support the reporting layer and connect findings to tools, dashboards, and publications
Turn recurring bespoke research questions into repeatable queries
Validate inputs, document assumptions, maintain version control, and produce reproducible outputs
Identify and drive additional data use cases across teams
Embed with the Market Intelligence team while working on Crux’s Data Team
Requirements
3+ years of experience building and maintaining production data pipelines in high-growth, fast-paced environments
Fluent in Python and SQL; able to write, test, and debug production code and complex queries
Proficiency in cloud data warehousing, including schema design, incremental data loading, query optimization, and cost management
Experience with extraction, transformation, loading, scheduling, and monitoring
Knowledge of data-quality practices, including input validation, automated testing, monitoring, documentation, version control, and reproducible outputs
Ability to translate business or research needs into technical requirements, deliverables, and implementation plans
Ability to communicate technical tradeoffs, project status, data limitations, and delivery risks to technical and nontechnical stakeholders
Hands-on experience with AI-enabled tools for software development, data analysis, testing, documentation, or workflow automation
Sound technical judgment evaluating datasets and engineering approaches
Bonus: experience with energy, finance, transaction, or market intelligence data
Bonus: exposure to research, forecasting, survey analysis, or data-intensive publications
Bonus: experience developing or supporting analytical or statistical models
Bonus: knowledge of model testing and data-validation practices
Bonus: familiarity with data visualization, business intelligence, or reporting tools
Benefits
Remote-first operating model: Work from anywhere in the US and Canada
Optional offices in DC and NYC
Optional co-working opportunities
Regular team offsites three times a year
100% of employee healthcare premiums covered; 70% subsidy for dependents
Dental and vision premiums covered 100% for employees and 50% for dependents
10 company holidays per year
20 days paid time off per year
401k account
Parental leave: 16 weeks for birthing parents and 12 weeks for non-birthing parents
Senior Data Engineer building Dandy’s data infrastructure for its technology - powered dental operating system. Developing pipelines, governed data products, and AI - ready platform capabilities.
Senior Data Engineer supporting the Government of Alberta’s Data Management Platform. Building, monitoring, and modernizing Talend integrations, ETL/ELT pipelines, APIs, and data services.
Data Engineer building cloud data pipelines, models, and analytics infrastructure for Boeing’s aviation programs. Supporting machine learning applications and data governance from Richmond/Vancouver.
Data Engineer building cloud - based data pipelines and analytics infrastructure for Boeing’s aviation programs. Supporting machine learning, data governance, and high - performance systems from Richmond/Vancouver.
ETL Data Engineer designing Informatica ETL pipelines and Hadoop workflows. Supporting SQL - driven reconciliation, data quality, BI reporting, and analytics solutions.
Data Engineer building Spark pipelines and analytics data models for Dropbox’s file collaboration platform. Supporting datamarts, KPIs, data quality, and production reliability.
Data systems engineer building Python pipelines and APIs for Northbeam’s marketing intelligence platform. Improving integrations, transformations, monitoring, and real - time data flows.
Staff Software Engineer owning ingestion and integration architecture for Northbeam’s marketing intelligence platform. Setting data - processing standards across ad, commerce, and real - time event systems.
Senior Forward Deployed Engineer building full - stack data and AI solutions for Warner Music Group. Automating workflows for music - label stakeholders using Python, Snowflake, Databricks, and Streamlit.