Data Engineer building trusted data pipelines for Crux’s clean-energy capital platform. Automating surveys, reporting datasets, and research queries for Market Intelligence.
Responsibilities
Build and maintain foundational data pipelines for Market Intelligence datasets
Extract, transform, schedule, and monitor survey responses, pricing series, volume and capacity forecasts, and buyer participation data
Automate survey ingestion, cleaning, and joining processes end to end
Support the reporting layer and connect findings to tools, dashboards, and publications
Turn recurring bespoke research questions into repeatable queries
Validate inputs, document assumptions, maintain version control, and produce reproducible outputs
Identify and drive additional data use cases across teams
Embed with the Market Intelligence team while working on Crux’s Data Team
Requirements
3+ years of experience building and maintaining production data pipelines in high-growth, fast-paced environments
Fluent in Python and SQL; able to write, test, and debug production code and complex queries
Proficiency in cloud data warehousing, including schema design, incremental data loading, query optimization, and cost management
Experience with extraction, transformation, loading, scheduling, and monitoring
Knowledge of data-quality practices, including input validation, automated testing, monitoring, documentation, version control, and reproducible outputs
Ability to translate business or research needs into technical requirements, deliverables, and implementation plans
Ability to communicate technical tradeoffs, project status, data limitations, and delivery risks to technical and nontechnical stakeholders
Hands-on experience with AI-enabled tools for software development, data analysis, testing, documentation, or workflow automation
Sound technical judgment evaluating datasets and engineering approaches
Bonus: experience with energy, finance, transaction, or market intelligence data
Bonus: exposure to research, forecasting, survey analysis, or data-intensive publications
Bonus: experience developing or supporting analytical or statistical models
Bonus: knowledge of model testing and data-validation practices
Bonus: familiarity with data visualization, business intelligence, or reporting tools
Benefits
Remote-first operating model: Work from anywhere in the US and Canada
Optional offices in DC and NYC
Optional co-working opportunities
Regular team offsites three times a year
100% of employee healthcare premiums covered; 70% subsidy for dependents
Dental and vision premiums covered 100% for employees and 50% for dependents
10 company holidays per year
20 days paid time off per year
401k account
Parental leave: 16 weeks for birthing parents and 12 weeks for non-birthing parents
Full Stack Data Engineer migrating legacy insurance licensing and compensation systems. Building ETL pipelines, data models, reconciliations, reporting, and downstream feeds for Manulife.
Senior Data Engineer building Azure Synapse big data pipelines for Quantiphi, an AI - first digital engineering company. Supporting healthcare cloud migrations, large - scale processing, and data platforms.
Senior Data Engineer building Azure, Databricks, and Snowflake pipelines for 73 Strings’ private - capital data platform. Owning ingestion, transformation, quality, CI/CD, and production delivery.
Senior Developer building C#, SQL, and cloud tooling to migrate legal, billing, and trust - accounting data. Supporting complex client migrations for a technology company serving financial services firms.
Data Migration Lead moving legal, billing, and trust accounting data into a legal technology platform. Leading analysts, conversion tooling, customer migrations, and compliance controls.
Senior Software Engineer building scalable AWS microservices and APIs for Morningstar's global investment data platform. Modernizing distributed systems and enabling reliable financial data delivery.
Data infrastructure engineer building searchable robotics datasets and quality pipelines at Mecka AI. Managing distributed robot fleet infrastructure, deployments, monitoring, governance, and cloud costs.
Senior Data Migration Engineer leading PACS, RIS, VNA, and cloud migrations for INFINITT’s healthcare IT business. Ensuring secure data integrity across clinical imaging environments.
Data Engineering Advisor building Azure data pipelines and analytics solutions for Desjardins. Designing ingestion, transformation, and data management systems for business needs.
Staff Software Engineer building Instacart’s advertising data platform for grocery delivery and household goods. Designing compliant, scalable systems for advertisers, data scientists, and sales teams.