About the role

Senior Data Engineer building scalable data pipelines for Lantern's healthcare platform. Collaborating with teams to develop enterprise-scale data solutions using cloud technologies.

Responsibilities

Design and implement robust, scalable, and high-performance data pipelines
Implement Data Ingestion, transformation, and Data Quality features to support Application Engineering, Analytics, and various Business Verticals across the organization.
Collaborate with Data Engineering Manager, and Product in building data models to improve reliability and interpretability of data for analytical and business needs.
Design, develop, and maintain robust data export solutions to facilitate the efficient transfer of data to external systems and platforms.
Actively contribute to the creation of design documents, assess technologies, and conduct Proof of Concepts (PoCs).
Experience supporting production jobs and mitigate issues in a timely manner.
Write unit, integration, and functional tests for new features.
Contribute to the Technology Roadmap, PR Reviews and formulate standards/best practices.
Bring in a positive attitude and foster a culture that embraces continuous learning and Innovation.

5+ years of experience as a Data Engineer, with a focus on building enterprise data solutions.
3+ years of experience with cloud and infrastructure on Azure (preferred), AWS, or GCP.
Strong experience with Python, with ability to discuss design patterns; strong SQL skills.
Expert in Microsoft SQL Server (preferred) or other relational databases.
Expertise with SQL, stored procedures, triggers, and performance tuning.
Experience working with big data technologies such as Spark (preferred), Databricks, or similar frameworks.
Experience using Infrastructure as Code tools such as Terraform (or similar) to provision and manage cloud resources.
Prior experience in building data pipelines that are scalable, reliable and fault tolerant while delivering data integrity and code quality.
Experience in building data lakes to support high speed querying by the end users.
Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
Prior Experience working with Healthcare Information exchange standards like HL7, X12 EDI, FHIR will be helpful.
Experience or knowledge of creating RESTful API’s is a plus.
Experience building Dashboards and visualizations using Power BI or other tools is a plus.