Senior Data Engineer focused on Databricks to deliver scalable data pipelines at BDO Digital. Leading client engagements and collaborating with cross-functional teams.
Responsibilities
Design, build, and optimize robust data pipelines using Databricks, Delta Lake, and Apache Spark
Develop scalable ETL processes for structured and unstructured data
Implement data integration solutions across cloud and on-premises sources
Automate data ingestion, transformation, and validation workflows
Monitor, troubleshoot, and enhance data pipeline performance
Serve as a primary technical lead for client engagements focused on data engineering
Translate business requirements into scalable data architectures
Collaborate with cross-functional teams to integrate data solutions
Requirements
A Bachelor’s or master’s degree in Computer Science, Data Engineering, Information Systems, or a closely related discipline
A minimum of 5 years of hands-on experience in data engineering
At least 3 years of direct experience with Databricks, Apache Spark, and cloud data platforms
In-depth knowledge of the Microsoft Azure ecosystem
Very strong proficiency with Databricks
Advanced programming skills in Python and/or Scala
Solid understanding of CI/CD practices
Familiarity with infrastructure-as-code tools such as Terraform or ARM templates
Excellent written and verbal communication skills
Benefits
competitive total cash compensation that recognizes and rewards your contribution
flexible benefits from day one
market leading personal time off policy
reimbursement for wellness initiatives that fit your lifestyle
Data Engineer developing scalable data processing architectures for CenterWell healthcare solutions. Utilizing AI and machine learning for data transformation in a remote setting.
Data Engineer at KUBRA building and maintaining data pipelines for BI solutions. Working closely with BI Analysts to ensure data is reliable and structured for client insights.
Data Engineer at OTIP Group of Companies designing and developing scalable data pipelines. Responsible for MDM processing and migrating existing solutions to Snowflake.
Data Engineer responsible for designing, building, and maintaining infrastructure for data handling at Avanquest. Focused on ensuring data accessibility and reliability for data scientists and analysts.
Data Migrations Specialist working with customers to transition their data smoothly into Clio's legal software. Collaborating with Sales and Customer Onboarding to enhance client experience.
Seeking Data Services Developer with 8 - 10 years experience in SQL & Python. Responsibilities include developing scalable data solutions, optimizing databases, and implementing ETL processes.
Data Engineering Advisor creating data systems and pipelines for data management solutions. Collaborating with stakeholders and using analytics to solve business problems in the financial sector.
Senior Data Engineer / Snowflake Architect leading the design and optimization of data solutions. Working closely with clients and internal teams to build scalable architectures in a hybrid environment.