Sr. Databricks Spark Developer role designing and optimizing data pipelines for banking. Requires Databricks/Spark experience in financial services with strong communication skills.
Responsibilities
Design, develop, and optimize data pipelines utilizing Databricks and Apache Spark. Manage and process large-scale datasets in a distributed computing environment. Collaborate with cross-functional teams including business and technical stakeholders. Participate in solution design discussions and provide insightful technical recommendations. Ensure data quality, performance optimization, and solution scalability. Troubleshoot and resolve data pipeline issues efficiently. Contribute to documentation and best practices for data engineering processes.
Requirements
Proven hands-on experience with Databricks and Apache Spark development. Familiarity with enterprise environments, preferably in banking or financial services. Strong understanding of distributed computing and data architecture. Excellent verbal and written communication skills. Ability to work independently in a dynamic, fast-paced environment. Experience working on large-scale data projects with multiple stakeholders.
Data Engineer I supporting data platform development at EverCommerce. Collaborating with senior engineers and analytics teams to deliver reliable, high - quality data.
Senior Software Engineer at Abnormal AI building next - gen data platform with experience in data - intensive applications. Collaborates with engineering teams to enhance scalability and operational excellence.
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer building data integration pipelines for data lakes and warehouses. Collaborating with stakeholders to meet business requirements in a leading publishing company.
Google Cloud Data Engineer implementing data ingestion and analytics frameworks at Fueled. Specializing in Google Cloud Platform and modern data modeling.
Consulting Senior Data Architect specializing in Microsoft Fabric solutions for digital products. Engage in hands - on delivery, architecture, and governance for data engineering in a remote capacity.
Data Engineer at Motive delivering data infrastructure for the AI era. Collaborating with stakeholders, building models, and implementing innovative tooling.
Data Architect designing and governing data foundations for analytics and AI applications at Clio. Collaborating cross - functionally to develop high - quality data models and standards.
IAM/Data Engineer role in Toronto (Hybrid). Requires 4+ years in ETL, data pipelines, cloud platforms, and skills in Windows IAM, Ansible, Terraform, SQL, Python/Java, Spark/Kafka.