Senior Data Engineer needed for IFRS17 project in Mississauga, ON. 12-month contract, hybrid work, requires PySpark, Scala, Python, SQL.
Responsibilities
Develop and maintain backend systems using Python and PySpark, ensuring high performance, scalability, and reliability. Design, develop, and implement data engineering and ETL pipelines using PySpark. Perform data analysis and support IFRS17-related data initiatives. Collaborate with cross-functional teams to gather, analyze, and prioritize project requirements. Lead the technical direction of the team, including architecture, design, and implementation of software systems. Mentor and guide engineers through technical leadership, code reviews, and best practices. Develop and maintain technical documentation, including architecture diagrams and technical specifications. Participate in code reviews to ensure high-quality code and adherence to coding standards. Work closely with DevOps and Operations teams to ensure smooth deployment and operation of applications. Support and implement DevOps practices and CI/CD pipelines. Research, evaluate, and recommend new technologies and technical solutions. Troubleshoot complex issues, optimize system performance, and ensure high-quality software delivery. Collaborate with Product Owners to define and prioritize business and technical requirements. Work within Agile development environments such as Scrum or Kanban. Adapt to new technologies and business challenges as required.
Requirements
Expert-level experience in Data Analysis, SQL, Python, and PySpark. Strong technical leadership experience, including mentoring, coaching, and technical decision-making. Experience leading technical teams and managing technical priorities and resources. Excellent communication and collaboration skills. Must have IFRS17 working experience, strong Data Analysis experience, Insurance domain knowledge, expertise in SQL, Python, and PySpark, experience with PySpark for Data Engineering/ETL pipelines. Good to have DATAIKU exposure.
Senior Data Architect guiding data architecture during regulatory platform development. Collaborating across teams for scalable, secure data solutions aligned with enterprise standards.
Senior Data Engineer managing Nimble's data platform for effective data access and compliance in healthcare. Collaborating across teams to streamline pharmacy operations and enhance data workflows.
Data Engineering Intern at Boeing Vancouver developing scalable data pipelines with Python and Spark. Collaborating with multidisciplinary teams and gaining exposure in the Aerospace industry.
Lead Data Engineer responsible for data infrastructure design and performance optimization. Collaborating with teams to enhance data products for Just Eat Takeaway.com.
Data Engineer at Capgemini Engineering transforming company operations through high data quality and tooling. Collaborating with various teams to improve merchandising and sales through data solutions.