Senior Data Engineer role in Mississauga, ON. Requires 6+ years experience with Azure, Databricks, Scala, Spark, and database design.
Responsibilities
Senior Data Engineer role focused on big data analytics and data engineering. Responsibilities include working with Databricks platform, Spark framework (RDD/DataFrame/SQL), Azure cloud services (Data Lake Storage, Azure Data Factory), database design & development, and implementing CI/CD pipelines for automated deployments. Additional focus on AI/ML development using Python, Langchain, Azure OpenAI, Vector Databases, and RAG (Retrieval-Augmented Generation) techniques.
Requirements
Bachelor’s or Master’s degree in Computer Science or related field. 6+ years of hands-on experience in software engineering/data engineering roles. Strong experience with Databricks platform for big data analytics. Proficient in Scala programming language; solid understanding of Spark framework (RDD/DataFrame/SQL). Hands-on experience working on Azure cloud services (e.g., Data Lake Storage, Azure Data Factory). Strong background in Database design & development; excellent SQL skills (T-SQL/PLSQL etc.). Understanding of CI/CD pipelines for automated deployments on cloud platforms. Experience working within Agile/Scrum methodologies. Advanced knowledge of Python for scripting, automation, and AI/ML development. Familiarity with Langchain for integrating and orchestrating large language model workflows. Hands-on experience with Azure OpenAI to leverage generative AI capabilities in applications. Understanding of Vector Databases for efficient storage and retrieval of high-dimensional data embeddings. Knowledge of RAG (Retrieval-Augmented Generation) techniques.
Staff Data Engineer responsible for modernizing analytics platforms and ensuring data governance across business domains at Dropbox. Collaborating with cross - functional teams for efficient data pipelines and governance standards.
Data Engineer Student role at Canada Life focusing on connected data products for Canadian business needs. Collaborating with data teams to support analytics and decision - making initiatives.
Sr. Data Engineer with Leadership Experience for contract role in Toronto. Requires 7+ years experience, SQL/Python/R skills, and leadership capabilities.
Lead technical delivery for a Law 25 regulatory project in banking. Work with cloud, large data sets, analytics, and regulatory reporting in a hybrid Toronto role.
Senior Azure Data Engineer at Parexel implementing and managing Azure data solutions for clinical research projects. Collaborating with teams to design and support data pipelines, optimizing healthcare solutions.
Senior Data Engineer responsible for data infrastructure in Cost Engineering. Enabling cost optimization and sustainability initiatives while collaborating across teams.
Senior Advisor managing data architecture and modeling frameworks for iA Financial Group. Supporting transformation and innovation of data management practices within the organization.
Salesforce Data Architect designing and optimizing enterprise - grade data architectures across Salesforce platforms. Collaborating with team members to ensure data quality and readiness for analytics.
Senior Data Engineer with a strong background in Google Cloud services at Valtech. Leading data engineering projects and developing highly available data pipelines.