LP
Data Warehouse Tester / Developer
LinkedIn Recruiter Post
Hiring Data Warehouse Tester/Developer in Toronto, ON (Hybrid). Requires 6 - 8 years exp in Databricks, PySpark, Python, SQL, Azure, ADF, DevOps, Informatica.
LP
Senior Data Engineer
Posted via LinkedIn Recruiter (not a company profile)
Posted 3 months ago
About the role
- Senior Data Engineer role in Mississauga, ON. Requires 6+ years experience with Azure, Databricks, Scala, Spark, and database design.
Responsibilities
- Senior Data Engineer role focused on big data analytics and data engineering. Responsibilities include working with Databricks platform, Spark framework (RDD/DataFrame/SQL), Azure cloud services (Data Lake Storage, Azure Data Factory), database design & development, and implementing CI/CD pipelines for automated deployments. Additional focus on AI/ML development using Python, Langchain, Azure OpenAI, Vector Databases, and RAG (Retrieval-Augmented Generation) techniques.
Requirements
- Bachelor’s or Master’s degree in Computer Science or related field. 6+ years of hands-on experience in software engineering/data engineering roles. Strong experience with Databricks platform for big data analytics. Proficient in Scala programming language; solid understanding of Spark framework (RDD/DataFrame/SQL). Hands-on experience working on Azure cloud services (e.g., Data Lake Storage, Azure Data Factory). Strong background in Database design & development; excellent SQL skills (T-SQL/PLSQL etc.). Understanding of CI/CD pipelines for automated deployments on cloud platforms. Experience working within Agile/Scrum methodologies. Advanced knowledge of Python for scripting, automation, and AI/ML development. Familiarity with Langchain for integrating and orchestrating large language model workflows. Hands-on experience with Azure OpenAI to leverage generative AI capabilities in applications. Understanding of Vector Databases for efficient storage and retrieval of high-dimensional data embeddings. Knowledge of RAG (Retrieval-Augmented Generation) techniques.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Lead Data Engineering and Analytics team to oversee data infrastructure design and governance for robotic deliveries. Collaborate cross - functionally to enable data - driven decision - making across departments.
Senior Data Architect delivering enterprise - scale data and analytics solutions at 3Pillar. Leading design and delivery of analytics platforms in mixed prem and cloud environments.
Cloud Data Engineer responsible for modern Data & AI solutions on Microsoft Azure. Collaborating with clients and teams to develop production - ready data platforms and support analytics.
Senior Data Engineer at Solana Foundation collaborating with blockchain engineers on data indexing and pipeline creation. Ensuring efficient data processing and metrics formulation for decentralized applications.
Senior Data Engineer responsible for designing and maintaining event streaming pipelines at Movable Ink. Working with modern technologies to enhance data availability and reliability.
Senior Engineer on Data Platform team designing and building systems for data flow at Movable Ink. Collaborating with engineering, analytics, and infrastructure teams to power data ingestion and processing.
Senior Data Engineer architecting and owning Snowflake layer for Knak’s Data Infrastructure and AI enablement. Collaborating across departments to ensure data accessibility and governance standards.
Data Engineer designing and implementing cloud - native data ecosystem for sports analytics. Building scalable infrastructure to transform raw data into valuable consent assets.
Data Engineer owning infrastructure that turns raw events from mobile users into trustworthy data. Building scalable data architecture and collaborating with cross - functional teams for data management.