Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
LP
Senior Data Engineer
Posted via LinkedIn Recruiter (not a company profile)
Posted last month
About the role
- Senior Data Engineer role in Mississauga, ON. Requires 6+ years experience with Azure, Databricks, Scala, Spark, and database design.
Responsibilities
- Senior Data Engineer role focused on big data analytics and data engineering. Responsibilities include working with Databricks platform, Spark framework (RDD/DataFrame/SQL), Azure cloud services (Data Lake Storage, Azure Data Factory), database design & development, and implementing CI/CD pipelines for automated deployments. Additional focus on AI/ML development using Python, Langchain, Azure OpenAI, Vector Databases, and RAG (Retrieval-Augmented Generation) techniques.
Requirements
- Bachelor’s or Master’s degree in Computer Science or related field. 6+ years of hands-on experience in software engineering/data engineering roles. Strong experience with Databricks platform for big data analytics. Proficient in Scala programming language; solid understanding of Spark framework (RDD/DataFrame/SQL). Hands-on experience working on Azure cloud services (e.g., Data Lake Storage, Azure Data Factory). Strong background in Database design & development; excellent SQL skills (T-SQL/PLSQL etc.). Understanding of CI/CD pipelines for automated deployments on cloud platforms. Experience working within Agile/Scrum methodologies. Advanced knowledge of Python for scripting, automation, and AI/ML development. Familiarity with Langchain for integrating and orchestrating large language model workflows. Hands-on experience with Azure OpenAI to leverage generative AI capabilities in applications. Understanding of Vector Databases for efficient storage and retrieval of high-dimensional data embeddings. Knowledge of RAG (Retrieval-Augmented Generation) techniques.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Data Engineer building data integration pipelines for data lakes and warehouses. Collaborating with stakeholders to meet business requirements in a leading publishing company.
LP
Principal Data Engineer
LinkedIn Recruiter Post
Principal Data Engineer with 10+ years experience, strong AWS skills. Design large - scale data platforms in hybrid Toronto role.
Google Cloud Data Engineer implementing data ingestion and analytics frameworks at Fueled. Specializing in Google Cloud Platform and modern data modeling.
Consulting Senior Data Architect specializing in Microsoft Fabric solutions for digital products. Engage in hands - on delivery, architecture, and governance for data engineering in a remote capacity.
Data Engineer at Motive delivering data infrastructure for the AI era. Collaborating with stakeholders, building models, and implementing innovative tooling.
Data Architect designing and governing data foundations for analytics and AI applications at Clio. Collaborating cross - functionally to develop high - quality data models and standards.
LP
IAM / Data Engineer
LinkedIn Recruiter Post
IAM/Data Engineer role in Toronto (Hybrid). Requires 4+ years in ETL, data pipelines, cloud platforms, and skills in Windows IAM, Ansible, Terraform, SQL, Python/Java, Spark/Kafka.
Data Migration Specialist managing client data migrations to gaiia's platform. Collaborating with teams to ensure accurate and timely data transitions.
Senior Data Architect/Strategist at Robots & Pencils blending advanced data knowledge with problem solving to drive intelligent products and smarter business decisions.