AI Platform Engineer leading multidisciplinary teams building AI - powered applications and intelligent workflows at Valtech. Shape the future of experience through Data, AI, and emerging solutions.
LP
Senior Data Engineer
Posted via LinkedIn Recruiter (not a company profile)
Posted 4 months ago
About the role
- Senior Data Engineer role in Mississauga, ON. Requires 6+ years experience with Azure, Databricks, Scala, Spark, and database design.
Responsibilities
- Senior Data Engineer role focused on big data analytics and data engineering. Responsibilities include working with Databricks platform, Spark framework (RDD/DataFrame/SQL), Azure cloud services (Data Lake Storage, Azure Data Factory), database design & development, and implementing CI/CD pipelines for automated deployments. Additional focus on AI/ML development using Python, Langchain, Azure OpenAI, Vector Databases, and RAG (Retrieval-Augmented Generation) techniques.
Requirements
- Bachelor’s or Master’s degree in Computer Science or related field. 6+ years of hands-on experience in software engineering/data engineering roles. Strong experience with Databricks platform for big data analytics. Proficient in Scala programming language; solid understanding of Spark framework (RDD/DataFrame/SQL). Hands-on experience working on Azure cloud services (e.g., Data Lake Storage, Azure Data Factory). Strong background in Database design & development; excellent SQL skills (T-SQL/PLSQL etc.). Understanding of CI/CD pipelines for automated deployments on cloud platforms. Experience working within Agile/Scrum methodologies. Advanced knowledge of Python for scripting, automation, and AI/ML development. Familiarity with Langchain for integrating and orchestrating large language model workflows. Hands-on experience with Azure OpenAI to leverage generative AI capabilities in applications. Understanding of Vector Databases for efficient storage and retrieval of high-dimensional data embeddings. Knowledge of RAG (Retrieval-Augmented Generation) techniques.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
LP
Datastage ETL
LinkedIn Recruiter Post
Aarorn Technologies seeks a Datastage ETL contractor with 5+ years of experience for a hybrid role in Toronto. Must have IBM InfoSphere DataStage, SQL, Unix scripting, and scheduling skills.
LP
Azure Databricks Developer-HR Platforms
LinkedIn Recruiter Post
Azure Databricks Developer needed for HR tech projects at a top financial client. Design ETL solutions, support data integrations, and modernize HR data platforms.
Senior Software Engineer, Data responsible for building data pipelines and maintaining infrastructure for analytics and ML. Collaborate with teams to optimize data systems at Narvar.
Data Architect leading conversations and decisions on data modeling at a global consulting firm specializing in Data & Analytics. Transforming complex processes into clear, reusable information models.
Senior Data Engineer at Supabase managing data pipelines from source to analysis. Collaborating with growth, finance, and product teams to drive business insights.
LP
Data Architect – Snowflake
LinkedIn Recruiter Post
Data Architect - Snowflake needed for full - time hybrid role in Markham, ON. Expertise in Snowflake on AWS, data migration, and ETL required.
LP
Datastage ETL
LinkedIn Recruiter Post
Hiring Datastage ETL contractor for hybrid role in Toronto. Requires 5+ years experience with IBM DataStage, SQL, Unix scripting.
LP
Data Architect (Snowflake & DBT)
LinkedIn Recruiter Post
Data Architect needed to architect and implement Snowflake on AWS solutions, with 8+ years experience in data architecture and engineering.
Associate Data Architect collaborating with stakeholders to design scalable data architecture for AXIS Capital. Maximizing profit through data - driven decision making and implementing effective data governance strategies.