Data Engineer focused on developing and sustaining Machine Learning solutions for ICBC's data needs. Collaborating with Data Scientists and Statistical Analysts on data-driven projects.
Responsibilities
Understanding Data Science, Machine Learning, Performance & Evaluative Analytics model requirements, working closely with Data Scientists & Statistical Analysts, supporting them with their data and Machine Learning operational needs.
Operationalizing Data Science Model into Machine Learning pipelines, applying coding optimization of the data science models, conducting model training and re-training, deploying the models and sustaining them in Production.
Responding to data requests, data discovery and data profiling to support various data science, evaluative and machine learning solutions and projects, reviewing and clarifying data requirements, ensuring the data artifacts are acceptable within policy and privacy protocols.
Providing subject matter & data expertise to the Strategic Analytics, Actuarial and Regulatory Affairs departs as well as ICBC divisional clients on data sources, reporting workflows, business process, and the appropriate tools with which to analyze their data.
Participating with corporate data user teams, developing data science model validation and test plans, performing user acceptance testing, and providing support to data scientists, evaluative & performance metrics analysts and sustainment of their end products.
Conducting analysis for moderate to complex strategic solutions and POCs, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification.
Requirements
Proven work-based experience coding using Python Language and PySpark data framework will be required.
Experience working with ML libraries & frameworks including Scikit-Learn for traditional ML, TensorFlow and PyTorch for deep learning.
Proficiency in Data Science Stack such as NumPy, PySpark and Pandas for data manipulation.
Technical knowledge in cleaning, transforming and preparing un-curated data including handling of values and feature scaling.
Exposure to Machine Learning Operations (MLOps) supporting Model development, skills with Docker for containerization, API development and using cloud platforms.
Knowledge & experience with Machine Learning Algorithms and techniques
Experience or exposure to working with pre-trained models such as Large Language Models (LLM), using Retrieval-Augmented Generation (RAG) and working with HuggingFace pre-trained models
Experience with processing structured and unstructured data.
Intermediate to Advance experience of writing SQL Queries & working with NoSQL Databases
Knowledge of experiment tracking & Management using tools like MLFlow, Data Version Control (DVC), managing model versions, parameters and results.
Pipeline orchestration using Apache AirFlow to automate training, testing and deployment workflows.
Setting up automated pipelines for Continuous integration and continuous deployment (CI/CD) using GitLab.
Excellent interpersonal, verbal and written communication skills to work with customers.
Strong data quality management process understanding, data analysis and data profiling.
Ability to apply critical thinking skills to troubleshoot and perform root cause analysis on technical problems and Machine Learning model deployments.
Understanding of Agile Methodologies.
Experience with reporting and visualization tools, such as Tableau, Jupiter or other reporting tools would be an asset.
Data Architect leading conversations and decisions on data modeling at a global consulting firm specializing in Data & Analytics. Transforming complex processes into clear, reusable information models.
Senior Data Engineer at Supabase managing data pipelines from source to analysis. Collaborating with growth, finance, and product teams to drive business insights.
Associate Data Architect collaborating with stakeholders to design scalable data architecture for AXIS Capital. Maximizing profit through data - driven decision making and implementing effective data governance strategies.
Data Engineer II at Finning supporting production data platforms and integrations using Snowflake, Databricks, Azure services. Collaborating with teams to ensure operational stability and reliability.
Staff Data Engineer at Ledgebrook responsible for architecting data platforms and ensuring data governance. Collaborates across teams to drive data - driven decisions and enhance engineering practices.
Senior Data Engineer responsible for building real - time data capabilities and infrastructure at DraftKings. Collaborating with various teams to optimize data solutions and drive innovative AI experiences.
Data Engineer designing and implementing solutions for Skip’s Business Intelligence and Data Warehouse. Collaborating with a multidisciplinary team to innovate data solutions for a global online delivery platform.