Data Engineer architecting and building cloud-based systems for Semios Group, an agricultural technology company. Responsibilities include managing data interfaces, scalable infrastructure, and delivering actionable insights.
Responsibilities
Architect and build Cloud based systems to manage and improve the interface between Semios data and its consumers.
Design, develop and maintain scalable infrastructure to process and store data, integrate data driven models and automate manual processes.
Implement highly scalable big data analytics systems in a cloud environment.
Design and build reliable, monitorable and fault-tolerant data systems & data processes.
Create data tools for analytics and data science team members that assist them in building and optimizing our product into an innovative industry leader.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Continuously identify bottlenecks in the data stack and optimize queries and processes for cost and performance.
Write clear documentation of data processes and products.
Requirements
Advanced skills in SQL; how to write elegant queries; written for humans first, machines second.
The ability to thrive both autonomously and in a team environment.
Hands-on experience with provisioning and developing on cloud platforms (familiarity with GCP is a definite plus).
Experience with at least one Data Warehouse (BigQuery, RedShift, Snowflake, On-Prem).
Excellent verbal & written communication skills: a talent to distill complex ideas to different audiences.
An in-depth experience with Big Data. A proven track-record of effective collection, storage, and access.
Proven experience with workflow and scheduling tools (e.g., like Prefect, Airflow, Dagster, Kubeflow, etc.) and version control (Git).
A fluency in Python, Node or other imperative language or ability to learn quickly and with enthusiasm.
Excellent troubleshooting skills to rapidly identify and resolve issues.
**Nice to have:**
Significant exposure to at least one relational database (Postgres, MySQL).
Real world experience with containers (Docker) & container management systems (Kubernetes).
Experience or Interest in working with IoT Cloud and IoT data.
Familiarity with data transformation tools (dbt, SQLMesh, Dataform) and syncing tools (e.g., dlt, Fivetran, Airbyte).
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.
Senior Data Engineer owning Databricks lakes, pipelines, and AI data infrastructure. Building Quandri’s AI operating system for insurance agencies and brokerages.
Senior Data Engineer architecting Azure and Databricks data platforms for TTEC Digital’s client experience solutions. Building governed pipelines, APIs, MCP integrations, and agentic AI data services.
Senior Data Engineer building Palantir Foundry data solutions for Unit8, a Swiss AI and data analytics consultancy. Supporting client delivery and establishing its Canadian market presence.
Staff Software Engineer building AWS data infrastructure and integrations for Solink’s cloud video - security platform. Driving scalability, architecture, and engineering mentorship.
Senior Azure Fabric Data Engineer building reliable pipelines and modern data platforms for Data Elephant, a Canadian data, analytics, and AI consultancy. Delivering trusted datasets for reporting, AI, and machine learning.
Senior Data Architect leading Microsoft Fabric implementations for Data Elephant, a Canadian data, analytics, and AI consulting firm. Designing secure Azure, OneLake, and Fabric platforms for clients.