Data Engineer architecting and building cloud-based systems for Semios Group, an agricultural technology company. Responsibilities include managing data interfaces, scalable infrastructure, and delivering actionable insights.
Responsibilities
Architect and build Cloud based systems to manage and improve the interface between Semios data and its consumers.
Design, develop and maintain scalable infrastructure to process and store data, integrate data driven models and automate manual processes.
Implement highly scalable big data analytics systems in a cloud environment.
Design and build reliable, monitorable and fault-tolerant data systems & data processes.
Create data tools for analytics and data science team members that assist them in building and optimizing our product into an innovative industry leader.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Continuously identify bottlenecks in the data stack and optimize queries and processes for cost and performance.
Write clear documentation of data processes and products.
Requirements
Advanced skills in SQL; how to write elegant queries; written for humans first, machines second.
The ability to thrive both autonomously and in a team environment.
Hands-on experience with provisioning and developing on cloud platforms (familiarity with GCP is a definite plus).
Experience with at least one Data Warehouse (BigQuery, RedShift, Snowflake, On-Prem).
Excellent verbal & written communication skills: a talent to distill complex ideas to different audiences.
An in-depth experience with Big Data. A proven track-record of effective collection, storage, and access.
Proven experience with workflow and scheduling tools (e.g., like Prefect, Airflow, Dagster, Kubeflow, etc.) and version control (Git).
A fluency in Python, Node or other imperative language or ability to learn quickly and with enthusiasm.
Excellent troubleshooting skills to rapidly identify and resolve issues.
**Nice to have:**
Significant exposure to at least one relational database (Postgres, MySQL).
Real world experience with containers (Docker) & container management systems (Kubernetes).
Experience or Interest in working with IoT Cloud and IoT data.
Familiarity with data transformation tools (dbt, SQLMesh, Dataform) and syncing tools (e.g., dlt, Fivetran, Airbyte).
Data Platform Engineer building ingestion pipelines, storage, governance, and observability systems for Movable Ink’s AI - driven marketing personalization platform. Supporting scalable, secure, multi - tenant data services.
Senior Data Engineer building AWS ETL/ELT pipelines and dbt models for Tango’s cloud real - estate and facilities SaaS. Managing databases, data quality, warehousing, and observability.
Senior Data Engineer building AWS and dbt data pipelines for Tango’s cloud real - estate and facilities SaaS platform. Managing databases, warehouses, data quality, and analytics - ready datasets.
Data Engineer building streaming pipelines and analytical databases for Movable Ink’s data - activated marketing personalization platform. Developing Elixir/Python services and reliable event - data products at billions - event scale.
Senior Data Engineer needed for a 1 - year contract with an asset management client in Toronto. Requires 7+ years of experience, Snowflake, Python, SQL, and cloud platform expertise.
Senior Data Engineer owning finance data pipelines and models for Instacart, a grocery delivery platform. Supporting accounting, billing, revenue, and financial reporting at scale.
Senior AI Data Engineer building production AI systems and marketing data infrastructure for Samsara’s connected - operations IoT platform. Automating workflows and enabling data - driven decisions.
Senior Data Engineer modernizing Alberta government regulatory data platforms. Building governed Azure pipelines, models, APIs, and analytics - ready datasets for DRAS.
Senior Data Engineer modernizing Alberta environmental regulatory data on Microsoft Azure. Building governed pipelines, APIs, and analytics - ready datasets for the DRAS platform.