Data Engineer architecting and building cloud-based systems for Semios Group, an agricultural technology company. Responsibilities include managing data interfaces, scalable infrastructure, and delivering actionable insights.
Responsibilities
Architect and build Cloud based systems to manage and improve the interface between Semios data and its consumers.
Design, develop and maintain scalable infrastructure to process and store data, integrate data driven models and automate manual processes.
Implement highly scalable big data analytics systems in a cloud environment.
Design and build reliable, monitorable and fault-tolerant data systems & data processes.
Create data tools for analytics and data science team members that assist them in building and optimizing our product into an innovative industry leader.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Continuously identify bottlenecks in the data stack and optimize queries and processes for cost and performance.
Write clear documentation of data processes and products.
Requirements
Advanced skills in SQL; how to write elegant queries; written for humans first, machines second.
The ability to thrive both autonomously and in a team environment.
Hands-on experience with provisioning and developing on cloud platforms (familiarity with GCP is a definite plus).
Experience with at least one Data Warehouse (BigQuery, RedShift, Snowflake, On-Prem).
Excellent verbal & written communication skills: a talent to distill complex ideas to different audiences.
An in-depth experience with Big Data. A proven track-record of effective collection, storage, and access.
Proven experience with workflow and scheduling tools (e.g., like Prefect, Airflow, Dagster, Kubeflow, etc.) and version control (Git).
A fluency in Python, Node or other imperative language or ability to learn quickly and with enthusiasm.
Excellent troubleshooting skills to rapidly identify and resolve issues.
**Nice to have:**
Significant exposure to at least one relational database (Postgres, MySQL).
Real world experience with containers (Docker) & container management systems (Kubernetes).
Experience or Interest in working with IoT Cloud and IoT data.
Familiarity with data transformation tools (dbt, SQLMesh, Dataform) and syncing tools (e.g., dlt, Fivetran, Airbyte).
Cloud Data Engineer responsible for modern Data & AI solutions on Microsoft Azure. Collaborating with clients and teams to develop production - ready data platforms and support analytics.
Senior Data Engineer at Solana Foundation collaborating with blockchain engineers on data indexing and pipeline creation. Ensuring efficient data processing and metrics formulation for decentralized applications.
Senior Engineer on Data Platform team designing and building systems for data flow at Movable Ink. Collaborating with engineering, analytics, and infrastructure teams to power data ingestion and processing.
Senior Data Engineer responsible for designing and maintaining event streaming pipelines at Movable Ink. Working with modern technologies to enhance data availability and reliability.
Senior Data Engineer architecting and owning Snowflake layer for Knak’s Data Infrastructure and AI enablement. Collaborating across departments to ensure data accessibility and governance standards.
Data Engineer designing and implementing cloud - native data ecosystem for sports analytics. Building scalable infrastructure to transform raw data into valuable consent assets.
Data Engineer owning infrastructure that turns raw events from mobile users into trustworthy data. Building scalable data architecture and collaborating with cross - functional teams for data management.
Data Architect engaging with companies on transformational data programs to enhance AI and data capabilities. Leading architectural frameworks and mentoring data teams against industry best practices.
ML Data Engineer responsible for designing and developing AI platforms at Newfold Digital. Collaborating across teams to integrate and optimize data sources for AI - driven applications.