Data Engineer role focused on building and optimizing data pipelines within Microsoft Fabric at AIM. Collaborating closely with analysts and developers to deliver scalable data solutions.
About the role
- Data Engineer specializing in building scalable analytics data pipelines at Dropbox. Focusing on leveraging the latest Big Data technologies without technical debt.
Responsibilities
- Help define company data assets (data model), Spark, SparkSQL jobs to populate data models
- Help define and design data integrations, data quality frameworks and design and evaluate open source/vendor tools for data lineage
- Work closely with Dropbox business units and engineering teams to develop strategy for long term Data Platform architecture to be efficient, reliable and scalable
- Conceptualize and own the data architecture for multiple large-scale projects, while evaluating design and operational cost-benefit tradeoffs within systems
- Collaborate with engineers, product managers, and data scientists to understand data needs, representing key data insights in a meaningful way
- Design, build, and launch collections of sophisticated data models and visualizations that support multiple use cases across different products or domains
- Optimize pipelines, dashboards, frameworks, and systems to facilitate easier development of data artifacts
Requirements
- 5+ years of Spark, Python, Java, C++, or Scala development experience
- 5+ years of SQL experience
- 5+ years of experience with schema design, dimensional data modeling, and medallion architectures
- Experience with the Databricks platform and data lake architectures for large-scale data processing and analytics
- Excellent product strategic thinking and communications to influence product and cross-functional teams by identifying the data opportunities to drive impact
- BS degree in Computer Science or related technical field involving coding (e.g., physics or mathematics), or equivalent technical experience
- Experience designing, building and maintaining data processing systems
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Software Engineer focusing on data engineering and machine learning for Workday. Involves data ingestion, governance, and collaboration using modern technologies.
LP
Data Warehouse Tester / Developer
LinkedIn Recruiter Post
Hiring Data Warehouse Tester/Developer in Toronto, ON (Hybrid). Requires 6 - 8 years exp in Databricks, PySpark, Python, SQL, Azure, ADF, DevOps, Informatica.
Lead Data Engineering and Analytics team to oversee data infrastructure design and governance for robotic deliveries. Collaborate cross - functionally to enable data - driven decision - making across departments.
Senior Data Architect delivering enterprise - scale data and analytics solutions at 3Pillar. Leading design and delivery of analytics platforms in mixed prem and cloud environments.
Cloud Data Engineer responsible for modern Data & AI solutions on Microsoft Azure. Collaborating with clients and teams to develop production - ready data platforms and support analytics.
Senior Data Engineer at Solana Foundation collaborating with blockchain engineers on data indexing and pipeline creation. Ensuring efficient data processing and metrics formulation for decentralized applications.
Senior Engineer on Data Platform team designing and building systems for data flow at Movable Ink. Collaborating with engineering, analytics, and infrastructure teams to power data ingestion and processing.
Senior Data Engineer responsible for designing and maintaining event streaming pipelines at Movable Ink. Working with modern technologies to enhance data availability and reliability.
Senior Data Engineer architecting and owning Snowflake layer for Knak’s Data Infrastructure and AI enablement. Collaborating across departments to ensure data accessibility and governance standards.