Distributed Systems Engineer at Movable Ink designing and implementing high - performance distributed software systems. Collaborating closely with other teams and delivering value to major brands.
MA
Senior Software Engineer, Python, PySpark
Posted 3 days ago
About the role
- Senior Software Engineer tackling complex data challenges for a major social media client. Join Capgemini Engineering to leverage big data technologies in an innovative environment.
Responsibilities
- Receive tasks from the Project Lead or Team Lead (TL), prepare functional and design specifications, and align them with all stakeholders
- Ensure assigned areas are delivered on time and meet quality expectations
- Provide effort estimations, agree on timelines with the manager, and contribute to project planning
- Evaluate existing data systems and identify improvement opportunities
- Develop best practices for data coding to ensure system-wide consistency
- Update and optimize local and metadata models
- Assess implemented data systems for discrepancies, variances, and performance efficiency
- Troubleshoot and optimize data infrastructure and pipelines
- Understand business drivers and analytical use cases, translating them into reliable data products
- Design, implement, and maintain cloud-based pipelines that deliver business-critical data efficiently
- Identify area-level risks and implement mitigation plans
- Report readiness/quality status and escalate critical issues appropriately
- Take responsibility for resolving crisis situations within the assigned area of responsibility (AOR)
- Initiate and conduct code reviews, and help establish coding standards, conventions, and guidelines
- Propose technical and functional improvements to enhance the product
- Continuously upgrade professional knowledge and skills
- Collaborate closely with cross-functional teams.
Requirements
- 5+ years of experience as a Software Engineer with strong Python development skills, including hands-on PySpark and Apache Spark implementation
- Mid-level Java proficiency (minimum 2.5/5), with practical experience writing, debugging, and maintaining Java code
- 3+ years of experience building, operating, and supporting large-scale, scalable Big Data platforms or infrastructure
- Strong knowledge of Big Data technologies, including: Apache Spark, Hadoop ecosystem, Parquet / ORC file formats, Apache Flink (or similar stream-processing frameworks)
- Proven troubleshooting and production support skills, including the ability to handle SEV-1 / critical production incidents under pressure
- Strong ability to organize, document, and communicate solutions, including technical design, root cause analysis (RCA), and operational runbooks
- A passion for streamlining systems and processes to make the difficult trivial
- Strong OOP skills
- Experience with Node.js
- Experience with AWS, Kubernetes (K8s), and Docker.
Benefits
- Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade
- Company paid holidays
- Personal Days
- Sick Leave
- Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
- Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
- Life and disability insurance
- Employee assistance programs
- Other benefits as provided by local policy and eligibility
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Backend Engineer joining Movable Ink's analytics team to build scalable backend systems. Designing data pipelines and mentoring junior engineers on software engineering best practices.
Senior C++ Engineer developing high - quality software solutions at Manulife. Collaborating within cross - functional teams to ensure production reliability and performance.
Senior Backend Developer at Tempo improving time management solutions. Develop scalable software and APIs using Java/Kotlin while collaborating with cross - functional teams.
Backend Engineer developing and enhancing features for Deel's platform. Collaborating with teams to deliver seamless experiences and APIs while focusing on customer - centric solutions.
Full - Stack Java Developer contributing to all phases of delivery at Alithya, including coding and automating tests.
Social Commerce Specialist at Grail managing TikTok Go creator program and collaborating with partners. Focus on sourcing creators and supporting operations within a fast - paced e - commerce environment.
Senior Staff Backend Engineer leading the design and delivery of AI - powered SaaS products at Kaseya. Collaborating with teams to embed data, ML, and AI capabilities into the product.
Staff Back - End Engineer focusing on AI - native R&D at Viggle AI. Leading design and development of high - performance distributed systems and cloud - native architectures.
Senior Back End Developer at Aequilibrium integrating and extending the Backbase digital banking platform. Collaborate with teams to deliver innovative solutions in financial services.