Senior Software Engineer working on large-scale data platforms for Capgemini Engineering. Handling complex technical challenges with cutting-edge technologies in remote work environment.
Responsibilities
Receive tasks from the Project Lead or Team Lead (TL), prepare functional and design specifications, and align them with all stakeholders.
Ensure assigned areas are delivered on time and meet quality expectations.
Provide effort estimations, agree on timelines with the manager, and contribute to project planning.
Evaluate existing data systems and identify improvement opportunities.
Develop best practices for data coding to ensure system-wide consistency.
Update and optimize local and metadata models.
Assess implemented data systems for discrepancies, variances, and performance efficiency.
Troubleshoot and optimize data infrastructure and pipelines.
Understand business drivers and analytical use cases, translating them into reliable data products.
Design, implement, and maintain cloud-based pipelines that deliver business-critical data efficiently.
Identify area-level risks and implement mitigation plans.
Report readiness/quality status and escalate critical issues appropriately.
Take responsibility for resolving crisis situations within the assigned area of responsibility (AOR).
Initiate and conduct code reviews, and help establish coding standards, conventions, and guidelines.
Propose technical and functional improvements to enhance the product.
Continuously upgrade professional knowledge and skills.
Collaborate closely with cross-functional teams.
Requirements
5+ years of experience as a Software Engineer with strong Python development skills, including hands-on PySpark and Apache Spark implementation.
Mid-level Java proficiency (minimum 2.5/5), with practical experience writing, debugging, and maintaining Java code.
3+ years of experience building, operating, and supporting large-scale, scalable Big Data platforms or infrastructure.
Strong knowledge of Big Data technologies, including: Apache Spark, Hadoop ecosystem, Parquet / ORC file formats, Apache Flink (or similar stream-processing frameworks)
Proven troubleshooting and production support skills, including the ability to handle SEV-1 / critical production incidents under pressure.
Strong ability to organize, document, and communicate solutions, including technical design, root cause analysis (RCA), and operational runbooks.
A passion for streamlining systems and processes to make the difficult trivial
Strong OOP skills
Effective communication (oral & written), collaboration, and interpersonal skills
Result oriented approach
Experience with AWS, Kubernetes (K8s), and Docker.
Benefits
Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade
Company paid holidays
Personal Days
Sick Leave
Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
Life and disability insurance
Employee assistance programs
Other benefits as provided by local policy and eligibility
Senior Engineer contributing across the stack with a focus on backend systems in a rapidly growing AI technology company. Involvement includes designing and maintaining scalable services and APIs.
Kubernetes/DevOps Engineer at Capgemini Engineering working on large - scale social media platforms. Collaborating in a self - organized team to handle petabytes of data daily.
Java Tech Lead designing and evolving scalable trading technology platforms at Morgan Stanley. Leading teams and driving modernization initiatives in Commodities Technology as part of a global team.
Senior Backend Developer building secure backend applications using Java and Spring Boot for financial institutions. Working to mitigate security vulnerabilities while collaborating with multidisciplinary engineering teams.
Senior Engineer responsible for high - quality software engineering practices at Enable. Contributing from design to maintenance of scalable, secure software systems.
P2P Node.js Engineer expanding core P2P networking and storage primitives at Holepunch. Building apps without infrastructure using peer - to - peer technology for data privacy.
Senior Full - Stack .NET Engineer designing and developing enterprise - level applications for B2B iGaming platforms. Leading technical discussions and mentoring teams to deliver high - quality software solutions.