Senior HPC and Platform Engineer

Posted 3 days ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Senior HPC engineer building distributed execution, cloud infrastructure and CI/CD platforms for GeoSoftware’s geoscience software. Optimizing scientific workloads across HPC, cloud and object-storage environments.

Responsibilities

  • Design and build the distributed execution framework, including task sequencing, dependencies, elastic scaling, checkpoint and restart, retry with backoff, structured error reporting and preservation of partial output
  • Make workloads run across local multiprocessing, Dask, Ray, Slurm, PBS, Databricks, and managed cloud batch services on Azure, AWS and GCP behind one consistent interface
  • Design structured job submission, status, progress and cost reporting for programmatic and manual monitoring
  • Build job admission, entitlement and metering paths
  • Build and maintain Terraform infrastructure as code for bring-your-own-cloud and externally administered environments
  • Containerize compute components as lean, independently versioned images
  • Implement deployment security, including identity and access management, least-privilege roles, secrets handling, network isolation, encryption and image/dependency scanning
  • Support restricted and disconnected deployment scenarios
  • Work with identity, blob and object storage, networking, quotas and cost control across a major cloud
  • Parallelize and profile compute-bound scientific workloads across CPU, GPU and storage bandwidth
  • Diagnose and fix I/O-bound behavior against blob and object storage
  • Establish and defend performance baselines through measurement
  • Own CI/CD, build and release engineering, including pipelines, nightly regression harnesses, native Windows and Linux installers, and containerized cloud delivery
  • Establish observability for job lifecycle, resource utilization and cost across every backend
  • Support the platform and incorporate operational learning into its design
  • Collaborate with computational algorithm and front-end engineers in a small, senior, distributed team

Requirements

  • Bachelor's degree in computer science, engineering, physics, mathematics or a related technical discipline, or equivalent practical experience
  • Minimum 5 years of professional engineering experience in distributed computing, HPC or cloud platform engineering
  • Demonstrable production experience with a distributed compute framework
  • Demonstrable experience with infrastructure as code and working proficiency in one or two major cloud providers
  • Experience owning a CI/CD and release pipeline end to end
  • Sound security practice in cloud and containerized deployment: identity and access management, secrets handling and least privilege
  • Able to work effectively in a small, remote, multi-timezone team, including writing things down, communicating asynchronously and operating without close supervision
  • Fluent written and spoken English
  • Production experience with at least one distributed compute framework—Ray, Dask, Spark or MPI
  • Strong Python for orchestration, services and bindings
  • Solid modern C++, or confidence to work in it
  • Infrastructure as code, particularly Terraform
  • Containerization and Kubernetes, including image layering and size discipline
  • Working proficiency in Azure, AWS or GCP
  • Practical blob and object storage performance experience
  • Practical cloud security experience
  • CI/CD pipelines, release engineering and operational support experience

Benefits

  • Equal employment opportunities for all professionals
  • Opportunities to work with international and diverse teams of experts
  • Environment of excellence supporting talent development and career opportunities
  • Hybrid work arrangement

Job type

Full Time

Experience level

Senior

Salary

Not specified

Degree requirement

Bachelor's Degree

Tech skills

AWSAzureCloudGoogle Cloud PlatformKubernetesLinuxPythonRaySparkTerraformC++

Location requirements

HybridCalgaryCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.