Systems Designer I designing and supporting complex system components at Comtech Telecommunications Corp. Collaborating with cross - functional teams for reliable and secure networks.
About the role
- Senior LLM Systems Engineer improving accuracy and resilience of LLM-driven oracle automation systems. Collaborating on evaluations, tooling, and debugging for production operations.
Responsibilities
- We are hiring a Senior LLM Systems Engineer to own and improve the LLM-driven components of our oracle automation stack.
- Focus on the accuracy, performance, resilience, and operational quality of the systems that use models to reason about wide ranging prediction market rules, evidence, and oracle outcomes.
- Build the evaluations, observability, tooling, fallbacks, and feedback loops that make LLM behavior measurable and dependable in real-world conditions.
- Improve prompts, model selection, tool usage, structured outputs, retrieval, and evaluation coverage so the system gets more decisions right over time.
- Design validation, retries, fallbacks, uncertainty handling, and human review paths for ambiguous, adversarial, incomplete, or conflicting inputs.
- Build datasets, regression tests, dashboards, traces, and review loops that make model quality visible and prevent repeated failures.
- Help debug live issues, investigate regressions, improve runbooks, and reduce repeated operator friction.
Requirements
- 3+ years of professional software engineering experience in Python, TypeScript, or similar production languages.
- Hands-on experience building production systems that use LLMs, agents, retrieval, structured outputs, or model-powered workflows.
- Experience designing evaluations, test datasets, regression checks, quality metrics, or manual review loops for AI systems.
- Strong debugging ability across APIs, databases, queues, logs, model outputs, and external data sources.
- Practical understanding of prompt engineering, tool calling, structured output validation, retrieval, and common LLM failure modes.
- Ability to reason carefully about correctness in uncertain or adversarial environments.
- High agency, strong ownership, and clear written communication.
Benefits
- Pay packages include competitive salaries & meaningful long term equity participation
- Salaries for this role range from $100-200k (USD)
- Will pay in stablecoins or fiat
- Philosophies for a culture that show we care: Take vacation when you need it, family care, training and development (just to name a few)
- 100% remote, which means we encourage you to create the work environment that you thrive in
- At least two team wide offsites a year
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
LP
Systems Integration Engineer (Android/QNX)
LinkedIn Recruiter Post
Procom seeks a Systems Integration Engineer (Android/QNX) for a 12 - month hybrid contract in Ontario. Requires C++, Android build system, and debugging skills.
Senior Control Systems Engineer designing and maintaining process control systems for Enbridge's Liquids Pipeline. Leading technical projects and supporting operational efficiency in a hybrid work environment.
Lead finance technology transformation at Block by architecting financial systems using Oracle Fusion. Collaborate with cross - functional teams to drive innovation and efficiency.
Senior Staff Engineer at Mozilla leading architectural design for next - gen AI agent frameworks and workflows. Focused on building and scaling autonomous capabilities in a remote role within a fast - paced team.
Conduct system design and simulations for railway communication control systems at Sogeclair. Collaborate with teams to ensure compliance with technical requirements and customer expectations.
Data & Systems Analyst in the nuclear sector at Aecon, providing data support and analysis for projects. Focusing on data analytics, process improvement, and collaboration with project teams.
Business Analyst joining an enterprise digital banking modernization project, bridging technical delivery and operational reality to ensure seamless transitions.
System Engineer managing virtualization technologies for TMX Group. Responsible for system design, implementation, and support of infrastructure technologies in a hybrid work environment.
Fire Alarm Systems Designer managing designs and project submissions in Canadian locations. Collaborating with team members to create compliant fire alarm systems and ensuring design quality standards.