Software Engineer Inference Platform

You will design, develop, test, and maintain production software for an inference orchestration platform. You will improve availability, failover, observability, security, latency, throughput, capacity efficiency, incident response, and scalable system design.

Responsibilities

• Design, develop, test, and maintain production software
• Help define platform direction, Kubernetes custom resource definitions, failure domains, and service boundaries
• Architect active-active systems with failover, graceful degradation, and service-level objectives
• Improve latency, throughput, capacity efficiency, and resilience
• Write and review production code for critical platform paths
• Drive observability, incident response, capacity planning, and post-incident improvements
• Translate requirements into scalable system designs with cross-functional partners

Requirements

• 3+ years of software engineering experience
• Large-scale distributed systems or cloud infrastructure
• Kubernetes
• Highly available latency-sensitive systems
• Security
• Certificates
• TLS
• mTLS
• High-QPS system optimization
• Go or C++