Senior Staff Software Engineer Inference Platform

You will lead the design, development, testing, and operation of inference-platform software. You will set technical direction, improve active-active system reliability and performance, guide senior engineers, make critical architectural decisions, and drive observability, incident response, capacity planning, and cross-functional alignment.

Responsibilities

• Design, develop, test, and maintain production software
• Raise senior-engineer effectiveness through design feedback, pairing, and technical standards
• Shape platform direction, Kubernetes custom resource definitions, failure domains, service boundaries, and technical roadmaps
• Architect active-active systems with failover, graceful degradation, and service-level objectives
• Improve latency, throughput, capacity efficiency, and resilience
• Write and review code for critical platform paths and make architectural decisions
• Lead production issue resolution, observability, incident response, and capacity planning
• Translate requirements into scalable system designs and align shared technical decisions

Requirements

• 8+ years of software engineering experience
• Large-scale distributed systems or cloud infrastructure
• Distributed-systems architecture
• Kubernetes
• Highly available latency-sensitive systems
• Security
• Certificates
• TLS
• mTLS
• High-QPS system optimization
• Go or C++
• Observability
• Metrics
• Logging
• Tracing
• Alerting
• Incident response
• SLO-driven operations
• Technical communication