Senior MaaS Backend Engineer
Posted Updated
Description
You will co-own MaaS architecture, build compatible inference APIs and routing, optimize model-serving performance, and scale global reliability. You will implement security, identity, metering, billing, migrations, observability, and data-retention controls while mentoring engineers and leading technical execution.
Responsibilities
- Co-own MaaS system design and technical execution
- Own inference gateway compatibility and API versioning
- Build load-aware routing, circuit breaking, and fallback mechanisms
- Optimize token throughput, caching, latency, and autoscaling
- Scale regional inference pools and active-active control planes
- Define and defend service-level objectives
- Enforce authorization, multi-tenant isolation, API-key management, and rate limits
- Build exactly-once token metering and usage ledgers
- Execute incremental migrations using shadow traffic and dual writes
- Deliver request tracing, cost telemetry, and log-retention controls
Requirements
- 8+ years of backend engineering experience
- 3+ years owning a high-traffic multi-tenant API platform for paying customers
- Experience with multi-region active-active distributed systems, caching, backpressure, and performance engineering
- Experience executing zero-downtime migrations for stateful systems
- Proficiency with Go, Kubernetes, Envoy, and GPU-aware scheduling
- Knowledge of PostgreSQL, Redis, Kafka, OpenTelemetry, and high-cardinality analytics stores
- Understanding of LLM serving, server-sent-event streaming, KV caching, and throughput trade-offs
- Experience with exactly-once metering and billing systems
- Experience designing fail-closed authorization and cross-tenant isolation
- On-call and incident-review experience
