Backend Engineer API
Posted Updated
Description
You will build the API that serves models to developers worldwide. You will own the end-to-end high-throughput inference system, including model-serving infrastructure, request routing, SDK development, rate limiting, observability, and efficient scaling.
Responsibilities
- Build the API serving models to developers
- Own high-throughput, low-latency inference systems
- Develop model-serving infrastructure and request routing
- Develop SDKs and rate limiting
- Maintain observability, availability, and efficient scaling
Requirements
- Expert knowledge of Rust or C++
- Experience designing, implementing, and maintaining reliable horizontally scalable distributed systems
- Knowledge of service observability and reliability practices
- Experience operating PostgreSQL, ClickHouse, and MongoDB
Benefits
- Equity
- Healthcare coverage
- Dental coverage
- Cash plan
- Income protection
- Life insurance
- Discounts and perks