Member of Technical Staff AI Infrastructure Engineer
Posted Updated
Description
You will design, deploy, and maintain Kubernetes clusters and Slurm environments for AI training and inference. You will develop APIs and orchestration systems, manage scheduling and workloads, improve system performance, build observability, respond to outages, and optimize cluster utilization and autoscaling.
Responsibilities
- Design, deploy, and maintain Kubernetes clusters for AI workloads
- Manage and optimize Slurm HPC environments
- Develop APIs and orchestration systems for training and inference
- Implement resource scheduling and job management
- Benchmark performance and resolve infrastructure bottlenecks
- Build monitoring, alerting, and observability solutions
- Respond to system outages and maintain availability
- Optimize cluster utilization and autoscaling
Requirements
- Kubernetes administration expertise
- Slurm workload-management experience
- Experience managing distributed training systems at scale
- Knowledge of container orchestration and distributed systems architecture
- Knowledge of LLM architecture and training processes
- Experience managing GPU clusters
- Python and C++ programming experience
- PyTorch distributed-training experience
- Knowledge of networking, storage, and compute resource management
- Experience with APIs, debugging, and observability
