Member of Technical Staff LLM Infrastructure

You will design and develop scalable backend infrastructure for distributed training, inference, and data pipelines. You will maintain CI/CD, control-plane, and model-serving systems; improve reliability and efficiency; and translate research and product needs into infrastructure solutions.

Responsibilities

• Design and develop scalable backend infrastructure
• Build and maintain CI/CD, control-plane, and model-serving systems
• Improve performance, cost efficiency, and reliability
• Build frameworks and safeguards for model quality
• Translate research and product needs into infrastructure solutions
• Participate in code reviews and deployment processes

Requirements

• Software engineering
• Infrastructure
• Machine learning system
• Python
• Go
• ML infrastructure
• PyTorch
• MLflow
• Vertex AI
• SageMaker
• Kubernetes
• LLM

Benefits

• Equity