Site Reliability Engineer Platform Infrastructure Foundations

You will design, build, and scale services that orchestrate Ray clusters across cloud and on-premises environments. You will optimize control-plane components, scheduling, resource management, reliability, performance, observability, accelerator integration, and container image management. You will also provide on-call support and participate in technical reviews.

Responsibilities

• Design, build, and scale services that orchestrate Ray clusters across cloud and on-premises environments.
• Optimize control-plane components for large-scale distributed AI and ML workloads.
• Build scheduling and resource-management systems for heterogeneous compute clusters.
• Develop reliability, performance, scalability, and observability features for Ray workloads.
• Support and optimize GPU and TPU integration.
• Manage container images and dependency resolution for distributed workloads.
• Participate in code reviews, design discussions, and architecture discussions.
• Provide on-call support and troubleshoot infrastructure issues with customer and field teams.

Requirements

• 3+ years of experience writing production code.
• Experience building and maintaining highly available, scalable, performant distributed systems.
• Experience with AWS, Azure, GCP, and Kubernetes deployments.
• Knowledge of cloud networking, security, and authentication mechanisms.
• Experience with Prometheus and Grafana.
• Proficiency in Go and Python.
• Knowledge of Linux kernel, file systems, and containers.

Benefits

• Stock options
• Healthcare plans with 95% of premiums covered by Anyscale
• 401k Retirement Plan
• Wellness & Education Stipend
• Paid Parental Leave
• Fertility Benefits
• Paid Time Off
• Commute reimbursement
• In-office lunch