Site Reliability Engineer

You will design and operate monitoring for GPU, host, and facility systems; lead technical incident response; and improve reliability across compute, network, storage, power, and cooling. You will manage high-risk changes, run blameless postmortems, maintain playbooks and dependency maps, define availability objectives, and participate in on-call response for critical campus incidents.

Responsibilities

• Own monitoring architecture and signal quality across GPU, host, and facility telemetry
• Provide technical incident leadership, bridge coordination, paging, escalation, and incident timeline management
• Run blameless postmortems and drive corrective actions to closure
• Gate high-risk firmware, BIOS, BMC, power, and cooling changes through change management
• Lead cross-functional reliability projects across compute, network, storage, and facility systems
• Partner with Hardware Failure Analysis to translate fleet failure data into monitoring and vendor RCA inputs
• Build and maintain playbooks, run game days, and keep dependency maps current
• Define error budgets and availability objectives at campus and service boundaries
• Participate in on-call rotations and SEV-class incident response

Requirements

• Bachelor's degree in Systems Engineering, Computer Science, Electrical Engineering, a related field, or equivalent experience
• 5+ years of experience in site reliability, systems engineering, plant operations, or large-scale production operations
• Large-scale incident command experience and technical leadership
• Fleet- or campus-scale monitoring and observability design experience
• Hands-on experience with Prometheus, Grafana, NVIDIA DCGM, or industrial telemetry and controls
• Experience across at least two of compute, network, storage, power, and cooling or facilities telemetry
• Experience writing and operating playbooks, runbooks, or SOP/MOP/EOPs with a 24/7 operations, control room, or NOC partner
• Proficiency in Python and Bash scripting for automation and analysis
• General experience with a systems language such as C, C++, Java, Go, or Rust
• Experience collaborating with NOC, data center operations, hardware failure analysis, and infrastructure engineering