Director or Senior Manager AI Inference Model Scaling
Posted Updated
Description
You will define the technical vision, organizational strategy, and execution roadmap for a distributed engineering organization. You will lead model compilation, optimization, and high-performance kernel development; hire and mentor engineers; set standards; partner across functions; and deliver model enablement for customer commitments.
Responsibilities
- Define the technical roadmap and strategy
- Establish technical direction and engineering standards
- Drive support for emerging LLM architectures and inference workloads
- Hire, mentor, and grow engineering teams
- Develop technical leaders and managers
- Drive organizational planning and investment priorities
- Partner with cloud, machine learning, hardware, product, and customer teams
- Own planning, prioritization, and execution across initiatives
- Drive delivery for strategic customer commitments
Requirements
- BS, MS, or PhD in Computer Science, Computer Engineering, or a related field
- 12+ years building compiler, machine learning systems, or infrastructure software
- 5+ years leading engineering teams
- Compiler infrastructure including LLVM, MLIR, XLA, TVM, or Torch FX
- Graph compilation and optimization
- Python
- C++
- Production software delivery
