Member of Technical Staff AI Inference Engineer

You will support transformer-based retrieval, text-generation, and multimodal models in inference infrastructure. You will port CUDA kernels to CuTe DSL, develop the Rust serving runtime, optimize performance across the serving path, and build observability and remediation systems while responding to production incidents.

Responsibilities

• Support retrieval, text-generation, and multimodal models in inference infrastructure
• Port CUDA kernels to CuTe DSL
• Develop a Rust-based inference server
• Profile and fix performance bottlenecks
• Build dashboards, alerts, and automated remediation
• Respond to and learn from production incidents

Requirements

• Experience with GPU programming and performance work
• Knowledge of CUDA, Triton, CUTLASS, or similar technologies
• Knowledge of LLM architectures
• Experience operating production distributed systems under load
• Experience with Rust, Python, CUDA, and CuTe DSL
• 3+ years of professional software engineering experience in ML inference or high-performance systems
• Familiarity with PyTorch, JAX, or TensorFlow
• Understanding of GPU architectures and inference optimization techniques

Benefits

• Equity
• Health insurance
• Dental insurance
• Vision insurance
• Retirement benefits
• Fitness account
• Commuter account
• Dependent care account