Applied AI Research Engineer

You will lead hands-on inference research to reduce token costs and latency for customer workloads. You will optimize inference systems, including speculative decoding, quantization, KV-cache usage, and memory management. You will work directly with customers, turn findings into platform improvements, and identify high-impact research opportunities.

Responsibilities

• Optimize inference systems using speculative decoding, quantization, KV-cache, and memory management
• Work with customers to optimize production workloads
• Apply customer workload learnings to platform product improvements
• Identify high-upside research opportunities and guide the inference platform

Requirements

• Systems or research background in LLM inference
• Deep understanding of LLM serving from kernel to scheduler
• History of shipping products or research used in production-like scenarios
• Ability to collaborate closely with customers
• Knowledge of developer tools, cloud-native technologies, and open-source software

Benefits

• Meaningful equity
• Health, dental, and vision benefits with 90% coverage for employees and 50% for dependents
• Opportunities to participate in cloud-native community events
• Fitness stipend
• Learning budget