Product Manager Deployment
Posted Updated
Description
You will own the deployment strategy, roadmap, and success metrics for models and fine-tuned checkpoints in production. You will define serving workflows, work on reliability and performance tradeoffs, gather user feedback, drive launches and incident learning, and shape deployment SLAs and hosted-inference inputs.
Responsibilities
- Own deployment strategy, roadmap, and success metrics
- Define deployment workflows for model serving, autoscaling, versioning, rollback, monitoring, and incident response
- Work on serving architecture, latency, cost, reliability, capacity planning, and API and SDK deployment surfaces
- Build feedback loops with production users
- Drive technical scoping, dependency resolution, launch readiness, escalation design, and post-incident learning
- Connect deployment decisions to model and infrastructure roadmaps
- Shape SLAs, hosted-inference pricing and packaging inputs, and the deployment operating model
- Review serving configurations, latency data, incident retrospectives, and rollout plans
Requirements
- Production ML serving
- Infrastructure product management
- Deployment
- Reliability
- Scalability
- Performance
- Latency
- Throughput
- Autoscaling
- Rollback
- Incident response
- Model serving
- GPU scheduling
- Batching
- Quantization
- Capacity planning
- API
- SDK
- SLA
Benefits
- Health benefits
- Dental benefits
- Vision benefits
- Unlimited PTO
- Paid parental leave
- Relocation support
- Visa sponsorship