Technical Program Manager Model Alignment and Deployment
Posted Updated
Description
You will lead cross-functional programs for data collection, annotation, model alignment, safety testing, and model serving. You will coordinate research, safety, infrastructure, and UX workstreams; build evaluation frameworks; monitor pipeline and deployment health; improve operations; and manage external vendors and data partners.
Responsibilities
- Lead programs spanning data collection, annotation, alignment workflows, safety guardrails, and model serving
- Define scopes, goals, timelines, risks, and success metrics
- Coordinate post-training, safety, trust and safety, ML infrastructure, UX research, and product workstreams
- Develop and maintain model evaluation frameworks
- Drive quality, safety, and toxicity evaluation initiatives
- Monitor data pipeline health, annotation quality, training progress, and deployment readiness
- Improve tooling, process, and developer velocity
- Partner with leaders on prioritization and tradeoffs
- Develop operational patterns and frameworks for capability development
- Manage annotation vendors, evaluation tooling providers, and data partners
Requirements
- 5+ years of technical program management, research operations, or product execution experience in AI, ML, or research
- Familiarity with supervised fine-tuning, RLHF, AI safety frameworks, LLM evaluation, and model deployment or serving
- Experience leading complex multi-team programs
- SQL proficiency
- Python proficiency
- Experience with data and user insights
- BS in a quantitative, scientific, or technical field
Benefits
- Health coverage for employees and their families with most premiums covered
- Generous 401(k) contribution
- Up to 20 weeks of paid parental leave
- Four weeks of PTO
- Daily in-office catering
- Monthly DoorDash stipend
- Monthly wellness stipend
