Skip to content

Search jobs inside your AI agent. ClaudeChatGPTCursorGrok Bot

Connect

Anyscale

Software Engineer ML Developer Experience

Posted Updated
Discussion

Description

You will build developer tooling and MLOps capabilities across CLI, SDK, API, MCP, cloud infrastructure, and the Ray runtime. You will improve distributed execution, debugging, observability, production serving, and highly available backend services while working with users to scope and iterate on solutions.

Responsibilities

  • Build developer tooling and MLOps capabilities on Ray
  • Develop CLI, SDK, API, and MCP interfaces
  • Improve distributed execution, dependency management, authentication, workload submission, and debugging
  • Build tools for data preparation, fine-tuning, evaluation, serving, experiment tracking, and lineage
  • Build model registration, deployment workflows, benchmarking, and service metrics
  • Surface observability across user and agent-facing interfaces
  • Design integrations using OpenAI-compatible APIs and OpenTelemetry
  • Design and operate highly available backend services

Requirements

  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
  • 5+ years of experience writing production code
  • Knowledge of algorithms, data structures, and system design
  • Experience with PyTorch, MLflow, data catalogs, or similar machine learning tooling
  • Experience building and operating highly available production services
  • Experience shipping developer-facing tools

Benefits

  • Stock options
  • Healthcare plans with 99% of premiums covered
  • 401k retirement plan
  • Wellness and education stipend
  • Paid parental leave
  • Fertility benefits
  • Paid time off
  • Commute reimbursement
  • In-office meals covered

Skills

Apply

See also

Software Engineering jobs by country — openings, pay and top skills →