Anyscale
Open positions
1 job
last month
Distributed LLM Inference Engineer
HybridNorth America
United States
You will deliver end-to-end batch and online inference solutions at scale. You will integrate Ray Data and LLM engines, optimize cost and performance, work with open-source communities, contribute improvements, and…
Deep Learning Distributed Systems LLM Machine Learning PyTorch +1 skills