Software Engineer Ray Data

You will develop open-source Ray software, improve Ray Core and Datasets architecture, strengthen release testing, and communicate your work through talks, tutorials, and blog posts. You will work on large-scale data performance, ML and data-source integrations, streaming workloads, and hosted Ray data operations.

Responsibilities

• Develop high-quality open-source software for Ray
• Identify, implement, and evaluate architectural improvements to Ray Core and Datasets
• Improve Ray testing and release processes
• Communicate work through talks, tutorials, and blog posts
• Optimize large-scale Ray Datasets performance
• Integrate ML training and data sources
• Develop stability and stress-testing infrastructure
• Lead streaming-workload integration initiatives
• Differentiate data operations in the hosted Ray service

Requirements

• At least 5 years of relevant work experience
• Background in algorithms, data structures, and system design
• Experience building scalable, fault-tolerant distributed systems
• Experience with data processing or database internals, including Spark or Dask