Tech jobs
Job listings
Machine Learning Engineer - Inference
About the Role Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. This role involves working with…
Senior Backend Engineer, Inference Platform
About the Role Together AI is building the Inference Platform that brings the most advanced generative AI models to the world. Our platform powers multi-tenant serverless workloads and dedicated endpoints, enabling…
Principal ML Engineer
Position Type: Full-Time About the Role: We are seeking a Principal ML Engineer with over 8 years of professional experience in software development to work with us. The ideal candidate has a strong foundation in…
NPU Software Engineer SDK
You will design, build, and operate SDK release pipelines, port and optimize AI models for NPU hardware, integrate open-source inference and serving frameworks, and build verification and debugging utilities. You will…
Staff Software Engineer GPU Inference
You will build and operate the GPU prefill path across APIs, model-serving workers, runtimes, GPU nodes, networking, and rack-scale infrastructure. You will improve operational readiness, reliability, numerical…
Software Engineer GPU Inference
You will build, deploy, and operate the GPU prefill path across API services, serving workers, vLLM, PyTorch, ROCm, GPU nodes, networking, and rack-scale infrastructure. You will improve reliability, numerical…
Member of Technical Staff AI Inference Engineer
You will support transformer-based retrieval, text-generation, and multimodal models in inference infrastructure. You will port CUDA kernels to CuTe DSL, develop the Rust serving runtime, optimize performance across…
Member of Technical Staff AI Inference Engineer
You will support transformer-based retrieval, text-generation, and multimodal models in inference infrastructure. You will port CUDA kernels to CuTe DSL, develop the Rust serving runtime, optimize performance across…
Solutions Architect US
You will enable US customers to deploy AI models on RNGD NPUs using the Furiosa SDK. You will develop proofs of concept, run benchmarks and debugging sessions, support pre-sales evaluations, train customers, present at…
Member of Technical Staff Performance Optimization
You will optimize AI workloads across GPU kernels and distributed systems. You will profile bottlenecks, improve latency and resource efficiency, implement CUDA and Triton optimizations, benchmark performance, and…
Senior Software Engineer Inference Engine Platform Software
You will design and implement a production inference engine for large and multimodal language models. You will optimize throughput, latency, memory use, scheduling, caching, distributed inference, and NPU execution…
Member of Technical Staff, Inference & Serving
You will build low-latency model serving systems and distributed inference infrastructure. You will manage traffic, autoscaling, versioning, deployments, and observability, while converting model advances into…
[집중채용] LLM Engineer (Optimization)
About the Team & Mission LLM Engineer (Optimization)는 대규모 언어 모델(LLM)의 추론 성능(Inference Performance)을 극대화하여 실제 서비스 환경에 최적화된 AI 시스템을 개발합니다. 서버(GPU Cluster)부터 Edge 및 On-device 환경까지 다양한 하드웨어에서 최고의 성능과 효율을 달성할 수 있도록…
Research Member of Technical Staff- Training Systems
At Rhoda AI, we’re building the next generation of generalist intelligent robots. We own the full robotics stack from high-performance hardware and robot systems to the infrastructure and state-of-the-art foundation…
Staff Machine Learning Engineer
Our Mission Expand human ambition in the physical world. Critical infrastructure is constrained by labor shortages, hazardous working conditions, and operational complexity. Watney builds and deploys autonomous robotic…
AI Infrastructure Engineer
Fin, now part of Salesforce, is on a mission to help businesses provide perfect customer experiences. Our AI Agent Fin is the highest-performing AI Customer Agent on the market today, enabling businesses to deliver…
Technical Product Manager, Observability – remote in the US
Job Summary Mirantis is looking for a Technical Product Manager to own observability for k0rdent AI, our control plane for GPU infrastructure and distributed AI workloads. In this role, you will define the…
Software Engineer, AI Infrastructure - LVM Inference & Evaluation
Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar, the first reasoning Vision-Language Model purpose-built for…