Tech jobs
Job listings
Software Engineer, AI Infrastructure - LVM Inference & Evaluation
Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar, the first reasoning Vision-Language Model purpose-built for…
2027 Internship Onboard Infrastructure Engineer, ML Inference
Join the team bringing autonomy to the built world At Bedrock, we're moving AI out of the lab and onto real job sites. Our team includes veterans who helped launch Waymo, scaled Segment to a $3.2B acquisition, and grew…
PHY Algorithms Senior Engineer - AI/ML
Parallel Wireless is reimagining mobile networks with innovative, energy-efficient Open RAN solutions. Join us as we lead the future of telecommunications, driving innovation through green and sustainable networks .…
Token Foundry-云端推理服务技术专家-北京/杭州
1. 设计并构建面向多模态交互（语音、视觉、语言、上下文融合）的云端推理服务平台，支持Omni/Speech/VL等大模型的在线/近线推理。 2. 主导端云协同架构中云端服务模块的技术方案，包括模型服务化（Model Serving）、动态批处理（Dynamic Batching）、请求调度、弹性扩缩容、负载均衡等关键能力。 3. 优化云端推理链路的延迟、吞吐与资源利用率，针对ToB客户对SLA（如99.9%…
Software Engineer - Training/Inference (C++)
You will design and optimize large-scale model-serving systems from distributed infrastructure through low-level GPU optimizations. You will improve inference latency, throughput, reliability, deployment, and testing…
阿里云智能-技术服务工程师-全栈TAM - 北京
客户贴身技术服务 技术问题处置：持续关注并分析客户用云技术问题，通过对客户业务的深入理解协助客户完成技术案例的快速高效处置。 需求追踪：在各行业结合客户业务场景和云产品使用情况，对客户使用情况和需求进行正确分析，挖掘真实产品需求并协助产品持续优化。 稳定性支持与保障 应急保障：重大故障问题的应急处置，协助业务快速恢复，故障逃逸等保障工作 风险巡检：针对客户使用云产品，进行使用负载，业务容量，风险事件，变更通知等巡检…
阿里云智能-模型性能优化专家-PAI
你将加入PAI平台团队，负责面向各类AI应用场景的模型训练与推理性能优化工作。该岗位聚焦于AI计算性能与系统效率的极致提升，以多层次优化手段，持续提升模型训练与推理的速度、稳定性与资源利用率，具体工作内容包含但不限于： ● 分析客户模型在不同硬件（GPU、NPU、CPU 等）和集群环境中的性能瓶颈，制定优化方案； ● 对主流深度学习框架（如 PyTorch、TensorFlow、JAX 等）进行算子、内核或图优化； ●…
Member of Technical Staff, Inference
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection…
基础设施与稳定性工程-大模型推理优化工程师-高性能网络通信
负责设计、实现、维护 AI 和高性能计算所需要的高性能网络通信框架和大模型推理场景的性能优化，聚焦模型通信场景的能力建设，完善集合通信、点对点通信等通信方式与推理框架的联合方案设计，追求极致的推理性能。 1. 精通 cpp 语言编程，熟悉 python 编程，具备优秀的系统开发、调试、优化能力和经验； 2. 具备扎实的计算机理论基础，对数据结构及算法有较强的功底，有高性能通信框架相关经验优先； 3. 有通信库如…
Embedded Autonomy Engineer
About Mach Industries Founded in 2023, Mach Industries is a rapidly growing defense technology company focused on developing next-generation autonomous defense platforms. At the core of our mission is the commitment to…
Machine Learning Engineer
About Mach Industries Founded in 2023, Mach Industries is a rapidly growing defense technology company focused on developing next-generation autonomous defense platforms. At the core of our mission is the commitment to…
高德-算法工程化/推理优化/计算图工程师/专家-具身系统软件方向
1、负责感知、运控、Agent 等算法模块在机器人端侧的工程化接入、部署和集成； 2、负责端侧模型部署链路建设，包括模型格式转换、模型裁剪、模型量化、模型编译、推理加速等； 3、负责端侧推理运行时优化，提升模型在 CPU/GPU/NPU 等异构计算平台上的运行性能； 4、负责算法 pipeline 设计与编排，包括多传感器数据流、算法模块调度、并发执行、依赖管理和性能优化；…
AI推理平台-大模型服务性能与可观测性技术专家-杭州/北京
面向大模型在线服务系统，负责线上实时性能观测、端到端分析与优化，推动问题从业务指标定位到推理引擎和 GPU Kernel。 岗位职责如下： 1.建设面向生产环境的实时可观测与诊断能力，持续采集并关联 Metrics、Logs、Trace，在异常发生时按需触发 Profile；结合 OpenTelemetry、Nsight Systems/Compute、CUPTI 等工具，在线发现并定位计算、显存带宽、通信、调度、KV Cache…
Research Engineer - Model Evaluation & MLOps
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with…
Machine Learning Engineer
Machine Learning Engineer Location: McLean, VA (hybrid); occasional travel to Durham, NC and customer sites About CoVar CoVar is a small AI/ML R&D software company with offices in Durham, NC and McLean, VA, that uses…
阿里云智能-PolarDB for AI研发工程师-杭州
1）构建数据库内AI推理系统架构，高效整合CPU，GPU等资源，设计数据迁移管理机制，优化模型（包括大模型和小模型）的核心性能指标；对PostgreSQL/MySQL等任一数据库有深入理； 2）研发具备负载自适应能力的推理框架，开发高精度指标采集模块，实现基于实时负载特征的动态参数调优功能； 3）研究在精度可接受范围内，多种近似推理及轻量化技术，包括采用模型压缩（如量化、剪枝）或近似算法（如近似最近邻搜索）降低计算开销；…
Technical Program Manager, Model Performance
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible…
Software Engineer - Applied AI
Company Background: Specter is creating a software-defined "control plane" for the physical world. We are starting with providing ubiquitous perception over physical assets. To do so, we are creating a connected…
阿里国际站-大模型推理工程师/专家-杭州
1. 负责大模型训练和推理系统的研发和性能优化，包括性能计算性能优化，大模型推理框架，大模型流量调度，高效 CUDA 算子开发，低精度计算，高并发服务请求优化等打造领先的推理引擎。 2. 负责大模型训练和推理等前瞻性技术架构的调研和引入，不限于子图匹配、编译优化、模型量化等。 3. 与算法团队深度合作，进行算法和系统的联合优化，包括分析业务性能瓶颈，通过软硬结合的 方式，高效部署和优化 AIGC 核心业务模型，建设 AI…