Skip to content

Search jobs inside your AI agent. ClaudeChatGPTCursorGrok Bot

Connect

Shield AI

Staff Engineer Test Automation

Posted Updated
Discussion

Description

You will own the strategy and architecture for automated testing, verification, and MLOps quality. You will build test and ML-validation frameworks, CI/CD workflows, observability, Python automation, simulation tools, and AI-assisted engineering workflows for distributed hardware and software systems.

Responsibilities

  • Own the technical strategy, architecture, and roadmap for automated testing, verification, and MLOps quality
  • Design and maintain scalable test frameworks
  • Lead functional, integration, regression, system, performance, reliability, and end-to-end testing
  • Build automated ML validation pipelines
  • Establish CI/CD and continuous-training workflows
  • Develop scenario-based validation for autonomy models
  • Create observability, analytics, and failure-triage capabilities
  • Build Python automation for test execution and reporting
  • Create test harnesses, simulators, stubs, mocks, and synthetic-data capabilities
  • Define verification strategies with engineering stakeholders
  • Develop and govern AI-assisted engineering workflows

Requirements

  • 8+ years of relevant experience in software engineering, test infrastructure, developer tooling, MLOps, systems integration, or systems verification
  • 5+ years building scalable automation frameworks or developer tooling in Python
  • Experience designing test, CI/CD, or MLOps infrastructure across multiple engineering teams
  • Experience validating machine-learning systems across their lifecycle
  • Understanding of ML quality risks and model-performance baselines
  • Experience testing GPU-accelerated infrastructure and workloads in Kubernetes
  • Experience validating multi-tenant Kubernetes environments
  • Experience qualifying integrated hardware and software systems
  • System-design experience testing distributed systems, backend services, APIs, and integrated systems
  • Experience developing integration and regression strategies
  • Understanding of asynchronous and concurrent Python programming
  • Experience with package and dependency management and reproducible environments
  • Experience with observability, log collection, analytics, reporting, and root-cause analysis
  • Experience working in Linux-based development environments

Benefits

  • Bonus
  • Equity

Skills

What Staff QA jobs ask for — and how much of it you have →
Apply

See also

QA jobs by country — openings, pay and top skills →