Staff Engineer Data Platform
Posted Updated
Description
You will design and implement a knowledge graph and multimodal API platform. You will build DataOps infrastructure and integrations, establish data-modeling standards, evaluate storage and compute technologies, create developer tools and SDKs, and improve the platform's reliability, security, and operational quality.
Responsibilities
- Lead the architecture and implementation of a knowledge graph and multimodal API layer
- Maintain storage, indexing, query, ingestion, and compute infrastructure
- Establish schema modeling, relationship, lineage, and schema evolution practices
- Build APIs for agentic data access
- Develop storage, compute, deployment, benchmark, and operational reference architectures
- Turn downstream workflows into reusable platform capabilities
- Deliver integrations for simulation, testing, training, and edge-device data
- Create self-service APIs, SDKs, tools, examples, and diagnostics
- Evaluate data and AI infrastructure technologies and guide implementation
- Establish observability, reliability, security, data integrity, disaster recovery, and lifecycle practices
Requirements
- Distributed systems
- Data platform
- Storage systems
- Backend
- Go
- Python
- Data modeling
- API design
- Schema evolution
- Identity
- Consistency
- Indexing
- Query planning
- Relational database
- Graph database
- Object storage
- Columnar database
- File storage
- Data ingestion
- Kubernetes
- Linux
- Networking
- Security
- Observability
- Infrastructure as Code
- Platform engineering
- Apache Arrow
- Parquet
- OpenAPI
- AsyncAPI
- WebSocket
- Terraform
- Helm
- GitOps
- Ray
- Kafka
- NATS
- Redpanda
- Machine learning
- Experiment tracking
- Dataset management
- Model versioning
- Authorization
- Data governance
- Auditability
Benefits
- Bonus
- Benefits
- Equity
- Temporary benefits package after 60 days of employment
