Data Engineer
Posted Updated
Description
You will design, build, and operate scalable data pipelines and models for infrastructure, platform, and business data. You will create trusted datasets, enable self-service analytics, implement governance and quality controls, and deliver data products for operational and customer-facing use cases.
Responsibilities
- Design and build scalable data pipelines
- Define data models and schemas
- Clean, transform, and structure data
- Manage Foundry permissions, access, and security
- Create trusted datasets and metrics
- Enable self-service analytics through data contracts and semantic layers
- Build capacity-planning, cost-optimisation, reliability, and customer-reporting use cases
- Implement data quality checks, monitoring, and alerting
- Codify data lineage, freshness, and consistency
- Establish data versioning, access-control, and governance practices
- Own projects from design through production and iteration
Requirements
- Hands-on Palantir Foundry experience
- Ontology modelling
- Pipeline development
- API integration
- Large-scale data platform design
- Python
- Spark
- PySpark
- Dask
- pandas
- REST
- GraphQL
- Foundry Action APIs
- Git-based development workflows
- Code review
- Version control
- CI/CD pipelines
- Communication skills
Benefits
- Equity
- Flexible workplace
- Medical insurance
- Dental insurance
- Vision insurance
- Flexible paid time off
- Parental leave
- Retirement plan participation
