Senior Data Engineer

You will build and maintain batch and streaming data pipelines, operate Airflow workflows, and design warehouse data models. You will improve data quality, freshness, performance, and costs; investigate pipeline issues; and document data flows, transformations, and dependencies.

Responsibilities

• Build and maintain batch and streaming data pipelines using Python, SQL, Kafka, and Spark
• Develop and operate Airflow workflows
• Design and maintain data models and warehouse datasets
• Improve data quality and freshness through validation, monitoring, and issue investigation
• Optimise pipeline and query performance and manage processing and storage costs
• Define datasets and metrics and document data flows, transformations, and dependencies

Requirements

• Data engineering experience within crypto or Web3
• Strong Python and SQL skills
• Hands-on experience with Airflow, Kafka, and Spark
• Experience with data warehouses, ETL/ELT pipelines, and data modelling
• Ability to investigate data discrepancies and troubleshoot pipeline failures
• Ability to communicate technical details and business requirements clearly in Mandarin

Benefits

• Fully remote work within APAC