Skill diminta
AirflowBigQueryGCPPythonSQL
Deskripsi
Deskripsi pekerjaan Middle Data Engineer Celerates
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes
- Manage and optimize data workflows using GCP services
- Build and maintain data warehouses and data lakes
- Collaborate with Data Analysts, Data Scientists, and Business Teams to support data needs
- Ensure data quality, integrity, and security across systems
- Monitor and troubleshoot data pipeline performance issues
- Create technical documentation related to data architecture and processes
Requirements
- 3–5 years of experience as a Data Engineer.
- Hands-on experience with Python, Google Cloud Platform (GCP), BigQuery, and Big Data technologies.
- Proven experience building and maintaining scalable ETL/ELT pipelines and processing large datasets.
- Strong SQL skills with a good understanding of data modeling and data warehousing.
- Experience with Airflow/Cloud Composer and cloud-native data architectures is a plus.
- Available to join immediately or within a short notice period.