Data Engineer

• Kualifikasi umum
• Minimum S1
• Minimum 5 tahun pengalaman sebagai Data Engineer, ETL Engineer, Big Data Engineer, atau Data Platform Support.
• Berpengalaman menangani production support dan troubleshooting pada lingkungan Big Data.
• Technical Skills
• Strong understanding of ETL/ELT concepts and data pipeline architecture.
• Strong experience with Apache Spark (batch processing, Spark SQL, job troubleshooting).
• Good understanding of Tencent WeData atau platform ETL sejenis (Airflow, Informatica, Talend, Ab Initio, AWS Glue, DataWorks, dsb.).
• Advanced SQL untuk troubleshooting dan data validation.
• Familiar dengan Hadoop ecosystem (Hive, HDFS, YARN menjadi nilai tambah).
• ⁠Basic Linux command dan shell scripting.
• Memahami monitoring log, execution log, dependency, scheduler, dan job recovery.

Responsibilities

• Monitor seluruh pipeline WeData.
• ⁠Troubleshoot failed ETL/Spark jobs.
• Root Cause Analysis (RCA).
• ⁠Handle complex production incident.
• Melakukan rerun, recovery, tuning, dan workaround.
• ⁠Menjadi escalation point untuk Junior Data Engineer. •
• Berkoordinasi dengan L3 Platform Engineer/Tencent Cloud.