Skill diminta
AirflowCommunicationDeliveryEnglishSQLSpark
Deskripsi
Role Summary
We are looking for multiple ETL Development Engineers to execute the design, coding, and implementation of ETL data flows on the Tencent Cloud WeData platform. The role focuses on developing high-throughput data pipelines, incremental scheduling, and data consistency verification during large-scale ETL migration projects.
Key Responsibilities
Develop and implement full lifecycle ETL data flows (design, coding, extraction, cleaning, transformation, and loading) on Tencent Cloud WeData
- Perform data pipeline performance tuning, incremental scheduling, and scheduling optimization
- Support data consistency verification and quality testing of migration results
- Work with data architects and engineers to refactor and optimize existing ETL logic
- Person Specifications
- Required Qualifications
- Bachelor's degree or above in Computer Science or related fields
- Minimum 3+ years of hands-on experience in Spark batch ETL development
- Strong experience with Spark Core/SQL, scheduling platforms (Airflow preferred), scheduling standards, and incremental delivery
- Proficiency in coding standards and independent delivery capability
- Strong English reading, writing, and communication skills
- Ability to read and interpret technical documents seamlessly
- Preferred Qualifications
- Experience with Tencent Cloud WeData or Lakehouse platforms.
- Background in telecom, data warehouse (DW), or large-scale ETL migration projects
- Experience with cross-border data compliance or LLM data engineering is a plus
- Joining: Immediate joiners are highly preferable
- Vendor submissions -
- 06 months