Skill diminta
AWSAirflowAnalytical ThinkingApacheHadoopPythonSQLShell ScriptSparkTeamworkdbt
Gaji pasar untuk posisi ini
Median Rp8,7 jt/bulan · rentang umum Rp7,8 jt – Rp9,2 jt
Berdasarkan 78 lowongan Data Engineering se-Indonesia (semua level).
Lihat data gaji selengkapnya →Deskripsi
Job description for Data Engineer at bTaskee Vietnam
Job Overview
The purpose of the Data Engineer role is to maintain, improve, clean and manipulate data in the business’s operational and analytics databases. The Data Engineer works with the business’s software engineers and data analytics team in order to understand and aid in the implementation of database requirements, analyse performance, and troubleshoot any existent issues.
Responsibilities and Duties
- Design and build automated ETL/ELT pipelines to ingest data from multiple sources.
- Develop and maintain robust data models for analytics and reporting.
- Develop scheduling, monitoring, and alerting mechanisms to ensure pipeline reliability and SLA compliance.
- Build and maintain a comprehensive metadata catalog with clear descriptions for every table and column across all datasets.
Design and implement a semantic layer that defines dataset purposes, field definitions, data types, business logic, and relationships between tables.
- Prepare and serve datasets for AI/ML workloads: feature stores, training datasets, and inference data feeds.
- Collaborate with the AI team to define data requirements for model training, evaluation, and monitoring.
- Build and maintain data APIs or serving layers that enable AI systems to consume data in real time or near-real time.
Ensure the semantic layer is structured for AI consumption - enabling AI systems to understand data context, scan datasets, perform analysis, and generate reports without manual intervention.
- Ensure data quality, governance, and validation frameworks.
- Optimize performance of queries, pipelines, and data storage.
- Work with the technical team on system integration and data flow architecture across platforms.
Qualifications and Skills
- Minimum 2 years of experience as a Data Engineer, particularly in AI-driven environments;