Skill diminta
ApachePythonSQLScalaSpark
Gaji pasar untuk posisi ini
Median Rp8,7 jt/bulan · rentang umum Rp7,5 jt – Rp9,7 jt
Berdasarkan 86 lowongan Data Engineering se-Indonesia (semua level).
Lihat data gaji selengkapnya →Deskripsi
Job Description
- Develop and maintain
- ETL/ELT processes
- and data integration workflows.
- Develop and optimize
- SQL queries
- for data processing.
- Build and maintain ETL processes using
SSIS
- and
- Informatica
- Work with
- IBM InfoSphere
- tools, including DataStage, IA, BPM, RAD/Workbench, PME, and DB2.
- Develop big data processing solutions using
- Apache Spark
- , including PySpark, Spark R, or Scala.
- Develop data processing scripts using
- Python and/or R
- Support
- data modeling, data architecture, and data warehousing
- activities.
- Automate data flows and data integration across different platforms.
- Monitor, troubleshoot, and optimize data processing and integration processes.
- Ensure data quality, consistency, and integrity.
- Work closely with technical teams and business stakeholders to support data requirements.
Requirements
- Minimum
- 1 year of experience
- in Data Engineering, ETL, Data Integration, or a related field. Equivalent skills or experience may be considered.
- Good knowledge of
SQL
- and data processing.
- Experience with
SSIS
- Experience with
- IBM InfoSphere Family
- (DataStage, IA, BPM, RAD/Workbench, PME, DB2).
- Experience with
- Informatica Data Engineering Integration
- Experience with
- Apache Spark
- using PySpark, Spark R, or Scala.
- Experience with
- Python and/or R
- Understanding of
- ETL, data modeling, data architecture, and data warehousing
- Knowledge of
- data integration, data flow automation, and data processing
- Knowledge of various
- database technologies
- Good analytical and problem-solving skills.