Skill diminta
AWSAirflowAzureGCPPythonSQLSpark
Deskripsi
Deskripsi pekerjaan Data Engineer PT Eternal Kreasi Indonesia
Job Description
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes
- Build and optimize data integration workflows from various data sources
- Develop and maintain data warehouses, databases, and data models
- Ensure data quality, accuracy, availability, and reliability across data pipelines
- Monitor and troubleshoot data pipeline performance and resolve data-related issues
- Optimize SQL queries and data processing performance
- Collaborate with Data Analysts, Data Scientists, Software Engineers, and business stakeholders
- Implement data engineering best practices related to security, scalability, and maintainability
- Document data pipelines, processes, and technical solutions
Requirements
- Bachelor’s degree in Computer Science, Information Technology, Engineering, Mathematics, Statistics, or a related field
- Minimum 2–5 years of experience as a Data Engineer or in a similar data-related role
- Strong proficiency in SQL and experience with relational databases
- Hands-on experience with ETL/ELT processes and data pipeline development
- Experience with Python or other programming languages commonly used in data engineering
- Familiarity with data warehouse concepts, data modeling, and database optimization
- Experience with cloud platforms such as AWS, Google Cloud Platform (GCP), or Microsoft Azure is a plus
- Experience with Big Data technologies such as Spark, Kafka, Airflow, or similar tools is a plus