Skill diminta
AWSApacheCI/CDCommunicationEnglishGitLeadershipMentoringPythonSQLSparkTroubleshooting
Deskripsi
Responsibilities
Design, develop, and optimize scalable data pipelines, transformation logic, and curated datasets to support reporting, KPI automation, and business analytics.
- Build and maintain ETL/ELT pipelines using SQL, Python/PySpark, and cloud data technologies.
- Develop, optimize, and maintain data workflows to ensure performance, scalability, and reliability.
- Support data modeling, reconciliation, validation, and performance tuning.
- Ensure data quality, governance, security, and maintainability across data platforms.
- Collaborate with BI, QA, Product, and Business teams throughout development, testing, and production deployment.
- Participate in code reviews, troubleshooting, and continuous improvement of data engineering processes.
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
- 3+ years of experience
- in Data Engineering or a related role.
- Strong proficiency in
SQL
- and
- Python
- Experience with
- PySpark
- Apache Spark
- , or similar distributed data processing frameworks.
- Hands-on experience with
AWS
- and cloud-based data platforms.
- Experience with
- Databricks
- is highly preferred.
- Strong understanding of
- ETL/ELT pipelines
- , data integration, and workflow orchestration.
- Knowledge of
- data warehouse concepts
- , dimensional modeling, and modern data architecture.
- Experience processing and optimizing large-scale datasets.
- Familiarity with
CI/CD
- , Git, and deployment best practices.
- Knowledge of data quality, governance, security, and performance optimization.
- Strong analytical, problem-solving, and communication skills.
- Able to work collaboratively in Agile environments.
- Professional proficiency in
- English
- is required;
- Bahasa Indonesia
- is preferred.
- Preferred Qualifications (For Senior Candidates – 7+ Years)
- Experience designing enterprise-scale data architecture and end-to-end data platforms.
- Strong expertise in performance tuning, optimization, and cloud-native data engineering solutions.
- Experience mentoring junior engineers and providing technical leadership.
- Proven track record of leading complex migration, integration, or data modernization projects.