Skill diminta
AWSCI/CDCommunicationDockerGitGrafanaKubernetesPostgreSQLPrometheusPythonSQLTroubleshooting
Deskripsi
- Develop, maintain, and support data pipelines to move data from source systems to Oracle On-Premises ODS.
- Monitor and maintain CDC (Change Data Capture) connectors using Debezium.
- Troubleshoot and optimize Python-based consumer applications and data processing workflows.
- Investigate and resolve data pipeline failures, performance issues, and production incidents.
- Deploy, monitor, and troubleshoot applications running on Kubernetes.
- Support data loading, transformation, and integration processes.
- Maintain technical documentation and operational runbooks.
- Collaborate with cross-functional teams to ensure reliable and efficient data operations.
- Participate in on-call support for critical production issues when required.
- Bachelor's degree in
- Computer Science, Information Technology, Engineering,
- or a related field.
- Minimum 5 years
- of experience as a
- Data Engineer, Backend Engineer
- , or a similar role.
- Hands-on experience with
- Python, SQL,
- and
- Kubernetes
- in a production environment.
- Experience building, maintaining, and troubleshooting
ETL/ELT
- processes or data pipelines.
- Strong knowledge of relational databases such as
- Oracle, PostgreSQL, or SQL
- Server.
- Familiar with
- Docker, Git, CI/CD tools
- , and monitoring tools (e.g., Grafana, Prometheus, ELK).
- Experience with
- Debezium (CDC), Solace/Kafka, or AWS
- is a plus.
- Strong troubleshooting, problem-solving, and communication skills.
- Able to work independently, collaborate with cross-functional teams, and participate in on-call support when required.