Skill diminta
AWSAirflowApacheAzureBigQueryCI/CDCommunicationEnglishGCPMentoringPythonSQLSnowflakeSparkTroubleshooting
Deskripsi
Job description for [Remote 2nd]_Senior Data Engineer at Công ty TNHH Diksha Technologies
Job Description
We are looking for a strong and experienced Senior Data Engineer to join a project for our Singapore-based client. The ideal candidate should have solid hands-on experience in designing, developing, and maintaining scalable data platforms and data pipelines.
The candidate will work closely with Singapore-based stakeholders and technical teams, so fluent English communication skills are required.
Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines and ETL/ELT processes.
- Develop and optimize complex SQL queries and data transformation processes.
- Build and maintain data warehouse and data lake solutions.
- Perform data modeling, data integration, and data quality management.
- Monitor and troubleshoot data pipelines, jobs, and production issues.
- Analyze performance issues and provide effective technical solutions.
- Work closely with Business Analysts, Data Scientists, Software Engineers, and business stakeholders to understand data requirements.
- Participate in system design, technical discussions, code reviews, and architecture decisions.
- Ensure data solutions meet requirements for performance, scalability, reliability, and security.
- Provide technical guidance and mentoring to junior engineers when required.
- Communicate directly with Singapore-based clients and stakeholders in English.
Requirements
- 7+ years of experience in Data Engineering or a related field.
- Strong hands-on experience with SQL and relational databases.
- Strong experience in Python or another programming language commonly used for data engineering.
- Solid experience with ETL/ELT, data pipelines, data integration, and data transformation.
- Good understanding of Data Warehouse, Data Lake, and Data Modeling concepts.
- Hands-on experience with at least one major cloud platform: AWS, Azure, or GCP.
Experience with modern data technologies such as Apache Spark, Databricks, Airflow, Kafka, Snowflake, Redshift, BigQuery, or similar technologies is a strong advantage.
- Strong troubleshooting and problem-solving skills.
- Ability to work independently and take ownership of assigned tasks.
- Experience working with international clients or distributed teams is preferred.
- Fluent English communication skills, both written and verbal.
- Preferred Skills
- Experience with cloud-based data platforms.
- Experience in building large-scale data processing pipelines.
- Experience with CI/CD and DevOps practices.
- Knowledge of data governance, data security, and data quality.
- Experience in Agile/Scrum environments.