Data Engineer

Role Overview

We are seeking an experienced and highly technical Data Engineer to design, develop, and implement our corporate Business Intelligence (BI) platform. This role will lead the extraction, transformation, and ingestion of critical enterprise data from our two main core systems: SAP ERP ECC6 (running on SAP HANA 2) and Epicor Kinetic (running on MS SQL Server 2019). The ideal candidate will be the foundational architect of our data warehouse pipeline.

Key Responsibilities

As our Data Engineer, you will be responsible for building robust, scalable ETL/ELT pipelines that consolidate transactional data from highly complex ERP schemas into an optimized analytics repository. You will work closely with Business Analysts, Technical Operations, and Project Sponsors to translate enterprise business processes into high-performance data models.

Pipeline Development

Design, build, and optimize highly reliable ETL/ELT pipelines to ingest data from SAP ECC6 (HANA 2) and Epicor (SQL Server 2019).

Data Architecture

Design and maintain the corporate Data Warehouse/Data Lake schemas (Star, Snowflake, or OBT) optimized for BI reporting tools.

Performance Optimization

Troubleshoot and tune complex database queries, pipeline execution bottlenecks, and storage configurations across both source systems and target analytical databases.

Data Governance

Implement pipeline monitoring, data reconciliation frameworks, and audit logs to guarantee data integrity, completeness, and freshness.

Collaboration

Partner with SAP functional consultants, Epicor administrators, and downstream BI report developers to ensure end-to-end alignment.

Technical Competency

1.SAP Integration & Extraction

Experience extracting data from SAP ECC6 using standard methods (ABAP Core Data Services (CDS) views, SAP SLT, OData Services, or RFC-based SDKs).

• Direct querying, view creation, and performance tuning inside SAP HANA 2 databases. Understanding of HANA schemas and calculation views.
• 2.SQL Server & Epicor Integration

High proficiency in MS SQL Server 2019 database administration and query design. Deep capability in writing and optimizing complex T-SQL (stored procedures, CTEs, dynamic SQL, indexing).

• Understanding of the Epicor database schema structure or Epicor BAQs (Business Activity Queries) is highly preferred.
• 3.ETL/ELT Technologies

Strong command of standard ETL tools (SSIS (SQL Server Integration Services), Azure Data Factory, Talend, Apache Airflow, or modern ELT tools like dbt).

• Experience setting up incremental/delta-loading patterns (Change Data Capture - CDC) to minimize performance impacts on the production ERPs.
• 4.Data Modeling & Warehouse Design
• Expertise in dimensional modeling (Kimball methodology), building robust Fact and Dimension tables.

Ability to map complex business domains (Finance, Sales, Supply Chain, Inventory) across mismatched ERP models (SAP & Epicor) into a unified warehouse schema.

5.Scripting & Automation

Strong scripting skills using Python or PowerShell to orchestrate pipelines, handle system telemetry, run custom API extractions, or trigger administrative tasks.

Qualifications

Education

Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or related fields.

Experience

Minimum 4+ years of dedicated experience in Data Engineering or BI Pipeline development, with at least 2 years dealing directly with enterprise ERP backends.

Analytical Skills

Excellent analytical and troubleshooting skills, particularly with complex transactional data schemas.

Communication

Strong communication skills to act as a bridge between PMO, external vendors, and technical infrastructure teams.

Mindset

Self-driven, with a strict commitment to data precision and pipeline reliability.