McFadyen Digital is seeking an experienced ETL Integration Engineer to design, build, and optimize data pipelines that support our eCommerce marketplace solutions. This role will be responsible for integrating multi-source data from ERP, CRM, PIM, and eCommerce platforms into cloud-based data warehouses and analytics tools. The ideal candidate will have expertise in ETL/ELT processes, data modeling, and cloud platforms such as AWS, Azure, Google Cloud, and Snowflake.
The ETL Integration Engineer will collaborate closely with data architects, engineers, and analysts to ensure data integrity, security, and efficiency in large-scale commerce-driven data environments.
Responsibilities
Top 5 Responsibilities:
- Data Pipeline Development & Maintenance
- System & API Integration:
- Data Synchronization & Orchestration
- Data Consistency & Integrity Assurance
- Performance Monitoring & Optimization
Additional Responsibilities:
Design, develop, test, and optimize ETL/ELT workflows for data ingestion, transformation, and delivery.
Implement real-time and batch processing pipelines for efficient data movement.
Integrate APIs and external vendor systems with TSN data services.
Support data exchange between ERP platforms (SAP, Oracle) and third-party applications.
Implement bi-directional data sync processes to ensure accurate data flow between interconnected systems.
Develop workflow automation for streamlined data orchestration.
Enforce data validation, error handling, and logging mechanisms.
Ensure compliance with data governance and quality standards.
Continuously monitor ETL pipelines to identify and resolve performance bottlenecks.
Improve system scalability and efficiency for high-volume data transactions.
Hands-on experience in ETL/ELT development, data integration, and pipeline monitoring.
Proficiency in working with APIs, databases, and data transformation tools.
Strong knowledge of ERP systems (SAP, Oracle) and vendor platforms (e.g., AeroXchange).
Expertise in handling large-scale data sets while ensuring integrity and consistency.
Ability to troubleshoot and optimize integration workflows for performance and reliability.
Qualifications
- 6+ years of hands-on experience with ETL/ELT tools such as dbt, Apache Airflow, Informatica, Talend, or Fivetran in a cloud or hybrid environment.
- Expertise in SQL and database technologies (SQL, NoSQL, Graph databases) with experience in data modeling, schema design, and query optimization.
- Strong cloud experience with platforms like AWS Redshift, Snowflake, Google BigQuery, and Azure Synapse for large-scale data integration.
- Understanding of data security measures, including role-based access control (RBAC), row-level security (RLS), column-level security (CLS), and dynamic data masking (DDM).
- Experience integrating enterprise applications, including ERP, CRM, OMS, and PIM systems, into a centralized data ecosystem.