82 Data Pipeline jobs in Malaysia

Overview

The System Integration Manager is to lead and manage the delivery of integrated data solutions that enhance reporting speed, data reliability, and business value. This includes overseeing the integration architecture, managing a high-performing team, and collaborating with stakeholders to deliver scalable and efficient data systems.

• Lead and mentor a team of integration specialists and data engineers.
• Foster a culture of continuous improvement and professional development.
• Drive team retention through targeted development initiatives.

• Oversee the design and implementation of integration solutions using orchestration tools such as Apache Airflow or Azure Data Factory.
• Ensure integration architecture aligns with enterprise standards and supports scalability.
• Implement modern AI/ML tools for predictive analytics and anomaly detection.

• Collaborate with Business Analysts to define data requirements.
• Partner with Architecture & Engineering Manager to align integration standards.
• Engage with business units to ensure integration solutions meet operational needs.

• Quality of releases and alignment to customer requirements.
• Accurate estimates for project delivery of outcomes.
• Timely team capacity management, and longer-term capacity forecasting.
• Development and career planning for the team.

• Experience with orchestration tools (e.g. Azure Data Factory).
• Strong understanding of data integration and ETL processes.
• Proficiency in cloud platforms (e.g., AWS, Azure).
• Excellent stakeholder engagement and communication skills.
• Experience with AI/ML platforms (e.g., Azure ML).
• Experience with AI assistance tools (e.g. copilot).
• Relevant certifications (e.g., AWS Certified Data Analytics, Azure Data Engineer Associate).
• Degree in Computer Science, Data Engineering, or related field.
• Curious
• Great sense of humour

• Director

• Full-time

• Information Technology and Engineering

• Administrative and Support Services and Food and Beverage Retail

Summary

The Data Integration Specialist is responsible for designing, implementing, and maintaining efficient and scalable data integration solutions. This role involves connecting diverse data sources, transforming data into meaningful insights, and ensuring its accuracy, quality, and availability for organizational needs. The ideal candidate will possess strong analytical skills, expertise in data integration tools, and a deep understanding of data architecture and ETL processes.

What We Offer?

• Attractive Salary
• Great Bonus
• Free Parking
• Accommodations
• Career Growth

What You Will Be Accountable For

• Specialise in data management of member enrolment, policy renewal and termination for various portfolios in insurance and healthcare industry.
• Work closely with the data & report owner to understand and support their data, template and report needs.
• Develop and manage ETL processes using SSIS and DTS to integrate, transform and mapping data.
• Develop custom reports using SSRS to support business needs and provide insights.
• Develop system/application (Script, window services or window program) for file transfer & automation tasks.
• Develop modern API for data transfer
• Develop web applications and portals
• Write complex SQL queries to extract, manipulate, and analyze data.
• Ensure data accuracy and integrity during the processing and integration stages.
• Perform routine data validation and cleansing tasks to maintain data quality.
• Collaborate with application development teams, implement measures to ensure data accuracy and consistency across all systems.
• Adhere to data protection regulations and company policies to ensure data security.
• Document data processing procedures and maintain comprehensive records.
• Ensure data processed & updated within the agreed TAT.
• Ensure all scheduled tasks/jobs are running smooth.
• Any other task assigned by immediate superior.

Essential Experience, Skills And Knowledge

• Candidate must possess at least a Diploma, Advanced, Higher or Graduate Diploma, Bachelor's Degree, Post Graduate Diploma, Professional Degree, Computer Science or Information Technology or equivalent.
• At least 2 years of working experiences in the related field is required.
• Strong knowledge of SQL Server database management and query optimization.
• Proficiency in creating and managing reports using SSRS.
• Experience with ETL tools (SSIS, DTS) for data integration and transformation.
• Familiarity with sFTP for secure data transfers.
• Excellent problem-solving abilities and attention to detail.
• Ability to analyze complex data sets and ensure data accuracy.
• Ability to work collaboratively with cross-functional teams.
• Fresh graduates are encouraged to apply.
• Candidates who have programming knowledge (C#.NET) and automation tool will have an added advantage.
• Applicants must be willing to work in Bukit Jelutong, Shah Alam.

Job Description: Product Manager – Data Integration

About the Role

We are seeking a seasoned Product Manager with a minimum of 8 years of experience to lead the data integration efforts for a next-generation Fleet Management Application for a global Oil & Gas major. The application supports B2B and B2C fleet customers, focusing on card management, transaction visibility, and operational optimization.

This role demands strong product ownership, agile delivery leadership, and strategic stakeholder engagement to ensure seamless integration of data across systems and platforms.

Key Responsibilities

Product Ownership & Backlog Management

Own and manage the product backlog for data integration features.

Convert business needs into actionable user stories with clear acceptance criteria.

Prioritize features based on business impact, technical feasibility, and stakeholder feedback.

Align backlog with overall product roadmap and release plans.

Agile Delivery & Team Coordination:

Lead sprint ceremonies: planning, daily stand-ups, reviews, and retrospectives.

Collaborate with development and QA teams to ensure timely and high-quality delivery.

Identify and resolve delivery bottlenecks and dependencies.

Data Integration & Technical Oversight:

Define and manage integration of data from internal systems (ERP, CRM, fuel card platforms) and external partners.

Ensure data consistency, accuracy, and security across the application.

Work with data engineers and architects to design scalable data pipelines and APIs.

Stakeholder Management & Reporting

Serve as the primary liaison for internal and external stakeholders on data integration.

Deliver regular progress reports, dashboards, and presentations to senior leadership.

Gather feedback and iterate on integration features to enhance user experience.

Compliance & Quality Assurance

Ensure data integration processes comply with internal policies and external regulations (e.g., GDPR, PCI-DSS).

Collaborate with QA to define test cases and validate integration workflows.

Required Skills & Experience

Minimum 8 years of experience in product management, with at least 3 years in data integration or backend-heavy applications.

Strong understanding of APIs, ETL, cloud platforms, and enterprise data architecture.

Proven experience in Agile/Scrum environments.

Excellent communication, leadership, and stakeholder management skills.

Experience in fleet management, card systems, or Oil & Gas domain is a strong advantage.

Preferred Qualifications

Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Certifications: CSPO, PMP, or equivalent in Product Management or Agile

Familiarity with tools like JIRA, Confluence, Tableau/Power BI, and integration platforms (e.g., MuleSoft, Azure Data Factory).

Senior Executive, Data Integration - ETL Development

Role Purpose:

• Implement ETL systems that are operationally stable, efficient and automated. This include technical solutions that are scalable, aligned with the enterprise architecture and can adapt to changes in business.
• Monitor and optimize batch jobs, including automation and scheduling. Consistently review and enhance performance with key focus on ease of maintenance & jobs reusability.
• Work closely with internal/external teams devise requirements of data integrations, specific to Data Warehouse/Data Marts implementations.

Key Accountabilities and Responsibilities

• Review business and technical requirements and ensure the data integration platform meets requirements.
• Apply industry best practices for ETL design and development.
• Produce written deliverables for technical design, system testing and implementation activities.
• Conduct System Testing - execute job flows, investigate system defects, resolve defects and document results.
• Work with DBAs, application specialists and technical services to tune performance of the system to meet performance standards and SLAs.
• Work with DBAs, application specialists and technical services to tune performance of the ETL system to meet performance standards and SLAs.
• Assist in the development, documentation and application of best practices and procedures

Skills & Competencies

• Strong knowledge in SQL writing skills.
• Familiarity with ETL tools like DataStage, Informatica, Oracle Data Integrator

Data Integration

• Understanding of data integration best practices, leading industry applications and features such as master data management, entity resolution, data quality assessment, metadata management, etc.
• Exposure in data warehouse architecture, data analysis/data profiling of source systems
• Able to function well in a fast-paced and adaptive environment.
• Financial domain experience is a plus
• Ability to work independently and communicate across multiple levels (Product owners, Executive sponsors, Team members)
• Work experience in Agile methodology is a plus
• A very good team player & good communication skills.
• Good interpersonal skills and the ability to collaborate with other technical teams, project management, client management and business analysts.

Requirements

• Minimum Bachelor's Degree in computer science/Information Technology or equivalent
• Candidates should have more than 5+ years total work experience, 2+ years' experience programming ETL programs using Informatica, Data Stage or Oracle Data Integrator (ODI)
• 2+ years' experience performing data analysis and profiling, and designing ETL systems/programs.

Job Type: Full-time

Pay: RM12, RM17,000.00 per month

Education:

• Bachelor's (Preferred)

Experience:

• Oracle Data Integrator: 2 years (Required)
• Data Integration: 2 years (Required)
• ETL Development: 2 years (Required)
• DataStage, Informatica, Oracle Data Integrator: 2 years (Required)
• SQL writing skills.: 2 years (Preferred)
• Informatica, Data Stage or Oracle Data Integrator (ODI): 3 years (Required)

Work Location: In person

Role Purpose:

• Implement ETL systems that are operationally stable, efficient and automated. This include technical solutions that are scalable, aligned with the enterprise architecture and can adapt to changes in business.
• Monitor and optimize batch jobs, including automation and scheduling. Consistently review and enhance performance with key focus on ease of maintenance & jobs reusability.
• Work closely with internal/external teams devise requirements of data integrations, specific to Data Warehouse/Data Marts implementations.

Key Accountabilities and Responsibilities

• Review business and technical requirements and ensure the data integration platform meets requirements.
• Apply industry best practices for ETL design and development.
• Produce written deliverables for technical design, system testing and implementation activities.
• Conduct System Testing - execute job flows, investigate system defects, resolve defects and document results.
• Work with DBAs, application specialists and technical services to tune performance of the system to meet performance standards and SLAs.
• Work with DBAs, application specialists and technical services to tune performance of the ETL system to meet performance standards and SLAs.
• Assist in the development, documentation and application of best practices and procedures

Skills & Competencies

• Strong knowledge in SQL writing skills.
• Familiarity with ETL tools like DataStage, Informatica, Oracle Data Integrator

Data Integration

• Understanding of data integration best practices, leading industry applications and features such as master data management, entity resolution, data quality assessment, metadata management, etc.
• Exposure in data warehouse architecture, data analysis/data profiling of source systems
• Able to function well in a fast-paced and adaptive environment.
• Financial domain experience is a plus
• Ability to work independently and communicate across multiple levels (Product owners, Executive sponsors, Team members)
• Work experience in Agile methodology is a plus
• A very good team player & good communication skills.
• Good interpersonal skills and the ability to collaborate with other technical teams, project management, client management and business analysts.

Requirements

• Minimum Bachelor's Degree in computer science/Information Technology or equivalent
• Candidates should have more than 5+ years total work experience, 2+ years' experience programming ETL programs using Informatica, Data Stage or Oracle Data Integrator (ODI)
• 2+ years' experience performing data analysis and profiling, and designing ETL systems/programs.

Senior Software Engineer (Data Integration)

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

We are currently seeking a data integration expert for a Backend Developer backfill role in Kuala Lumpur. Your Azure expertise will be put to good use and you will focus on building our Python ETL processes and writing excellent SQL. If your passion is in making use of data and working with equally brilliant and driven teammates, this is the ideal role for you to grow your career.

• Develop and maintain data integration solutions
• Collaborate with the team to design and implement ETL processes
• Create and maintain database structures and schema
• Develop and implement data quality controls
• Assist with troubleshooting and issue resolution

• At least 5 years of experience working in Data Integration with 3 years of Azure Data Factory experience
• DWH & DB Concepts knowledge
• Microsoft Power BI familiarity is a bonus

• By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

• EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
• We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients

• Mid-Senior level

• Full-time

• Business Development, Information Technology, and Engineering

• Software Development and IT Services and IT Consulting

Referrals increase your chances of interviewing at EPAM Systems.

Maybank WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Get AI-powered advice on this job and more exclusive features.

• Implement ETL systems that are operationally stable, efficient, and automated. This includes technical solutions that are scalable, aligned with the enterprise architecture, and adaptable to business changes.
• Collaborate with internal and external teams to define requirements for data integrations, specifically for Data Warehouse/Data Marts implementations.

Responsibilities of the Role

• Review business and technical requirements to ensure the data integration platform meets specifications.
• Apply industry best practices for ETL design and development.
• Produce technical design documents, system testing plans, and implementation documentation.
• Conduct system testing: execute job flows, investigate and resolve system defects, and document results.
• Work with DBAs, application specialists, and technical support teams to optimize ETL system performance and meet SLAs.
• Assist in developing, documenting, and applying best practices and procedures.
• Strong SQL writing skills are required.
• Familiarity with ETL tools such as pySpark, NiFi, Informatica, and Hadoop is preferred.
• Understanding of data integration best practices, including master data management, entity resolution, data quality, and metadata management.
• Experience with data warehouse architecture, source system data analysis, and data profiling.
• Ability to work effectively in a fast-paced, adaptive environment.
• Financial domain experience is a plus.
• Ability to work independently and communicate effectively across various levels, including product owners, executive sponsors, and team members.
• Experience working in an Agile environment is advantageous.

Qualifications

• Bachelor’s Degree in Computer Science, Information Technology, or equivalent.
• Over 5 years of total work experience, with experience programming ETL processes using Informatica, NiFi, pySpark, and Hadoop.
• At least 4 years of experience in data analysis, profiling, and designing ETL systems/programs.

• Mid-Senior level

• Full-time

• Information Technology

• Banking