58 Etl Engineer jobs in Malaysia

Functional Area:

Data Engineering and IT Solutions Delivery Role Category: Role Category:

Data Integration and ETL Development Role Category: Role Category:

-- Employment Type: Employment Type:

Full Time Experience: Experience:

3-5 Years Location: Location:

Malaysia Job Summary

The ETL Engineer in IT Solutions Delivery is responsible for managing and developing ETL processes, maintaining job scheduling, and optimizing data pipelines for efficient load and processing. This role involves designing, developing, and implementing end-to-end data pipelines, collaborating with various teams to understand data needs, and ensuring high data quality and integrity. Responsibilities

Design, develop, document, and implement end-to-end data pipelines and data integration processes (batch and real-time). Conduct data analysis, profiling, cleansing, lineage, mapping, and transformation. Develop and deploy ETL/ELT jobs and workflows. Monitor and optimize ETL/ELT processes for reliability, efficiency, and cleanliness. Implement best practices in data management and lifecycle processes, including modular development, coding standards, error handling, and data archival. Prepare test data, create and execute test plans, test cases, and test scripts. Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors, and internal business stakeholders to gather requirements and implement data solutions. Provide BAU support for data issues and change requests, documenting investigations, findings, recommendations, and resolutions. Required Skills

Familiarity with ETL/ELT frameworks, data warehousing concepts, data management frameworks, and data lifecycle processes. Experience handling and processing structured, semi-structured, and unstructured data. Strong knowledge of various database technologies (RDBMS, NoSQL, and columnar). Proficiency in programming languages like Python. Strong communication and presentation skills. Ability to work independently and collaborate with diverse teams in a multi-stakeholder environment. Strong sense of ownership, high affinity for data, and a desire for constant improvement. Experience in the insurance industry is an added advantage. Knowledge of IBM DataStage or relevant ETL software is preferable. Required Qualification

3 to 5 years of working experience in ETL. Preferably 2 years of work experience in the insurance industry. Strong communication, prioritization, problem-solving, and interpersonal relationship-building skills. Proven time management and organizational skills, with the ability to prioritize workload and meet deadlines. Apply Now

Name

* Email

* Phone

*

+91

United States

+1 United Kingdom

+44 Afghanistan (افغانستان)

+93 Albania (Shqipëri)

+355 Algeria (الجزائر)

+213 American Samoa

+1 Andorra

+376 Angola

+244 Anguilla

+1 Antigua and Barbuda

+1 Argentina

+54 Armenia (Հայաստան)

+374 Aruba

+297 Ascension Island

+247 Australia

+61 Austria (Österreich)

+43 Azerbaijan (Azərbaycan)

+994 Bahamas

+1 Bahrain (البحرين)

+973 Bangladesh (বাংলাদেশ)

+880 Barbados

+1 Belarus (Беларусь)

+375 Belgium (België)

+32 Belize

+501 Benin (Bénin)

+229 Bermuda

+1 Bhutan (འབྲུག)

+975 Bolivia

+591 Bosnia and Herzegovina (Босна и Херцеговина)

+387 Botswana

+267 Brazil (Brasil)

+55 British Indian Ocean Territory

+246 British Virgin Islands

+1 Brunei

+673 Bulgaria (България)

+359 Burkina Faso

+226 Burundi (Uburundi)

+257 Cambodia (កម្ពុជា)

+855 Cameroon (Cameroun)

+237 Canada

+1 Cape Verde (Kabu Verdi)

+238 Caribbean Netherlands

+599 Cayman Islands

+1 Central African Republic (République centrafricaine)

+236 Chad (Tchad)

+235 Chile

+56 China (中国)

+86 Christmas Island

+61 Cocos (Keeling) Islands

+61 Colombia

+57 Comoros (جزر القمر)

+269 Congo (DRC) (Jamhuri ya Kidemokrasia ya Kongo)

+243 Congo (Republic) (Congo-Brazzaville)

+242 Cook Islands

+682 Costa Rica

+506 Côte d’Ivoire

+225 Croatia (Hrvatska)

+385 Cuba

+53 Curaçao

+599 Cyprus (Κύπρος)

+357 Czech Republic (Česká republika)

+420 Denmark (Danmark)

+45 Djibouti

+253 Dominica

+1 Dominican Republic (República Dominicana)

+1 Ecuador

+593 Egypt (مصر)

+20 El Salvador

+503 Equatorial Guinea (Guinea Ecuatorial)

+240 Eritrea

+291 Estonia (Eesti)

+372 Eswatini

+268 Ethiopia

+251 Falkland Islands (Islas Malvinas)

+500 Faroe Islands (Føroyar)

+298 Fiji

+679 Finland (Suomi)

+358 France

+33 French Guiana (Guyane française)

+594 French Polynesia (Polynésie française)

+689 Gabon

+241 Gambia

+220 Georgia (საქართველო)

+995 Germany (Deutschland)

+49 Ghana (Gaana)

+233 Gibraltar

+350 Greece (Ελλάδα)

+30 Greenland (Kalaallit Nunaat)

+299 Grenada

+1 Guadeloupe

+590 Guam

+1 Guatemala

+502 Guernsey

+44 Guinea (Guinée)

+224 Guinea-Bissau (Guiné Bissau)

+245 Guyana

+592 Haiti

+509 Honduras

+504 Hong Kong (香港)

+852 Hungary (Magyarország)

+36 Iceland (Ísland)

+354 India (भारत)

+91 Indonesia

+62 Iran (ایران)

+98 Iraq (العراق)

+964 Ireland

+353 Isle of Man

+44 Israel (ישראל)

+972 Italy (Italia)

+39 Jamaica

+1 Japan (日本)

+81 Jersey

+44 Jordan (الأردن)

+962 Kazakhstan (Казахстан)

+7 Kenya

+254 Kiribati

+686 Kosovo

+383 Kuwait (الكويت)

+965 Kyrgyzstan (Кыргызстан)

+996 Laos (ລາວ)

+856 Latvia (Latvija)

+371 Lebanon (لبنان)

+961 Lesotho

+266 Liberia

+231 Libya (ليبيا)

+218 Liechtenstein

+423 Lithuania (Lietuva)

+370 Luxembourg

+352 Macau (澳門)

+853 Macedonia (FYROM) (Македонија)

+389 Madagascar (Madagasikara)

+261 Malawi

+265 Malaysia

+60 Maldives

+960 Mali

+223 Malta

+356 Marshall Islands

+692 Martinique

+596 Mauritania (موريتانيا)

+222 Mauritius (Moris)

+230 Mayotte

+262 Mexico (México)

+52 Micronesia

+691 Moldova (Republica Moldova)

+373 Monaco

+377 Mongolia (Монгол)

+976 Montenegro (Crna Gora)

+382 Montserrat

+1 Morocco (المغرب)

+212 Mozambique (Moçambique)

+258 Myanmar (Burma) (မြန်မာ)

+95 Namibia (Namibië)

+264 Nauru

+674 Nepal (नेपाल)

+977 Netherlands (Nederland)

+31 New Caledonia (Nouvelle-Calédonie)

+687 New Zealand

+64 Nicaragua

+505 Niger (Nijar)

+227 Nigeria

+234 Niue

+683 Norfolk Island

+672 North Korea (조선 민주주의 인민 공화국)

+850 Northern Mariana Islands

+1 Norway (Norge)

+47 Oman (عُمان)

+968 Pakistan (پاکستان)

+92 Palau

+680 Palestine (فلسطين)

+970 Panama (Panamá)

+507 Papua New Guinea

+675 Paraguay

+595 Peru (Perú)

+51 Philippines

+63 Poland (Polska)

+48 Portugal

+351 Puerto Rico

+1 Qatar (قطر)

+974 Réunion (La Réunion)

+262 Romania (România)

+40 Russia (Россия)

+7 Rwanda

+250 Saint Barthélemy

+590 Saint Helena

+290 Saint Kitts and Nevis

+1 Saint Lucia

+1 Saint Martin (Saint-Martin (partie française))

+590 Saint Pierre and Miquelon (Saint-Pierre-et-Miquelon)

+508 Saint Vincent and the Grenadines

+1 Samoa

+685 San Marino

+378 São Tomé and Príncipe (São Tomé e Príncipe)

+239 Saudi Arabia (المملكة العربية السعودية)

+966 Senegal (Sénégal)

+221 Serbia (Србија)

+381 Seychelles

+248 Sierra Leone

+232 Singapore

+65 Sint Maarten

+1 Slovakia (Slovensko)

+421 Slovenia (Slovenija)

+386 Solomon Islands

+677 Somalia (Soomaaliya)

+252 South Africa

+27 South Korea (대한민국)

+82 South Sudan (جنوب السودان)

+211 Spain (España)

+34 Sri Lanka (ශ්රී ලංකාව)

+94 Sudan (السودان)

+249 Suriname

+597 Svalbard and Jan Mayen

+47 Sweden (Sverige)

+46 Switzerland (Schweiz)

+41 Syria (سوريا)

+963 Taiwan (台灣)

+886 Tajikistan

+992 Tanzania

+255 Thailand (ไทย)

+66 Timor-Leste

+670 Togo

+228 Tokelau

+690 Tonga

+676 Trinidad and Tobago

+1 Tunisia (تونس)

+216 Turkey (Türkiye)

+90 Turkmenistan

+993 Turks and Caicos Islands

+1 Tuvalu

+688 U.S. Virgin Islands

+1 Uganda

+256 Ukraine (Україна)

+380 United Arab Emirates (الإمارات العربية المتحدة)

+971 United Kingdom

+44 United States

+1 Uruguay

+598 Uzbekistan (Oʻzbekiston)

+998 Vanuatu

+678 Vatican City (Città del Vaticano)

+39 Venezuela

+58 Vietnam (Việt Nam)

+84 Wallis and Futuna (Wallis-et-Futuna)

+681 Western Sahara (الصحراء الغربية)

+212 Yemen (اليمن)

+967 Zambia

+260 Zimbabwe

+263 Åland Islands

+358

#J-18808-Ljbffr

DevOps and ETL Engineer with Azure (m/f/x)

Join to apply for the DevOps and ETL Engineer with Azure (m/f/x) role at Mitsui Chemicals Group

DevOps and ETL Engineer with Azure (m/f/x)

1 month ago Be among the first 25 applicants

Join to apply for the DevOps and ETL Engineer with Azure (m/f/x) role at Mitsui Chemicals Group

Get AI-powered advice on this job and more exclusive features.

What To Expect

Are you creative, with a passion to put your ideas and expertise to good use? Then welcome to ARRK Engineering. We offer you excellent career prospects, a challenging range of tasks, independence, as well as a welcoming and respectful working environment.

Come and join our team!

YOUR TASKS

• Development and implementation of scalable ETL processes, in particular using Azure Databricks.
• Management and optimization of data pipelines and data integration solutions based on the Azure and AWS.
• Build and maintain CI/CD pipelines and automate development and operations processes using Azure DevOps.
• Collaborate with cross-functional teams to analyze requirements and ensure successful implementation of cloud-based solutions
• Monitoring and optimizing system and application performance in the cloud
• Ensuring best practices in terms of security, scalability and reliability
• Takeover of the responsibility of on-call availability at least one week per month.
  
  
  

LOCATION

Petaling Jaya

Company

ARRK Malaysia Sdn Bhd

CONTRACT TYPE

Full-time

Form of Work

Hybride

What To Expect

Are you creative, with a passion to put your ideas and expertise to good use? Then welcome to ARRK Engineering. We offer you excellent career prospects, a challenging range of tasks, independence, as well as a welcoming and respectful working environment. Come and join our team!

YOUR TASKS

• Development and implementation of scalable ETL processes, in particular using Azure Databricks.
• Management and optimization of data pipelines and data integration solutions based on the Azure and AWS.
• Build and maintain CI/CD pipelines and automate development and operations processes using Azure DevOps.
• Collaborate with cross-functional teams to analyze requirements and ensure successful implementation of cloud-based solutions
• Monitoring and optimizing system and application performance in the cloud
• Ensuring best practices in terms of security, scalability and reliability
• Takeover of the responsibility of on-call availability at least one week per month.
  
  
  

YOUR PROFILE

• Experience with Azure Cloud is a plus (e.g. Databricks and other Azure data services).
• In-depth knowledge of developing and managing ETL processes and data pipelines.
• Hands-on experience with DevOps tools and processes.
• Good knowledge of common programming languages for data processing and pipeline development.
• Experience with container technologies such as Docker and Kubernetes.
• Ability to work in an agile environment and translate complex technical requirements into practical solutions.
  
  
  

Your Benefits

• Exciting projects
• Flexible working hours
• ARRK Engineering Academy
• Employee events
• Attractive salary
  
  
  

Apply now

CONTACT

Iliana Morales Reyes

• 49 (0)89 / 31857-0
  
  
  

Privacy Policy

ARRK Engineering is part of the international ARRK group of companies and specialized in product development. Within the ARRK group of companies we implement product developments from virtual development to prototypes and small series production.

For reasons of simplification, only the masculine form is used in this job advertisement. However, persons of any gender and any orientation are always meant equally.

Our job offer is equally directed at severely disabled persons and persons of equal status.Seniority level

• Seniority level Entry level

Employment type

• Employment type Contract

Job function

• Job function Business Development and Sales
• Industries Chemical Manufacturing

Referrals increase your chances of interviewing at Mitsui Chemicals Group by 2x

Get notified about new ETL Developer jobs in Petaling Jaya, Selangor, Malaysia .

Petaling Jaya, Selangor, Malaysia 2 months ago

Petaling Jaya, Selangor, Malaysia 2 days ago

Petaling Jaya, Selangor, Malaysia 2 months ago

Petaling Jaya, Selangor, Malaysia 2 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Petaling Jaya, Selangor, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Entry Level / Fresh Graduate Data Analyst / Developer Data Analyst - SG Business Intelligence (Open for fresh graduates)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Experienced Associate - ETL Developer (Guidewire) (PwC Acceleration Center Kuala Lumpur)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR120,000.00-MYR156,000.00 2 weeks ago

Petaling Jaya, Selangor, Malaysia 17 hours ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia SGD1.00-SGD1.00 2 months ago

WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Federal Territory of Kuala Lumpur, Malaysia 3 days ago

WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 days ago

Federal Territory of Kuala Lumpur, Malaysia 1 day ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Federal Territory of Kuala Lumpur, Malaysia 3 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Petaling Jaya, Selangor, Malaysia 6 days ago

Petaling Jaya, Selangor, Malaysia 2 months ago

Petaling Jaya, Selangor, Malaysia 2 days ago

Federal Territory of Kuala Lumpur, Malaysia 1 day ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago

WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

DevOps and ETL Engineer with Azure (m/f/x)

Join to apply for the

DevOps and ETL Engineer with Azure (m/f/x)

role at

Mitsui Chemicals Group DevOps and ETL Engineer with Azure (m/f/x)

1 month ago Be among the first 25 applicants Join to apply for the

DevOps and ETL Engineer with Azure (m/f/x)

role at

Mitsui Chemicals Group Get AI-powered advice on this job and more exclusive features. What To Expect

Are you creative, with a passion to put your ideas and expertise to good use? Then welcome to ARRK Engineering. We offer you excellent career prospects, a challenging range of tasks, independence, as well as a welcoming and respectful working environment. Come and join our team!

YOUR TASKS Development and implementation of scalable ETL processes, in particular using Azure Databricks. Management and optimization of data pipelines and data integration solutions based on the Azure and AWS. Build and maintain CI/CD pipelines and automate development and operations processes using Azure DevOps. Collaborate with cross-functional teams to analyze requirements and ensure successful implementation of cloud-based solutions Monitoring and optimizing system and application performance in the cloud Ensuring best practices in terms of security, scalability and reliability Takeover of the responsibility of on-call availability at least one week per month.

LOCATION

Petaling Jaya

Company

ARRK Malaysia Sdn Bhd

CONTRACT TYPE

Full-time

Form of Work

Hybride

What To Expect

Are you creative, with a passion to put your ideas and expertise to good use? Then welcome to ARRK Engineering. We offer you excellent career prospects, a challenging range of tasks, independence, as well as a welcoming and respectful working environment.

Come and join our team!

YOUR TASKS

Development and implementation of scalable ETL processes, in particular using Azure Databricks. Management and optimization of data pipelines and data integration solutions based on the Azure and AWS. Build and maintain CI/CD pipelines and automate development and operations processes using Azure DevOps. Collaborate with cross-functional teams to analyze requirements and ensure successful implementation of cloud-based solutions Monitoring and optimizing system and application performance in the cloud Ensuring best practices in terms of security, scalability and reliability Takeover of the responsibility of on-call availability at least one week per month.

YOUR PROFILE

Experience with Azure Cloud is a plus (e.g. Databricks and other Azure data services). In-depth knowledge of developing and managing ETL processes and data pipelines. Hands-on experience with DevOps tools and processes. Good knowledge of common programming languages for data processing and pipeline development. Experience with container technologies such as Docker and Kubernetes. Ability to work in an agile environment and translate complex technical requirements into practical solutions.

Your Benefits

Exciting projects Flexible working hours ARRK Engineering Academy Employee events Attractive salary

Apply now

CONTACT

Iliana Morales Reyes



49 (0)89 / 31857-0

Privacy Policy

ARRK Engineering is part of the international ARRK group of companies and specialized in product development. Within the ARRK group of companies we implement product developments from virtual development to prototypes and small series production.

For reasons of simplification, only the masculine form is used in this job advertisement. However, persons of any gender and any orientation are always meant equally.

Our job offer is equally directed at severely disabled persons and persons of equal status. Seniority level

Seniority level Entry level Employment type

Employment type Contract Job function

Job function Business Development and Sales Industries Chemical Manufacturing Referrals increase your chances of interviewing at Mitsui Chemicals Group by 2x Get notified about new ETL Developer jobs in

Petaling Jaya, Selangor, Malaysia . Petaling Jaya, Selangor, Malaysia 2 months ago Petaling Jaya, Selangor, Malaysia 2 days ago Petaling Jaya, Selangor, Malaysia 2 months ago Petaling Jaya, Selangor, Malaysia 2 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Petaling Jaya, Selangor, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Entry Level / Fresh Graduate Data Analyst / Developer

Data Analyst - SG Business Intelligence (Open for fresh graduates)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Experienced Associate - ETL Developer (Guidewire) (PwC Acceleration Center Kuala Lumpur)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR120,000.00-MYR156,000.00 2 weeks ago Petaling Jaya, Selangor, Malaysia 17 hours ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia SGD1.00-SGD1.00 2 months ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Federal Territory of Kuala Lumpur, Malaysia 3 days ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 days ago Federal Territory of Kuala Lumpur, Malaysia 1 day ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Federal Territory of Kuala Lumpur, Malaysia 3 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Petaling Jaya, Selangor, Malaysia 6 days ago Petaling Jaya, Selangor, Malaysia 2 months ago Petaling Jaya, Selangor, Malaysia 2 days ago Federal Territory of Kuala Lumpur, Malaysia 1 day ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Key Responsibilities:

ETL & Data Engineering:

• Build and maintain robust ETL pipelines to ingest, transform, and load high-volume, high-velocity data from IT infrastructure, monitoring systems, and cloud environments.
• Develop batch and real-time data flows using frameworks.
• Optimize ETL jobs for scalability, fault tolerance, and low latency.
• Implement data validation, cleansing, and normalization processes for consistent AI model input.
• Integrate with AIOps platforms and ML pipelines using REST APIs or event-driven architectures.
• Develop and maintain robust data pipelines for ingesting, filter, transforming, and loading data from various sources (e.g., network devices, appliances, databases, APIs, cloud storage)

Application & Backend Development:

• Design and build backend services (microservices, APIs) in Python / Go/Java / Ruby to support data ingestion, metadata services, and configuration management.

DevOps & Orchestration:

• Use tools like Elastic Stack, Apache Airflow, Prefect, or Dagster to schedule and monitor ETL jobs.
• Implement CI/CD pipelines for deploying ETL services and full-stack apps.

Required Skillset:

Programming & Scripting:

• Proficient in one or more of the following:
  • Python – ETL scripting, backend APIs, ML interfacing
  • Ruby – Scripting and legacy tool integration
  • Go (Golang) – High-performance microservices, concurrency handling
  • Java – Enterprise-grade systems, Spark, Kafka pipelines
  • JavaScript/TypeScript with Next.js – Frontend dashboards and admin UIs

Data Engineering Tools:

• Proficient in one or more of the following:
  • ETL Frameworks: Apache NiFi, Spark, Airflow, Flink, Kafka, Talend
  • Orchestration: Airflow, Prefect, Dagster
  • Data Storage: PostgreSQL, MongoDB, Elasticsearch, Snowflake, BigQuery
  • Streaming Platforms: Kafka, Kinesis, Pub/Sub
  • Data Lake/File Storage: S3, GCS, Azure Blob

Good to have:

AIOps & Observability:

• Experience integrating with tools like Splunk, Dynatrace, AppDynamics, New Relic, Elastic Stack
• Familiarity with ITSM systems (e.g., ServiceNow) and CMDB integrations
• Understanding of metrics/logs/traces and their value in AI-driven operations

Interested applicants please send your resume to

Venessa Goh Wee Ni

R24124686

Recruit Express Pte Ltd

EA License No: 99C4599

We regret that only shortlisted candidates will be contacted.

#J-18808-Ljbffr

Key Responsibilities: ETL & Data Engineering: Build and maintain robust ETL pipelines to ingest, transform, and load high-volume, high-velocity data from IT infrastructure, monitoring systems, and cloud environments. Develop batch and real-time data flows using frameworks. Optimize ETL jobs for scalability, fault tolerance, and low latency. Implement data validation, cleansing, and normalization processes for consistent AI model input. Integrate with AIOps platforms and ML pipelines using REST APIs or event-driven architectures. Develop and maintain robust data pipelines for ingesting, filter, transforming, and loading data from various sources (e.g., network devices, appliances, databases, APIs, cloud storage) Application & Backend Development: Design and build backend services (microservices, APIs) in Python / Go/Java / Ruby to support data ingestion, metadata services, and configuration management. DevOps & Orchestration: Use tools like Elastic Stack, Apache Airflow, Prefect, or Dagster to schedule and monitor ETL jobs. Implement CI/CD pipelines for deploying ETL services and full-stack apps. Required Skillset: Programming & Scripting: Proficient in one or more of the following:

Python

– ETL scripting, backend APIs, ML interfacing Ruby

– Scripting and legacy tool integration Go (Golang)

– High-performance microservices, concurrency handling Java

– Enterprise-grade systems, Spark, Kafka pipelines JavaScript/TypeScript with Next.js

– Frontend dashboards and admin UIs

Data Engineering Tools: Proficient in one or more of the following:

ETL Frameworks: Apache NiFi, Spark, Airflow, Flink, Kafka, Talend Orchestration: Airflow, Prefect, Dagster Data Storage: PostgreSQL, MongoDB, Elasticsearch, Snowflake, BigQuery Streaming Platforms: Kafka, Kinesis, Pub/Sub Data Lake/File Storage: S3, GCS, Azure Blob

Good to have: AIOps & Observability: Experience integrating with tools like Splunk, Dynatrace, AppDynamics, New Relic, Elastic Stack Familiarity with ITSM systems (e.g., ServiceNow) and CMDB integrations Understanding of metrics/logs/traces and their value in AI-driven operations Interested applicants please send your resume to Venessa Goh Wee Ni R24124686 Recruit Express Pte Ltd EA License No: 99C4599 We regret that only shortlisted candidates will be contacted.

#J-18808-Ljbffr

Join to apply for the Data Engineering Manager role at UST

3 days ago Be among the first 25 applicants

Join to apply for the Data Engineering Manager role at UST

Get AI-powered advice on this job and more exclusive features.

Role Description

We are seeking an experienced Data Engineering Manager to lead a team of 10 skilled data engineers. The successful candidate will collaborate closely with business and technology stakeholders across multiple regions in APAC, translating business needs into a clear and prioritized delivery backlog. You will be accountable for driving data engineering best practices, ensuring timely delivery, and fostering a high-performance culture within the team.

Role Description

We are seeking an experienced Data Engineering Manager to lead a team of 10 skilled data engineers. The successful candidate will collaborate closely with business and technology stakeholders across multiple regions in APAC, translating business needs into a clear and prioritized delivery backlog. You will be accountable for driving data engineering best practices, ensuring timely delivery, and fostering a high-performance culture within the team.

Key Responsibilities

• Lead, mentor, and manage a team of 10 data engineers, ensuring high-quality deliverables and adherence to engineering best practices.
• Partner with stakeholders from multiple APAC regions to understand business priorities, gather requirements, and translate them into a well-defined product backlog.
• Prioritize and manage the backlog to align with strategic business objectives and technical feasibility.
• Oversee the design, development, and maintenance of scalable, high-performance data pipelines and data models.
• Ensure data quality, security, and governance standards are met across all projects.
• Facilitate effective communication between the data engineering team and cross-functional teams, including data scientists, analysts, and product managers.
• Monitor delivery timelines, proactively identify risks, and implement mitigation plans.
• Drive continuous improvement in processes, tools, and team capabilities.
  
  

Required Skills & Qualifications

• 15+ years of experience in data engineering, with at least 3 years in a people management role.
• Proven track record in managing distributed teams and delivering complex data engineering projects.
• Strong experience with cloud-based data platforms (e.g., Azure, AWS, GCP) and modern data engineering tools.
• Solid understanding of data modeling (dimensional and relational), ETL/ELT design, and data warehouse architectures.
• Strong stakeholder management and communication skills, with experience engaging teams across multiple geographies.
• Ability to prioritize work, manage competing demands, and deliver results under tight timelines.
• Familiarity with Agile methodologies and backlog management tools (e.g., Jira, Azure DevOps).
  
  

Preferred Qualifications

• Experience with Azure Data Factory, Azure Synapse Analytics, Databricks, and ADLS Gen2.
• Knowledge of data governance tools and frameworks.
• Exposure to APAC market dynamics and cross-cultural collaboration.
  
  

Skills

Data Engineering,Data Management,Excellent Communication

Seniority level

• Seniority level Not Applicable

Employment type

• Employment type Full-time

Job function

• Job function Engineering and Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at UST by 2x

Sign in to set job alerts for “Engineering Manager” roles. Manager 3,Program Management Engineering Section Manager Product Development Engineering Section Manager Equipment Engineering (Advanced Packaging- Fan Out) Senior Manager Systems Design Engineering Quality & Process Improvement Engineer (Teradyne, Penang) Talent and Organization Solutions Program Manager

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Join to apply for the

Data Engineering Manager

role at

UST 3 days ago Be among the first 25 applicants Join to apply for the

Data Engineering Manager

role at

UST Get AI-powered advice on this job and more exclusive features. Role Description

We are seeking an experienced Data Engineering Manager to lead a team of 10 skilled data engineers. The successful candidate will collaborate closely with business and technology stakeholders across multiple regions in APAC, translating business needs into a clear and prioritized delivery backlog. You will be accountable for driving data engineering best practices, ensuring timely delivery, and fostering a high-performance culture within the team. Role Description

We are seeking an experienced Data Engineering Manager to lead a team of 10 skilled data engineers. The successful candidate will collaborate closely with business and technology stakeholders across multiple regions in APAC, translating business needs into a clear and prioritized delivery backlog. You will be accountable for driving data engineering best practices, ensuring timely delivery, and fostering a high-performance culture within the team.

Key Responsibilities

Lead, mentor, and manage a team of 10 data engineers, ensuring high-quality deliverables and adherence to engineering best practices. Partner with stakeholders from multiple APAC regions to understand business priorities, gather requirements, and translate them into a well-defined product backlog. Prioritize and manage the backlog to align with strategic business objectives and technical feasibility. Oversee the design, development, and maintenance of scalable, high-performance data pipelines and data models. Ensure data quality, security, and governance standards are met across all projects. Facilitate effective communication between the data engineering team and cross-functional teams, including data scientists, analysts, and product managers. Monitor delivery timelines, proactively identify risks, and implement mitigation plans. Drive continuous improvement in processes, tools, and team capabilities.

Required Skills & Qualifications

15+ years of experience in data engineering, with at least 3 years in a people management role. Proven track record in managing distributed teams and delivering complex data engineering projects. Strong experience with cloud-based data platforms (e.g., Azure, AWS, GCP) and modern data engineering tools. Solid understanding of data modeling (dimensional and relational), ETL/ELT design, and data warehouse architectures. Strong stakeholder management and communication skills, with experience engaging teams across multiple geographies. Ability to prioritize work, manage competing demands, and deliver results under tight timelines. Familiarity with Agile methodologies and backlog management tools (e.g., Jira, Azure DevOps).

Preferred Qualifications

Experience with Azure Data Factory, Azure Synapse Analytics, Databricks, and ADLS Gen2. Knowledge of data governance tools and frameworks. Exposure to APAC market dynamics and cross-cultural collaboration.

Skills

Data Engineering,Data Management,Excellent Communication Seniority level

Seniority level Not Applicable Employment type

Employment type Full-time Job function

Job function Engineering and Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at UST by 2x Sign in to set job alerts for “Engineering Manager” roles.

Manager 3,Program Management Engineering

Section Manager Product Development Engineering

Section Manager Equipment Engineering (Advanced Packaging- Fan Out)

Senior Manager Systems Design Engineering

Quality & Process Improvement Engineer (Teradyne, Penang)

Talent and Organization Solutions Program Manager

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from TIMESCONSULT

Assistant Manager - HR and Operation @ AskHeadHunter | HR functions, internal recruitment

Company Background

The company is established since 1999 and is the industry leader in cloud-based transformative technologies for business supply chains to retail, supply chain and FMCG industry through collaborative platforms. They have global presence in Malaysia, Thailand, Vietnam, Indonesia and Cambodia.

Working Location

Working Mode

Fully in office (Mon - Fri, 9am - 6pm)

Job Responsibilities

• Able to perform data extraction, data loading solving the errors, checking filter criteria.
• Understanding on the steps - input, output, and connection to database.
• Understanding on job/transformation, inspecting the data.
• Understanding on salesforce basics - fields, objects, and lookups.
• Provide technical knowledge/expertise to support the requirements definition, design, and development of data warehouse components/subsystems, specifically Extract-Transform Load or Extract-Load-Transform technologies and implementations and/or Change Data Capture technologies and implementations.
• Getting fallout report and analyzing the bugs and errors, should understand how to get output file.
• Research, design, develop, and modify the ETL and related database functions, implementing changes/enhancements to the system.
• Design ETL processes and develop source to target transformations, and load processes.

Job Requirements

• Bachelor’s degree in computer science or a related field or the equivalent demonstrated experience
• Must have at least 2 years of experience in Pentaho.
• Experience running large scale web scrapes
• Experience with techniques and tools for crawling, extracting, and processing data.
• Great communication skills (written and Spoken in English)

Seniority level

• Seniority level Associate

Employment type

• Employment type Full-time

Job function

• Job function Information Technology
• Industries Staffing and Recruiting

Referrals increase your chances of interviewing at TIMESCONSULT by 2x

Sign in to set job alerts for “Data Engineer” roles. Data Engineer/ Python Developer - Data Lake

Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Federal Territory of Kuala Lumpur, Malaysia 4 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Data Analyst - SG Business Intelligence (Open for fresh graduates)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 days ago

Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Petaling Jaya, Selangor, Malaysia 3 months ago

Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR120,000.00-MYR156,000.00 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Bukit Raja, Selangor, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 days ago

Petaling Jaya, Selangor, Malaysia 5 days ago

Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR3,500.00-MYR4,000.00 3 weeks ago

WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Petaling Jaya, Selangor, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Job Summary:

We are looking for a highly skilled Python / ETL Data Engineer to design, develop, and optimize data pipelines using AWS Glue, AWS Athena, AWS Data Pipeline, and other ETL tools. The ideal candidate will have strong expertise in Python, SQL, AWS, and data pipeline management, ensuring smooth data extraction, transformation, and loading (ETL) processes.

Key Responsibilities:

• Develop and maintain data pipelines using AWS Glue, AWS Athena, AWS Data Pipeline, and other ETL tools.
• Implement monitoring and early detection processes for pipeline issues such as missing or lagging data.
• Extract, transform, and load (ETL) data from various sources, including relational databases, non-relational databases, and flat files.
• Optimize and transform data to meet business requirements and load it into target data stores.
• Troubleshoot and optimize performance of data pipelines for scalability and efficiency.
• Collaborate with Data Scientists and Business Analysts to understand data requirements and implement solutions.
• Build and maintain REST APIs for data access and integration with external systems.
• Ensure data security and compliance best practices across all pipelines.
• Document and test ETL processes to maintain high-quality data flows.

Required Skills:

• Strong Python programming skills for data processing and ETL automation.
• Proficiency in SQL and database design (relational and non-relational databases).
• In-depth knowledge of AWS services, including AWS Glue, Redshift, S3, and EMR.
• Experience in building ETL pipelines on cloud-based environments (preferably AWS).
• Hands-on experience with REST API development and integration.
• Familiarity with data warehousing concepts and best practices.
• Understanding of data modeling, API testing, and troubleshooting.
• Experience with data governance, data security, and compliance frameworks.
• Exposure to big data technologies like Spark, Hadoop, or Kafka.
• Knowledge of containerization (Docker, Kubernetes) and DevOps practices.

Qualifications:

• Minimum 5 years of experience as a Data Engineer with ETL cloud experience, preferably AWS.
• AWS or Azure certification preferred.
• Strong Python programming skills and experience building APIs.
• Malaysian citizen or permanent resident.
• Oil & Gas industry experience is a plus.
• Degree in Computer Science, Engineering, or equivalent.

#J-18808-Ljbffr