2,138 Spark jobs in Malaysia

We are seeking a highly skilled
Spark Engineer
to design, build, and optimize large-scale data processing systems using
Apache Spark
. The ideal candidate will have deep expertise in distributed data processing, ETL pipelines, and performance tuning for high-volume data environments. You will collaborate with data scientists, analysts, and engineers to ensure scalable, reliable, and efficient data solutions.

Key Responsibilities:

• Design, develop, and maintain big data solutions using Apache Spark (Batch and Streaming).
• Build data pipelines for processing structured, semi-structured, and unstructured data from multiple sources.
• Optimize Spark jobs for performance and scalability across large datasets.
• Integrate Spark with various data storage systems (HDFS, S3, Hive, Cassandra, etc.).
• Collaborate with data scientists and analysts to deliver robust data solutions for analytics and machine learning.
• Implement data quality checks, monitoring, and alerting for Spark-based workflows.
• Ensure security and compliance of data processing systems.
• Troubleshoot and resolve data pipeline and Spark job issues in production environments.

Required Skills & Qualifications

• Bachelor's degree
  in Computer Science, Engineering, or related field (Master's preferred).
• 3+ years
  of hands-on experience with
  Apache Spark
  (Core, SQL, Streaming).
• Strong
  programming skills
  in
  Scala
  ,
  Java
  , or
  Python
  (PySpark).
• Solid understanding of
  distributed computing concepts
  and
  big data ecosystems
  (Hadoop, YARN, HDFS).
• Experience with
  data serialization formats
  (Parquet, ORC, Avro).
• Familiarity with
  data lake and cloud environments
  (AWS EMR, Databricks, GCP DataProc, or Azure Synapse).
• Knowledge of
  SQL
  and experience with
  data warehouses
  (Snowflake, Redshift, BigQuery is a plus).
• Strong background in
  performance tuning
  and
  Spark job optimization
  .
• Experience with
  CI/CD pipelines
  and
  version control
  (Git).
• Familiarity with
  containerization
  (Docker, Kubernetes) is an advantage.

This is a 12-month contract appointment, with the potential for extension or conversion to a permanent position subject to performance and business needs.

Unison Group Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

1 day ago Be among the first 25 applicants

This range is provided by Unison Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

SGD5,000.00/yr - SGD7,500.00/yr

We are seeking a skilled Data Engineer to join our team. The ideal candidate will have strong expertise in SQL, Python, Spark, and Hive , with hands-on experience building scalable data pipelines, data models, and analytical solutions. You will work closely with data scientists, analysts, and business stakeholders to deliver high-quality data solutions that support business decision-making.

• Design, develop, and maintain robust, scalable data pipelines and ETL processes.
• Optimize data storage, retrieval, and processing using SQL, Spark, and Hive.
• Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
• Implement data quality, validation, and monitoring processes to ensure reliability.
• Support data modeling, warehousing, and integration for analytics and reporting.
• Write clean, efficient, and reusable Python code for automation and data processing.
• Ensure data security, compliance, and governance across all solutions.

• Bachelor's degree in Computer Science, Engineering, or related field.
• 4-7 years of experience as a Data Engineer (or similar role).
• Strong proficiency in SQL, Python, Spark, and Hive .
• Experience with distributed data processing and big data ecosystems.
• Hands-on experience with data pipeline tools (e.g., Airflow, NiFi, or similar) is a plus.
• Familiarity with cloud platforms (AWS, Azure, or GCP) is advantageous.
• Strong problem-solving and communication skills.

• Associate

• Full-time

• Analyst

• IT Services and IT Consulting

Referrals increase your chances of interviewing at Unison Group by 2x

Get notified about new Data Engineer jobs in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia .

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Overview

We are looking for a proficient Data Engineer with strong skills in Spark and SQL to join Unison Group. The successful candidate will be responsible for designing, building, and managing data pipelines that facilitate real-time data processing. This role involves optimizing data flow and enhancing data quality to support the analytical needs of various teams within the organization.

SGD48,000.00/yr - SGD95,000.00/yr

This range is provided by Unison Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

• Develop and maintain robust data pipelines using Apache Spark to process large datasets efficiently


• Utilize SQL for data querying, manipulation, and management across various relational database systems


• Collaborate with data scientists and analytics teams to understand data requirements and deliver suitable solutions


• Implement data transformation and aggregation processes to optimize data for analysis


• Monitor and troubleshoot data pipelines, ensuring high availability and reliability


• Perform data quality checks and maintain data integrity throughout the data lifecycle


• Stay updated on industry trends and best practices in data engineering, particularly in Spark and SQL technologies

• Bachelor's degree in Computer Science, Information Technology, or a related field


• Experience as a Data Engineer, with a focus on Spark and SQL


• Good to have experience in Banking/Finance domain


• Proficiency in Spark for distributed data processing and ability to write efficient Spark jobs


• Strong SQL skills, with experience working with relational databases (e.g., MySQL, PostgreSQL, Oracle)


• Experience with data integration, ETL processes, and data warehousing concepts


• Knowledge of big data technologies and frameworks is a plus


• Strong analytical and problem-solving skills


• Excellent communication and teamwork capabilities

• Salary: SGD 6000 - 8000


• Great Work Culture


• Includes Standard Annual and Sick Leave

• Seniority level: Associate


• Employment type: Full-time


• Job function: Information Technology


• Industries: IT Services and IT Consulting

Overview

HP is a proven leader in personal systems and printing, delivering innovations that empower people to create, interact, and inspire. We leverage our strong financial position to extend our leadership in traditional markets and invest in exciting new technologies. HP has an impressive portfolio and strong innovation pipeline across areas such as blended reality technology, 3D printing, multi-function printing, ink in the office, tablets, phablets, notebooks, and mobile workstations.

We are looking for visionaries who are ready to make an impact on the way the world works. At HP, the future is yours to create!

If you are the Pen Assembly Process Engineer in Malaysia, you will:

• Designs engineering solutions, including methods, operation sequences, and processes for final assemblies, based on established engineering principles and in accordance with provided specifications and requirements.
• Develops and implements cost estimates, capacity models, time standards, production area layouts, and recommendations for tooling and process requirements for new product introductions.
• Collaborates and communicates with management, internal, and outsourced manufacturing and development partners regarding process and standards compliance, recording and reporting issues, and recommendations for problem resolution for manufacture of existing products.
• Leads a project team of other manufacturing engineers and internal and outsourced manufacturing partners to develop and execute reliable, cost effective and high quality manufacturing solutions for moderately-complex products from new-product introduction through end of lifecycle.
• Represents the manufacturing engineering team for all phases of larger and more-complex development and manufacturing projects.
• Provides guidance and mentoring to less-experienced staff members.

Bachelor’s degree in Mechanical Engineering, Mechatronic Engineering, Manufacturing Engineering, or Electrical & Electronic (E&E) Engineering. Open for fresh graduates only.

• Using engineering tools and software packages to design and automate manufacturing processes.
• Strong analytical and problem solving skills.
• Understanding of material properties and hardware and electrical component design.
• Using empirical analysis, modeling and methodologies to validate manufacturing process and tooling design and specifications.
• Excellent written and verbal communication skills; mastery in English and local language.
• Ability to effectively communicate manufacturing plans, proposals, and results, and negotiate options.

Sustainable impact is HP’s commitment to create positive, lasting change for the planet, its people, and our communities. This serves as a guiding principle for delivering on our corporate vision – to create technology that makes life better for everyone, everywhere.