37 Big W jobs in Malaysia

Big Data Engineer

Shirlyn Technology

Posted 11 days ago

Job Viewed

Tap Again To Close

Job Description

Position Summary

We are looking for a full-time Big Data Engineer II to join our team at Shirlyn Technology in Petaling Jaya, Malaysia and Palo Alto, California. The Big Data team is at the heart of our operations, playing a critical role in scaling and optimizing our data infrastructure. As we continue to grow, we are seeking an experienced and driven Big Data Engineer to help us tackle complex data challenges, enhance data solutions, and ensure the security and quality of our data systems. You will be instrumental in building and deploying scalable data pipelines to ensure seamless data flow across systems, driving business success through reliable data solutions.

Job Responsibilities

  • Collaborate with global teams in data, security, infrastructure, and business functions to understand data requirements and provide scalable solutions.
  • Design, implement, and maintain efficient ETL (Extract, Transform, Load) pipelines to enable smooth data flow between systems.
  • Conduct regular data quality checks to ensure accuracy, consistency, and completeness within our data pipelines.
  • Continuously improve data pipeline performance and reliability, identifying and addressing any inefficiencies or bottlenecks.
  • Ensure data integrity, security, privacy, and availability across all systems.
  • Proactively monitor data pipelines, quickly diagnosing issues and taking action to resolve them and maintain system uptime.
  • Conduct root cause analysis of data-related issues and work on long-term solutions to prevent recurring problems.
  • Document pipeline designs, data processes, and troubleshooting procedures, keeping stakeholders informed with clear communication of updates.
  • Provide on-call support for critical data operations, ensuring systems are running 24/7, with rotational responsibilities.

Job Requirements

  • Bachelor’s degree in Computer Science, Information Systems, or a related technical field.
  • 5+ years of hands-on experience building and optimizing data pipelines using big data technologies (Hive, Presto, Spark, Flink).
  • Expertise in writing complex SQL queries and proficiency in Python programming, focusing on maintainable and clean code.
  • Solid knowledge of scripting languages (e.g., Shell, Perl).
  • Experience working in Unix/Linux environments.
  • Familiarity with cloud platforms such as Azure, AWS, or GCP.
  • High personal integrity and professionalism in handling confidential information, exercising sound judgment.
  • Ability to remain calm and resolve issues swiftly during high-pressure situations, adhering to SLAs.
  • Strong leadership skills, including the ability to guide junior team members and lead projects across the team.
  • Excellent verbal and written communication skills, with the ability to collaborate effectively with remote teams globally.
#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Kelantan, Kelantan Shirlyn Technology

Posted today

Job Viewed

Tap Again To Close

Job Description

Position Summary We are looking for a full-time Big Data Engineer II to join our team at Shirlyn Technology in Petaling Jaya, Malaysia and Palo Alto, California. The Big Data team is at the heart of our operations, playing a critical role in scaling and optimizing our data infrastructure. As we continue to grow, we are seeking an experienced and driven Big Data Engineer to help us tackle complex data challenges, enhance data solutions, and ensure the security and quality of our data systems. You will be instrumental in building and deploying scalable data pipelines to ensure seamless data flow across systems, driving business success through reliable data solutions. Job Responsibilities Collaborate with global teams in data, security, infrastructure, and business functions to understand data requirements and provide scalable solutions. Design, implement, and maintain efficient ETL (Extract, Transform, Load) pipelines to enable smooth data flow between systems. Conduct regular data quality checks to ensure accuracy, consistency, and completeness within our data pipelines. Continuously improve data pipeline performance and reliability, identifying and addressing any inefficiencies or bottlenecks. Ensure data integrity, security, privacy, and availability across all systems. Proactively monitor data pipelines, quickly diagnosing issues and taking action to resolve them and maintain system uptime. Conduct root cause analysis of data-related issues and work on long-term solutions to prevent recurring problems. Document pipeline designs, data processes, and troubleshooting procedures, keeping stakeholders informed with clear communication of updates. Provide on-call support for critical data operations, ensuring systems are running 24/7, with rotational responsibilities. Job Requirements Bachelor’s degree in Computer Science, Information Systems, or a related technical field. 5+ years of hands-on experience building and optimizing data pipelines using big data technologies (Hive, Presto, Spark, Flink). Expertise in writing complex SQL queries and proficiency in Python programming, focusing on maintainable and clean code. Solid knowledge of scripting languages (e.g., Shell, Perl). Experience working in Unix/Linux environments. Familiarity with cloud platforms such as Azure, AWS, or GCP. High personal integrity and professionalism in handling confidential information, exercising sound judgment. Ability to remain calm and resolve issues swiftly during high-pressure situations, adhering to SLAs. Strong leadership skills, including the ability to guide junior team members and lead projects across the team. Excellent verbal and written communication skills, with the ability to collaborate effectively with remote teams globally.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Big Data Hadoop Developer

Kuala Lumpur, Kuala Lumpur Unison Consulting Pte Ltd

Posted 7 days ago

Job Viewed

Tap Again To Close

Job Description

Job Summary:
We are looking for a Big Data Hadoop Developer to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem and integration with relational databases such as MariaDB or Oracle DB for analytics and reporting.

Key Responsibilities:

  • Design, develop, and optimize Hadoop-based big data solutions for batch and real-time data processing.
  • Work with data ingestion frameworks to integrate data from MariaDB/Oracle DB into Hadoop (Sqoop, Apache Nifi, Kafka).
  • Implement Hive, Spark, and MapReduce jobs for data transformation and analytics.
  • Optimize Hive queries, Spark jobs, and HDFS usage for performance and cost efficiency.
  • Create and maintain ETL pipelines for structured and unstructured data.
  • Troubleshoot and resolve issues in Hadoop jobs and database connectivity.
  • Collaborate with BI, analytics, and data science teams for data provisioning.
  • Ensure data security, governance, and compliance in all solutions.

Technical Skills:

  • Big Data Ecosystem: Hadoop (HDFS, YARN), Hive, Spark, Sqoop, MapReduce, Oozie, Flume.
  • Databases: MariaDB and/or Oracle DB (SQL, PL/SQL).
  • Programming: Java, Scala, or Python for Spark/MapReduce development.
  • Data Ingestion: Sqoop, Kafka, Nifi (for integrating RDBMS with Hadoop).
  • Query Optimization: Hive tuning, partitioning, bucketing, indexing.
  • Tools: Ambari, Cloudera Manager, Git, Jenkins.
  • OS & Scripting: Linux/Unix shell scripting.

Soft Skills:

  • Strong analytical skills and problem-solving abilities.
  • Good communication skills for working with cross-functional teams.
  • Ability to manage priorities in a fast-paced environment.

Nice to Have:

  • Experience with cloud-based big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc).
  • Knowledge of NoSQL databases (HBase, Cassandra).
  • Exposure to machine learning integration with Hadoop/Spark.
#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Kuala Lumpur, Kuala Lumpur NEAR

Posted 11 days ago

Job Viewed

Tap Again To Close

Job Description

Senior Java Engineer (Base Kuala Lumpur)

Job Advantages

Cutting-edge technology (web3 and blockchain), globalized company

Job Responsibilities

  1. Responsible for the architectural design and development of the company's data center.
  2. Continuously deliver data value to the company's businesses with high quality, low cost and high efficiency.
  3. Provide solutions for platform architecture and performance optimization, and lead the rapid iteration of big data platform.
  4. Enabling the rapid development of the company's business through data-driven approaches, continuously improving the company's core competitiveness.

Job Requirements

  1. Bachelor's degree or above in computer science or related majors, with more than 3 years of experience in Java development, proficient in Java development, and an in-depth understanding of JVM principles.
  2. Familiar with commonly used frameworks (Spring, Spring MVC, gRPC, Mybatis) and able to master their principles and mechanisms.
  3. Solid computer fundamentals, mastery of computer operating systems and network architecture, familiar with commonly used algorithms, data structures, and design patterns.
  4. Familiar with distributed systems, caching, messaging, and other mechanisms; experience with Redis, Kafka, Spark, Flink, Zookeeper, and TiDB is preferred.
  5. Experience in data center or microservice design and development, with a focus on high availability and scalability of architecture is preferred.
  6. Experience in tagging systems or algorithmic recommendation systems is preferred.
  7. Full of enthusiasm and expectation for the blockchain industry, committed to working hard for the development of the industry.
#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Kuala Lumpur, Kuala Lumpur Bybit

Posted 11 days ago

Job Viewed

Tap Again To Close

Job Description

Company : Web3 & Blockchain-focused Company

Job Advantages

  • Cutting-edge technology (Web3 and blockchain)
  • Globalized company

Job Responsibilities

As a Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include:

  • Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability.
  • Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs.
  • Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness.
  • Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output.

Job Requirements

We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria:

  • Education : Bachelor’s degree or above in Computer Science or related majors.
  • Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices.
  • Frameworks : Proficient in frameworks such as Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms.
  • Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns.
  • Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like Spark, Flink , and Zookeeper . Experience with TiDB is a plus.
  • Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability.
  • Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable.
  • Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development.

Why Join Us?

This role offers the opportunity to work at the forefront of blockchain and Web3 technologies within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you.

Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem!

Pioneer Talent Program - Organic Content Operations Crypto Operations Manager - Oregon, United States Crypto-Native UX Researcher (Remote - Jakarta, Indonesia) Web3 Head of Marketing and Communications (Remote) #J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Kuala Lumpur, Kuala Lumpur Bybit

Posted today

Job Viewed

Tap Again To Close

Job Description

Company : Web3 & Blockchain-focused Company Job Advantages Cutting-edge technology (Web3 and blockchain) Globalized company Job Responsibilities As a

Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include: Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability. Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs. Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness. Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output. Job Requirements We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria: Education : Bachelor’s degree or above in Computer Science or related majors. Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices. Frameworks : Proficient in frameworks such as

Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms. Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns. Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like

Spark, Flink , and

Zookeeper . Experience with

TiDB

is a plus. Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability. Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable. Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development. Why Join Us? This role offers the opportunity to work at the forefront of

blockchain

and

Web3 technologies

within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you. Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem! Pioneer Talent Program - Organic Content Operations

Crypto Operations Manager - Oregon, United States

Crypto-Native UX Researcher (Remote - Jakarta, Indonesia)

Web3 Head of Marketing and Communications (Remote) #J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Kuala Lumpur, Kuala Lumpur NEAR

Posted today

Job Viewed

Tap Again To Close

Job Description

Senior Java Engineer (Base Kuala Lumpur) Job Advantages Cutting-edge technology (web3 and blockchain), globalized company Job Responsibilities Responsible for the architectural design and development of the company's data center. Continuously deliver data value to the company's businesses with high quality, low cost and high efficiency. Provide solutions for platform architecture and performance optimization, and lead the rapid iteration of big data platform. Enabling the rapid development of the company's business through data-driven approaches, continuously improving the company's core competitiveness. Job Requirements Bachelor's degree or above in computer science or related majors, with more than 3 years of experience in Java development, proficient in Java development, and an in-depth understanding of JVM principles. Familiar with commonly used frameworks (Spring, Spring MVC, gRPC, Mybatis) and able to master their principles and mechanisms. Solid computer fundamentals, mastery of computer operating systems and network architecture, familiar with commonly used algorithms, data structures, and design patterns. Familiar with distributed systems, caching, messaging, and other mechanisms; experience with Redis, Kafka, Spark, Flink, Zookeeper, and TiDB is preferred. Experience in data center or microservice design and development, with a focus on high availability and scalability of architecture is preferred. Experience in tagging systems or algorithmic recommendation systems is preferred. Full of enthusiasm and expectation for the blockchain industry, committed to working hard for the development of the industry.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Big w Jobs in Malaysia !

Big Data Hadoop Developer

Kuala Lumpur, Kuala Lumpur Unison Consulting Pte Ltd

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Summary: We are looking for a Big Data Hadoop Developer to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem and integration with relational databases such as MariaDB or Oracle DB for analytics and reporting. Key Responsibilities: Design, develop, and optimize Hadoop-based big data solutions for batch and real-time data processing. Work with data ingestion frameworks to integrate data from MariaDB/Oracle DB into Hadoop (Sqoop, Apache Nifi, Kafka). Implement Hive, Spark, and MapReduce jobs for data transformation and analytics. Optimize Hive queries, Spark jobs, and HDFS usage for performance and cost efficiency. Create and maintain ETL pipelines for structured and unstructured data. Troubleshoot and resolve issues in Hadoop jobs and database connectivity. Collaborate with BI, analytics, and data science teams for data provisioning. Ensure data security, governance, and compliance in all solutions. Technical Skills: Big Data Ecosystem:

Hadoop (HDFS, YARN), Hive, Spark, Sqoop, MapReduce, Oozie, Flume. Databases:

MariaDB and/or Oracle DB (SQL, PL/SQL). Programming:

Java, Scala, or Python for Spark/MapReduce development. Data Ingestion:

Sqoop, Kafka, Nifi (for integrating RDBMS with Hadoop). Query Optimization:

Hive tuning, partitioning, bucketing, indexing. Tools:

Ambari, Cloudera Manager, Git, Jenkins. OS & Scripting:

Linux/Unix shell scripting. Soft Skills: Strong analytical skills and problem-solving abilities. Good communication skills for working with cross-functional teams. Ability to manage priorities in a fast-paced environment. Nice to Have: Experience with cloud-based big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc). Knowledge of NoSQL databases (HBase, Cassandra). Exposure to machine learning integration with Hadoop/Spark.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Lead Software Engineer (Big Data)

Kuala Lumpur, Kuala Lumpur EPAM Systems

Posted 11 days ago

Job Viewed

Tap Again To Close

Job Description

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Join or sign in to find your next job

Join to apply for the Lead Software Engineer (Big Data) role at EPAM Systems

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

1 week ago Be among the first 25 applicants

Join to apply for the Lead Software Engineer (Big Data) role at EPAM Systems

Get AI-powered advice on this job and more exclusive features.

Are you a highly skilled and motivated Data Software Engineer with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!

Responsibilities


  • Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies
  • Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks
  • Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions
  • Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals
  • Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions
  • Participate actively in code reviews and ensure adherence to best practices and coding standards
  • Foster a high-performance engineering culture, mentor team members and provide motivation and guidance
  • Maintain comprehensive project documentation to support development and operations


Requirements


  • 8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions
  • Proficiency in Python, Java, Scala, or Kotlin
  • Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals
  • Expert skills in SQL and relational algebra
  • Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies
  • Hands-on experience with modern Big Data components and data modeling
  • Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems
  • Deep understanding and practical application of CI/CD principles and best practices
  • Expertise in Docker and Kubernetes for containerization and resource management
  • Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture
  • Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations
  • Significant experience with high-load and IoT data platform architectures
  • Solid infrastructure troubleshooting skills
  • Practical experience in performance tuning, optimization and problem analysis
  • Advanced understanding of distributed computing principles
  • Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus
  • Excellent interpersonal, leadership and communication skills
  • Experience in direct customer communications and stakeholder management
  • Experience in technical leadership and mentoring within data-oriented projects
  • Ability to handle multiple projects in a fast-paced, startup-like agile development environment
  • Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA


We offer


  • By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
  • Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
  • You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
  • We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
  • At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us


Life at EPAM


  • EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
  • We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients

Seniority level
  • Seniority level Mid-Senior level
Employment type
  • Employment type Full-time
Job function
  • Job function Engineering, Information Technology, and Business Development
  • Industries Software Development and IT Services and IT Consulting

Referrals increase your chances of interviewing at EPAM Systems by 2x

Get notified about new Lead Software Engineer jobs in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia .

Petaling Jaya, Selangor, Malaysia 5 days ago

Petaling Jaya, Selangor, Malaysia 5 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,000.00-MYR5,000.00 1 month ago

Petaling Jaya, Selangor, Malaysia 5 days ago

Petaling Jaya, Selangor, Malaysia 5 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Petaling Jaya, Selangor, Malaysia 5 days ago

Petaling Jaya, Selangor, Malaysia 5 days ago

Petaling Jaya, Selangor, Malaysia 5 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 8 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR3,800.00-MYR5,000.00 3 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 months ago

Kota Damansara, Selangor, Malaysia 2 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR3,500.00-MYR4,000.00 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Petaling Jaya, Selangor, Malaysia 2 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Lead Software Engineer (Big Data)

Kuala Lumpur, Kuala Lumpur EPAM Systems

Posted today

Job Viewed

Tap Again To Close

Job Description

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia Join or sign in to find your next job

Join to apply for the

Lead Software Engineer (Big Data)

role at

EPAM Systems EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Be among the first 25 applicants Join to apply for the

Lead Software Engineer (Big Data)

role at

EPAM Systems Get AI-powered advice on this job and more exclusive features. Are you a highly skilled and motivated

Data Software Engineer

with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!

Responsibilities

Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions Participate actively in code reviews and ensure adherence to best practices and coding standards Foster a high-performance engineering culture, mentor team members and provide motivation and guidance Maintain comprehensive project documentation to support development and operations

Requirements

8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions Proficiency in Python, Java, Scala, or Kotlin Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals Expert skills in SQL and relational algebra Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies Hands-on experience with modern Big Data components and data modeling Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems Deep understanding and practical application of CI/CD principles and best practices Expertise in Docker and Kubernetes for containerization and resource management Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations Significant experience with high-load and IoT data platform architectures Solid infrastructure troubleshooting skills Practical experience in performance tuning, optimization and problem analysis Advanced understanding of distributed computing principles Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus Excellent interpersonal, leadership and communication skills Experience in direct customer communications and stakeholder management Experience in technical leadership and mentoring within data-oriented projects Ability to handle multiple projects in a fast-paced, startup-like agile development environment Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA

We offer

By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

Life at EPAM

EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients

Seniority level

Seniority level Mid-Senior level Employment type

Employment type Full-time Job function

Job function Engineering, Information Technology, and Business Development Industries Software Development and IT Services and IT Consulting Referrals increase your chances of interviewing at EPAM Systems by 2x Get notified about new Lead Software Engineer jobs in

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia . Petaling Jaya, Selangor, Malaysia 5 days ago Petaling Jaya, Selangor, Malaysia 5 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,000.00-MYR5,000.00 1 month ago Petaling Jaya, Selangor, Malaysia 5 days ago Petaling Jaya, Selangor, Malaysia 5 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Petaling Jaya, Selangor, Malaysia 5 days ago Petaling Jaya, Selangor, Malaysia 5 days ago Petaling Jaya, Selangor, Malaysia 5 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 8 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR3,800.00-MYR5,000.00 3 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 months ago Kota Damansara, Selangor, Malaysia 2 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR3,500.00-MYR4,000.00 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago Petaling Jaya, Selangor, Malaysia 2 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Big W Jobs