322 Dataengineer jobs in Malaysia

Big Data Engineer

Shirlyn Technology

Posted 6 days ago

Job Viewed

Tap Again To Close

Job Description

Position Summary

We are looking for a full-time Big Data Engineer II to join our team at Shirlyn Technology in Petaling Jaya, Malaysia and Palo Alto, California. The Big Data team is at the heart of our operations, playing a critical role in scaling and optimizing our data infrastructure. As we continue to grow, we are seeking an experienced and driven Big Data Engineer to help us tackle complex data challenges, enhance data solutions, and ensure the security and quality of our data systems. You will be instrumental in building and deploying scalable data pipelines to ensure seamless data flow across systems, driving business success through reliable data solutions.

Job Responsibilities

  • Collaborate with global teams in data, security, infrastructure, and business functions to understand data requirements and provide scalable solutions.
  • Design, implement, and maintain efficient ETL (Extract, Transform, Load) pipelines to enable smooth data flow between systems.
  • Conduct regular data quality checks to ensure accuracy, consistency, and completeness within our data pipelines.
  • Continuously improve data pipeline performance and reliability, identifying and addressing any inefficiencies or bottlenecks.
  • Ensure data integrity, security, privacy, and availability across all systems.
  • Proactively monitor data pipelines, quickly diagnosing issues and taking action to resolve them and maintain system uptime.
  • Conduct root cause analysis of data-related issues and work on long-term solutions to prevent recurring problems.
  • Document pipeline designs, data processes, and troubleshooting procedures, keeping stakeholders informed with clear communication of updates.
  • Provide on-call support for critical data operations, ensuring systems are running 24/7, with rotational responsibilities.

Job Requirements

  • Bachelor’s degree in Computer Science, Information Systems, or a related technical field.
  • 5+ years of hands-on experience building and optimizing data pipelines using big data technologies (Hive, Presto, Spark, Flink).
  • Expertise in writing complex SQL queries and proficiency in Python programming, focusing on maintainable and clean code.
  • Solid knowledge of scripting languages (e.g., Shell, Perl).
  • Experience working in Unix/Linux environments.
  • Familiarity with cloud platforms such as Azure, AWS, or GCP.
  • High personal integrity and professionalism in handling confidential information, exercising sound judgment.
  • Ability to remain calm and resolve issues swiftly during high-pressure situations, adhering to SLAs.
  • Strong leadership skills, including the ability to guide junior team members and lead projects across the team.
  • Excellent verbal and written communication skills, with the ability to collaborate effectively with remote teams globally.
#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Kelantan, Kelantan Shirlyn Technology

Posted 8 days ago

Job Viewed

Tap Again To Close

Job Description

Position Summary We are looking for a full-time Big Data Engineer II to join our team at Shirlyn Technology in Petaling Jaya, Malaysia and Palo Alto, California. The Big Data team is at the heart of our operations, playing a critical role in scaling and optimizing our data infrastructure. As we continue to grow, we are seeking an experienced and driven Big Data Engineer to help us tackle complex data challenges, enhance data solutions, and ensure the security and quality of our data systems. You will be instrumental in building and deploying scalable data pipelines to ensure seamless data flow across systems, driving business success through reliable data solutions. Job Responsibilities Collaborate with global teams in data, security, infrastructure, and business functions to understand data requirements and provide scalable solutions. Design, implement, and maintain efficient ETL (Extract, Transform, Load) pipelines to enable smooth data flow between systems. Conduct regular data quality checks to ensure accuracy, consistency, and completeness within our data pipelines. Continuously improve data pipeline performance and reliability, identifying and addressing any inefficiencies or bottlenecks. Ensure data integrity, security, privacy, and availability across all systems. Proactively monitor data pipelines, quickly diagnosing issues and taking action to resolve them and maintain system uptime. Conduct root cause analysis of data-related issues and work on long-term solutions to prevent recurring problems. Document pipeline designs, data processes, and troubleshooting procedures, keeping stakeholders informed with clear communication of updates. Provide on-call support for critical data operations, ensuring systems are running 24/7, with rotational responsibilities. Job Requirements Bachelor’s degree in Computer Science, Information Systems, or a related technical field. 5+ years of hands-on experience building and optimizing data pipelines using big data technologies (Hive, Presto, Spark, Flink). Expertise in writing complex SQL queries and proficiency in Python programming, focusing on maintainable and clean code. Solid knowledge of scripting languages (e.g., Shell, Perl). Experience working in Unix/Linux environments. Familiarity with cloud platforms such as Azure, AWS, or GCP. High personal integrity and professionalism in handling confidential information, exercising sound judgment. Ability to remain calm and resolve issues swiftly during high-pressure situations, adhering to SLAs. Strong leadership skills, including the ability to guide junior team members and lead projects across the team. Excellent verbal and written communication skills, with the ability to collaborate effectively with remote teams globally.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Kuala Lumpur, Kuala Lumpur NEAR

Posted 6 days ago

Job Viewed

Tap Again To Close

Job Description

Senior Java Engineer (Base Kuala Lumpur)

Job Advantages

Cutting-edge technology (web3 and blockchain), globalized company

Job Responsibilities

  1. Responsible for the architectural design and development of the company's data center.
  2. Continuously deliver data value to the company's businesses with high quality, low cost and high efficiency.
  3. Provide solutions for platform architecture and performance optimization, and lead the rapid iteration of big data platform.
  4. Enabling the rapid development of the company's business through data-driven approaches, continuously improving the company's core competitiveness.

Job Requirements

  1. Bachelor's degree or above in computer science or related majors, with more than 3 years of experience in Java development, proficient in Java development, and an in-depth understanding of JVM principles.
  2. Familiar with commonly used frameworks (Spring, Spring MVC, gRPC, Mybatis) and able to master their principles and mechanisms.
  3. Solid computer fundamentals, mastery of computer operating systems and network architecture, familiar with commonly used algorithms, data structures, and design patterns.
  4. Familiar with distributed systems, caching, messaging, and other mechanisms; experience with Redis, Kafka, Spark, Flink, Zookeeper, and TiDB is preferred.
  5. Experience in data center or microservice design and development, with a focus on high availability and scalability of architecture is preferred.
  6. Experience in tagging systems or algorithmic recommendation systems is preferred.
  7. Full of enthusiasm and expectation for the blockchain industry, committed to working hard for the development of the industry.
#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Kuala Lumpur, Kuala Lumpur Bybit

Posted 6 days ago

Job Viewed

Tap Again To Close

Job Description

Company : Web3 & Blockchain-focused Company

Job Advantages

  • Cutting-edge technology (Web3 and blockchain)
  • Globalized company

Job Responsibilities

As a Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include:

  • Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability.
  • Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs.
  • Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness.
  • Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output.

Job Requirements

We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria:

  • Education : Bachelor’s degree or above in Computer Science or related majors.
  • Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices.
  • Frameworks : Proficient in frameworks such as Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms.
  • Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns.
  • Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like Spark, Flink , and Zookeeper . Experience with TiDB is a plus.
  • Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability.
  • Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable.
  • Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development.

Why Join Us?

This role offers the opportunity to work at the forefront of blockchain and Web3 technologies within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you.

Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem!

Pioneer Talent Program - Organic Content Operations Crypto Operations Manager - Oregon, United States Crypto-Native UX Researcher (Remote - Jakarta, Indonesia) Web3 Head of Marketing and Communications (Remote) #J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Kuala Lumpur, Kuala Lumpur NEAR

Posted 8 days ago

Job Viewed

Tap Again To Close

Job Description

Senior Java Engineer (Base Kuala Lumpur) Job Advantages Cutting-edge technology (web3 and blockchain), globalized company Job Responsibilities Responsible for the architectural design and development of the company's data center. Continuously deliver data value to the company's businesses with high quality, low cost and high efficiency. Provide solutions for platform architecture and performance optimization, and lead the rapid iteration of big data platform. Enabling the rapid development of the company's business through data-driven approaches, continuously improving the company's core competitiveness. Job Requirements Bachelor's degree or above in computer science or related majors, with more than 3 years of experience in Java development, proficient in Java development, and an in-depth understanding of JVM principles. Familiar with commonly used frameworks (Spring, Spring MVC, gRPC, Mybatis) and able to master their principles and mechanisms. Solid computer fundamentals, mastery of computer operating systems and network architecture, familiar with commonly used algorithms, data structures, and design patterns. Familiar with distributed systems, caching, messaging, and other mechanisms; experience with Redis, Kafka, Spark, Flink, Zookeeper, and TiDB is preferred. Experience in data center or microservice design and development, with a focus on high availability and scalability of architecture is preferred. Experience in tagging systems or algorithmic recommendation systems is preferred. Full of enthusiasm and expectation for the blockchain industry, committed to working hard for the development of the industry.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Senior Big Data Engineer

Kuala Lumpur, Kuala Lumpur Bybit

Posted 8 days ago

Job Viewed

Tap Again To Close

Job Description

Company : Web3 & Blockchain-focused Company Job Advantages Cutting-edge technology (Web3 and blockchain) Globalized company Job Responsibilities As a

Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include: Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability. Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs. Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness. Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output. Job Requirements We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria: Education : Bachelor’s degree or above in Computer Science or related majors. Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices. Frameworks : Proficient in frameworks such as

Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms. Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns. Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like

Spark, Flink , and

Zookeeper . Experience with

TiDB

is a plus. Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability. Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable. Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development. Why Join Us? This role offers the opportunity to work at the forefront of

blockchain

and

Web3 technologies

within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you. Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem! Pioneer Talent Program - Organic Content Operations

Crypto Operations Manager - Oregon, United States

Crypto-Native UX Researcher (Remote - Jakarta, Indonesia)

Web3 Head of Marketing and Communications (Remote) #J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Assistant Manager - Big Data

Petaling Jaya, Selangor Sunway Digital Hub, Digital Technology Solutions & Group Cybersecurity

Posted 9 days ago

Job Viewed

Tap Again To Close

Job Description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Sunway Digital Hub, Digital Technology Solutions & Group Cybersecurity

You will be responsible for managing and analyzing large datasets to provide insights to support business decisions especially in the field of marketing / martech tools. You will be part of a team that designs, develops, and implements data solutions using cutting-edge technologies leveraging advanced analytics and machine learning techniques to optimize business performance. You will collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. You will also be responsible for optimizing data processes and ensuring data quality.

Responsibilities:

  • Design, build, and maintain big data systems with stakeholder requirements in mind.
  • Develop data processing solutions using technologies such as Hadoop, Spark, and Kafka and ensure data accuracy, consistency, and integrity.
  • Leverage advanced data science techniques (such as predictive modeling, clustering, regression, NLP, etc.) to extract actionable insights and build customer-centric data products.
  • Collaborate with cross-functional teams (marketing, engineering, product, etc.) to understand business needs and translate them into technical specifications for models and data solutions.
  • Ensure compliance with data privacy and security regulations during development
  • Stay current with industry trends in data science, big data technologies, and marketing technology to inform new approaches and solutions.

Requirements:

  • Experience working with big data technologies such as Spark (preferred), Hadoop, or Kafka.
  • Strong programming skills in languages such as Python, SQL, Terraform, or Docker. Pyspark is a plus.
  • Experience working with big data analytics platforms such as Huawei Cloud (DLI), Databricks, or Amazon EMR.
  • Familiarity with data warehousing concepts and technologies such as DWS (Huawei), Airflow, BigQuery, Redshift, or Snowflake.
  • Familiarity with data modelling (supervised training and unsupervised training)
  • Experience with data visualization tools such as PowerBI (preferred), Tableau or Qilksense
  • Proven experience in working with databases such as MSSQL (preferred), Postgres, and NoSQL.
  • Strong problem-solving skills and attention to detail.
  • Experience working in Agile development environments is a plus.
  • Experience in CDP / Martech tools / Marketing industry will be a plus
  • Manage and Lead a team of junior to deliver the task.
  • Leaves: Annual Leave, Medical Leave, Hospitalization Leave, Special Leave.
  • Medical Benefits – Sunway Medical Insurance for Outpatient & Inpatient inclusive for dependents.
  • Dental and Optical benefits for confirmed executive.
  • Group Term Life & Personal Accident Insurance Scheme.
  • Salary increment based on individual performance.
  • Bonus based on company & individual performance.
  • Career Development: Training and certification sponsored by the company, Annual Talent Review, Career Planning.
  • Rewards and recognition: Long Service Award.
  • Additional Benefits: Staff Discount (i.e. ThemePark, Hospitality, Education, Property, Medical, Retail, Food & Beverages), Sports and Recreational, Family Day, Annual Dinner, Flexible Working Arrangement for working mothers.
  • Hybrid Working Arrangement, Flexible Working Hours
  • Open communication. Young, energetic and fun working environment.

Are you ready to elevate your working skills and experience? Click the ‘Apply Now’ and you are one step ahead to an outstanding career.

Our recruitment team will reach out to shortlisted candidates only

Seniority level
  • Seniority level Mid-Senior level
Employment type
  • Employment type Full-time
Job function
  • Job function Information Technology and Consulting
  • Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at Sunway Digital Hub, Digital Technology Solutions & Group Cybersecurity by 2x

Sign in to set job alerts for “Data Scientist” roles.

Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 2 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR6,000.00-MYR8,000.00 2 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 23 hours ago

Data Scientist Lead - Advanced Analytics & Recommendations Artificial Intelligence (AI) Software Engineer (Gen AI, Python)

Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago

Mid Valley City, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Petaling Jaya, Selangor, Malaysia 2 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

Petaling Jaya, Selangor, Malaysia 2 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Bukit Jalil, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia $2,000.00-$,000.00 3 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2,000.00- 5,000.00 3 weeks ago

AI & Data - Data Scientist (GenAI), Experienced Hire

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 days ago

Petaling Jaya, Selangor, Malaysia 1 month ago

Petaling Jaya, Selangor, Malaysia 2 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 months ago

Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Federal Territory of Kuala Lumpur, Malaysia 1 week ago

AI & Data - Data Scientist, Experienced Associate/Senior Associate

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Dataengineer Jobs in Malaysia !

Lead Software Engineer (Big Data)

Kuala Lumpur, Kuala Lumpur EPAM Systems

Posted 9 days ago

Job Viewed

Tap Again To Close

Job Description

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Join or sign in to find your next job

Join to apply for the Lead Software Engineer (Big Data) role at EPAM Systems

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

1 week ago Be among the first 25 applicants

Join to apply for the Lead Software Engineer (Big Data) role at EPAM Systems

Get AI-powered advice on this job and more exclusive features.

Are you a highly skilled and motivated Data Software Engineer with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!

Responsibilities


  • Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies
  • Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks
  • Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions
  • Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals
  • Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions
  • Participate actively in code reviews and ensure adherence to best practices and coding standards
  • Foster a high-performance engineering culture, mentor team members and provide motivation and guidance
  • Maintain comprehensive project documentation to support development and operations


Requirements


  • 8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions
  • Proficiency in Python, Java, Scala, or Kotlin
  • Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals
  • Expert skills in SQL and relational algebra
  • Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies
  • Hands-on experience with modern Big Data components and data modeling
  • Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems
  • Deep understanding and practical application of CI/CD principles and best practices
  • Expertise in Docker and Kubernetes for containerization and resource management
  • Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture
  • Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations
  • Significant experience with high-load and IoT data platform architectures
  • Solid infrastructure troubleshooting skills
  • Practical experience in performance tuning, optimization and problem analysis
  • Advanced understanding of distributed computing principles
  • Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus
  • Excellent interpersonal, leadership and communication skills
  • Experience in direct customer communications and stakeholder management
  • Experience in technical leadership and mentoring within data-oriented projects
  • Ability to handle multiple projects in a fast-paced, startup-like agile development environment
  • Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA


We offer


  • By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
  • Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
  • You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
  • We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
  • At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us


Life at EPAM


  • EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
  • We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients

Seniority level
  • Seniority level Mid-Senior level
Employment type
  • Employment type Full-time
Job function
  • Job function Engineering, Information Technology, and Business Development
  • Industries Software Development and IT Services and IT Consulting

Referrals increase your chances of interviewing at EPAM Systems by 2x

Get notified about new Lead Software Engineer jobs in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia .

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago

Petaling Jaya, Selangor, Malaysia 1 day ago

WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago

Business Senior Analyst (Software Developer)

Petaling Jaya, Selangor, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Petaling Jaya, Selangor, Malaysia 3 months ago

Senior Manager, Full Stack Software Engineer (Staff Software Engineer)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Petaling Jaya, Selangor, Malaysia 7 months ago

Petaling Jaya, Selangor, Malaysia 4 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Federal Territory of Kuala Lumpur, Malaysia 5 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Bangsar South, Federal Territory of Kuala Lumpur, Malaysia 6 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,500.00-MYR8,000.00 2 months ago

Petaling Jaya, Selangor, Malaysia 2 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 hours ago

Petaling Jaya, Selangor, Malaysia 1 day ago

Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Senior/Staff Software Engineer, Custom Commerce

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Lead Software Engineer (Big Data)

Kuala Lumpur, Kuala Lumpur EPAM Systems

Posted 8 days ago

Job Viewed

Tap Again To Close

Job Description

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia Join or sign in to find your next job

Join to apply for the

Lead Software Engineer (Big Data)

role at

EPAM Systems EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Be among the first 25 applicants Join to apply for the

Lead Software Engineer (Big Data)

role at

EPAM Systems Get AI-powered advice on this job and more exclusive features. Are you a highly skilled and motivated

Data Software Engineer

with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!

Responsibilities

Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions Participate actively in code reviews and ensure adherence to best practices and coding standards Foster a high-performance engineering culture, mentor team members and provide motivation and guidance Maintain comprehensive project documentation to support development and operations

Requirements

8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions Proficiency in Python, Java, Scala, or Kotlin Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals Expert skills in SQL and relational algebra Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies Hands-on experience with modern Big Data components and data modeling Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems Deep understanding and practical application of CI/CD principles and best practices Expertise in Docker and Kubernetes for containerization and resource management Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations Significant experience with high-load and IoT data platform architectures Solid infrastructure troubleshooting skills Practical experience in performance tuning, optimization and problem analysis Advanced understanding of distributed computing principles Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus Excellent interpersonal, leadership and communication skills Experience in direct customer communications and stakeholder management Experience in technical leadership and mentoring within data-oriented projects Ability to handle multiple projects in a fast-paced, startup-like agile development environment Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA

We offer

By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

Life at EPAM

EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients

Seniority level

Seniority level Mid-Senior level Employment type

Employment type Full-time Job function

Job function Engineering, Information Technology, and Business Development Industries Software Development and IT Services and IT Consulting Referrals increase your chances of interviewing at EPAM Systems by 2x Get notified about new Lead Software Engineer jobs in

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia . Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago Petaling Jaya, Selangor, Malaysia 1 day ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Business Senior Analyst (Software Developer)

Petaling Jaya, Selangor, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Petaling Jaya, Selangor, Malaysia 3 months ago Senior Manager, Full Stack Software Engineer (Staff Software Engineer)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Petaling Jaya, Selangor, Malaysia 7 months ago Petaling Jaya, Selangor, Malaysia 4 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Federal Territory of Kuala Lumpur, Malaysia 5 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Federal Territory of Kuala Lumpur, Malaysia 1 week ago Bangsar South, Federal Territory of Kuala Lumpur, Malaysia 6 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,500.00-MYR8,000.00 2 months ago Petaling Jaya, Selangor, Malaysia 2 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 hours ago Petaling Jaya, Selangor, Malaysia 1 day ago Federal Territory of Kuala Lumpur, Malaysia 1 week ago Senior/Staff Software Engineer, Custom Commerce

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer (Spark, Flink, Java)

Kuala Lumpur, Kuala Lumpur Binance

Posted 1 day ago

Job Viewed

Tap Again To Close

Job Description

Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia

Join or sign in to find your next job

Join to apply for the Big Data Engineer (Spark, Flink, Java) role at Binance

Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia

6 days ago Be among the first 25 applicants

Join to apply for the Big Data Engineer (Spark, Flink, Java) role at Binance

Get AI-powered advice on this job and more exclusive features.

Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 250 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments, institutional services, Web3 features, and more. We leverage the power of digital assets and blockchain to build an inclusive financial ecosystem to advance the freedom of money and improve financial access for people around the world.

Responsibilities

  • Design and develop microservices architecture using Java Spring Boot, ensuring system performance, scalability, and reliability.
  • Implement and manage microservices components such as service discovery, configuration management, and load balancing with Spring Cloud.
  • Analyze, process, and explore data using big data technologies.
  • Optimize and manage data storage and retrieval systems like ES/HBase ensuring efficient data handling.
  • Work closely with business stakeholders to understand requirements and deliver data solutions that align with business goals.
  • Monitor, troubleshoot, and improve backend services to ensure smooth operation.
  • Participate in the full development lifecycle, including requirements gathering, system design, coding, testing, and deployment.
  • Maintain and enhance existing backend services, ensuring code quality and performance.
  • Collaborate with cross-functional teams to integrate data solutions into existing applications.

Requirements

  • Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
  • 8 years of professional experience in Java development, with a minimum of 3 years focused on Spring Boot microservices.
  • Expertise in designing and implementing Java Spring-based microservices architecture, with experience in Spring Cloud.
  • Hands-on experience with data development and big data technologies, including Hive, Spark and Flink
  • Familiar with and proficient in using components such as Apollo Configuration Center, Kafka Message Middleware, Xxl Job Scheduler, Pinpoint Link Tracking, and Prometheus Monitoring.
  • Proficient in optimizing and managing large-scale databases and data processing workflows.
  • Strong problem-solving skills, with a proven ability to troubleshoot and optimize backend services.
  • Excellent communication and teamwork skills, with the ability to work in a cross-functional environment.
  • Experience with CI/CD pipelines, such as Jenkins or GitLab CI, is a plus.
  • Knowledge of cloud services like AWS or is a plus.
  • Strong knowledge of financial or blockchain business models and processes, is a plus.

Why Binance

  • Shape the future with the world’s leading blockchain ecosystem
  • Collaborate with world-class talent in a user-centric global organization with a flat structure
  • Tackle unique, fast-paced projects with autonomy in an innovative environment
  • Thrive in a results-driven workplace with opportunities for career growth and continuous learning
  • Competitive salary and company benefits
  • Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)

Binance is committed to being an equal opportunity employer. We believe that having a diverse workforce is fundamental to our success.

By submitting a job application, you confirm that you have read and agree to our Candidate Privacy Notice .

Seniority level
  • Seniority level Mid-Senior level
Employment type
  • Employment type Full-time
Job function
  • Job function Information Technology and Engineering
  • Industries Technology, Information and Internet

Referrals increase your chances of interviewing at Binance by 2x

Sign in to set job alerts for “Big Data Developer” roles.

Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 days ago

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago

Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Binance Accelerator Program - Frontend Developer (Big Data)

Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 6 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Dataengineer Jobs