200 Big Data jobs in Kuala Lumpur

Company : Web3 & Blockchain-focused Company

Job Advantages

• Cutting-edge technology (Web3 and blockchain)
• Globalized company

Job Responsibilities

As a Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include:

• Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability.
• Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs.
• Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness.
• Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output.

Job Requirements

We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria:

• Education : Bachelor’s degree or above in Computer Science or related majors.
• Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices.
• Frameworks : Proficient in frameworks such as Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms.
• Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns.
• Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like Spark, Flink , and Zookeeper . Experience with TiDB is a plus.
• Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability.
• Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable.
• Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development.

Why Join Us?

This role offers the opportunity to work at the forefront of blockchain and Web3 technologies within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you.

Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem!

Pioneer Talent Program - Organic Content Operations Crypto Operations Manager - Oregon, United States Crypto-Native UX Researcher (Remote - Jakarta, Indonesia) Web3 Head of Marketing and Communications (Remote) #J-18808-Ljbffr

Senior Java Engineer (Base Kuala Lumpur) Job Advantages Cutting-edge technology (web3 and blockchain), globalized company Job Responsibilities Responsible for the architectural design and development of the company's data center. Continuously deliver data value to the company's businesses with high quality, low cost and high efficiency. Provide solutions for platform architecture and performance optimization, and lead the rapid iteration of big data platform. Enabling the rapid development of the company's business through data-driven approaches, continuously improving the company's core competitiveness. Job Requirements Bachelor's degree or above in computer science or related majors, with more than 3 years of experience in Java development, proficient in Java development, and an in-depth understanding of JVM principles. Familiar with commonly used frameworks (Spring, Spring MVC, gRPC, Mybatis) and able to master their principles and mechanisms. Solid computer fundamentals, mastery of computer operating systems and network architecture, familiar with commonly used algorithms, data structures, and design patterns. Familiar with distributed systems, caching, messaging, and other mechanisms; experience with Redis, Kafka, Spark, Flink, Zookeeper, and TiDB is preferred. Experience in data center or microservice design and development, with a focus on high availability and scalability of architecture is preferred. Experience in tagging systems or algorithmic recommendation systems is preferred. Full of enthusiasm and expectation for the blockchain industry, committed to working hard for the development of the industry.

#J-18808-Ljbffr

Company : Web3 & Blockchain-focused Company Job Advantages Cutting-edge technology (Web3 and blockchain) Globalized company Job Responsibilities As a

Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include: Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability. Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs. Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness. Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output. Job Requirements We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria: Education : Bachelor’s degree or above in Computer Science or related majors. Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices. Frameworks : Proficient in frameworks such as

Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms. Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns. Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like

Spark, Flink , and

Zookeeper . Experience with

TiDB

is a plus. Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability. Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable. Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development. Why Join Us? This role offers the opportunity to work at the forefront of

blockchain

and

Web3 technologies

within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you. Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem! Pioneer Talent Program - Organic Content Operations

Crypto Operations Manager - Oregon, United States

Crypto-Native UX Researcher (Remote - Jakarta, Indonesia)

Web3 Head of Marketing and Communications (Remote) #J-18808-Ljbffr

Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia

Join or sign in to find your next job

Join to apply for the Big Data Engineer (Spark, Flink, Java) role at Binance

Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia

6 days ago Be among the first 25 applicants

Join to apply for the Big Data Engineer (Spark, Flink, Java) role at Binance

Get AI-powered advice on this job and more exclusive features.

Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 250 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments, institutional services, Web3 features, and more. We leverage the power of digital assets and blockchain to build an inclusive financial ecosystem to advance the freedom of money and improve financial access for people around the world.

Responsibilities

• Design and develop microservices architecture using Java Spring Boot, ensuring system performance, scalability, and reliability.
• Implement and manage microservices components such as service discovery, configuration management, and load balancing with Spring Cloud.
• Analyze, process, and explore data using big data technologies.
• Optimize and manage data storage and retrieval systems like ES/HBase ensuring efficient data handling.
• Work closely with business stakeholders to understand requirements and deliver data solutions that align with business goals.
• Monitor, troubleshoot, and improve backend services to ensure smooth operation.
• Participate in the full development lifecycle, including requirements gathering, system design, coding, testing, and deployment.
• Maintain and enhance existing backend services, ensuring code quality and performance.
• Collaborate with cross-functional teams to integrate data solutions into existing applications.
  
  

Requirements

• Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
• 8 years of professional experience in Java development, with a minimum of 3 years focused on Spring Boot microservices.
• Expertise in designing and implementing Java Spring-based microservices architecture, with experience in Spring Cloud.
• Hands-on experience with data development and big data technologies, including Hive, Spark and Flink
• Familiar with and proficient in using components such as Apollo Configuration Center, Kafka Message Middleware, Xxl Job Scheduler, Pinpoint Link Tracking, and Prometheus Monitoring.
• Proficient in optimizing and managing large-scale databases and data processing workflows.
• Strong problem-solving skills, with a proven ability to troubleshoot and optimize backend services.
• Excellent communication and teamwork skills, with the ability to work in a cross-functional environment.
• Experience with CI/CD pipelines, such as Jenkins or GitLab CI, is a plus.
• Knowledge of cloud services like AWS or is a plus.
• Strong knowledge of financial or blockchain business models and processes, is a plus.
  
  

Why Binance

• Shape the future with the world’s leading blockchain ecosystem
• Collaborate with world-class talent in a user-centric global organization with a flat structure
• Tackle unique, fast-paced projects with autonomy in an innovative environment
• Thrive in a results-driven workplace with opportunities for career growth and continuous learning
• Competitive salary and company benefits
• Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)
  
  

Binance is committed to being an equal opportunity employer. We believe that having a diverse workforce is fundamental to our success.

By submitting a job application, you confirm that you have read and agree to our Candidate Privacy Notice .

Seniority level

• Seniority level Mid-Senior level

Employment type

• Employment type Full-time

Job function

• Job function Information Technology and Engineering
• Industries Technology, Information and Internet

Referrals increase your chances of interviewing at Binance by 2x

Sign in to set job alerts for “Big Data Developer” roles.

Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 days ago

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago

Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Binance Accelerator Program - Frontend Developer (Big Data)

Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 6 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia Join or sign in to find your next job

Join to apply for the

Big Data Engineer (Spark, Flink, Java)

role at

Binance Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 6 days ago Be among the first 25 applicants Join to apply for the

Big Data Engineer (Spark, Flink, Java)

role at

Binance Get AI-powered advice on this job and more exclusive features. Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 250 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments, institutional services, Web3 features, and more. We leverage the power of digital assets and blockchain to build an inclusive financial ecosystem to advance the freedom of money and improve financial access for people around the world.

Responsibilities

Design and develop microservices architecture using Java Spring Boot, ensuring system performance, scalability, and reliability. Implement and manage microservices components such as service discovery, configuration management, and load balancing with Spring Cloud. Analyze, process, and explore data using big data technologies. Optimize and manage data storage and retrieval systems like ES/HBase ensuring efficient data handling. Work closely with business stakeholders to understand requirements and deliver data solutions that align with business goals. Monitor, troubleshoot, and improve backend services to ensure smooth operation. Participate in the full development lifecycle, including requirements gathering, system design, coding, testing, and deployment. Maintain and enhance existing backend services, ensuring code quality and performance. Collaborate with cross-functional teams to integrate data solutions into existing applications.

Requirements

Bachelor's or Master’s degree in Computer Science, Engineering, or a related field. 8 years of professional experience in Java development, with a minimum of 3 years focused on Spring Boot microservices. Expertise in designing and implementing Java Spring-based microservices architecture, with experience in Spring Cloud. Hands-on experience with data development and big data technologies, including Hive, Spark and Flink Familiar with and proficient in using components such as Apollo Configuration Center, Kafka Message Middleware, Xxl Job Scheduler, Pinpoint Link Tracking, and Prometheus Monitoring. Proficient in optimizing and managing large-scale databases and data processing workflows. Strong problem-solving skills, with a proven ability to troubleshoot and optimize backend services. Excellent communication and teamwork skills, with the ability to work in a cross-functional environment. Experience with CI/CD pipelines, such as Jenkins or GitLab CI, is a plus. Knowledge of cloud services like AWS or is a plus. Strong knowledge of financial or blockchain business models and processes, is a plus.

Why Binance

Shape the future with the world’s leading blockchain ecosystem Collaborate with world-class talent in a user-centric global organization with a flat structure Tackle unique, fast-paced projects with autonomy in an innovative environment Thrive in a results-driven workplace with opportunities for career growth and continuous learning Competitive salary and company benefits Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)

Binance is committed to being an equal opportunity employer. We believe that having a diverse workforce is fundamental to our success.

By submitting a job application, you confirm that you have read and agree to our

Candidate Privacy Notice

. Seniority level

Seniority level Mid-Senior level Employment type

Employment type Full-time Job function

Job function Information Technology and Engineering Industries Technology, Information and Internet Referrals increase your chances of interviewing at Binance by 2x Sign in to set job alerts for “Big Data Developer” roles.

Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 days ago Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Binance Accelerator Program - Frontend Developer (Big Data)

Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 6 days ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Join or sign in to find your next job

Join to apply for the Lead Software Engineer (Big Data) role at EPAM Systems

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

1 week ago Be among the first 25 applicants

Join to apply for the Lead Software Engineer (Big Data) role at EPAM Systems

Get AI-powered advice on this job and more exclusive features.

Are you a highly skilled and motivated Data Software Engineer with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!

Responsibilities

• Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies
• Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks
• Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions
• Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals
• Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions
• Participate actively in code reviews and ensure adherence to best practices and coding standards
• Foster a high-performance engineering culture, mentor team members and provide motivation and guidance
• Maintain comprehensive project documentation to support development and operations
  
  
  

Requirements

• 8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions
• Proficiency in Python, Java, Scala, or Kotlin
• Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals
• Expert skills in SQL and relational algebra
• Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies
• Hands-on experience with modern Big Data components and data modeling
• Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems
• Deep understanding and practical application of CI/CD principles and best practices
• Expertise in Docker and Kubernetes for containerization and resource management
• Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture
• Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations
• Significant experience with high-load and IoT data platform architectures
• Solid infrastructure troubleshooting skills
• Practical experience in performance tuning, optimization and problem analysis
• Advanced understanding of distributed computing principles
• Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus
• Excellent interpersonal, leadership and communication skills
• Experience in direct customer communications and stakeholder management
• Experience in technical leadership and mentoring within data-oriented projects
• Ability to handle multiple projects in a fast-paced, startup-like agile development environment
• Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA
  
  
  

We offer

• By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
  
  
  

Life at EPAM

• EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
• We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients

Seniority level

• Seniority level Mid-Senior level

Employment type

• Employment type Full-time

Job function

• Job function Engineering, Information Technology, and Business Development
• Industries Software Development and IT Services and IT Consulting

Referrals increase your chances of interviewing at EPAM Systems by 2x

Get notified about new Lead Software Engineer jobs in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia .

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago

Petaling Jaya, Selangor, Malaysia 1 day ago

WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago

Business Senior Analyst (Software Developer)

Petaling Jaya, Selangor, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago

Petaling Jaya, Selangor, Malaysia 3 months ago

Senior Manager, Full Stack Software Engineer (Staff Software Engineer)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Petaling Jaya, Selangor, Malaysia 7 months ago

Petaling Jaya, Selangor, Malaysia 4 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Federal Territory of Kuala Lumpur, Malaysia 5 days ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago

Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Bangsar South, Federal Territory of Kuala Lumpur, Malaysia 6 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,500.00-MYR8,000.00 2 months ago

Petaling Jaya, Selangor, Malaysia 2 months ago

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 hours ago

Petaling Jaya, Selangor, Malaysia 1 day ago

Federal Territory of Kuala Lumpur, Malaysia 1 week ago

Senior/Staff Software Engineer, Custom Commerce

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia Join or sign in to find your next job

Join to apply for the

Lead Software Engineer (Big Data)

role at

EPAM Systems EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Be among the first 25 applicants Join to apply for the

Lead Software Engineer (Big Data)

role at

EPAM Systems Get AI-powered advice on this job and more exclusive features. Are you a highly skilled and motivated

Data Software Engineer

with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!

Responsibilities

Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions Participate actively in code reviews and ensure adherence to best practices and coding standards Foster a high-performance engineering culture, mentor team members and provide motivation and guidance Maintain comprehensive project documentation to support development and operations

Requirements

8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions Proficiency in Python, Java, Scala, or Kotlin Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals Expert skills in SQL and relational algebra Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies Hands-on experience with modern Big Data components and data modeling Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems Deep understanding and practical application of CI/CD principles and best practices Expertise in Docker and Kubernetes for containerization and resource management Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations Significant experience with high-load and IoT data platform architectures Solid infrastructure troubleshooting skills Practical experience in performance tuning, optimization and problem analysis Advanced understanding of distributed computing principles Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus Excellent interpersonal, leadership and communication skills Experience in direct customer communications and stakeholder management Experience in technical leadership and mentoring within data-oriented projects Ability to handle multiple projects in a fast-paced, startup-like agile development environment Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA

We offer

By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

Life at EPAM

EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients

Seniority level

Seniority level Mid-Senior level Employment type

Employment type Full-time Job function

Job function Engineering, Information Technology, and Business Development Industries Software Development and IT Services and IT Consulting Referrals increase your chances of interviewing at EPAM Systems by 2x Get notified about new Lead Software Engineer jobs in

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia . Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago Petaling Jaya, Selangor, Malaysia 1 day ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Business Senior Analyst (Software Developer)

Petaling Jaya, Selangor, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Petaling Jaya, Selangor, Malaysia 3 months ago Senior Manager, Full Stack Software Engineer (Staff Software Engineer)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Petaling Jaya, Selangor, Malaysia 7 months ago Petaling Jaya, Selangor, Malaysia 4 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Federal Territory of Kuala Lumpur, Malaysia 5 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Federal Territory of Kuala Lumpur, Malaysia 1 week ago Bangsar South, Federal Territory of Kuala Lumpur, Malaysia 6 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,500.00-MYR8,000.00 2 months ago Petaling Jaya, Selangor, Malaysia 2 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 hours ago Petaling Jaya, Selangor, Malaysia 1 day ago Federal Territory of Kuala Lumpur, Malaysia 1 week ago Senior/Staff Software Engineer, Custom Commerce

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

The Deputy Manager of Engineering (Data Engineers) is responsible for developing, testing, and maintaining ETL (Extract, Transform, Load) processes and designing data pipelines using modern tools such as Apache Airflow and Apache Kafka, which are currently used by the CDX Data team. The role ensures data quality and integrity across all data stores, collaborates with DevOps to deploy and monitor data infrastructure, and manages data storage solutions including Data Lakes, Data Warehouses, and Big Lakes. The Deputy Manager is also expected to perform data mining and advanced statistical analysis for various CDX Product projects.

Duties and Responsibilities

1. Develop, test, and maintain ETL processes.
2. Design and implement data pipelines using tools like Apache Airflow and Kafka.
3. Ensure data quality and integrity across data stores.
4. Collaborate with DevOps to deploy and monitor data infrastructure.
5. Manage and optimize data storage solutions, including Data Lakes, Data Warehouses, and Big Lakes.
6. Ensure high availability and disaster recovery of data infrastructure.
7. Implement and manage scalable cloud-based data solutions.
8. Perform exploratory data analysis to identify trends and patterns.
9. Create and maintain dashboards and reports using BI tools such as Tableau and Power BI.
10. Work with stakeholders to gather requirements and deliver analytical solutions.
11. Build and deploy machine learning models to address business problems.
12. Perform data mining and advanced statistical analysis.
13. Collaborate with data engineers to ensure models are integrated into production.
14. Manage data stewardship programs, ensuring data lineage and metadata management.
15. Monitor and improve data quality across the data ecosystem.
16. Implement data quality checks and validation routines.
17. Work with teams to resolve data quality issues and maintain data standards.
18. Automate deployment of data applications and infrastructure.

Additional responsibilities include monitoring system performance, troubleshooting issues, and ensuring data system availability.

Qualifications

Bachelor's degree in Computer Science or related discipline or equivalent experience. Minimum of 2 years in application development/support and 1 year in management.

Experience

Over 2 years in application development/support; over 2 years in banking and management.

Skills, Knowledge, and Certifications

Supervisory experience, project planning and control skills, strategic application approach, excellent communication skills, a proactive "Make-it-happen-fast" attitude, hands-on expertise, and respect from Business Department Heads.

#J-18808-Ljbffr

ROCKWOOL is seeking a (Senior) Data Engineer to join our global Data Science & Engineering team . Based in Malaysia, you will play a critical role in supporting and developing our global data platform, which collects and processes IoT factory data across our international operations. The current platform is built on Azure and leverages Databricks, Airflow, Docker, Blob Storage, and MongoDB . Future initiatives include migrating to a modern architecture involving Azure EventHub, Databricks, and Kafka .

You will be part of the operational arm of a global team, collaborating closely with colleagues in Poland and Denmark , as well as local team members in Malaysia consisting of Data Engineers, ML Engineers, and Data Scientists .

Key Responsibilities:

• Develop and maintain robust data pipelines for ingesting and transforming factory and IoT data.
• Contribute to platform improvements including automation, CI/CD processes, data governance, and monitoring.
• Address technical challenges and implement scalable and efficient features.
• Support upcoming migrations to new technologies such as Databricks, Azure EventHub, and Kafka .
• Collaborate across distributed teams and communicate effectively with global stakeholders.
• Document solutions and promote knowledge sharing across teams.

Required Qualifications:

Technical Skills:

• 5+ years of experience in Data Engineering, with a focus on ETL, data integration , and data warehousing .
• Proficiency in Databricks and Apache Spark .
• Solid experience working with Azure cloud services.
• Strong programming skills in Python .
• Familiarity with DevOps/DataOps practices.

Communication:

• Strong communication skills in English (C1 level) .

Personal Attributes:

• Self-motivated and capable of independently driving tasks to completion.
• Proactive in identifying and proposing effective solutions.
• Strong collaboration skills with both technical and non-technical stakeholders.

Preferred Qualifications (Big Advantages):

• Experience with MongoDB or other NoSQL databases.
• Knowledge of Airflow or similar workflow orchestration tools.
• Proficiency in Docker and containerization practices.
• Familiarity with advanced Databricks features like Unity Catalog or Delta Live Tables (DLT) .
• Strong SQL expertise and experience with both on-prem and cloud database management.
• Understanding of programming fundamentals, algorithms, and data structures.
• Experience with Git (preferably GitHub) and version control best practices.
• Solid grasp of modern data architecture concepts: data lakes, data vaults, and warehouses.
• Working knowledge of Infrastructure-as-Code (IaC) tools, preferably Terraform .
• Familiarity with productivity-enhancing tools like ChatGPT and GitHub Copilot .

Nice to Have:

• Experience with data modeling .
• Proficiency in additional languages such as C#, Java, Scala .
• Familiarity with DBT , Snowflake , or Kafka .

Other Expectations:

• Experience working with Scrum/Kanban methodologies and tools like Jira .
• Ability to gather requirements independently and work closely with business users.
• Proven experience working in international, cross-functional teams .

#J-18808-Ljbffr