202 Big Data jobs in Kuala Lumpur
Data Engineer
Posted 7 days ago
Job Viewed
Job Description
#J-18808-Ljbffr
Senior Big Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Company : Web3 & Blockchain-focused Company
Job Advantages
- Cutting-edge technology (Web3 and blockchain)
- Globalized company
Job Responsibilities
As a Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include:
- Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability.
- Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs.
- Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness.
- Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output.
Job Requirements
We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria:
- Education : Bachelor’s degree or above in Computer Science or related majors.
- Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices.
- Frameworks : Proficient in frameworks such as Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms.
- Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns.
- Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like Spark, Flink , and Zookeeper . Experience with TiDB is a plus.
- Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability.
- Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable.
- Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development.
Why Join Us?
This role offers the opportunity to work at the forefront of blockchain and Web3 technologies within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you.
Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem!
Pioneer Talent Program - Organic Content Operations Crypto Operations Manager - Oregon, United States Crypto-Native UX Researcher (Remote - Jakarta, Indonesia) Web3 Head of Marketing and Communications (Remote) #J-18808-LjbffrSenior Big Data Engineer
Posted 7 days ago
Job Viewed
Job Description
#J-18808-Ljbffr
Senior Big Data Engineer
Posted 7 days ago
Job Viewed
Job Description
Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include: Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability. Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs. Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness. Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output. Job Requirements We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria: Education : Bachelor’s degree or above in Computer Science or related majors. Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices. Frameworks : Proficient in frameworks such as
Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms. Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns. Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like
Spark, Flink , and
Zookeeper . Experience with
TiDB
is a plus. Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability. Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable. Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development. Why Join Us? This role offers the opportunity to work at the forefront of
blockchain
and
Web3 technologies
within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you. Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem! Pioneer Talent Program - Organic Content Operations
Crypto Operations Manager - Oregon, United States
Crypto-Native UX Researcher (Remote - Jakarta, Indonesia)
Web3 Head of Marketing and Communications (Remote) #J-18808-Ljbffr
Big Data Engineer (Spark, Flink, Java)
Posted 28 days ago
Job Viewed
Job Description
Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia
Join or sign in to find your next jobJoin to apply for the Big Data Engineer (Spark, Flink, Java) role at Binance
Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia
6 days ago Be among the first 25 applicants
Join to apply for the Big Data Engineer (Spark, Flink, Java) role at Binance
Get AI-powered advice on this job and more exclusive features.
Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 250 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments, institutional services, Web3 features, and more. We leverage the power of digital assets and blockchain to build an inclusive financial ecosystem to advance the freedom of money and improve financial access for people around the world.
Responsibilities
- Design and develop microservices architecture using Java Spring Boot, ensuring system performance, scalability, and reliability.
- Implement and manage microservices components such as service discovery, configuration management, and load balancing with Spring Cloud.
- Analyze, process, and explore data using big data technologies.
- Optimize and manage data storage and retrieval systems like ES/HBase ensuring efficient data handling.
- Work closely with business stakeholders to understand requirements and deliver data solutions that align with business goals.
- Monitor, troubleshoot, and improve backend services to ensure smooth operation.
- Participate in the full development lifecycle, including requirements gathering, system design, coding, testing, and deployment.
- Maintain and enhance existing backend services, ensuring code quality and performance.
- Collaborate with cross-functional teams to integrate data solutions into existing applications.
- Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
- 8 years of professional experience in Java development, with a minimum of 3 years focused on Spring Boot microservices.
- Expertise in designing and implementing Java Spring-based microservices architecture, with experience in Spring Cloud.
- Hands-on experience with data development and big data technologies, including Hive, Spark and Flink
- Familiar with and proficient in using components such as Apollo Configuration Center, Kafka Message Middleware, Xxl Job Scheduler, Pinpoint Link Tracking, and Prometheus Monitoring.
- Proficient in optimizing and managing large-scale databases and data processing workflows.
- Strong problem-solving skills, with a proven ability to troubleshoot and optimize backend services.
- Excellent communication and teamwork skills, with the ability to work in a cross-functional environment.
- Experience with CI/CD pipelines, such as Jenkins or GitLab CI, is a plus.
- Knowledge of cloud services like AWS or is a plus.
- Strong knowledge of financial or blockchain business models and processes, is a plus.
- Shape the future with the world’s leading blockchain ecosystem
- Collaborate with world-class talent in a user-centric global organization with a flat structure
- Tackle unique, fast-paced projects with autonomy in an innovative environment
- Thrive in a results-driven workplace with opportunities for career growth and continuous learning
- Competitive salary and company benefits
- Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)
By submitting a job application, you confirm that you have read and agree to our Candidate Privacy Notice . Seniority level
- Seniority level Mid-Senior level
- Employment type Full-time
- Job function Information Technology and Engineering
- Industries Technology, Information and Internet
Referrals increase your chances of interviewing at Binance by 2x
Sign in to set job alerts for “Big Data Developer” roles.Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 days ago
Python and Kubernetes Software Engineer - Data, AI/ML & AnalyticsKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago
Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & AnalyticsKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Binance Accelerator Program - Frontend Developer (Big Data)Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 6 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrBig Data Engineer (Spark, Flink, Java)
Posted 27 days ago
Job Viewed
Job Description
Join to apply for the
Big Data Engineer (Spark, Flink, Java)
role at
Binance Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 6 days ago Be among the first 25 applicants Join to apply for the
Big Data Engineer (Spark, Flink, Java)
role at
Binance Get AI-powered advice on this job and more exclusive features. Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 250 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments, institutional services, Web3 features, and more. We leverage the power of digital assets and blockchain to build an inclusive financial ecosystem to advance the freedom of money and improve financial access for people around the world.
Responsibilities
Design and develop microservices architecture using Java Spring Boot, ensuring system performance, scalability, and reliability. Implement and manage microservices components such as service discovery, configuration management, and load balancing with Spring Cloud. Analyze, process, and explore data using big data technologies. Optimize and manage data storage and retrieval systems like ES/HBase ensuring efficient data handling. Work closely with business stakeholders to understand requirements and deliver data solutions that align with business goals. Monitor, troubleshoot, and improve backend services to ensure smooth operation. Participate in the full development lifecycle, including requirements gathering, system design, coding, testing, and deployment. Maintain and enhance existing backend services, ensuring code quality and performance. Collaborate with cross-functional teams to integrate data solutions into existing applications.
Requirements
Bachelor's or Master’s degree in Computer Science, Engineering, or a related field. 8 years of professional experience in Java development, with a minimum of 3 years focused on Spring Boot microservices. Expertise in designing and implementing Java Spring-based microservices architecture, with experience in Spring Cloud. Hands-on experience with data development and big data technologies, including Hive, Spark and Flink Familiar with and proficient in using components such as Apollo Configuration Center, Kafka Message Middleware, Xxl Job Scheduler, Pinpoint Link Tracking, and Prometheus Monitoring. Proficient in optimizing and managing large-scale databases and data processing workflows. Strong problem-solving skills, with a proven ability to troubleshoot and optimize backend services. Excellent communication and teamwork skills, with the ability to work in a cross-functional environment. Experience with CI/CD pipelines, such as Jenkins or GitLab CI, is a plus. Knowledge of cloud services like AWS or is a plus. Strong knowledge of financial or blockchain business models and processes, is a plus.
Why Binance
Shape the future with the world’s leading blockchain ecosystem Collaborate with world-class talent in a user-centric global organization with a flat structure Tackle unique, fast-paced projects with autonomy in an innovative environment Thrive in a results-driven workplace with opportunities for career growth and continuous learning Competitive salary and company benefits Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)
Binance is committed to being an equal opportunity employer. We believe that having a diverse workforce is fundamental to our success.
By submitting a job application, you confirm that you have read and agree to our
Candidate Privacy Notice
. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Information Technology and Engineering Industries Technology, Information and Internet Referrals increase your chances of interviewing at Binance by 2x Sign in to set job alerts for “Big Data Developer” roles.
Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 days ago Python and Kubernetes Software Engineer - Data, AI/ML & Analytics
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Binance Accelerator Program - Frontend Developer (Big Data)
Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 6 days ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Lead Software Engineer (Big Data)
Posted 8 days ago
Job Viewed
Job Description
EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Join or sign in to find your next jobJoin to apply for the Lead Software Engineer (Big Data) role at EPAM Systems
EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
1 week ago Be among the first 25 applicants
Join to apply for the Lead Software Engineer (Big Data) role at EPAM Systems
Get AI-powered advice on this job and more exclusive features.
Are you a highly skilled and motivated Data Software Engineer with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!
Responsibilities
- Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies
- Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks
- Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions
- Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals
- Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions
- Participate actively in code reviews and ensure adherence to best practices and coding standards
- Foster a high-performance engineering culture, mentor team members and provide motivation and guidance
- Maintain comprehensive project documentation to support development and operations
- 8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions
- Proficiency in Python, Java, Scala, or Kotlin
- Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals
- Expert skills in SQL and relational algebra
- Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies
- Hands-on experience with modern Big Data components and data modeling
- Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems
- Deep understanding and practical application of CI/CD principles and best practices
- Expertise in Docker and Kubernetes for containerization and resource management
- Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture
- Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations
- Significant experience with high-load and IoT data platform architectures
- Solid infrastructure troubleshooting skills
- Practical experience in performance tuning, optimization and problem analysis
- Advanced understanding of distributed computing principles
- Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus
- Excellent interpersonal, leadership and communication skills
- Experience in direct customer communications and stakeholder management
- Experience in technical leadership and mentoring within data-oriented projects
- Ability to handle multiple projects in a fast-paced, startup-like agile development environment
- Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA
- By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
- EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
- We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients
- Seniority level Mid-Senior level
- Employment type Full-time
- Job function Engineering, Information Technology, and Business Development
- Industries Software Development and IT Services and IT Consulting
Referrals increase your chances of interviewing at EPAM Systems by 2x
Get notified about new Lead Software Engineer jobs in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia .
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago
Petaling Jaya, Selangor, Malaysia 1 day ago
WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago
Business Senior Analyst (Software Developer)Petaling Jaya, Selangor, Malaysia 1 month ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago
Petaling Jaya, Selangor, Malaysia 3 months ago
Senior Manager, Full Stack Software Engineer (Staff Software Engineer)Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Petaling Jaya, Selangor, Malaysia 7 months ago
Petaling Jaya, Selangor, Malaysia 4 days ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Federal Territory of Kuala Lumpur, Malaysia 5 days ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Bangsar South, Federal Territory of Kuala Lumpur, Malaysia 6 months ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,500.00-MYR8,000.00 2 months ago
Petaling Jaya, Selangor, Malaysia 2 months ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 hours ago
Petaling Jaya, Selangor, Malaysia 1 day ago
Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Senior/Staff Software Engineer, Custom CommerceKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrBe The First To Know
About the latest Big data jobs in Kuala Lumpur !
Lead Software Engineer (Big Data)
Posted 7 days ago
Job Viewed
Job Description
Join to apply for the
Lead Software Engineer (Big Data)
role at
EPAM Systems EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Be among the first 25 applicants Join to apply for the
Lead Software Engineer (Big Data)
role at
EPAM Systems Get AI-powered advice on this job and more exclusive features. Are you a highly skilled and motivated
Data Software Engineer
with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!
Responsibilities
Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions Participate actively in code reviews and ensure adherence to best practices and coding standards Foster a high-performance engineering culture, mentor team members and provide motivation and guidance Maintain comprehensive project documentation to support development and operations
Requirements
8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions Proficiency in Python, Java, Scala, or Kotlin Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals Expert skills in SQL and relational algebra Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies Hands-on experience with modern Big Data components and data modeling Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems Deep understanding and practical application of CI/CD principles and best practices Expertise in Docker and Kubernetes for containerization and resource management Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations Significant experience with high-load and IoT data platform architectures Solid infrastructure troubleshooting skills Practical experience in performance tuning, optimization and problem analysis Advanced understanding of distributed computing principles Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus Excellent interpersonal, leadership and communication skills Experience in direct customer communications and stakeholder management Experience in technical leadership and mentoring within data-oriented projects Ability to handle multiple projects in a fast-paced, startup-like agile development environment Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA
We offer
By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
Life at EPAM
EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients
Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Engineering, Information Technology, and Business Development Industries Software Development and IT Services and IT Consulting Referrals increase your chances of interviewing at EPAM Systems by 2x Get notified about new Lead Software Engineer jobs in
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia . Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago Petaling Jaya, Selangor, Malaysia 1 day ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Business Senior Analyst (Software Developer)
Petaling Jaya, Selangor, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Petaling Jaya, Selangor, Malaysia 3 months ago Senior Manager, Full Stack Software Engineer (Staff Software Engineer)
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Petaling Jaya, Selangor, Malaysia 7 months ago Petaling Jaya, Selangor, Malaysia 4 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Federal Territory of Kuala Lumpur, Malaysia 5 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Federal Territory of Kuala Lumpur, Malaysia 1 week ago Bangsar South, Federal Territory of Kuala Lumpur, Malaysia 6 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,500.00-MYR8,000.00 2 months ago Petaling Jaya, Selangor, Malaysia 2 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 hours ago Petaling Jaya, Selangor, Malaysia 1 day ago Federal Territory of Kuala Lumpur, Malaysia 1 week ago Senior/Staff Software Engineer, Custom Commerce
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Data Engineer
Posted today
Job Viewed
Job Description
The Deputy Manager of Engineering (Data Engineers) is responsible for developing, testing, and maintaining ETL (Extract, Transform, Load) processes and designing data pipelines using modern tools such as Apache Airflow and Apache Kafka, which are currently used by the CDX Data team. The role ensures data quality and integrity across all data stores, collaborates with DevOps to deploy and monitor data infrastructure, and manages data storage solutions including Data Lakes, Data Warehouses, and Big Lakes. The Deputy Manager is also expected to perform data mining and advanced statistical analysis for various CDX Product projects.
Duties and Responsibilities- Develop, test, and maintain ETL processes.
- Design and implement data pipelines using tools like Apache Airflow and Kafka.
- Ensure data quality and integrity across data stores.
- Collaborate with DevOps to deploy and monitor data infrastructure.
- Manage and optimize data storage solutions, including Data Lakes, Data Warehouses, and Big Lakes.
- Ensure high availability and disaster recovery of data infrastructure.
- Implement and manage scalable cloud-based data solutions.
- Perform exploratory data analysis to identify trends and patterns.
- Create and maintain dashboards and reports using BI tools such as Tableau and Power BI.
- Work with stakeholders to gather requirements and deliver analytical solutions.
- Build and deploy machine learning models to address business problems.
- Perform data mining and advanced statistical analysis.
- Collaborate with data engineers to ensure models are integrated into production.
- Manage data stewardship programs, ensuring data lineage and metadata management.
- Monitor and improve data quality across the data ecosystem.
- Implement data quality checks and validation routines.
- Work with teams to resolve data quality issues and maintain data standards.
- Automate deployment of data applications and infrastructure.
Additional responsibilities include monitoring system performance, troubleshooting issues, and ensuring data system availability.
QualificationsBachelor's degree in Computer Science or related discipline or equivalent experience. Minimum of 2 years in application development/support and 1 year in management.
ExperienceOver 2 years in application development/support; over 2 years in banking and management.
Skills, Knowledge, and CertificationsSupervisory experience, project planning and control skills, strategic application approach, excellent communication skills, a proactive "Make-it-happen-fast" attitude, hands-on expertise, and respect from Business Department Heads.
#J-18808-LjbffrData Engineer
Posted today
Job Viewed
Job Description
ROCKWOOL is seeking a (Senior) Data Engineer to join our global Data Science & Engineering team . Based in Malaysia, you will play a critical role in supporting and developing our global data platform, which collects and processes IoT factory data across our international operations. The current platform is built on Azure and leverages Databricks, Airflow, Docker, Blob Storage, and MongoDB . Future initiatives include migrating to a modern architecture involving Azure EventHub, Databricks, and Kafka .
You will be part of the operational arm of a global team, collaborating closely with colleagues in Poland and Denmark , as well as local team members in Malaysia consisting of Data Engineers, ML Engineers, and Data Scientists .
Key Responsibilities:- Develop and maintain robust data pipelines for ingesting and transforming factory and IoT data.
- Contribute to platform improvements including automation, CI/CD processes, data governance, and monitoring.
- Address technical challenges and implement scalable and efficient features.
- Support upcoming migrations to new technologies such as Databricks, Azure EventHub, and Kafka .
- Collaborate across distributed teams and communicate effectively with global stakeholders.
- Document solutions and promote knowledge sharing across teams.
Technical Skills:
- 5+ years of experience in Data Engineering, with a focus on ETL, data integration , and data warehousing .
- Proficiency in Databricks and Apache Spark .
- Solid experience working with Azure cloud services.
- Strong programming skills in Python .
- Familiarity with DevOps/DataOps practices.
Communication:
- Strong communication skills in English (C1 level) .
Personal Attributes:
- Self-motivated and capable of independently driving tasks to completion.
- Proactive in identifying and proposing effective solutions.
- Strong collaboration skills with both technical and non-technical stakeholders.
- Experience with MongoDB or other NoSQL databases.
- Knowledge of Airflow or similar workflow orchestration tools.
- Proficiency in Docker and containerization practices.
- Familiarity with advanced Databricks features like Unity Catalog or Delta Live Tables (DLT) .
- Strong SQL expertise and experience with both on-prem and cloud database management.
- Understanding of programming fundamentals, algorithms, and data structures.
- Experience with Git (preferably GitHub) and version control best practices.
- Solid grasp of modern data architecture concepts: data lakes, data vaults, and warehouses.
- Working knowledge of Infrastructure-as-Code (IaC) tools, preferably Terraform .
- Familiarity with productivity-enhancing tools like ChatGPT and GitHub Copilot .
- Experience with data modeling .
- Proficiency in additional languages such as C#, Java, Scala .
- Familiarity with DBT , Snowflake , or Kafka .
- Experience working with Scrum/Kanban methodologies and tools like Jira .
- Ability to gather requirements independently and work closely with business users.
- Proven experience working in international, cross-functional teams .