322 Dataengineer jobs in Malaysia
Big Data Engineer
Posted 6 days ago
Job Viewed
Job Description
Position Summary
We are looking for a full-time Big Data Engineer II to join our team at Shirlyn Technology in Petaling Jaya, Malaysia and Palo Alto, California. The Big Data team is at the heart of our operations, playing a critical role in scaling and optimizing our data infrastructure. As we continue to grow, we are seeking an experienced and driven Big Data Engineer to help us tackle complex data challenges, enhance data solutions, and ensure the security and quality of our data systems. You will be instrumental in building and deploying scalable data pipelines to ensure seamless data flow across systems, driving business success through reliable data solutions.
Job Responsibilities
- Collaborate with global teams in data, security, infrastructure, and business functions to understand data requirements and provide scalable solutions.
- Design, implement, and maintain efficient ETL (Extract, Transform, Load) pipelines to enable smooth data flow between systems.
- Conduct regular data quality checks to ensure accuracy, consistency, and completeness within our data pipelines.
- Continuously improve data pipeline performance and reliability, identifying and addressing any inefficiencies or bottlenecks.
- Ensure data integrity, security, privacy, and availability across all systems.
- Proactively monitor data pipelines, quickly diagnosing issues and taking action to resolve them and maintain system uptime.
- Conduct root cause analysis of data-related issues and work on long-term solutions to prevent recurring problems.
- Document pipeline designs, data processes, and troubleshooting procedures, keeping stakeholders informed with clear communication of updates.
- Provide on-call support for critical data operations, ensuring systems are running 24/7, with rotational responsibilities.
Job Requirements
- Bachelor’s degree in Computer Science, Information Systems, or a related technical field.
- 5+ years of hands-on experience building and optimizing data pipelines using big data technologies (Hive, Presto, Spark, Flink).
- Expertise in writing complex SQL queries and proficiency in Python programming, focusing on maintainable and clean code.
- Solid knowledge of scripting languages (e.g., Shell, Perl).
- Experience working in Unix/Linux environments.
- Familiarity with cloud platforms such as Azure, AWS, or GCP.
- High personal integrity and professionalism in handling confidential information, exercising sound judgment.
- Ability to remain calm and resolve issues swiftly during high-pressure situations, adhering to SLAs.
- Strong leadership skills, including the ability to guide junior team members and lead projects across the team.
- Excellent verbal and written communication skills, with the ability to collaborate effectively with remote teams globally.
Big Data Engineer
Posted 8 days ago
Job Viewed
Job Description
#J-18808-Ljbffr
Senior Big Data Engineer
Posted 6 days ago
Job Viewed
Job Description
Senior Java Engineer (Base Kuala Lumpur)
Job Advantages
Cutting-edge technology (web3 and blockchain), globalized company
Job Responsibilities
- Responsible for the architectural design and development of the company's data center.
- Continuously deliver data value to the company's businesses with high quality, low cost and high efficiency.
- Provide solutions for platform architecture and performance optimization, and lead the rapid iteration of big data platform.
- Enabling the rapid development of the company's business through data-driven approaches, continuously improving the company's core competitiveness.
Job Requirements
- Bachelor's degree or above in computer science or related majors, with more than 3 years of experience in Java development, proficient in Java development, and an in-depth understanding of JVM principles.
- Familiar with commonly used frameworks (Spring, Spring MVC, gRPC, Mybatis) and able to master their principles and mechanisms.
- Solid computer fundamentals, mastery of computer operating systems and network architecture, familiar with commonly used algorithms, data structures, and design patterns.
- Familiar with distributed systems, caching, messaging, and other mechanisms; experience with Redis, Kafka, Spark, Flink, Zookeeper, and TiDB is preferred.
- Experience in data center or microservice design and development, with a focus on high availability and scalability of architecture is preferred.
- Experience in tagging systems or algorithmic recommendation systems is preferred.
- Full of enthusiasm and expectation for the blockchain industry, committed to working hard for the development of the industry.
Senior Big Data Engineer
Posted 6 days ago
Job Viewed
Job Description
Company : Web3 & Blockchain-focused Company
Job Advantages
- Cutting-edge technology (Web3 and blockchain)
- Globalized company
Job Responsibilities
As a Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include:
- Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability.
- Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs.
- Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness.
- Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output.
Job Requirements
We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria:
- Education : Bachelor’s degree or above in Computer Science or related majors.
- Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices.
- Frameworks : Proficient in frameworks such as Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms.
- Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns.
- Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like Spark, Flink , and Zookeeper . Experience with TiDB is a plus.
- Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability.
- Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable.
- Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development.
Why Join Us?
This role offers the opportunity to work at the forefront of blockchain and Web3 technologies within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you.
Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem!
Pioneer Talent Program - Organic Content Operations Crypto Operations Manager - Oregon, United States Crypto-Native UX Researcher (Remote - Jakarta, Indonesia) Web3 Head of Marketing and Communications (Remote) #J-18808-LjbffrSenior Big Data Engineer
Posted 8 days ago
Job Viewed
Job Description
#J-18808-Ljbffr
Senior Big Data Engineer
Posted 8 days ago
Job Viewed
Job Description
Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include: Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability. Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs. Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness. Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output. Job Requirements We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria: Education : Bachelor’s degree or above in Computer Science or related majors. Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices. Frameworks : Proficient in frameworks such as
Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms. Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns. Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like
Spark, Flink , and
Zookeeper . Experience with
TiDB
is a plus. Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability. Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable. Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development. Why Join Us? This role offers the opportunity to work at the forefront of
blockchain
and
Web3 technologies
within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you. Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem! Pioneer Talent Program - Organic Content Operations
Crypto Operations Manager - Oregon, United States
Crypto-Native UX Researcher (Remote - Jakarta, Indonesia)
Web3 Head of Marketing and Communications (Remote) #J-18808-Ljbffr
Assistant Manager - Big Data
Posted 9 days ago
Job Viewed
Job Description
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Sunway Digital Hub, Digital Technology Solutions & Group Cybersecurity
You will be responsible for managing and analyzing large datasets to provide insights to support business decisions especially in the field of marketing / martech tools. You will be part of a team that designs, develops, and implements data solutions using cutting-edge technologies leveraging advanced analytics and machine learning techniques to optimize business performance. You will collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. You will also be responsible for optimizing data processes and ensuring data quality.
Responsibilities:
- Design, build, and maintain big data systems with stakeholder requirements in mind.
- Develop data processing solutions using technologies such as Hadoop, Spark, and Kafka and ensure data accuracy, consistency, and integrity.
- Leverage advanced data science techniques (such as predictive modeling, clustering, regression, NLP, etc.) to extract actionable insights and build customer-centric data products.
- Collaborate with cross-functional teams (marketing, engineering, product, etc.) to understand business needs and translate them into technical specifications for models and data solutions.
- Ensure compliance with data privacy and security regulations during development
- Stay current with industry trends in data science, big data technologies, and marketing technology to inform new approaches and solutions.
Requirements:
- Experience working with big data technologies such as Spark (preferred), Hadoop, or Kafka.
- Strong programming skills in languages such as Python, SQL, Terraform, or Docker. Pyspark is a plus.
- Experience working with big data analytics platforms such as Huawei Cloud (DLI), Databricks, or Amazon EMR.
- Familiarity with data warehousing concepts and technologies such as DWS (Huawei), Airflow, BigQuery, Redshift, or Snowflake.
- Familiarity with data modelling (supervised training and unsupervised training)
- Experience with data visualization tools such as PowerBI (preferred), Tableau or Qilksense
- Proven experience in working with databases such as MSSQL (preferred), Postgres, and NoSQL.
- Strong problem-solving skills and attention to detail.
- Experience working in Agile development environments is a plus.
- Experience in CDP / Martech tools / Marketing industry will be a plus
- Manage and Lead a team of junior to deliver the task.
- Leaves: Annual Leave, Medical Leave, Hospitalization Leave, Special Leave.
- Medical Benefits – Sunway Medical Insurance for Outpatient & Inpatient inclusive for dependents.
- Dental and Optical benefits for confirmed executive.
- Group Term Life & Personal Accident Insurance Scheme.
- Salary increment based on individual performance.
- Bonus based on company & individual performance.
- Career Development: Training and certification sponsored by the company, Annual Talent Review, Career Planning.
- Rewards and recognition: Long Service Award.
- Additional Benefits: Staff Discount (i.e. ThemePark, Hospitality, Education, Property, Medical, Retail, Food & Beverages), Sports and Recreational, Family Day, Annual Dinner, Flexible Working Arrangement for working mothers.
- Hybrid Working Arrangement, Flexible Working Hours
- Open communication. Young, energetic and fun working environment.
Are you ready to elevate your working skills and experience? Click the ‘Apply Now’ and you are one step ahead to an outstanding career.
Our recruitment team will reach out to shortlisted candidates only
Seniority level- Seniority level Mid-Senior level
- Employment type Full-time
- Job function Information Technology and Consulting
- Industries IT Services and IT Consulting
Referrals increase your chances of interviewing at Sunway Digital Hub, Digital Technology Solutions & Group Cybersecurity by 2x
Sign in to set job alerts for “Data Scientist” roles.Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 2 days ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago
Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR6,000.00-MYR8,000.00 2 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 23 hours ago
Data Scientist Lead - Advanced Analytics & Recommendations Artificial Intelligence (AI) Software Engineer (Gen AI, Python)Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago
Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago
Mid Valley City, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Petaling Jaya, Selangor, Malaysia 2 days ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago
Petaling Jaya, Selangor, Malaysia 2 months ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Bukit Jalil, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia $2,000.00-$,000.00 3 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 months ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2,000.00- 5,000.00 3 weeks ago
AI & Data - Data Scientist (GenAI), Experienced HireKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 days ago
Petaling Jaya, Selangor, Malaysia 1 month ago
Petaling Jaya, Selangor, Malaysia 2 days ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 months ago
Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Federal Territory of Kuala Lumpur, Malaysia 1 week ago
AI & Data - Data Scientist, Experienced Associate/Senior AssociateKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrBe The First To Know
About the latest Dataengineer Jobs in Malaysia !
Lead Software Engineer (Big Data)
Posted 9 days ago
Job Viewed
Job Description
EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Join or sign in to find your next jobJoin to apply for the Lead Software Engineer (Big Data) role at EPAM Systems
EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
1 week ago Be among the first 25 applicants
Join to apply for the Lead Software Engineer (Big Data) role at EPAM Systems
Get AI-powered advice on this job and more exclusive features.
Are you a highly skilled and motivated Data Software Engineer with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!
Responsibilities
- Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies
- Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks
- Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions
- Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals
- Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions
- Participate actively in code reviews and ensure adherence to best practices and coding standards
- Foster a high-performance engineering culture, mentor team members and provide motivation and guidance
- Maintain comprehensive project documentation to support development and operations
- 8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions
- Proficiency in Python, Java, Scala, or Kotlin
- Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals
- Expert skills in SQL and relational algebra
- Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies
- Hands-on experience with modern Big Data components and data modeling
- Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems
- Deep understanding and practical application of CI/CD principles and best practices
- Expertise in Docker and Kubernetes for containerization and resource management
- Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture
- Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations
- Significant experience with high-load and IoT data platform architectures
- Solid infrastructure troubleshooting skills
- Practical experience in performance tuning, optimization and problem analysis
- Advanced understanding of distributed computing principles
- Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus
- Excellent interpersonal, leadership and communication skills
- Experience in direct customer communications and stakeholder management
- Experience in technical leadership and mentoring within data-oriented projects
- Ability to handle multiple projects in a fast-paced, startup-like agile development environment
- Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA
- By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
- EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
- We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients
- Seniority level Mid-Senior level
- Employment type Full-time
- Job function Engineering, Information Technology, and Business Development
- Industries Software Development and IT Services and IT Consulting
Referrals increase your chances of interviewing at EPAM Systems by 2x
Get notified about new Lead Software Engineer jobs in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia .
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago
Petaling Jaya, Selangor, Malaysia 1 day ago
WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago
Business Senior Analyst (Software Developer)Petaling Jaya, Selangor, Malaysia 1 month ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago
Petaling Jaya, Selangor, Malaysia 3 months ago
Senior Manager, Full Stack Software Engineer (Staff Software Engineer)Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Petaling Jaya, Selangor, Malaysia 7 months ago
Petaling Jaya, Selangor, Malaysia 4 days ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Federal Territory of Kuala Lumpur, Malaysia 5 days ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Bangsar South, Federal Territory of Kuala Lumpur, Malaysia 6 months ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,500.00-MYR8,000.00 2 months ago
Petaling Jaya, Selangor, Malaysia 2 months ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 hours ago
Petaling Jaya, Selangor, Malaysia 1 day ago
Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Senior/Staff Software Engineer, Custom CommerceKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrLead Software Engineer (Big Data)
Posted 8 days ago
Job Viewed
Job Description
Join to apply for the
Lead Software Engineer (Big Data)
role at
EPAM Systems EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Be among the first 25 applicants Join to apply for the
Lead Software Engineer (Big Data)
role at
EPAM Systems Get AI-powered advice on this job and more exclusive features. Are you a highly skilled and motivated
Data Software Engineer
with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!
Responsibilities
Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions Participate actively in code reviews and ensure adherence to best practices and coding standards Foster a high-performance engineering culture, mentor team members and provide motivation and guidance Maintain comprehensive project documentation to support development and operations
Requirements
8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions Proficiency in Python, Java, Scala, or Kotlin Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals Expert skills in SQL and relational algebra Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies Hands-on experience with modern Big Data components and data modeling Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems Deep understanding and practical application of CI/CD principles and best practices Expertise in Docker and Kubernetes for containerization and resource management Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations Significant experience with high-load and IoT data platform architectures Solid infrastructure troubleshooting skills Practical experience in performance tuning, optimization and problem analysis Advanced understanding of distributed computing principles Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus Excellent interpersonal, leadership and communication skills Experience in direct customer communications and stakeholder management Experience in technical leadership and mentoring within data-oriented projects Ability to handle multiple projects in a fast-paced, startup-like agile development environment Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA
We offer
By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
Life at EPAM
EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients
Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Engineering, Information Technology, and Business Development Industries Software Development and IT Services and IT Consulting Referrals increase your chances of interviewing at EPAM Systems by 2x Get notified about new Lead Software Engineer jobs in
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia . Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago Petaling Jaya, Selangor, Malaysia 1 day ago WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Business Senior Analyst (Software Developer)
Petaling Jaya, Selangor, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago Petaling Jaya, Selangor, Malaysia 3 months ago Senior Manager, Full Stack Software Engineer (Staff Software Engineer)
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago Petaling Jaya, Selangor, Malaysia 7 months ago Petaling Jaya, Selangor, Malaysia 4 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 day ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Federal Territory of Kuala Lumpur, Malaysia 5 days ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago Federal Territory of Kuala Lumpur, Malaysia 1 week ago Bangsar South, Federal Territory of Kuala Lumpur, Malaysia 6 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia MYR4,500.00-MYR8,000.00 2 months ago Petaling Jaya, Selangor, Malaysia 2 months ago Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 5 hours ago Petaling Jaya, Selangor, Malaysia 1 day ago Federal Territory of Kuala Lumpur, Malaysia 1 week ago Senior/Staff Software Engineer, Custom Commerce
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Big Data Engineer (Spark, Flink, Java)
Posted 1 day ago
Job Viewed
Job Description
Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia
Join or sign in to find your next jobJoin to apply for the Big Data Engineer (Spark, Flink, Java) role at Binance
Binance Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia
6 days ago Be among the first 25 applicants
Join to apply for the Big Data Engineer (Spark, Flink, Java) role at Binance
Get AI-powered advice on this job and more exclusive features.
Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 250 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments, institutional services, Web3 features, and more. We leverage the power of digital assets and blockchain to build an inclusive financial ecosystem to advance the freedom of money and improve financial access for people around the world.
Responsibilities
- Design and develop microservices architecture using Java Spring Boot, ensuring system performance, scalability, and reliability.
- Implement and manage microservices components such as service discovery, configuration management, and load balancing with Spring Cloud.
- Analyze, process, and explore data using big data technologies.
- Optimize and manage data storage and retrieval systems like ES/HBase ensuring efficient data handling.
- Work closely with business stakeholders to understand requirements and deliver data solutions that align with business goals.
- Monitor, troubleshoot, and improve backend services to ensure smooth operation.
- Participate in the full development lifecycle, including requirements gathering, system design, coding, testing, and deployment.
- Maintain and enhance existing backend services, ensuring code quality and performance.
- Collaborate with cross-functional teams to integrate data solutions into existing applications.
- Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
- 8 years of professional experience in Java development, with a minimum of 3 years focused on Spring Boot microservices.
- Expertise in designing and implementing Java Spring-based microservices architecture, with experience in Spring Cloud.
- Hands-on experience with data development and big data technologies, including Hive, Spark and Flink
- Familiar with and proficient in using components such as Apollo Configuration Center, Kafka Message Middleware, Xxl Job Scheduler, Pinpoint Link Tracking, and Prometheus Monitoring.
- Proficient in optimizing and managing large-scale databases and data processing workflows.
- Strong problem-solving skills, with a proven ability to troubleshoot and optimize backend services.
- Excellent communication and teamwork skills, with the ability to work in a cross-functional environment.
- Experience with CI/CD pipelines, such as Jenkins or GitLab CI, is a plus.
- Knowledge of cloud services like AWS or is a plus.
- Strong knowledge of financial or blockchain business models and processes, is a plus.
- Shape the future with the world’s leading blockchain ecosystem
- Collaborate with world-class talent in a user-centric global organization with a flat structure
- Tackle unique, fast-paced projects with autonomy in an innovative environment
- Thrive in a results-driven workplace with opportunities for career growth and continuous learning
- Competitive salary and company benefits
- Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)
By submitting a job application, you confirm that you have read and agree to our Candidate Privacy Notice . Seniority level
- Seniority level Mid-Senior level
- Employment type Full-time
- Job function Information Technology and Engineering
- Industries Technology, Information and Internet
Referrals increase your chances of interviewing at Binance by 2x
Sign in to set job alerts for “Big Data Developer” roles.Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 6 days ago
Python and Kubernetes Software Engineer - Data, AI/ML & AnalyticsKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 4 months ago
Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & AnalyticsKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 3 weeks ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 2 days ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 month ago
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia 1 week ago
Binance Accelerator Program - Frontend Developer (Big Data)Kuala Lumpur City, Federal Territory of Kuala Lumpur, Malaysia 6 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr