512 Data Engineer jobs in Kuala Lumpur
Big Data Engineer
Posted today
Job Viewed
Job Description
Job Description:
1.Gain insights into the competitiveness and serviceability requirements of HUAWEI CLOUD Big Data service products. Such as: MRS, DWS, DataLake Insights, Elasticsearch, etc.
2.Be responsible for the delivery of global key projects, including Solution design, Resources management, Data migration, Expanding and Optimizing resources based-on HUAWEI CLOUD Big Data service products.
3.Manage requirements of key projects, develop project plans, identify project risks, ensure timely project delivery, and take charge of operations of some HUAWEI CLOUD sites.
4.Provides technical support for HUAWEI CLOUD customers and ensures the proper running of customer services at the technical level.
5.Troubleshoot faults of Big Data service products in various scenarios, communicate with customers about solutions, and track the solution implementation results.
Job Requirement:
1.Have a good project management experience in the ICT or CLOUD industry.
2.Be familiar with Big Data knowledge. Such as: Hadoop, MapReduce, Kafka, HBase, Spark, Datalake Insights, etc.
3.Experience in cloud development, delivery, or O&M. Background in the cloud industry preferred.
4.HCIA/HCIP/HCIE certificate in cloud computing, or equivalent certificates in the industry preferred, ep: AWS, Azure, GCP cloud certificates.
5.Have a good sense of teamwork and organizational coordination skills.
Big Data Engineer
Posted today
Job Viewed
Job Description
Are you a dedicated IT Operation Executive with a passion for maintaining and optimizing IT systems? Do you thrive in a fast-paced, dynamic environment where your expertise ensures seamless operations and supports millions of users? If so, we want YOU on our team
你是一位热爱 IT 运营的专业人士吗?你擅长维护和优化 IT 系统,并希望在充满活力的游戏行业确保系统稳定运行,支持数百万用户?如果你的答案是 YES,那我们正在寻找的就是你
Why Join Us? / 为什么加入我们?
- 100% Work from Home (100% 远程工作)
- 13th-month salary + attractive bonus & increments (第13个月薪资 + 诱人奖金 & 加薪机会)
- Career growth opportunities – Promotion (Review in every HALF a Year) & professional development (职业发展机会 – 每半年一次晋升评估 & 专业成长)
- Many Public holiday entitlement (超多公共假期福利)
- Annual leave start from 14 days and MORE (年假从 14 天起,还有更多)
- Medical claims, Annual Dinner, Team Building, Sport Activities, Meals Gathering and MORE (医疗报销、年度晚宴、团队建设、体育活动、聚餐等多项福利)
- Birthday Gift, Birthday Celebration, Festival Gifts and MANY MORE (生日礼物、生日庆祝、节日礼品,还有更多惊喜等待你)
- Annual Dinner Cash Prizes Lucky Draw and MANY MORE Rewards WAITING FOR YOU (年度晚宴现金大奖抽奖,更多奖励等你来拿)
It will be a considerable amount of time post-writing. If the preceding content aligns with your preferences, promptly click the "Quick apply" button Missing out on such a remarkable and stable company would be regrettable, and not attempting it would be a lost opportunity. Take the chance and seize it Hurry Up….Join our team
为了公司业务扩展,我们需求更多的人才加入我们的团队这将是一个值得投入时间的机会如果以上内容符合你的期待,请立即点击"快速申请"按钮错过如此优质稳定的公司将是巨大的遗憾,不尝试就等于失去一次宝贵的机会抓住机会,立即加入我们吧
Big Data Responsibilities
Design, develop, and tackle technical challenges for core components of the big data platform;
Participate in data middleware construction, including the development and upgrades of components such as data integration, metadata management, and task management;
Research big data technologies (e.g., ELK, Flink, Spark, ClickHouse) to optimize cluster architecture, troubleshoot issues, and resolve performance bottlenecks.
大数据岗位职责
负责大数据平台核心组件模块的架构设计、开发及技术攻关;
参与数据中台建设,完成数据集成、元数据管理、任务管理等组件的开发与升级;
研究ELK、Flink、Spark、ClickHouse等大数据计算与存储技术,持续优化集群架构,发现并解决故障及性能瓶颈。
Requirements
Proficient in big data platform principles, with expertise in building and optimizing platforms using Hadoop ecosystem tools (e.g., Spark, Impala, Flume, Kafka, HBase, Hive, ZooKeeper) and ClickHouse;
Hands-on experience in developing and deploying ELK-based big data analytics platforms;
Strong grasp of big data modeling methodologies and techniques;
Skilled in Java/Scala programming, design patterns, and big data technologies (Spark, Flink);
Experience in large-scale data warehouse architecture/model/ETL design, with capabilities in massive data processing and performance tuning;
Extensive database design/development experience, familiar with relational databases and NoSQL.
Fluent in Mandarin in order to liaise with Mandarin speaking associates
任职要求
熟悉大数据平台原理,精通大数据平台搭建与优化,熟练使用Hadoop生态系统组件(如Spark、Impala、Flume、Kafka、HBase、Hive、ZooKeeper等)及ClickHouse构建大数据平台;
具备ELK大数据分析平台开发及部署经验;
熟练掌握大数据建模方法和技术;
精通Java/Scala编程及常用设计模式,熟悉Spark、Flink等大数据编程技术与原理;
具备大型数据仓库架构设计、模型设计、ETL设计经验,有海量数据处理及性能调优能力;
丰富的数据库设计与开发经验,熟悉关系型数据库及NoSQL技术。
流利的中文,需要与中文团队成员沟通.
Candidates with PhP or Java Experienced is Prioritized / 拥有PhP 或 大数据经验者会优先考虑
Big Data Engineer
Posted today
Job Viewed
Job Description
Job Description:
• Gather operational Intel on business processes and policies from multiple sources
• Prepare periodical and ad-hoc reports using operational data
• Develop semantic core to align data with business processes
• Support operations team's work streams for data processing, analysis and reporting
• Analyze data and Create dashboards for the senior management
• Design and implement optimal processes
• Regression testing of the releases
Skills Required:
• Big Data : Spark, Hive, Data Bricks
• Language : SQL, JAVA/Python
• BI & Analytics: Power BI (DAX), Tableau, Dataiku
• Operating System : Unix
• Experience with Data Migration, Data Engineering, Data Analysis
• Big Data : SCALA, HADOOP
• Tools: DB Visualizer, JIRA, GIT, Bit bucket, Control-M
• Strong problem-solving skills and the ability to work independently and in a team environment.
• Excellent communication skills and the ability to work effectively with cross-functional teams
Big Data Engineer
Posted today
Job Viewed
Job Description
Job Description:
1.Gain insights into the competitiveness and serviceability requirements of HUAWEI CLOUD Big Data service products. Such as: MRS, DWS, DataLake Insights, Elasticsearch, etc.
2.Be responsible for the delivery of global key projects, including Solution design, Resources management, Data migration, Expanding and Optimizing resources based-on HUAWEI CLOUD Big Data service products.
3.Manage requirements of key projects, develop project plans, identify project risks, ensure timely project delivery, and take charge of operations of some HUAWEI CLOUD sites.
4.Provides technical support for HUAWEI CLOUD customers and ensures the proper running of customer services at the technical level.
5.Troubleshoot faults of Big Data service products in various scenarios, communicate with customers about solutions, and track the solution implementation results.
Job Requirement:
1.Have a good project management experience in the ICT or CLOUD industry.
2.Be familiar with Big Data knowledge. Such as: Hadoop, MapReduce, Kafka, HBase, Spark, Datalake Insights, etc.
3.Experience in cloud development, delivery, or O&M. Background in the cloud industry preferred.
4.HCIA/HCIP/HCIE certificate in cloud computing, or equivalent certificates in the industry preferred, ep: AWS, Azure, GCP cloud certificates.
5.Have a good sense of teamwork and organizational coordination skills.
Big Data Engineer
Posted today
Job Viewed
Job Description
- Design, develop, and optimize
big data pipelines
using Apache Spark (batch and streaming). - Implement data ingestion, transformation, and processing frameworks to handle
structured, semi-structured, and unstructured data
. - Work with
NoSQL databases
(Cassandra, MongoDB, HBase, DynamoDB, or Couchbase) for large-scale data storage and retrieval. - Integrate big data solutions with
data lakes, cloud platforms (AWS, Azure, GCP), and traditional RDBMS systems
. - Bachelor's/Master's degree in
Computer Science, Data Engineering, or related field
. - 3–6+ years of hands-on experience in
Big Data Development
. - Strong expertise in
Apache Spark (PySpark/Scala/Java)
for data processing and optimization. - Proficiency in
NoSQL databases
(Cassandra, MongoDB, HBase, Dynamo
Big Data Engineer
Posted today
Job Viewed
Job Description
Responsibilities
- ETL & Data Pipeline Development (80%): Design and implement ETL processes, data pipeline development, and data warehouse management using Airflow, Spark, and Python/Java.
- Data Extraction (20%): Provide data tables or CSVs as per the requirements of game operators.
Qualifications
- Degree in Computer Science or related technical and engineering fields
- Experience with programming language Python or java or scala or golang;SQL is a must.
- Good understanding of various types of databases, including relational databases and distributed databases
- Tabeau or PowerBI or Looker experience will be a plus.
- Good analytical and technical skills in building batch or streaming data pipelines for big data
- Business proficiency (written and spoken) in Mandarin to communicate both verbally and in writing with non-English speaking counterparts based in China for gathering requirements and analysis
Senior Big Data Engineer
Posted today
Job Viewed
Job Description
Required Skills & Qualifications
• Bachelor's, Master's, or PhD in Computer Science, Data Engineering, or a related discipline.
• 5–7 years of experience in data engineering and distributed data systems.
• Strong hands-on experience with Apache Hive, HBase, Kafka, Solr, Elasticsearch.
• Proficient in data architecture, data modelling, and pipeline scheduling/orchestration.
• Operational experience with Data Mesh, Data Product development, and hybrid cloud data
platforms.
• Familiarity with CRM systems, including CRM system, and data sourcing/mapping strategies.
• Proficient in managing metadata, glossary, and lineage tools like Apache Atlas.
• Proven experience in generating large-scale batch files using Spark and Hive.
• Strong understanding of document-based data models and the transformation of relational
schemas into document-oriented structures.
Additional Technical & Business Competencies
• Expertise in data administration, modelling, mapping, collection, and distribution.
• Strong understanding of business workflows to support metadata governance.
• Hands-on experience with analytics and DWH tools (e.g., SAS, Oracle, MS SQL, Python, R
Programming).
• Familiarity with data modelling tools (e.g., ERWIN), and enterprise databases (Oracle, IBM
DB2, MS SQL, Hadoop, Object Store).
• Experience working across hybrid cloud environments (e.g., AWS, Azure Data Factory).
• In-depth knowledge of ETL/ELT processes and automation frameworks.
• Analytical thinker with strong problem-solving and communication skills.
• Able to collaborate effectively across technical and business teams.
• Proven ability to deliver high-quality outcomes within
Be The First To Know
About the latest Data engineer Jobs in Kuala Lumpur !
Data Engineer-python-big Data
Posted today
Job Viewed
Job Description
`
About the Company
RiDiK is a global technology solutions provider and a subsidiary of CLPS Incorporation (NASDAQ: CLPS), delivering cutting-edge end-to-end services across banking, wealth management, and e-commerce. With deep expertise in AI, cloud, big data, and blockchain, we support clients across Asia, North America, and the Middle East in driving digital transformation and achieving sustainable growth. Operating from regional hubs in 10 countries and backed by a global delivery network, we combine local insight with technical excellence to deliver real, measurable impact. Join RiDiK and be part of an innovative, fast-growing team shaping the future of technology across industries.
About the Role
The role involves building a universal data platform that meets real-time/offline computing and storage requirements, defining the data pipeline scheme according to demand scenarios, and enhancing the data platform for improved stability and resource efficiency.
Responsibilities
- Build a universal data platform, meet real-time/offline computing and storage requirements.
- Define the data pipeline scheme according to the demand scenarios, and deliver it by multiple methods based on various infrastructure.
- Enhance the data platform, improve the stability and flexibility of data asset, and optimize the resource efficiency.
Qualifications
- Bachelor degree or above, major in computer, big data, mathematics, and more than 5 years of data development experience.
Required Skills
- Familiar with Hadoop, Spark, Flink, Airflow and other popular data platform components, understand the working principle of them, and have optimization experience about these components.
- Have a certain understanding of distributed system principles, calculations, and storage.
- Good communication and logical thinking skills, good self-drive, continuous learning and updating knowledge system.
Data Engineer/ Senior Data Engineer
Posted 4 days ago
Job Viewed
Job Description
Overview
Join to apply for the Data Engineer/ Senior Data Engineer role at MoneyHero Group (Nasdaq: MNY) .
Get AI-powered advice on this job and more exclusive features.
This is a fully remote role to be based in Malaysia. We will prioritize candidates who are based in Malaysia and do not require a work visa sponsorship.
About UsMoneyHero Group (Nasdaq: MNY) is a market leading financial products platform in Greater Southeast Asia, reaching 9.8m monthly unique users and working with more than 270 commercial partners across five markets including Singapore, Hong Kong S.A.R., Philippines, Taiwan, and Malaysia.
The JobThe Senior Data Engineer is responsible for overseeing the design, development, implementation, and maintenance of all data-related systems, infrastructure, and processes within an organization. They will lead a team of data engineers and work closely with data scientists, business analysts, and other stakeholders to ensure that data is properly collected, processed, stored, and made available for analysis and decision-making purposes.
Responsibilities- Develop and implement technical data architecture and engineering strategies to support the organisation's data-driven initiatives, including data warehousing, ETL processes, and data governance.
- Build and maintain scalable and reliable data pipelines, ensuring data quality and consistency across all systems.
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Manage, guide and support junior data engineers in the development and implementation of data-related solutions
- Collaborate with data scientists, business analysts, and other stakeholders to identify data-related needs and requirements, and develop and implement solutions.
- Monitor and troubleshoot data-related issues, providing timely resolution and support to minimize downtime and disruption.
- At least 4+ years of hands-on experience in data engineering building scalable pipelines and infrastructure
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Strong technical skills in data warehousing, ETL processes, and database management systems, such as SQL, Python and dbt
- Experience with cloud-based data technologies such as AWS, Azure, or Google Cloud (BigQuery preferred)
- Knowledge of data security and privacy regulations, such as GDPR and HIPAA
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders
- Analytical and problem-solving skills, with the ability to identify and resolve data-related issues and implement effective solutions
- Bachelor's degree in computer science, engineering, or a related field
- Impact : We are actively empowering and connecting people to a better financial future. Join us if you want to help us achieve our mission.
- Work : We have a team of over 350 talented individuals in 4 markets who are hyper passionate about building innovative financial solutions and making an impact on people’s lives.
- Culture : We take our work seriously but don’t hesitate to keep things light. We can only create magic when we have a little bit of fun.
- Thrive : We launched in 2014, and now help over 10 million monthly users make the best financial decisions. Accelerate your career and become a pioneer in your field with a leading fintech company that seeks to push the boundaries of your imagination and is committed to growing your career.
- Reputation : We are backed by world-class organizations and companies and have raised over US$110 million from investors including Experian, Pacific Century Group, IFC - a member of the World Bank Group
MoneyHero Group is an equal opportunity employer. We value, support and respect all individuals and is committed to maintaining an inclusive and diverse working environment. Decisions in hiring are based on business needs, requirements of the job and individual qualifications and shall not be influenced by any consideration of race, ethnic or national origin, religion, sex (including gender identity and/or expression), age, sexual orientation, marital status, parental status, disability, genetic information, political affiliation or other applicable legally protected characteristics.
#J-18808-LjbffrData Engineer/ Senior Data Engineer
Posted 4 days ago
Job Viewed
Job Description
Overview
Join to apply for the Data Engineer/ Senior Data Engineer role at MoneyHero Group (Nasdaq: MNY) .
Get AI-powered advice on this job and more exclusive features.
This is a fully remote role to be based in Malaysia. We will prioritize candidates who are based in Malaysia and do not require a work visa sponsorship.
About UsMoneyHero Group (Nasdaq: MNY) is a market leading financial products platform in Greater Southeast Asia, reaching 9.8m monthly unique users and working with more than 270 commercial partners across five markets including Singapore, Hong Kong S.A.R., Philippines, Taiwan, and Malaysia.
The JobThe Senior Data Engineer is responsible for overseeing the design, development, implementation, and maintenance of all data-related systems, infrastructure, and processes within an organization. They will lead a team of data engineers and work closely with data scientists, business analysts, and other stakeholders to ensure that data is properly collected, processed, stored, and made available for analysis and decision-making purposes.
Responsibilities- Develop and implement technical data architecture and engineering strategies to support the organisation's data-driven initiatives, including data warehousing, ETL processes, and data governance.
- Build and maintain scalable and reliable data pipelines, ensuring data quality and consistency across all systems.
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Manage, guide and support junior data engineers in the development and implementation of data-related solutions
- Collaborate with data scientists, business analysts, and other stakeholders to identify data-related needs and requirements, and develop and implement solutions.
- Monitor and troubleshoot data-related issues, providing timely resolution and support to minimize downtime and disruption.
- At least 4+ years of hands-on experience in data engineering building scalable pipelines and infrastructure
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Strong technical skills in data warehousing, ETL processes, and database management systems, such as SQL, Python and dbt
- Experience with cloud-based data technologies such as AWS, Azure, or Google Cloud (BigQuery preferred)
- Knowledge of data security and privacy regulations, such as GDPR and HIPAA
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders
- Analytical and problem-solving skills, with the ability to identify and resolve data-related issues and implement effective solutions
- Bachelor's degree in computer science, engineering, or a related field
- Impact : We are actively empowering and connecting people to a better financial future. Join us if you want to help us achieve our mission.
- Work : We have a team of over 350 talented individuals in 4 markets who are hyper passionate about building innovative financial solutions and making an impact on people’s lives.
- Culture : We take our work seriously but don’t hesitate to keep things light. We can only create magic when we have a little bit of fun.
- Thrive : We launched in 2014, and now help over 10 million monthly users make the best financial decisions. Accelerate your career and become a pioneer in your field with a leading fintech company that seeks to push the boundaries of your imagination and is committed to growing your career.
- Reputation : We are backed by world-class organizations and companies and have raised over US$110 million from investors including Experian, Pacific Century Group, IFC - a member of the World Bank Group
MoneyHero Group is an equal opportunity employer. We value, support and respect all individuals and is committed to maintaining an inclusive and diverse working environment. Decisions in hiring are based on business needs, requirements of the job and individual qualifications and shall not be influenced by any consideration of race, ethnic or national origin, religion, sex (including gender identity and/or expression), age, sexual orientation, marital status, parental status, disability, genetic information, political affiliation or other applicable legally protected characteristics.
#J-18808-Ljbffr