253 Senior Data Engineer jobs in Kuala Lumpur
Senior Big Data Engineer
Posted 4 days ago
Job Viewed
Job Description
Company : Web3 & Blockchain-focused Company
Job Advantages
- Cutting-edge technology (Web3 and blockchain)
- Globalized company
Job Responsibilities
As a Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include:
- Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability.
- Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs.
- Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness.
- Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output.
Job Requirements
We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria:
- Education : Bachelor’s degree or above in Computer Science or related majors.
- Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices.
- Frameworks : Proficient in frameworks such as Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms.
- Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns.
- Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like Spark, Flink , and Zookeeper . Experience with TiDB is a plus.
- Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability.
- Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable.
- Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development.
Why Join Us?
This role offers the opportunity to work at the forefront of blockchain and Web3 technologies within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you.
Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem!
Pioneer Talent Program - Organic Content Operations Crypto Operations Manager - Oregon, United States Crypto-Native UX Researcher (Remote - Jakarta, Indonesia) Web3 Head of Marketing and Communications (Remote) #J-18808-LjbffrSenior Big Data Engineer
Posted 21 days ago
Job Viewed
Job Description
Senior Java Engineer , you will play a pivotal role in the development and optimization of the company’s data infrastructure, ensuring it supports the evolving needs of our blockchain-focused business. Your primary responsibilities will include: Architectural Design & Development : Lead the design and development of the company’s data center, ensuring robust performance and scalability. Data Platform Optimization : Provide ongoing solutions for platform architecture and performance optimization to support the company’s rapid growth and business needs. Business Enablement : Drive data-driven solutions that accelerate business development and continuously enhance the company's core competitiveness. Big Data Iteration : Lead the rapid iteration of big data platforms, ensuring efficiency, cost-effectiveness, and high-quality output. Job Requirements We are seeking candidates who are passionate about blockchain technology and possess a strong technical foundation. Ideal candidates will meet the following criteria: Education : Bachelor’s degree or above in Computer Science or related majors. Experience : More than 3 years of experience in Java development, with a deep understanding of JVM principles and Java development best practices. Frameworks : Proficient in frameworks such as
Spring, Spring MVC, gRPC, Mybatis , and an ability to understand their underlying principles and mechanisms. Core Computer Fundamentals : Strong knowledge of computer operating systems, network architecture, and proficiency in commonly used algorithms, data structures, and design patterns. Distributed Systems : Familiarity with distributed systems, caching mechanisms (Redis), messaging systems (Kafka), and big data processing frameworks like
Spark, Flink , and
Zookeeper . Experience with
TiDB
is a plus. Experience in Microservices : Experience in the design and development of data centers or microservices, with an emphasis on high availability and scalability. Tagging Systems/Recommendation Systems : Experience with tagging systems or algorithmic recommendation systems is highly desirable. Passion for Blockchain : A strong enthusiasm for the blockchain industry and a commitment to contributing to its growth and development. Why Join Us? This role offers the opportunity to work at the forefront of
blockchain
and
Web3 technologies
within a global company. You will have the chance to develop and optimize critical infrastructure that powers innovative and scalable solutions in the blockchain space. If you’re ready to work in a fast-paced and cutting-edge environment, this role could be the perfect fit for you. Apply now to be part of an exciting journey in revolutionizing the Web3 ecosystem! Pioneer Talent Program - Organic Content Operations
Crypto Operations Manager - Oregon, United States
Crypto-Native UX Researcher (Remote - Jakarta, Indonesia)
Web3 Head of Marketing and Communications (Remote) #J-18808-Ljbffr
Senior Software Engineer (Big Data)
Posted 3 days ago
Job Viewed
Job Description
Overview
EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Software Engineers at EPAM are the driving force behind strategic initiatives for our clients. As a Senior Software Engineer at EPAM Malaysia, you will use your expertise in Big Data to collaborate with product and engineering teams and combine the functional and technical aspects of Software Development with Big Data technology in the project space of cloud services.
Responsibilities- Design and implement innovative analytical solutions using Hadoop, NoSQL and other Big Data related technologies, evaluating new features and architecture in cloud / on-premise / hybrid solutions
- Build collaborative partnerships with architects, technical leads and key individuals within other functional groups
- Perform detailed analysis of business problems and technical environments to design quality technical solutions
- Participate in code review and test solutions
- At least 6 years of working experience with Big Data technologies and Enterprise Software Development
- Solid skills in enterprise software development, practical experience in infrastructure & bug troubleshooting
- Proven expertise in overseeing and evaluating deliverables produced by team members
- Strong skills in enterprise software development, including infrastructure troubleshooting, incident investigation, performance tuning and root cause analysis
- Hands-on experience in Spark / Pandas, Airflow and Python
- Hands-on experience in cloud experience, preferably AWS, and NoSQL
- Experience with component / integration testing, unit testing, and hands-on experience with GitHub, Kubernetes and Docker
- By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
- EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
- We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients
Senior Software Engineer (Big Data)
Posted 2 days ago
Job Viewed
Job Description
EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia Software Engineers at EPAM are the driving force behind strategic initiatives for our clients. As a
Senior Software Engineer
at EPAM Malaysia, you will use your expertise in Big Data to collaborate with product and engineering teams and combine the functional and technical aspects of Software Development with Big Data technology in the project space of cloud services. Responsibilities
Design and implement innovative analytical solutions using Hadoop, NoSQL and other Big Data related technologies, evaluating new features and architecture in cloud / on-premise / hybrid solutions Build collaborative partnerships with architects, technical leads and key individuals within other functional groups Perform detailed analysis of business problems and technical environments to design quality technical solutions Participate in code review and test solutions Requirements
At least 6 years of working experience with Big Data technologies and Enterprise Software Development Solid skills in enterprise software development, practical experience in infrastructure & bug troubleshooting Proven expertise in overseeing and evaluating deliverables produced by team members Strong skills in enterprise software development, including infrastructure troubleshooting, incident investigation, performance tuning and root cause analysis Hands-on experience in Spark / Pandas, Airflow and Python Hands-on experience in cloud experience, preferably AWS, and NoSQL Experience with component / integration testing, unit testing, and hands-on experience with GitHub, Kubernetes and Docker We offer
By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us Life at EPAM
EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients
#J-18808-Ljbffr
Data Engineer/ Senior Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Overview
Join to apply for the Data Engineer/ Senior Data Engineer role at MoneyHero Group (Nasdaq: MNY) .
Get AI-powered advice on this job and more exclusive features.
This is a fully remote role to be based in Malaysia. We will prioritize candidates who are based in Malaysia and do not require a work visa sponsorship.
About UsMoneyHero Group (Nasdaq: MNY) is a market leading financial products platform in Greater Southeast Asia, reaching 9.8m monthly unique users and working with more than 270 commercial partners across five markets including Singapore, Hong Kong S.A.R., Philippines, Taiwan, and Malaysia.
The JobThe Senior Data Engineer is responsible for overseeing the design, development, implementation, and maintenance of all data-related systems, infrastructure, and processes within an organization. They will lead a team of data engineers and work closely with data scientists, business analysts, and other stakeholders to ensure that data is properly collected, processed, stored, and made available for analysis and decision-making purposes.
Responsibilities- Develop and implement technical data architecture and engineering strategies to support the organisation's data-driven initiatives, including data warehousing, ETL processes, and data governance.
- Build and maintain scalable and reliable data pipelines, ensuring data quality and consistency across all systems.
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Manage, guide and support junior data engineers in the development and implementation of data-related solutions
- Collaborate with data scientists, business analysts, and other stakeholders to identify data-related needs and requirements, and develop and implement solutions.
- Monitor and troubleshoot data-related issues, providing timely resolution and support to minimize downtime and disruption.
- At least 4+ years of hands-on experience in data engineering building scalable pipelines and infrastructure
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Strong technical skills in data warehousing, ETL processes, and database management systems, such as SQL, Python and dbt
- Experience with cloud-based data technologies such as AWS, Azure, or Google Cloud (BigQuery preferred)
- Knowledge of data security and privacy regulations, such as GDPR and HIPAA
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders
- Analytical and problem-solving skills, with the ability to identify and resolve data-related issues and implement effective solutions
- Bachelor's degree in computer science, engineering, or a related field
- Impact : We are actively empowering and connecting people to a better financial future. Join us if you want to help us achieve our mission.
- Work : We have a team of over 350 talented individuals in 4 markets who are hyper passionate about building innovative financial solutions and making an impact on people’s lives.
- Culture : We take our work seriously but don’t hesitate to keep things light. We can only create magic when we have a little bit of fun.
- Thrive : We launched in 2014, and now help over 10 million monthly users make the best financial decisions. Accelerate your career and become a pioneer in your field with a leading fintech company that seeks to push the boundaries of your imagination and is committed to growing your career.
- Reputation : We are backed by world-class organizations and companies and have raised over US$110 million from investors including Experian, Pacific Century Group, IFC - a member of the World Bank Group
MoneyHero Group is an equal opportunity employer. We value, support and respect all individuals and is committed to maintaining an inclusive and diverse working environment. Decisions in hiring are based on business needs, requirements of the job and individual qualifications and shall not be influenced by any consideration of race, ethnic or national origin, religion, sex (including gender identity and/or expression), age, sexual orientation, marital status, parental status, disability, genetic information, political affiliation or other applicable legally protected characteristics.
#J-18808-LjbffrData Engineer/ Senior Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Overview
Join to apply for the Data Engineer/ Senior Data Engineer role at MoneyHero Group (Nasdaq: MNY) .
Get AI-powered advice on this job and more exclusive features.
This is a fully remote role to be based in Malaysia. We will prioritize candidates who are based in Malaysia and do not require a work visa sponsorship.
About UsMoneyHero Group (Nasdaq: MNY) is a market leading financial products platform in Greater Southeast Asia, reaching 9.8m monthly unique users and working with more than 270 commercial partners across five markets including Singapore, Hong Kong S.A.R., Philippines, Taiwan, and Malaysia.
The JobThe Senior Data Engineer is responsible for overseeing the design, development, implementation, and maintenance of all data-related systems, infrastructure, and processes within an organization. They will lead a team of data engineers and work closely with data scientists, business analysts, and other stakeholders to ensure that data is properly collected, processed, stored, and made available for analysis and decision-making purposes.
Responsibilities- Develop and implement technical data architecture and engineering strategies to support the organisation's data-driven initiatives, including data warehousing, ETL processes, and data governance.
- Build and maintain scalable and reliable data pipelines, ensuring data quality and consistency across all systems.
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Manage, guide and support junior data engineers in the development and implementation of data-related solutions
- Collaborate with data scientists, business analysts, and other stakeholders to identify data-related needs and requirements, and develop and implement solutions.
- Monitor and troubleshoot data-related issues, providing timely resolution and support to minimize downtime and disruption.
- At least 4+ years of hands-on experience in data engineering building scalable pipelines and infrastructure
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Strong technical skills in data warehousing, ETL processes, and database management systems, such as SQL, Python and dbt
- Experience with cloud-based data technologies such as AWS, Azure, or Google Cloud (BigQuery preferred)
- Knowledge of data security and privacy regulations, such as GDPR and HIPAA
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders
- Analytical and problem-solving skills, with the ability to identify and resolve data-related issues and implement effective solutions
- Bachelor's degree in computer science, engineering, or a related field
- Impact : We are actively empowering and connecting people to a better financial future. Join us if you want to help us achieve our mission.
- Work : We have a team of over 350 talented individuals in 4 markets who are hyper passionate about building innovative financial solutions and making an impact on people’s lives.
- Culture : We take our work seriously but don’t hesitate to keep things light. We can only create magic when we have a little bit of fun.
- Thrive : We launched in 2014, and now help over 10 million monthly users make the best financial decisions. Accelerate your career and become a pioneer in your field with a leading fintech company that seeks to push the boundaries of your imagination and is committed to growing your career.
- Reputation : We are backed by world-class organizations and companies and have raised over US$110 million from investors including Experian, Pacific Century Group, IFC - a member of the World Bank Group
MoneyHero Group is an equal opportunity employer. We value, support and respect all individuals and is committed to maintaining an inclusive and diverse working environment. Decisions in hiring are based on business needs, requirements of the job and individual qualifications and shall not be influenced by any consideration of race, ethnic or national origin, religion, sex (including gender identity and/or expression), age, sexual orientation, marital status, parental status, disability, genetic information, political affiliation or other applicable legally protected characteristics.
#J-18808-LjbffrData Engineer/ Senior Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Overview
Join to apply for the Data Engineer/ Senior Data Engineer role at MoneyHero Group (Nasdaq: MNY) .
Get AI-powered advice on this job and more exclusive features.
This is a fully remote role to be based in Malaysia. We will prioritize candidates who are based in Malaysia and do not require a work visa sponsorship.
About UsMoneyHero Group (Nasdaq: MNY) is a market leading financial products platform in Greater Southeast Asia, reaching 9.8m monthly unique users and working with more than 270 commercial partners across five markets including Singapore, Hong Kong S.A.R., Philippines, Taiwan, and Malaysia.
The JobThe Senior Data Engineer is responsible for overseeing the design, development, implementation, and maintenance of all data-related systems, infrastructure, and processes within an organization. They will lead a team of data engineers and work closely with data scientists, business analysts, and other stakeholders to ensure that data is properly collected, processed, stored, and made available for analysis and decision-making purposes.
Responsibilities- Develop and implement technical data architecture and engineering strategies to support the organisation's data-driven initiatives, including data warehousing, ETL processes, and data governance.
- Build and maintain scalable and reliable data pipelines, ensuring data quality and consistency across all systems.
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Manage, guide and support junior data engineers in the development and implementation of data-related solutions
- Collaborate with data scientists, business analysts, and other stakeholders to identify data-related needs and requirements, and develop and implement solutions.
- Monitor and troubleshoot data-related issues, providing timely resolution and support to minimize downtime and disruption.
- At least 4+ years of hands-on experience in data engineering building scalable pipelines and infrastructure
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Strong technical skills in data warehousing, ETL processes, and database management systems, such as SQL, Python and dbt
- Experience with cloud-based data technologies such as AWS, Azure, or Google Cloud (BigQuery preferred)
- Knowledge of data security and privacy regulations, such as GDPR and HIPAA
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders
- Analytical and problem-solving skills, with the ability to identify and resolve data-related issues and implement effective solutions
- Bachelor's degree in computer science, engineering, or a related field
- Impact : We are actively empowering and connecting people to a better financial future. Join us if you want to help us achieve our mission.
- Work : We have a team of over 350 talented individuals in 4 markets who are hyper passionate about building innovative financial solutions and making an impact on people’s lives.
- Culture : We take our work seriously but don’t hesitate to keep things light. We can only create magic when we have a little bit of fun.
- Thrive : We launched in 2014, and now help over 10 million monthly users make the best financial decisions. Accelerate your career and become a pioneer in your field with a leading fintech company that seeks to push the boundaries of your imagination and is committed to growing your career.
- Reputation : We are backed by world-class organizations and companies and have raised over US$110 million from investors including Experian, Pacific Century Group, IFC - a member of the World Bank Group
MoneyHero Group is an equal opportunity employer. We value, support and respect all individuals and is committed to maintaining an inclusive and diverse working environment. Decisions in hiring are based on business needs, requirements of the job and individual qualifications and shall not be influenced by any consideration of race, ethnic or national origin, religion, sex (including gender identity and/or expression), age, sexual orientation, marital status, parental status, disability, genetic information, political affiliation or other applicable legally protected characteristics.
#J-18808-LjbffrBe The First To Know
About the latest Senior data engineer Jobs in Kuala Lumpur !
Data Engineer
Posted 2 days ago
Job Viewed
Job Description
Overview
Quantuma Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Join to apply for the Data Engineer role at Quantuma
Get AI-powered advice on this job and more exclusive features.
Role PurposeBuild and maintain reliable ELT pipelines, data models, and data products powering analytics and AI across all K3 brands. Enable data-driven decision making through high-quality, secure data access.
Key Responsibilities- Develop ELT pipelines from SaaS/ERP systems to Azure Data Lake/Synapse
- Design and implement data models (star/medallion) with semantic layers
- Implement data quality rules, lineage tracking, and security controls
- Optimize performance and manage schema evolution with CDC
- Support cross-brand data integration while maintaining data segregation
- 4+ years in modern data engineering with cloud platforms
- Strong SQL and Python/Scala for data transformation
- Experience with Azure Data Factory/Fabric/Databricks
- Data governance and PII handling expertise
- Data freshness >95% on priority datasets
- Data quality score ≥98% on critical fields
- New connectors delivered within agreed SLAs (≤10 days)
RM 110,000 - 172,000 per year + competitive benefits package
LocationKuala Lumpur, Malaysia (Hybrid working model)
Seniority level- Mid-Senior level
- Full-time
- Information Technology
Referrals increase your chances of interviewing at Quantuma by 2x
Get notified about new Data Engineer jobs in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia .
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrData Engineer
Posted 2 days ago
Job Viewed
Job Description
Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE)
DATA ENGINEER - IT with Extensive experience in "Healthcare ".
With Minimum Experience - 3 years & Maximun Experience - 15 years
Core responsibilities include:
- Work within a highly specialized and growing team to enable delivery of data and advanced analytics system capability.
- Develop and implement a reusable architecture of data pipelines to make data available for various purposes including Machine Learning (ML), Analytics and Reporting
- Work collaboratively as part of team engaging with system architects, data scientists and business in a healthcare context
- Define hardware, tools and software to enable the reusable framework for data sharing and ML model productionization
- Work comfortably with structured and unstructured data in a variety of different programming languages such as SQL, R, python, Java etc
- Understanding of distributing programming and advising data scientists on how to optimally structure program code for maximum efficiency
- Build data solutions that leverage controls to ensure privacy, security, compliance, and data quality
- Understand meta-data management systems and orchestration architecture in the designing of ML/AI pipelines
- Deep understanding of cutting-edge cloud technology and frameworks to enable Data Science
- System integration skills between Business Intelligence and source transactional
- Define strategies with Data Scientists to monitor models post production
- Write unit tests and participate in code reviews
Improving overall production landscape as required
- Honours or Master’s degree in BSc Computer Science or Engineering or Software Engineering with solid experience in data mining and machine learning
- 5 to 15 years of work experience
- Expert in programming languages such as R, Python, Scala and Java
- Expert database knowledge in SQL a nd experience with MS Azure tools such as Data Factory, Synapse Analytics, Data Lake, Databricks, Azure stream analytics and PowerBI
- Modern Azure datawarehouse skills
- Expert Unix/Linux admin experience including shell script development
- Exposure to AI or model development
- Experience working on large and complex datasets
- Understanding and application of Big Data and distributed computing principles (Hadoop and MapReduce)
- ML model optimization skills in a production environment
- Production environment machine learning and AI
- DevOps/DataOps and CI/CD experience
- AWS experience
Data Engineer
Posted 2 days ago
Job Viewed
Job Description
Overview
Join to apply for the Data Engineer role at RHB Banking Group .
Responsibilities- End-to-End Data Product Pipelines - Design, build, and maintain robust data pipelines that ingest, process, transform, and deliver Data Products for analytics, reporting, and operational use cases. Ensure pipelines are scalable, maintainable, and aligned with business requirements.
- Automated Data Workflow Development - Develop and orchestrate automated workflows using modern data engineering frameworks and orchestration tools to enable continuous, reliable, and timely delivery of Data Products to downstream systems and stakeholders.
- Data Preparation & Transformation - Perform comprehensive data cleansing, preprocessing, and transformation to ensure accuracy, consistency, and usability. Implement ETL/ELT processes that extract data from diverse sources, transform it into a unified structure, and load it into analytics-ready storage. Provide recommendations to optimize data usability and operational efficiency.
- Cross-Functional Collaboration & Pipeline Strategy - Work closely with business, product, and technology teams to define data requirements, design pipeline architectures, and implement solutions that meet current needs while anticipating future scalability and integration requirements.
- Data Quality, Reliability & Governance - Define and implement frameworks for data validation, monitoring, and error handling to ensure high data quality, source integrity, and reliability. Partner with governance teams to enforce compliance, metadata management, and lineage tracking across the pipeline ecosystem.