Big Data Engineer

3 weeks ago

Singapur, Singapore DCS CARD CENTRE PTE. LTD. Full time

Key Responsibilities Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation layers. Architect a cloud-native data warehouse solution on AWS, incorporating Spark and Flink to support both batch and streaming use cases with millisecond-level latency for payment data insights. Partner with key business units (e.g., acquiring and issuing teams) to develop data masking and auditing mechanisms that comply with PCI DSS and other regulatory standards. Design and maintain dashboards that enable data-driven decision-making across business functions. Integrate data from diverse payment systems to enable consistent, reliable, and scalable data flow across platforms. Own the full data pipeline—from ingestion and processing to modeling and standardization—ensuring high data quality, consistency, and accessibility. Enable cross-functional teams by driving data standardization, automation, and seamless access to clean, actionable datasets. Collaborate with compliance, risk, and product teams to deliver secure and reliable data solutions in a regulated environment. Required Qualifications Minimum 5 years of experience in data engineering or data warehouse development, with a strong track record of independently building scalable data platforms. Expertise in big data ecosystems and technologies, particularly Hadoop, Spark, and Flink, with deep knowledge of performance optimization techniques (e.g., shuffle tuning, checkpointing). Proficient in dimensional data modeling (e.g., star schema), ETL development, and data governance best practices. Industry experience in payments, fintech, or internet platforms is highly desirable; familiarity with payment data structures is a significant advantage. Strong interpersonal and communication skills, with the ability to work cross-functionally with product, compliance, and risk stakeholders. Preferred Qualifications Previous experience at a fintech or payment processing company. Proven success delivering end-to-end data platforms and analytical dashboards from the ground up. Knowledge of data compliance standards and secure data handling procedures. #J-18808-Ljbffr

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore ALMR CONSULTING PTE. LTD. Full time

    Job Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...

  • Big Data Engineer

    4 weeks ago

    Singapur, Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Job Title: Big Data Engineer (Java, Spark, Hadoop) Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...

  • Big Data Engineer

    4 days ago

    Singapur, Singapore Tata Consultancy Services Limited Full time

    Requirements Proven experience as a Big Data Engineer or similar role. Strong proficiency in Apache Spark and Scala programming. Experience with big data technologies such as Hadoop, Hive, Kafka, etc. Familiarity with data warehousing concepts and tools. Knowledge of SQL and NoSQL databases. Excellent problem-solving skills and attention to detail. Strong...

  • Big Data Engineer

    4 days ago

    Singapur, Singapore OCBC Full time

    Who We Are As Singapore’s longest established bank, we have been dedicated to enabling individuals and businesses to achieve their aspirations since 1932. How? By taking the time to truly understand people. From there, we provide support, services, solutions, and career paths that meet their individual needs and desires. Today, we’re on a journey of...

  • Big Data Test Engineer

    3 weeks ago

    Singapur, Singapore Patsnap Full time

    About PatSnap PatSnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...

  • Big Data Engineer

    4 weeks ago

    Singapur, Singapore Baidu, Inc. Full time

    Build the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....

  • Big Data Support Engineer

    2 days ago

    Singapur, Singapore ADVANCED E-SOLUTIONS PTE. LTD. Full time

    Overview POSITION OVERVIEW : Big Data Support Engineer General Duties and Tasks Skillset Up to 9 years of IT experience & 5+ Years on Teradata or Hadoop Last 3 years of relevant experience in banking/financial services industry Hands-on technologist, strong in SQL, UNIX and Hadoop/Teradata tools and technologies Demonstrable analytical skills with good...

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore ARYAN SOLUTIONS PTE. LTD. Full time

    Experience Hands-on Big Data experience using common open-source components (Hadoop, Hive, Spark, Presto, NiFi, MinIO, K8S, Kafka). Experience in stakeholder management in heterogeneous business/technology organizations. Experience in banking or financial business, with handling sensitive data across regions. Experience in large data migration projects with...

  • Senior Data Engineer

    2 weeks ago

    Singapur, Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join us to apply for the Senior Data Engineer (Big Data Processing) role at Centre for Strategic Infocomm Technologies (CSIT) . CSIT develops products to advance Singapore's national security interests, including counter-terrorism and computer network defence. We seek talented senior data engineers to lead and develop mission-critical products that identify,...

  • AI-Driven Big Data Engineer

    4 weeks ago

    Singapur, Singapore Pixalate, Inc Full time

    AI- Driven Big Data Engineer Employment Type: Full-TimeLocation : Remote, SingaporeLevel: Entry to Mid Level (PhD Required) Bridge Cutting-Edge AI Research with Petabyte-Scale Data Systems Pixalate is an online trust and safety platform that protects businesses, consumers and children from deceptive, fraudulent and non-compliant mobile, CTV apps and...