Lead Big Data Engineer

3 weeks ago


Singapur, Singapore GREAT EASTERN Full time
Job Number:

Lead Big Data Engineer (Job Number: WW )

About the Job

We are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain robust data pipelines and ETL solutions. This role involves working closely with cross-functional teams to ensure data quality, scalability, and alignment with business and technical requirements.

  • Design, develop, test, and maintain scalable ETL pipelines to meet business, technical, and user requirements.
  • Collect, refine, and integrate new datasets. Maintain comprehensive documentation and data mappings across multiple systems.
  • Create optimized and scalable data models that align with organizational data architecture standards and best practices.
  • Conduct code reviews and perform rigorous testing to ensure high-quality deliverables.
  • Drive continuous improvement in data quality through optimization, testing, and solution design reviews.
  • Ensure all solutions conform to big data architecture guidelines and long-term roadmap.
  • Implement robust monitoring, logging, and alerting systems to ensure pipeline reliability and data accuracy.
  • Apply best practices in data engineering to design and build reliable data marts within the Hadoop ecosystem for planning, reporting, and analytics.
  • Maintain and optimize data pipelines to ensure data accuracy, integrity, and timeliness.
  • Manage code in a centralized repository with clear branching strategies and well-documented commit messages.
  • Coordinate with stakeholders to ensure smooth production deployment and adherence to data governance policies.
  • Proactively identify and implement improvements to data engineering processes and workflows.
  • Architect end-to-end solutions for insurance data modeling in the data warehouse, including data acquisition, contextualization, and integration with business processes.
  • Act as a business process owner for onboarding users and data products onto the data platform and pipelines supporting dashboards and statistical models.
  • Ensure adherence to development standards and perform periodic reviews to maintain pipeline performance and sustainability.
  • Coordinate and conduct testing with stakeholders to ensure effective deployment of data pipelines and dashboards.
  • Monitor data pipelines continuously and collaborate with stakeholders to troubleshoot and optimize performance.
We are looking for people who
  • Diploma with at least 10 years’ working experience, preferably in Life Insurance
  • Proven experience in data engineering, ETL development, and big data technologies
  • A strong team player who is meticulous, detail-oriented, and capable of performing under pressure
  • Proficiency in tools and platforms such as Hadoop, Spark, Hive, and cloud data services (e.g., AWS, Azure, GCP).
  • Possesses strong problem-solving and interpersonal skills.
  • Committed, dependable, and adaptable with the flexibility to support during peak periods and tight deadlines
  • Demonstrate high integrity, accountability, and a collaborative mindset
How you succeed
  • Champion and embody our Core Values in everyday tasks and interactions.
  • Demonstrate high level of integrity and accountability.
  • Take initiative to drive improvements and embrace change.
  • Take accountability of business and regulatory compliance risks, implementing measures to mitigate them effectively.
  • Keep abreast with industry trends, regulatory compliance, and emerging threats and technologies to understand and highlight potential concerns/ risks to safeguard our company proactively.
Who we are

Founded in 1908, Great Eastern is a well-established market leader and trusted brand in Singapore and Malaysia. With over S$100 billion in assets and more than 16 million policyholders, including 12.5 million from government schemes, it provides insurance solutions to customers through three successful distribution channels – a tied agency force, bancassurance, and financial advisory firm Great Eastern Financial Advisers. The Group also operates in Indonesia and Brunei. The Great Eastern Life Assurance Company Limited and Great Eastern General Insurance Limited have been assigned the financial strength and counterparty credit ratings of "AA-" by S&P Global Ratings since 2010, one of the highest among Asian life insurance companies. Great Eastern's asset management subsidiary, Lion Global Investors Limited, is one of the leading asset management companies in Southeast Asia. Great Eastern is a subsidiary of OCBC, the longest established Singapore bank, formed in 1932. It is the second largest financial services group in Southeast Asia by assets and one of the world’s most highly-rated banks, with an Aa1 rating from Moody’s and AA- by both Fitch and S&P. Recognised for its financial strength and stability, OCBC is consistently ranked among the World’s Top 50 Safest Banks by Global Finance and has been named Best Managed Bank in Singapore by The Asian Banker.

To All Recruitment Agencies Great Eastern does not accept unsolicited agency resumes. Please do not forward resumes to our email or our employees. We will not be responsible for any fees related to unsolicited resumes.

#J-18808-Ljbffr
  • Big Data Engineer

    7 days ago


    Singapur, Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Job Title: Big Data Engineer (Java, Spark, Hadoop) Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...

  • Data Engineering Lead

    2 weeks ago


    Singapur, Singapore Citi Full time

    Join to apply for the Data Engineering Lead - Big Data Technologies- Vice President role at Citi . The Engineering Lead Analyst is a senior level position responsible for leading a variety of engineering activities including the design, acquisition and deployment of hardware, software and network infrastructure in coordination with the Technology team. The...


  • Singapur, Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) 1 week ago Be among the first 25 applicants Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) Data processing is an essential part of national security in the modern world. As an engineer in...


  • Singapur, Singapore Citi Full time

    Overview The Engineering Lead Analyst is a senior level position responsible for leading a variety of engineering activities including the design, acquisition and deployment of hardware, software and network infrastructure in coordination with the Technology team. The overall objective of this role is to lead efforts to ensure quality standards are being met...

  • Big Data Engineer

    7 days ago


    Singapur, Singapore Baidu, Inc. Full time

    Build the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....

  • Big Data Engineer

    2 weeks ago


    Singapur, Singapore Helius Technologies Pte Ltd Full time

    Big Data Engineer Job Requirement: 5 years of hands on work experience in Hadoop, Scala, Pyspark and Python. Work with Hadoop Distributed File System (HDFS) to manage and store large datasets Utilize tools like Hive, HBase, and Pig to process data in Hadoop Set up and manage data pipelines to extract, transform, and load (ETL) large datasets Develop and...

  • Big Data Engineer

    1 day ago


    Singapur, Singapore DCS CARD CENTRE PTE. LTD. Full time

    Key Responsibilities Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation layers. Architect a cloud-native data warehouse solution on AWS, incorporating Spark and Flink to support both batch and streaming use cases...

  • Data Engineering Lead

    3 weeks ago


    Singapur, Singapore Citigroup Inc. Full time

    Overview The Engineering Lead Analyst is a senior level position responsible for leading a variety of engineering activities including the design, acquisition and deployment of hardware, software and network infrastructure in coordination with the Technology team. The overall objective of this role is to lead efforts to ensure quality standards are being...


  • Singapur, Singapore OCBC Full time

    Overview As Singapore’s longest established bank, we have been dedicated to enabling individuals and businesses to achieve their aspirations since 1932. Today, we’re on a journey of transformation, leveraging technology and creativity to become a future-ready learning organisation. Our strategic ambition is to be Asia’s leading financial services...


  • Singapur, Singapore Centre for Strategic Infocomm Technologies Full time

    CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer NetworkDefence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the...