Avp, Big Data Engineer, Data Technology, Technology

2 weeks ago


Singapore NodeFlair Full time

Job Summary:

Salary
S$6,500 - S$11,700 / Monthly

Job Type

Seniority
Senior

Years of Experience
At least 7 years

Tech Stacks
ETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDB

Business Function

Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation.

In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels.


We are looking for a Big Data Engineer that will work on developing frameworks using Spark and Spring Boot microservices to create jobs for collecting, storing, processing, and analysing of huge sets of data.

The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

You will also be responsible for integrating them with the architecture used across the company.

Responsibilities

  • Implementing Big Data tools and frameworks required to provide requested capabilities.
  • Work with stakeholders including the Product owner, Data and Design teams to assist with
- data-related technical issues and support their data infrastructure needs.

  • Support customers implementing ETL process
  • Monitoring performance and advising any necessary infrastructure changes

Requirements:

  • Bachelor's degree in Computer Science or a related field. At least 7 years of IT experience of which at least 5 years' experience in similar role, ideally in a Big Data tools.
  • Proficient understanding of distributed computing principles
  • Strong experience of
    Hadoop, Spark, Iceberg and Spring Boot:
  • Experience with building stream-processing systems, using solutions such as Spark-Streaming
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
  • Experience with integration of data from multiple data sources
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
  • Knowledge of various ETL techniques and frameworks
  • Experience with various messaging systems, such as Kafka or RabbitMQ
  • Knowlege with Big Data ML toolkits, such as Mahout, SparkML, or H2O
  • Good understanding of Lambda Architecture, along with its advantages and drawbacks


We offer a competitive salary and benefits package and the professional advantages of a dynamic environment that supports your development and recognises your achievements.



  • Singapore DBS Bank Limited Full time

    Business Function Group Technology and Operations department at the bank ensures the existence of a strong, agile, and reliable infrastructure by focusing on productivity, quality, technology, skilled individuals, and innovation. Within Group T&O, we handle most of the Bank's operational procedures and strive to impress our business partners through...


  • Singapore DBS Bank Limited Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$13,160 - S$22,080 / Monthly ESTJob TypePermanentSeniorityDirectorYears of ExperienceAt least 7 yearsTech StacksETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDB We are looking for a Big Data Engineer that will work on developing frameworks using Spark and Spring Boot microservices to...


  • Singapore DBS Bank Limited Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business...


  • Singapore DBS Bank Limited Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business...


  • Singapore DBS Bank Limited Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business...


  • Singapore Grab Full time

    Job Description:Life at Grab:At Grab, every Grabber is guided by The Grab Way, which spells out our mission, how we believe we can achieve it, and our operating principles - the 4Hs: Heart, Hunger, Honour and Humility. These principles guide and help us make decisions as we work to create economic empowerment for the people of Southeast Asia.Get to know our...


  • Singapore DBS Bank Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we managethe majority ofthe Bank\'s operational processes and inspire to delight our business...


  • Singapore DBS Bank Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we managethe majority ofthe Bank\'s operational processes and inspire to delight our business...


  • Singapore DBS Bank Limited Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business...


  • Singapore DBS Bank Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we managethe majority ofthe Bank\'s operational processes and inspire to delight our business...

  • Data Engineer

    2 weeks ago


    Singapore DOZER DATA PTE. LTD. Full time

    About the job:This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data.This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers.Responsibilities:In this role,...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$6,500 - S$13,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 1 yearTech StacksETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQLResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.TikTok is the...

  • Senior Data Engineer

    3 months ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY Full time

    What you will be doing Day to Day:Collaborate closely with the data product team and business end-users to create and maintain data platforms with best-in-class technology and methodology.Create robust and scalable data ingestion and data management solutions for batch and streaming data sources.Collaborate with the data governance team to develop the data...

  • Senior Data Engineer

    4 weeks ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY Full time

    What you will be doing Day to Day:Collaborate closely with the data product team and business end-users to create and maintain data platforms with best-in-class technology and methodology.Create robust and scalable data ingestion and data management solutions for batch and streaming data sources.Collaborate with the data governance team to develop the data...

  • Senior Data Engineer

    2 months ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY Full time

    What you will be doing Day to Day:Collaborate closely with the data product team and business end-users to create and maintain data platforms with best-in-class technology and methodology.Create robust and scalable data ingestion and data management solutions for batch and streaming data sources.Collaborate with the data governance team to develop the data...

  • Senior Data Engineer

    4 weeks ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY Full time

    What you will be doing Day to Day:Collaborate closely with the data product team and business end-users to create and maintain data platforms with best-in-class technology and methodology.Create robust and scalable data ingestion and data management solutions for batch and streaming data sources.Collaborate with the data governance team to develop the data...


  • Singapore DBS Bank Limited Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business...

  • Data Engineer

    1 month ago


    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    The Insurance Risk and Finance Research Centre (IRFRC) at the Nanyang Business School (NBS), Nanyang Technological University (NTU) is looking for an experienced Data Engineer to join the team.Key Responsibilities:Co-evaluate business needs and objectives.Build IT/data systems and pipelines.Build algorithms and prototypes.Support data acquisition for...

  • Data Engineer

    2 months ago


    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    The Insurance Risk and Finance Research Centre (IRFRC) at the Nanyang Business School (NBS), Nanyang Technological University (NTU) is looking for an experienced Data Engineer to join the team.Key Responsibilities:Co-evaluate business needs and objectives.Build IT/data systems and pipelines.Build algorithms and prototypes.Support data acquisition for...