Avp, Big Data Engineer, Data Technology, Technology

1 week ago


Singapore NodeFlair Full time

**Job Summary**:
**Salary**
S$6,500 - S$11,700 / Monthly

**Job Type**

**Seniority**

Senior

**Years of Experience**
At least 7 years

**Tech Stacks**
ETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDB

**Business Function**
Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels.

We are looking for a Big Data Engineer that will work on developing frameworks using Spark and Spring Boot microservices to create jobs for collecting, storing, processing, and analysing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

**Responsibilities**
- Implementing Big Data tools and frameworks required to provide requested capabilities.
- Work with stakeholders including the Product owner, Data and Design teams to assist with
- data-related technical issues and support their data infrastructure needs.
- Support customers implementing ETL process
- Monitoring performance and advising any necessary infrastructure changes

**Requirements**:

- Bachelor's degree in Computer Science or a related field. At least 7 years of IT experience of which at least 5 years' experience in similar role, ideally in a Big Data tools.
- Proficient understanding of distributed computing principles
- Strong experience of **Hadoop, Spark, Iceberg and Spring Boot**:

- Experience with building stream-processing systems, using solutions such as Spark-Streaming
- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
- Experience with integration of data from multiple data sources
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
- Knowledge of various ETL techniques and frameworks
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Knowlege with Big Data ML toolkits, such as Mahout, SparkML, or H2O
- Good understanding of Lambda Architecture, along with its advantages and drawbacks

We offer a competitive salary and benefits package and the professional advantages of a dynamic environment that supports your development and recognises your achievements.



  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$13,160 - S$22,080 / Monthly EST **Job Type** Permanent **Seniority** Director **Years of Experience** At least 7 years **Tech Stacks** ETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDB - We are looking for a Big Data Engineer that will work on developing frameworks using...

  • Big Data Engineer

    3 days ago


    Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time

    **Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...


  • Singapore Pixocial Technology Full time

    **Job Description**: - 1. Responsible for building data systems for our apps and continuously optimizing our data-oriented operation capacity based on data, algorithm, and engineering capabilities. - 2. Participate in the planning and construction of big data basic frameworks and technology systems, including data collection, smart and automatic data...


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...


  • Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. **Key Responsibilities**: - Design and...

  • Big Data Engineer

    2 weeks ago


    Singapore Baidu, Inc. Full time

    Build the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....


  • Singapore QUESSCORP HOLDINGS PTE. LTD. Full time

    **Job Description**: - Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. - Ensure data quality, integrity, and consistency across various data sources. - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that...

  • Big Data Architect

    3 days ago


    Singapore Unison Consulting Pte Ltd Full time

    Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. - Optimize data...


  • Singapore AVP Full time

    Responsibilities Wharf & Vessel Side Mechanisation / Automation Embodied AI / Robotics strategy & execution including digital twin & simulations as well as AI orchestration across aPM aQC and automated wharf coning / deconing for optimal operational performance. PSA SG / PSAM Technology Roadmap & RIE Partnership (MOT MPA SMI S&TPPO A Star IHLs) to optimise...


  • Singapore Sea Full time

    Join to apply for the Data Engineer/Senior Engineer role at Sea Join to apply for the Data Engineer/Senior Engineer role at Sea About Us Sea is the leading consumer internet company in Southeast Asia and Taiwan. Our mission is to better the lives of the consumers and small businesses of our region with technology. About the Team: About Us Sea is the leading...