Senior Data Engineer

Found in: Talent SG 2A C2 - 2 weeks ago

Singapore SAKSOFT PTE LIMITED Full time
Roles & Responsibilities

Role: Senior Data Engineer

Job level: More than 10 years of relevant experience (L4)

Key skills:

AS400, Hadoop, Data Lake, SQL, Informatica

Key Responsibilities:

· Design, develop, and implement data processing pipelines to process large volumes of structured and unstructured data

· Should have good knowledge and working experience in Database and Hadoop (Hive, Impala, Kudu).

· Should have good knowledge and working experience in scripting using (Shell script, awk programming, quick automation to integrating any third-party tools), BMC monitoring tools

· Good understanding and knowledge in Data Modelling area using industry standard data model like (FSLDM)

· Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions

· It will be good to have experience in working with No SQL as well as virtualized Database Environment

· Implement data transformations, aggregations, and computations using Spark RDDs, Data Frames, and Datasets, and integrate them with Elasticsearch

· Develop and maintain scalable and fault-tolerant Spark applications, adhering to industry best practices and coding standards

· Troubleshoot and resolve issues related to data processing, performance, and data quality in the Spark-Elasticsearch integration

· Monitor and analyze job performance metrics, identify bottlenecks, and propose optimizations in both Spark and Elasticsearch components

· Prior experience in developing banking application using ETL, Hadoop is mandatory. In depth knowledge of technology stack at global banks is mandatory.

· Flexibility to stretch and take challenges

· Communication & Interpersonal skills

· Attitude to learn and execute

Key Requirements:

• 7+ years of AS400, RPG, CLP & SQL

• Knowledge of Aldon Change Management System(ACMS) is a must·

• Experience in developing Hadoop

• Experience in data lake (integration of different data sources into the data lake)

• SQL Stored Procedures/Queries/Functions

• Unix Scripting

• Experience with distributed computing, parallel processing, and working with large datasets

• Familiarity with big data technologies such as Hadoop, Hive, and HDFS

• Job Scheduling in Control-M

• Strong problem-solving and analytical skills with the ability to debug and resolve complex issues

• Familiarity with version control systems (e.g., Git) and collaborative development workflows

• Excellent communication and teamwork skills with the ability to work effectively in cross-functional teams.


Tell employers what skills you have

Control M
Version Control
Informatica PowerCenter
As400
Big Data
Hadoop Database
Hadoop
Informatica
Scripting
Dataframe
ETL
Unix
RPG
NoSQL
Data Engineering
SQL
HDFS
Hive
Unix Shell Scripting

  • Data Centre Operations Technology

    3 weeks ago

    Singapore Bridge Data Centres (international) Pte. Ltd. Full time

    Key Responsibilities:. Conduct in-depth design reviews and oversee the commissioning/Integrated Systems Testing (IST) processes for new data centre projects, as well as modifications and expansions to existing data centres. Enhance and standardize data centre operation and maintenance policies and procedures to ensure efficiency and compliance. Perform...

  • Senior Data Engineer

    2 weeks ago

    Singapore Airswift Full time

    Airswift is inviting an experienced Senior Data Engineerto work on large scale high value projects in the oil and gas marine industry. The Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other...

  • Data Engineer

    Found in: Talent SG 2A C2 - 2 weeks ago

    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates, please email your resume to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits: Renewable contract (Performance-based, with possibility of conversion to...

  • Data Engineer

    2 weeks ago

    Singapore Ntt Data Singapore Pte. Ltd. Full time

    ' EMAIL ID : Interested candidates, please email your resume to [HIDDEN TEXT]Only shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits:Renewable contract (Performance-based, with possibility of conversion to perm)Medical Insurance CoverageLeave...

  • Senior Data Engineer

    Found in: Talent SG 2A C2 - 2 weeks ago

    Singapore MINDEN INTERNATIONAL PTE. LTD. Full time

    Roles & ResponsibilitiesWho we are:minden.ai is a technology venture founded by Temasek in strategic partnership with DFI Retail Group and coalition partners BreadTalk Group, DBS Bank, PAssion Card, Mandai Wildlife Group, Singtel, FoodPanda, GoJek and Great Eastern. We are on a mission to redefine the engagement between brands and consumers in Southeast...

  • Senior Data Engineer

    3 weeks ago

    Singapore Minden International Pte. Ltd. Full time

    Who we are:minden.ai is a technology venture founded by Temasek in strategic partnership with DFI Retail Group and coalition partners BreadTalk Group, DBS Bank, PAssion Card, Mandai Wildlife Group, Singtel, FoodPanda, GoJek and Great Eastern. We are on a mission to redefine the engagement between brands and consumers in Southeast Asia.The way we work:At...

  • Senior Data Engineer

    3 weeks ago

    Singapore Technology Services Group Pte. Ltd. Full time

    Our company is at the forefront of innovation in financial technology. Our mission is to develop an AI-driven platform that predicts market trends, empowering retail investors with the tools previously only accessible to professionals. We're looking for a talented Senior Data Engineer with an interest in finance to join our growing team in our Singapore...

  • Senior Data Engineer

    2 weeks ago

    Singapore One Consulting (global) Pte. Ltd. Full time

    SummaryThe Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other digital use cases.Job Requirements:Design, develop, and maintain robust, scalable and sustainable data products and build &...

  • Senior Data Engineer

    1 week ago

    Singapore Ntuc Enterprise Nexus Co-operative Limited Full time

    Job DescriptionWe are looking for an experienced data engineer (DE) with a strong sense of social mission. This role is seconded to NTUC Health (NHealth), as a part of NHealth's multidisciplinary data team consisting of data engineer, data scientist and data analyst. You will report to the Head of Data & Analytics, who is accountable to the NHealth and NTUC...

  • Senior Data Engineer

    Found in: Talent SG 2A C2 - 2 weeks ago

    Singapore ONE CONSULTING (GLOBAL) PTE. LTD. Full time

    Roles & ResponsibilitiesSummaryThe Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other digital use cases.Job Requirements: Design, develop, and maintain robust, scalable and sustainable...

  • Senior Data Engineer

    Found in: Talent SG 2A C2 - 2 weeks ago

    Singapore NTUC ENTERPRISE NEXUS CO-OPERATIVE LIMITED Full time

    Roles & ResponsibilitiesJob DescriptionWe are looking for an experienced data engineer (DE) with a strong sense of social mission. This role is seconded to NTUC Health (NHealth), as a part of NHealth’s multidisciplinary data team consisting of data engineer, data scientist and data analyst. You will report to the Head of Data & Analytics, who is...

  • Senior Data Engineer

    Found in: Talent SG 2A C2 - 2 weeks ago

    Singapore TECHNOLOGY SERVICES GROUP PTE. LTD. Full time

    Roles & ResponsibilitiesOur company is at the forefront of innovation in financial technology. Our mission is to develop an AI-driven platform that predicts market trends, empowering retail investors with the tools previously only accessible to professionals. We're looking for a talented Senior Data Engineer with an interest in finance to join our growing...

  • Senior Data Engineer

    2 weeks ago

    Singapore Saksoft Pte Limited Full time

    Role: Senior Data EngineerJob level: More than 10 years of relevant experience (L4)Key skills:AS400, Hadoop, Data Lake, SQL, InformaticaKey Responsibilities:. Design, develop, and implement data processing pipelines to process large volumes of structured and unstructured data. Should have good knowledge and working experience in Database and Hadoop (Hive,...

  • Senior / Lead Data Engineer

    2 weeks ago

    Singapore Vanguard Software Pte. Ltd. Full time

    JOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data engineering, expertise in...

  • Senior Software Engineer

    2 weeks ago

    Singapore Ntt Data Singapore Pte. Ltd. Full time

    Responsibilities:. Collaborates and works with Engineering team to develop technical solutions, plans and configuration, in response to requirements from Business and Application teams.. Plan and build efficient data platforms, systems and infrastructure for intelligent engines which empower business critical features leveraging background of distributed...

  • Senior / Lead Data Engineer

    Found in: Talent SG 2A C2 - 2 weeks ago

    Singapore VANGUARD SOFTWARE PTE. LTD. Full time

    Roles & ResponsibilitiesJOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data...

  • Data Engineer

    2 weeks ago

    Singapore Combuilder Pte Ltd Full time

    We are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and systems.About the RoleCollaborating with a team of highly...

  • Senior Director, Design and Engineering

    3 weeks ago

    Singapore Jj Consulting Services Full time

    Our Client is an established company in Singapore, who is seeking to recruit a Senior Director, Design and Engineering (Data Centre).Senior Director, Design and Engineering (Data Centre)Our client is looking for a senior director to manage their data centre design / engineering for regional expansion. You will be leading the inhouse engineering design...

  • Data Engineer

    Found in: Talent SG 2A C2 - 2 weeks ago

    Singapore COMBUILDER PTE LTD Full time

    Roles & ResponsibilitiesWe are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and systems.About the Role ...

  • Senior Director, Design and Engineering

    Found in: Talent SG 2A C2 - 3 weeks ago

    Singapore JJ CONSULTING SERVICES Full time

    Roles & ResponsibilitiesOur Client is an established company in Singapore, who is seeking to recruit a Senior Director, Design and Engineering (Data Centre).Senior Director, Design and Engineering (Data Centre)Our client is looking for a senior director to manage their data centre design / engineering for regional expansion. You will be leading the inhouse...