Data Engineer

1 day ago

Singapore A-IT SOFTWARE SERVICES PTE LTD Full time
Roles & Responsibilities

Data Engineer - Cloud

Expected Years of Experience: 5 – 10 years of experience


SCOPE OF THE ROLE

You will be responsible for the end-to-end software development and support for all work related to projects, quarterly change requests, L3 production fixes. This includes software product implementation and administration, application design, development, implementation, testing and support. You will be expected to work on Kubernetes based platforms.


You will also be responsible for quality assurance of the team’s delivery in conformance with the Bank-defined software delivery methodology and tools. You will partner with other technology functions to help deliver required technology solutions.


Other responsibilities include:

- Create frameworks, technical features which helps in faster implementation of OpenShift Kubernetes based applications


- Carry out POCs involving new data technologies, new container platforms, sidecars, daemonsets


- Design and develop application frameworks for container integration


- Create technical documents such as solution design, program specifications for target solutions


- Perform design and development of applications which may not be limited to: Software Applications, Data Integration, User Interfaces, Automation


- Maintain and recommend software improvements to ensure a platform centric management of software applications


- Performance tuning


- Work with production support team members to conduct root cause analysis of issues, review new and existing code and/or perform unit testing


- Perform tasks as part of a cross functional development team using agile or other methodologies and utilising project management software


- Independently install, customise and integrate software packages, programs, product releases


Functional skillsets


Hands-on experience in implementing large scale data warehouse & analytics platforms in financial services industry with good functional knowledge of products & services offered in Retail bank / Wholesale / Global Markets covering some of the following analytics domains:


- Experience in deploying stateless, stateful workloads on OpenShift Kubernetes based platform


- Experience in developing microservices applications using node js, React, Java, RabbitMQ, Akka framework, Apache Consul, Apache Geode, Redis


- Experience in developing frameworks using Spark, Scala, Java, Python


- Experience in working with in-memory applications


- Strong knowledge of Operating Systems


- Experience in container deployment management using either Helm Package manager or Kustomize


- Experience in integrating container applications with an external security vault such as CyberArk Conjur, AAM


- Experience in deployment automation of container applications using Jenkins, Jfrog, Gradle, Bitbucket, Groovy


- Expertise in implementing appropriate security of data (SSL, Encryption)


- Expertise in Load balancing and replication, scheduling


- Good knowledge of Custom Resources, Docker, Taints & tolerances, Node affinity, ConfigMaps


- Experience in Shell scripting, Control-M


- Expertise in design of role based fine grained access control


- Supporting application failures, planning for resiliency, Back-up Recovery


Technical skillsets


Cloud Engineer

- Platforms provided by IBM Cloud Pak for Data (CP4D)

- Kubernetes based platforms such as OpenShift, AWS, Azure, GCP

- Software defined storage (ODF)

- IBM Storage Fusion

- S3 compatible storage options (Dell ECS, HCP)

- Node js, React, Java, RabbitMQ, Akka framework, Apache Consul, Apache Geode, Redis

- Scala, Java, Python

- Helm Package manager, Kustomize

- Jenkins, Jfrog, Gradle, Bitbucket, Groovy

- Shell scripting, Docker

- Splunk, Prometheus, Geneous


At least, 2 to 3 technical certifications in any of the below technologies:

1. OpenShift

2. Kubernetes, Docker

3. Language – SQL, Java, Python, Scala

4. Automation / scripting – CtrlM, Shell Scripting, Groovy


Additional Experience required for all teams to create an added advantage:

1. CI/CD software, Testing Tools - Jenkins, SonarQube

2. Version Control Tool - Aldon+LMe, CA Endeavor

3. Deployment Tool kit -Jenkins

4. Service or Incident Management (IcM) Tools - Remedy

5. Source Code Repository Tool - Bitbucket

6. Scheduling Tool - Control-M

7. Defect Management Tool - JIRA

8. Application Testing tool – QuerySurge

9. Cloud certification


EDUCATION

- Bachelor’s degree/University degree in Computer Science, Engineering, or equivalent experience


WHAT WILL HELP YOU SUCCEED IN THIS ROLE

- Adopt an uncompromising attitude when it comes to quality and help raise bar of products and team members

- Be a team player who communicates effectively and professionally with both internal and external customers

- Identify ideas to improve system performance and impact availability

- Embrace tackling and resolving complex technical design issues

- Possess strong problem solving and decision-making skills while exercising good judgment

- Strong analytical and problem-solving skills

- Ability to work on multiple projects at a time

- Be able to work under pressure and manage deadlines or unexpected changes in expectations or requirements

- Good communication skills - ability to convey technical information to non-technical audience

- Ability to understand the big picture

- Ability to develop long lasting relationships with all levels

- Deep understanding and experience in software development cycle, including Agile based rapid delivery

- Collaborate with business and IT to analyse, elicit and review business requirements

- Facilitate communication between vendor, project team, business stakeholders and internal IT team

- Ability to work in a team distributed across multiple locations


Tell employers what skills you have

Kubernetes
Azure
NodeJS
Agile
Root Cause Analysis
Scripting
Administration
JIRA
Python
Operating Systems
Docker
GCP
Cloud
Java
S3
Apache
Financial Services

  • Data Engineer

    4 weeks ago

    Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Big Data Engineer to join our team at NTT Data Singapore. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably.Key...

  • Data Engineer

    4 weeks ago

    Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team at NTT Data Singapore.Key ResponsibilitiesAnalyze the Authority's data needs and document the requirements.Refine data collection/consumption by migrating data collection to more efficient channels.Plan, design and implement data engineering jobs and reporting solutions...

  • Senior Big Data Engineer

    1 week ago

    Singapore NTT Data Singapore Full time

    Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Proficiency in distributed computing principles and strong experience with Hadoop,...

  • Senior Big Data Engineer

    4 days ago

    Singapore NTT Data Singapore Full time

    Job Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Key Responsibilities • Proficient understanding of distributed computing...

  • Data Scientist

    4 weeks ago

    Singapore NTT Data Singapore Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore.Key Responsibilities:Design and develop large-scale data processing systems using Hadoop and Spark.Implement data pipelines using Spring Boot and integrate data from multiple sources.Develop and maintain data warehouses using NoSQL databases such as HBase and...

  • Data Solutions Engineer

    19 hours ago

    Singapore DATA CONNECT TECHNOLOGIES PTE. LTD. Full time

    Technical Consultant RoleAt DATA CONNECT TECHNOLOGIES PTE. LTD., we are seeking a skilled Technical Consultant to join our team. The ideal candidate will possess a strong understanding of systems administration, networking protocols, and cybersecurity principles.Pre-Sales Technical ServicesAssist potential clients in understanding our suite of products and...

  • Data Engineer

    1 month ago

    Singapore Cognizant Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Cognizant. As a Data Engineer, you will be responsible for designing, developing, and deploying large-scale data pipelines and architectures to support our business needs.Key Responsibilities:Data Pipeline Development: Design, build, and maintain efficient and reliable...

  • Data Engineer

    1 day ago

    Singapore NEURONES IT ASIA PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Engineer, Your main responsibilities will include: Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data. Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data. Optimize and tune Spark...

  • Data Engineer

    1 day ago

    Singapore SYNECHRON TECHNOLOGIES SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities:· Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives· Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions· Ensure data quality and integrity...

  • Data Engineer

    1 day ago

    Singapore ARISTON SERVICES PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities:· Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives· Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions· Ensure data quality and integrity...

  • Data Engineer

    1 day ago

    Singapore HTC SOFTWARE SINGAPORE PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking a talented Data Engineer experience in Quantexa with expertise in Hadoop, Scala, Spark, Elastic, Open Shift Container Platform (OCP) and DevOps practices.As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.You will...

  • Data Engineer

    1 month ago

    Singapore SINGAPORE SHELL EMPLOYEES' UNION CO-OPERATIVE LTD Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at SINGAPORE SHELL EMPLOYEES' UNION CO-OPERATIVE LTD. As a Data Engineer, you will play a critical role in designing and implementing data solutions that drive business growth and innovation.Key Responsibilities:Design and develop data pipelines to extract, transform, and...

  • Data Engineer

    1 day ago

    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesWe are seeking a skilled and motivated Intermediate Data Engineer to join our dynamic team. The successful candidate will play a crucial role in designing, developing, and maintaining our data infrastructure, ensuring efficient processing and analysis of large datasets. As an Intermediate Data Engineer, you will collaborate with...

  • Data Engineer

    1 day ago

    Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesJob DescriptionWe are seeking a skilled and motivated Intermediate Data Engineer to join our dynamic team. The successful candidate will play a crucial role in designing, developing, and maintaining our data infrastructure, ensuring efficient processing and analysis of large datasets. As an Intermediate Data Engineer, you will...

  • Data Engineer

    1 day ago

    Singapore JCO ANALYTICS PTE. LTD. Full time

    Roles & ResponsibilitiesJob Title: Data EngineerLocation: Tai Seng, SingaporeJob Type: Full-TimeOverview:We are looking for a fresh graduate (degree or diploma) Data Engineer to join our growing team. In this role, you will design, build, and maintain data pipelines and infrastructure to support the collection, storage, and analysis of large volumes of data....

  • Data Engineer

    1 month ago

    Singapore MAESTRO HUMAN RESOURCE PTE. LTD. Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our product development team at MAESTRO HUMAN RESOURCE PTE. LTD. As a key member of our team, you will be responsible for designing and implementing data integration pipelines and asynchronous data events using event-driven architecture approaches to consolidate data from various sources and...

  • Data Engineer

    1 day ago

    Singapore NICOLL CURTIN TECHNOLOGY PTE. LTD. Full time

    Roles & ResponsibilitiesKey Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Python. Collaborate with data scientists, analysts, and other engineers to ensure efficient data flow and processing. Manage and optimize data workflows in AWS cloud environments. Ensure data quality through data...

  • Data Engineer

    19 hours ago

    Singapore ABS CONNECT PTE. LTD. Full time

    Data Engineer Job at ABS CONNECT PTE. LTD.Are you looking for a challenging role in data engineering? We are seeking a skilled Data Engineer to join our team at ABS CONNECT PTE. LTD. As a Data Engineer, you will be responsible for designing and building robust and scalable data ingestion and data management solutions for batch loading and streaming from data...

  • Data Engineer

    3 weeks ago

    Singapore Cognizant Full time

    Job Title: Data EngineerCognizant is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and deploying data tables, views, and marts in data warehouses, operational data stores, data lakes, and data virtualization.Key Responsibilities:Data Engineering: Design and develop efficient...

  • Data Engineer

    1 day ago

    Singapore PEOPLEBANK SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesData Engineer 6 months contract with a possibility of extension Work location: CBDOur Client MNC IT companyThe Opportunity Work across workstreams to support data requirements including reports and dashboards Analyze and perform data profiling to understand data patterns and discrepancies following Data Quality and Data...