Current jobs related to Attractive Job Opening for Data Engineer(Big Data) - Singapore - IITMATRIX PTE. LTD.


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) 1 week ago Be among the first 25 applicants Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) Data processing is an essential part of national security in the modern world. As an engineer in...


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...


  • Singapore beBeeData Full time $180,000 - $240,000

    Job DescriptionData processing plays a vital role in national security in today's world.Develop and maintain real-time high-volume data processing, querying, and persistence solutions using Big Data technologies.Implement highly available, resilient, scalable, and sustainable Big Data platforms.Administer Big Data platform services running across multiple...

  • Big Data Engineer

    1 week ago


    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...


  • Singapore Proofpoint Full time

    It's fun to work in a company where people truly BELIEVE in what they're doing! - We're committed to bringing passion and customer focus to the business._ - Senior Big Data Engineer Excited to grow your career? - We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to...

  • Big Data Engineer

    1 week ago


    Singapore Employment Vietnam Full time

    Location: Singapore Industry: E-commerce **MAIN RESPONSIBILTIES**: - Devise and implement a robust offline data architecture tailored for large-scale recommendation systems. - Craft and deploy adaptable, scalable, resilient, and high-performing storage and computing systems. - Conduct troubleshooting of production systems and create necessary mechanisms...


  • Singapore beBeeDataScience Full time $80,000 - $120,000

    Job Title: Chief Data ArchitectWe are seeking a talented Chief Data Architect to lead the design and implementation of our big data architecture.A high degree of technical expertise in computer science and operating system principles is required for this role.The ideal candidate will have a strong foundation in programming languages such as Java, Scala or...

  • Big Data Engineer

    1 week ago


    Singapore UNISON Group Full time $104,000 - $130,878 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    1 week ago


    Singapore IITMATRIX Full time

    We are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...

Attractive Job Opening for Data Engineer(Big Data)

2 weeks ago


Singapore IITMATRIX PTE. LTD. Full time

**SCOPE OF THE ROLE
You will also be responsible for quality assurance of the team’s delivery in conformance with the Bank-defined software delivery methodology and tools. You will partner with other technology functions to help deliver required technology solutions.

Other responsibilities include:

- Create frameworks, technical features which helps in faster operationalisation of Data models, Analytical models(including AI/ML) and user generated contents (dashboards, reports etc)
- Effectively partner with data scientists in enabling faster adoption of AL/ML model based systems
- Independently install, customise and integrate software packages and programs
- Carry out POCs involving new data technologies
- Create technical documents such as solution design, program specifications for target solutions
- Performance tuning
- Work with production support team members to conduct root cause analysis of issues, review new and existing code and/or perform unit testing
- Perform tasks as part of a cross functional development team using agile or other methodologies and utilising project management software

**Technical skillsets**

**TEAMArchitecture (Big Data)**
- Experience in large scale implementations and performance optimizations in the Big Data Ecosystem using Spark, Hive, Impala, Apache Kudu, Ozone, Presto, Tez, Iceberg etc
- Knowledge of frameworks such as Spring, Struts, Hibernate etc
- Knowledge of Object Oriented Programming, Multi-threading, Containerization, etc
- Knowledge of related technologies such as HTML, Javascript, CSS, Jquery, node.js, docker
- Knowledge of Elastic, Kibana, Logstash, Hive, Sqoop, MongoDB, Oozie, Flume, Kafka

At least, 2 to 3 technical certifications in any of the below technologies:
1. Language - SQL, Java, Python, Scala, Javascript, node.js

2. Automation / scripting - CtrlM, Shell Scripting, Groovy

3. Cloudera Hadoop distribution - Hive, Impala, Spark, Kudo, Kafka, Flume

**Additional Experience required for all teams **to create an added advantage:
1. CI/CD software, Testing Tools - Jenkins, SonarQube

2. Version Control Tool - Aldon+LMe, CA Endeavor

3. Deployment Tool kit -Jenkins

4. Service or Incident Management (IcM) Tools - Remedy

5. Source Code Repository Tool - Bitbucket

6. Scheduling Tool - Control-M

7. Defect Management Tool - JIRA

8. Application Testing tool - QuerySurge

9. Cloud certification

10. Platforms provided by FICO, Experian, SAS for credit and portfolio management

**EDUCATION**
- Bachelor’s degree/University degree in Computer Science, Engineering, or equivalent experience

**WHAT WILL HELP YOU SUCCEED IN THIS ROLE**
- Adopt an uncompromising attitude when it comes to quality and help raise bar of products and team members
- Be a team player who communicates effectively and professionally with both internal and external customers
- Identify ideas to improve system performance and impact availability
- Embrace tackling and resolving complex technical design issues
- Possess strong problem solving and decision-making skills while exercising good judgment
- Strong analytical and problem-solving skills
- Ability to work on multiple projects at a time
- Be able to work under pressure and manage deadlines or unexpected changes in expectations or requirements
- Good communication skills - ability to convey technical information to non-technicalaudience
- Ability to understand the big picture
- Ability to develop long lasting relationships with all levels
- Deep understanding and experience in software development cycle, including Agile based rapid delivery
- Collaborate with business and IT to analyse, elicit and review business requirements
- Facilitate communication between vendor, project team, business stakeholders and internal IT team
- Ability to work in a team distributed across multiple locations