Developer (Big Data-framework Engineer)

6 days ago

Singapore NodeFlair Full time

**Job Summary**:
**Salary**
S$10,000 - S$13,000 / Monthly

**Job Type**

**Seniority**

Senior

**Years of Experience**
At least 10 years

**Tech Stacks**
Experian Greenplum Struts Docker Jenkins Go Netezza Shell Script Spring Teradata Sqoop Oozie Elastic CI Kudu Cloudera Sas Flume HBase Shell OOP Control-M Apache SonarQube Logstash Groovy Presto Kibana Java Hive Impala Spark HTML Bitbucket kafka Hibernate JavaScript SQL Scala jQuery Node.js Hadoop Elasticsearch MongoDB Python CSS

You will also be responsible for quality assurance of the team’s delivery in conformance with the Bank-defined software delivery methodology and tools. You will partner with other technology functions to help deliver required technology solutions.

**Other responsibilities include**:

- Create frameworks, technical features which helps in faster operationalisation of Data models, Analytical models(including AI/ML) and user generated contents (dashboards, reports etc)
- Effectively partner with data scientists in enabling faster adoption of AL/ML model based systems
- Independently install, customise and integrate software packages and programs
- Carry out POCs involving new data technologies
- Create technical documents such as solution design, program specifications for target solutions
- Performance tuning
- Work with production support team members to conduct root cause analysis of issues, review new and existing code and/or perform unit testing
- Perform tasks as part of a cross functional development team using agile or other methodologies and utilising project management software

**TEAM** **Architecture (Big Data)**
- Experience in large scale implementations and performance optimizations in the Big Data Ecosystem using Spark, Hive, Impala, Apache Kudu, Ozone, Presto, Tez, Iceberg etc
- **Knowledge of frameworks such as Spring, Struts, Hibernate etc**
- Knowledge of Object Oriented Programming, Multi-threading, Containerization, etc
- Knowledge of related technologies such as HTML, Javascript, CSS, Jquery, node.js, docker
- Knowledge of Elastic, Kibana, Logstash, Hive, Sqoop, MongoDB, Oozie, Flume, Kafka

At least, 2 to 3 technical certifications in any of the below technologies:
1. Language - SQL, Java, Python, Scala, Javascript, node.js

2. Automation / scripting - CtrlM, Shell Scripting, Groovy

3. Cloudera Hadoop distribution - Hive, Impala, Spark, Kudo, Kafka, Flume

**Additional Experience required for all teams **to create an added advantage:
1. CI/CD software, Testing Tools - Jenkins, SonarQube

2. Version Control Tool - Aldon+LMe, CA Endeavor

3. Deployment Tool kit -Jenkins

4. Service or Incident Management (IcM) Tools - Remedy

5. Source Code Repository Tool - Bitbucket

6. Scheduling Tool - Control-M

7. Defect Management Tool - JIRA

8. Application Testing tool - QuerySurge

9. Cloud certification

10. Platforms provided by FICO, Experian, SAS for credit and portfolio management

**EDUCATION**
- Bachelor’s degree/University degree in Computer Science, Engineering, or equivalent experience

  • Big Data Developer

    1 week ago

    Singapore DADACONSULTANTS PTE. LTD. Full time $80,000 - $120,000 per year

    My ClientIt is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the dynamic team. The role...

  • Big Data Test Engineer

    1 week ago

    Singapore Patsnap Full time

    About PatSnap PatSnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...

  • Big Data Test Engineer

    2 weeks ago

    Singapore Patsnap Full time $90,000 - $120,000 per year

    About PatSnapPatsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, deliversactionable insights...

  • Big Data Test Engineer

    1 week ago

    Singapore Patsnap Full time $80,000 - $120,000 per year

    About PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...

  • Avp, Big Data Engineer, Data Technology, Technology

    6 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,826 - S$12,397 / Monthly EST **Job Type** Permanent **Seniority** Senior **Years of Experience** At least 7 years **Tech Stacks** ETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDB - We are looking for a Big Data Engineer that will work on developing frameworks using...

  • Big Data Engineer

    1 week ago

    Singapore ALMR CONSULTING PTE. LTD. Full time

    Job Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...

  • Big Data Engineer

    2 weeks ago

    Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per year

    Job Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...

  • Big Data Engineer

    2 weeks ago

    Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per year

    Roles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...

  • Big Data Developer

    1 week ago

    Singapore SURPASS STAFFING PTE. LTD. Full time

    **Overview**: **Key Responsibilities**: - Design, develop, and optimize scalable data processing systems leveraging Hadoop, Flink, and other Big Data technologies. - Build and manage robust data pipelines for data ingestion, transformation, and analysis. - Create and implement efficient data models to support effective data storage and retrieval. -...

  • Big Data Engineer

    5 days ago

    Singapore Unison Group Full time $120,000 - $180,000 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...