Big Data Support Engineer

2 weeks ago

Singapore ADVANCED E-SOLUTIONS PTE. LTD. Full time

**Job Description: Big Data Support Engineer - Batch Monitoring (Junior Role)**

**Experience Requirements**:

- 1-3 years of IT experience.
- Minimum 1-3 years of hands-on experience with Hadoop and Kubernetes (K8s) ecosystems.
- At least 1-3 years of relevant experience in the banking/financial services industry.

**Skills and Qualifications**:

- Demonstrable analytical skills with in-depth knowledge of the Big Data ecosystem in a production support environment.
- Strong knowledge of SQL, Python, Java, and Unix shell scripting.
- Incident, problem, and service outage management experience is a plus.
- Excellent communication and articulation skills.

**Roles and Responsibilities**:

- **Batch Monitoring and Operational Support**:

- Troubleshoot and resolve batch issues and identify root causes to minimize SLA impacts.
- Proactively identify opportunities for preventive maintenance to enhance system reliability.
- **Performance Optimization**:

- Perform administration and optimization to achieve optimal system performance.
- Conduct reviews of technical and functional solutions from enhancement/project teams to ensure alignment with established standards.
- Recommend design and operational optimizations for continuous improvement.
- **Collaboration and Stakeholder Communication**:

- Provide timely updates on status, progress, issues, and resolutions to business stakeholders.
- Respond promptly to queries raised by various business units.
- **Data Engineering and Pipeline Management**:

- Build and optimize big data pipelines, architectures, and data sets.
- Support data transformation processes, metadatamanagement, dependency tracking, and workload management.
- Work on unstructured datasets and perform root cause analysis to identify opportunities for process improvement.
- **Incident Management and Disaster Recovery**:

- Participate in disaster recovery and business continuity exercises.
- Support software, platform, and database upgrades for systems.
- **Kubernetes and Streaming Applications Support**:
**Preferred Experience**:

- Experience with message queuing, stream processing, and scalable big data stores.
- Exposure to ledger balance reporting and GL datareconciliation between systems, datamarts, and reports.
- Knowledge of Teradata FSLDM and performance tuning on MPP data pipelines (e.g., Teradata).

  • Big Data Support Engineer

    1 week ago

    Singapore propitious Full time

    POSITION GENERAL DUTIES AND TASKS: Skillset - Up to 9 years of IT experience & 5+ Years on Hadoop and K8s Eco Systems - Last 3 years of relevant experience in banking/financial services industry - Demonstrable analytical skills with deep knowledge of Big Data Ecosystem in a Production Support Environment. - Hands On Experience within the Hadoop Tool Sets...

  • Big Data Engineer

    1 week ago

    Singapore ALMR CONSULTING PTE. LTD. Full time

    **Job Summary**: We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. **Key...

  • Big Data Engineer

    1 week ago

    Singapore ALMR Consulting Pte Ltd Full time

    **Roles & Responsibilities** **Job Summary**: We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and...

  • Big Data Engineer

    6 days ago

    Singapore AlgoriX Technology Pte. Ltd. Full time

    **Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...

  • Big Data Support Specialist

    2 weeks ago

    Singapore ANTAS PTE. LTD. Full time

    Description: POSITION OVERVIEW : Software Development Senior Analyst POSITION GENERAL DUTIES AND TASKS: Skillset - Up to 9 years of IT experience & 5+ Years on Hadoop and K8s Eco Systems - Last 3 years of relevant experience in banking/financial services industry - Demonstrable analytical skills with deep knowledge of Big Data Ecosystem in a Production...

  • Big Data Engineer

    4 days ago

    Singapore INCOME INSURANCE LIMITED Full time

    Responsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...

  • Big Data Support Engineer

    2 weeks ago

    Singapore EXASOFT PTE. LTD. Full time

    **Skillset** - Up to 9 years of IT experience & 5+ Years on Hadoop and K8s Eco Systems - Last 3 years of relevant experience in banking/financial services industry - Demonstrable analytical skills with deep knowledge of Big Data Ecosystem in a Production Support Environment. - Hands On Experience within the Hadoop Tool Sets Hive, Hue, Spark, Kafka, Kudu,...

  • Big Data Engineer

    1 week ago

    Singapore Unison Group Full time

    **SKILLS SET AND TRACK RECORD** - Good understanding and completion of projects using waterfall/Agile methodology. - Analytical, conceptualisation and problem-solving skills. - Good understanding of analytics and data warehouse implementations - Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica -...

  • Big Data Engineer

    1 day ago

    Singapore Ascendion Full time

    Direct message the job poster from Ascendion Empowering Digital Transformation & Building Future-Ready Teams to Drive Innovation Role: We are seeking a skilled data engineer to design, build, and maintain cloud-based data pipelines and analytics solutions. You will work closely with data analysts, product teams, and business stakeholders to ensure...

  • Big Data Support Engineer

    6 days ago

    Singapore ITCAN Pte Ltd Full time

    Skillset - Up to 9 years of IT experience & 5+ Years on Hadoop and K8s Eco Systems - Last 3 years of relevant experience in banking/financial services industry - Demonstrable analytical skills with deep knowledge of Big Data Ecosystem in a Production Support Environment. - Hands On Experience within the Hadoop Tool Sets Hive, Hue, Spark, Kafka, Kudu, Flink,...