Data Engineer

2 days ago

Singapore SAKSOFT PTE LIMITED Full time

Experience: 1 to 9 Years

Role: Data Engineer

Key Responsibilities:

- Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data
- Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch
- Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions
- Implement data transformations, aggregations, and computations using Spark RDDs, DataFrames, and Datasets, and integrate them with Elasticsearch
- Troubleshoot and resolve issues related to data processing, performance, and data quality in the Spark-Elasticsearch integration
- Monitor and analyze job performance metrics, identify bottlenecks, and propose optimizations in both Spark and Elasticsearch components
- Stay updated with emerging trends and advancements in the big data technologies space to ensure continuous improvement and innovation.

Key Requirements:

- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
- Proficiency in Scala programming language and familiarity with functional programming concepts
- In-depth understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL
- Solid understanding of Elasticsearch data modeling, indexing strategies, and query optimization
- Experience with distributed computing, parallel processing, and working with large datasets
- Familiarity with big data technologies such as Hadoop, Hive, and HDFS
- Strong problem-solving and analytical skills with the ability to debug and resolve complex issues
- Familiarity with version control systems (e.g., Git) and collaborative development workflows
- Excellent communication and teamwork skills with the ability to work effectively in cross-functional teams

  • Data Centre Engineer

    3 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description Summary:We are seeking a skilled Data Center Engineer to join our team at E-Engineer Service Pte Ltd. The ideal candidate will have hands-on experience in data center operations, familiarity with facility management, server hardware, and network equipment.Job Description:

  • Data Engineer

    2 weeks ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Data Engineer(Cloud Migration)

    2 days ago

    Singapore NTT DATA Full time

    Requirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...

  • Data Engineer

    2 days ago

    Singapore DOZER DATA PTE. LTD. Full time

    **About the job**: This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data. This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers. **Responsibilities**: In...

  • Senior Data Centre Engineer

    3 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Job DescriptionWe are seeking an experienced Data Center Engineer to join our team. The successful candidate will be responsible for setting up and installing network and server hardware according to business requirements.The role involves maintaining, diagnosing, and troubleshooting infrastructure system health, as well as fixing any issues that arise.Key...

  • Senior Data Centre Engineer

    4 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description● Setup and install network and server hardware according to business requirements● Maintain, diagnose and troubleshoot infrastructure system health and fix any issues that arise● Deploy and configure Linux server operating system● Manage data center assets and inventories● Maintain proper documentation and...

  • Senior Data Centre Engineer

    4 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description● Setup and install network and server hardware according to business requirements● Maintain, diagnose and troubleshoot infrastructure system health and fix any issues that arise● Deploy and configure Linux server operating system● Manage data center assets and inventories● Maintain proper documentation and...

  • Data Engineer

    1 day ago

    Singapore DOZER DATA PTE. LTD. Full time

    **About the job**:This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data.This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers.**Responsibilities**:In this...

  • Data Centre Engineer

    3 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Roles and ResponsibilitiesKey Job Description:Set up and install server & network hardware according to business requirements.Maintain, diagnose and troubleshoot server & network system health and fix any issues that arise.Deploy and configure Linux & Windows server operating systems.Manage data center assets and inventories.Maintain detailed documentation...

  • Data Centre Engineer

    4 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description1. Setup and install server & network hardware according to business requirements● Maintain, diagnose and troubleshoot server & network system health and fix any issues thatarise● Deploy and configure Linux & Windows server operating system● Manage data center assets and inventories● Maintaining detailed...