Hadoop Operations Engineer

6 days ago


Singapore ENSIGN INFOSECURITY (CYBERSECURITY) PTE. LTD. Full time

**Key Responsibilities**
- As part of the security operation teams, operate, support and maintain a Hadoop Date Lake environment in a dedicated customer environment
- Perform data engineering to extract, transform, load for data science analysis
- Work with customer’s and internal data science team to design effective data models for optimal storage and retrieval
- Ensure data segregation in accordance to role-base access control matrix
- Maintain up-to-date technical documentation for deployed systems

**Qualifications**
- At least 3 years of production experience working with Hadoop data engineering
- Demonstrate production experience in data engineering, data management and/or cluster management
- Experience designing data queries against data in the HDFS environment using tools such as Apache Hive
- Experience in implementing MapReduce, Spark jobs
- Experience maintain and expanding multi-node Hadoop clusters
- Experience in systems administration or DevOps experience with one or more open-source operating systems
- Experience implementing operational best practices such as alerting, monitoring, and metadata management
- Strong understanding with various enterprise security practices and solutions such as LDAP and/or Kerberos
- Familiarity with scripting tools such as bash shell scripts, Python and/or Perl
- Experience with Splunk Enterprise and Isilon storage is an added advantage
- Good verbal and written communications



  • Singapore OX CONSULTANCY PTE. LTD. Full time

    **Job Description - Person will be responsible to Perform **Big Data Platform **Administration **and Engineering activities on multiple **Hadoop, Kafka, Hbase and Spark clusters** - Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements - Working closely with development, engineering, and operation...


  • Central Singapore SKY & F PTE. LTD. Full time

    **Location** Singapore, Central Singapore **Job Type** Full Time **Salary** $4,000 - $7,500 Per Month **Date Posted** 4 hours ago Additional Details **Job ID** 133918 **Job Views** 1 **Job Description**: Roles & Responsibilities - Develop processes for optimizing database security. Manage database access. - Performance tuning of database...


  • Singapore beBeeHadoop Full time $120,000 - $160,000

    A dynamic team is seeking a highly skilled Hadoop Cluster Architect to lead the design, setup, and maintenance of large-scale Hadoop environments.Developing and implementing scalable Hadoop solutions that meet business requirements.Maintaining high-performing Hadoop clusters through efficient resource allocation, monitoring, and tuning.Collaborating with...

  • Hadoop Developer

    2 weeks ago


    Singapore ANTAS PTE. LTD. Full time

    Job Purpose To support development and maintenance of Hadoop solutions for the Enterprise. To be part of initiatives that brings data into the data lake and delivers insights. To perform production support and maintenance of existing datasets in Hadoop. The Job Develop ETL/ELT jobs based on requirements from source to Data lake platform. Ensure that all...


  • Singapore Cloud Kinetics Full time

    **Job Information**: Date Opened **10/08/2024*** Job Type **Full time*** Industry **Technology*** City **Singapore*** State/Province **Central Singapore*** Country **Singapore*** Zip/Postal Code **228208*** **Cloudera Hadoop Administrator** **Responsibilities Include**: - Administering large scale Cloudera Hadoop environments build and...

  • Data Lead

    3 days ago


    Singapore ENSIGN INFOSECURITY (CYBERSECURITY) PTE. LTD. Full time

    **Duties & Responsibilities**: - Consult, design and build high quality data lake solutions for customers and internal teams - Design highly scalable and reliable data pipelines to consume, integrate, and analyse large amounts of data from various data sources - Perform data engineering to extract, transform, load for data science analysis - Create...

  • Platform Engineer

    7 days ago


    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    We are hiring Platform Engineer - Big Data (Hadoop / Spark / Hive) with below requirements; **Responsibilities** - Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive. - Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. - Maintain and fine-tune Hadoop clusters...

  • Platform Engineer

    3 days ago


    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements; Responsibilities Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune Hadoop clusters (HDFS,...


  • Singapore Cloud Kinetics Full time

    Cloud Kinetics Technology Solutions Private Ltd | Full time Cloudera Hadoop Administrator Singapore, Singapore | Posted on 10/08/2024 Responsibilities Administering large scale Cloudera Hadoop environments build and support including design, cluster set up, performance tuning and monitoring in an enterprise environment. Installing, administering, and...

  • Platform Engineer

    3 days ago


    Singapore REGTECH INSIGHT PTE. LTD. Full time

    Overview Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Responsibilities Design, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune Hadoop clusters (HDFS,...