Hadoop Admin

5 days ago

Singapore POWER IT SERVICES Full time

**ABOUT US**

We are providing Recruitment Services and IT Consulting Services for our Tier-1 Multinational Clients covering following major domains, but not limited to Banking, Financial Services and Insurance, Retail, Airline, Automotive, Energy and Consumer Sector.

**ABOUT CLIENT**

Our client is a Tier-1 System Integrator and global leader in providing IT Services, Consulting and Business Solutions. Our client has been partnering with many of the world’s largest businesses for the past 50 years. Our client believe innovation and collective knowledge can transform all our future with greater purpose.

**ABOUT OPPORTUNITIES**

**Role**: **Hadoop Admin / Developers**

**Experience**:6-9 Years**

**Location: Singapore**

**Hadoop Administrator Responsibilities**:

- Install, configure, and maintain Hadoop clusters, ensuring their availability, performance, and security.
- Monitor and troubleshoot Hadoop cluster performance, resolving any issues or disruptions.
- Implement and enforce security measures and access controls to protect Hadoop clusters and data.
- Collaborate with cross-functional teams to plan and execute Hadoop cluster upgrades, patches, and migrations.
- Manage and optimize data storage and retention strategies in Hadoop clusters.
- Implement and maintain backup and recovery procedures for Hadoop clusters.
- Stay updated with the latest Hadoop technologies, tools, and best practices, and recommend improvements to enhance cluster performance and efficiency.
- Provide training and support to end-users on Hadoop cluster usage and administration.

**Hadoop Developer Responsibilities**:

- Collaborate with data scientists and analysts to understand data requirements and develop data processing solutions.
- Design and implement data ingestion processes, data transformation and cleansing workflows, and data loading mechanisms in Hadoop.
- Develop and maintain data models and schemas in Hadoop, ensuring data compatibility and consistency.
- Optimize Hadoop job performance through code and configuration tuning.
- Develop and maintain data processing scripts and workflows using Hadoop ecosystem tools, such as MapReduce, Hive, Pig, Spark, or HBase.

**Requirements**:

- Proven experience as a Hadoop Administrator, Hadoop Developer, or similar role.
- Strong understanding of Hadoop ecosystem components, such as HDFS, MapReduce, Hive, Pig, Spark, or HBase.
- Proficiency in administering and managing Hadoop clusters, including installation, configuration, and performance tuning.
- Experience with scripting languages, such as Python or Shell scripting, for Hadoop administration and development tasks.
- Familiarity with data ingestion, data transformation, and data loading techniques in Hadoop.
- Knowledge of data modeling and database concepts in the context of Hadoop.
- Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex Hadoop-related issues.
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with stakeholders at all levels.

**Salary**: Up to $10,000.00 per month

Schedule:

- Day shift

Work Location: In person

  • Hadoop Admin

    1 week ago

    Singapore U3 Infotech Pte Ltd. Full time

    Designs, builds, delivers, and maintains Cloudera data platforms, other semi-structured and un-structured data platforms to meet customer requirements, and leads overall efforts in working with cross-functional teams Implements processes, standards, and governance of Cloudera technologies, other semi-structured and un-structured data platforms Evaluates...

  • Resident Engineer

    2 days ago

    Singapore Peoplebank Full time

    **Resident Engineer (Cloudera)** - 12 months contract role, with potential extension **Our Client** - Multinational tech company **The Opportunity** We are looking for a Resident Engineer with Hadoop skillset as well as infrastructure support skills. Job Responsibilities: - Cluster configuration and deployment details to integrate with the data center -...

  • Cloudera Admin Engineer

    2 weeks ago

    Central Singapore Emprego SG Full time

    **Location** - Singapore, Central Singapore**Job Type** - Full Time**Salary** - $5,500 - $6,500 Per Month**Date Posted** - 3 hours agoAdditional Details **Job ID** - 94637**Job Views** - 1Roles & Responsibilities - Experienced working with CDH 5.x, CDH 6.x or CDP 7.x platform or equivalent platform (Hortonworks, MAPR, etc.) administration experience -...

  • Informatica Admin #sgunitedjobs

    1 day ago

    Singapore G2 COMTECH ASIA PTE. LTD. Full time

    **Responsibilities**: Design, configure and deploy Informatica EDC, EDQ and DEI in the new CDP private cloud environment Plan and execute the migration of all data from the HDP to CDP environment, ensuring data accuracy and completeness Implement and maintain data security and access controls in the CDP environment Monitor and troubleshoot any issues that...

  • Informatica Admin Engineer

    2 days ago

    Singapore Jobline Resources Pte Ltd Full time

    **Responsibilities**: - Design, configure and deploy Informatica EDC, EDQ and DEI in the new CDP private cloud environment - Plan and execute the migration of all data from the HDP to CDP environment, ensuring data accuracy and completeness - Implement and maintain data security and access controls in the CDP environment - Monitor and troubleshoot any...

  • Kafka Admin

    1 week ago

    Singapore CLPS TECHNOLOGY (SINGAPORE) PTE. LTD. Full time

    Experienced with one or more scripting languages, Python, Ruby, Bash, and/or NodeJS. - Experience in Kafka, Zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Mirror Maker - Establish best practice standards for configuring Source and Sink connectors. - Good understanding of OS (RHEL/Centos), SAN Storage, Networking technology, load...

  • Kafka / DevOps Admin

    2 days ago

    Singapore RIDIK PTE. LTD. Full time

    Must have work experience with a bachelor’s degree. - Experienced with one or more scripting languages, Python, Ruby, Bash, and/or NodeJS. - Experience in implementing Kafka platform in provisioning, implementing security & authorization on Kafka cluster includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w...

  • Data Platform Engineer

    3 days ago

    Singapore SKANDA TECHNOLOGIES PTE. LTD. Full time

    **Responsibilities**: Admin role: On-premises Kubernetes (inhouse Kubernetes Package) + Azure Kubernetes + Spark Cluster + ADO CICD-Apache Ranger, Spark, Kafka, Datahub, Airflow, Trino, Iceberg, Azure DevOps (CI/CD)& Kubernetes **Scope**: - Work with Client’s core platform team on installing inhouse packed on-premises Kubernetes. - Configure Azure...

  • Data Scientist, Ediscovery and Information Governance

    2 weeks ago

    Singapore Meta Full time

    Singapore - Full Time**Meta** **Legal, Finance, Facilities & Admin** **Legal** - **Data Scientist, eDiscovery and Information Governance Responsibilities**Collaborate with a variety of technical and non-technical stakeholders (including engineers, data scientists, and attorneys) to understand and identify data needs, understand business problems and design...

  • Data Architect

    1 day ago

    Singapore Capgemini Full time

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired bya collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizationsunlock the value of technology and build...