Hadoop Admin

10 hours ago


Singapore POWER IT SERVICES Full time

**ABOUT US**

We are providing Recruitment Services and IT Consulting Services for our Tier-1 Multinational Clients covering following major domains, but not limited to Banking, Financial Services and Insurance, Retail, Airline, Automotive, Energy and Consumer Sector.

**ABOUT CLIENT**

Our client is a Tier-1 System Integrator and global leader in providing IT Services, Consulting and Business Solutions. Our client has been partnering with many of the world’s largest businesses for the past 50 years. Our client believe innovation and collective knowledge can transform all our future with greater purpose.

**ABOUT OPPORTUNITIES**

**Role**: **Hadoop Admin / Developers**

**Experience**:6-9 Years**

**Location: Singapore**

**Hadoop Administrator Responsibilities**:

- Install, configure, and maintain Hadoop clusters, ensuring their availability, performance, and security.
- Monitor and troubleshoot Hadoop cluster performance, resolving any issues or disruptions.
- Implement and enforce security measures and access controls to protect Hadoop clusters and data.
- Collaborate with cross-functional teams to plan and execute Hadoop cluster upgrades, patches, and migrations.
- Manage and optimize data storage and retention strategies in Hadoop clusters.
- Implement and maintain backup and recovery procedures for Hadoop clusters.
- Stay updated with the latest Hadoop technologies, tools, and best practices, and recommend improvements to enhance cluster performance and efficiency.
- Provide training and support to end-users on Hadoop cluster usage and administration.

**Hadoop Developer Responsibilities**:

- Collaborate with data scientists and analysts to understand data requirements and develop data processing solutions.
- Design and implement data ingestion processes, data transformation and cleansing workflows, and data loading mechanisms in Hadoop.
- Develop and maintain data models and schemas in Hadoop, ensuring data compatibility and consistency.
- Optimize Hadoop job performance through code and configuration tuning.
- Develop and maintain data processing scripts and workflows using Hadoop ecosystem tools, such as MapReduce, Hive, Pig, Spark, or HBase.

**Requirements**:

- Proven experience as a Hadoop Administrator, Hadoop Developer, or similar role.
- Strong understanding of Hadoop ecosystem components, such as HDFS, MapReduce, Hive, Pig, Spark, or HBase.
- Proficiency in administering and managing Hadoop clusters, including installation, configuration, and performance tuning.
- Experience with scripting languages, such as Python or Shell scripting, for Hadoop administration and development tasks.
- Familiarity with data ingestion, data transformation, and data loading techniques in Hadoop.
- Knowledge of data modeling and database concepts in the context of Hadoop.
- Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex Hadoop-related issues.
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with stakeholders at all levels.

**Salary**: Up to $10,000.00 per month

Schedule:

- Day shift

Work Location: In person


  • Hadoop Admin

    4 days ago


    Singapore U3 Infotech Pte Ltd. Full time

    Designs, builds, delivers, and maintains Cloudera data platforms, other semi-structured and un-structured data platforms to meet customer requirements, and leads overall efforts in working with cross-functional teams Implements processes, standards, and governance of Cloudera technologies, other semi-structured and un-structured data platforms Evaluates...

  • Kafka Admin

    6 days ago


    Singapore CLPS TECHNOLOGY (SINGAPORE) PTE. LTD. Full time

    Experienced with one or more scripting languages, Python, Ruby, Bash, and/or NodeJS. - Experience in Kafka, Zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Mirror Maker - Establish best practice standards for configuring Source and Sink connectors. - Good understanding of OS (RHEL/Centos), SAN Storage, Networking technology, load...


  • Singapore Span Consultancy Pvt Ltd Full time

    **Work Experience** * Minimum 8 years of experience in design and development of reports, dashboards in a Business Intelligence environment - Strong hands-on experience on Tableau - Strong hands-on experience on Power BI - Strong knowledge in SQL - Knowledge of data warehouse concepts and data modeling - Experience in creating mock-up and prototyping -...