Hadoop Admin

4 days ago


Singapore POWER IT SERVICES Full time

**ABOUT US**

We are providing Recruitment Services and IT Consulting Services for our Tier-1 Multinational Clients covering following major domains, but not limited to Banking, Financial Services and Insurance, Retail, Airline, Automotive, Energy and Consumer Sector.

**ABOUT CLIENT**

Our client is a Tier-1 System Integrator and global leader in providing IT Services, Consulting and Business Solutions. Our client has been partnering with many of the world’s largest businesses for the past 50 years. Our client believe innovation and collective knowledge can transform all our future with greater purpose.

**ABOUT OPPORTUNITIES**

**Role**: **Hadoop Admin / Developers**

**Experience**:6-9 Years**

**Location: Singapore**

**Hadoop Administrator Responsibilities**:

- Install, configure, and maintain Hadoop clusters, ensuring their availability, performance, and security.
- Monitor and troubleshoot Hadoop cluster performance, resolving any issues or disruptions.
- Implement and enforce security measures and access controls to protect Hadoop clusters and data.
- Collaborate with cross-functional teams to plan and execute Hadoop cluster upgrades, patches, and migrations.
- Manage and optimize data storage and retention strategies in Hadoop clusters.
- Implement and maintain backup and recovery procedures for Hadoop clusters.
- Stay updated with the latest Hadoop technologies, tools, and best practices, and recommend improvements to enhance cluster performance and efficiency.
- Provide training and support to end-users on Hadoop cluster usage and administration.

**Hadoop Developer Responsibilities**:

- Collaborate with data scientists and analysts to understand data requirements and develop data processing solutions.
- Design and implement data ingestion processes, data transformation and cleansing workflows, and data loading mechanisms in Hadoop.
- Develop and maintain data models and schemas in Hadoop, ensuring data compatibility and consistency.
- Optimize Hadoop job performance through code and configuration tuning.
- Develop and maintain data processing scripts and workflows using Hadoop ecosystem tools, such as MapReduce, Hive, Pig, Spark, or HBase.

**Requirements**:

- Proven experience as a Hadoop Administrator, Hadoop Developer, or similar role.
- Strong understanding of Hadoop ecosystem components, such as HDFS, MapReduce, Hive, Pig, Spark, or HBase.
- Proficiency in administering and managing Hadoop clusters, including installation, configuration, and performance tuning.
- Experience with scripting languages, such as Python or Shell scripting, for Hadoop administration and development tasks.
- Familiarity with data ingestion, data transformation, and data loading techniques in Hadoop.
- Knowledge of data modeling and database concepts in the context of Hadoop.
- Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex Hadoop-related issues.
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with stakeholders at all levels.

**Salary**: Up to $10,000.00 per month

Schedule:

- Day shift

Work Location: In person


  • Hadoop Administrator

    2 weeks ago


    Singapore OX CONSULTANCY PTE. LTD. Full time

    **Job Description - Person will be responsible to Perform **Big Data Platform **Administration **and Engineering activities on multiple **Hadoop, Kafka, Hbase and Spark clusters** - Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements - Working closely with development, engineering, and operation...

  • Hadoop Admin

    7 days ago


    Singapore U3 Infotech Pte Ltd. Full time

    Designs, builds, delivers, and maintains Cloudera data platforms, other semi-structured and un-structured data platforms to meet customer requirements, and leads overall efforts in working with cross-functional teams Implements processes, standards, and governance of Cloudera technologies, other semi-structured and un-structured data platforms Evaluates...


  • Central Singapore Emprego SG Full time

    **Location** - Singapore, Central Singapore**Job Type** - Full Time**Salary** - $5,500 - $6,500 Per Month**Date Posted** - 3 hours agoAdditional Details **Job ID** - 94637**Job Views** - 1Roles & Responsibilities - Experienced working with CDH 5.x, CDH 6.x or CDP 7.x platform or equivalent platform (Hortonworks, MAPR, etc.) administration experience -...

  • Software Consultant

    3 weeks ago


    Singapore TCOGNITION CONSULTANCY PTE. LTD. Full time

    Roles & ResponsibilitiesCore Competencies:∙Big Data Ecosystem: Cloudera Hadoop, Spark, Hive, Hive on Tez, Impala, Beeline,Yarn∙ETL Development & Admin: Informatica PowerCenter (10.5), SQL Loader, PL/SQL∙Business Intelligence: SAP BO Suite (Webi, IDT, UDT, Deski), Dashboards∙Scripting & Automation: Unix Shell Scripting (Bash, Korn, AWK),...

  • Data Platform Engineer

    10 hours ago


    Singapore SKANDA TECHNOLOGIES PTE. LTD. Full time

    **Responsibilities**: Admin role: On-premises Kubernetes (inhouse Kubernetes Package) + Azure Kubernetes + Spark Cluster + ADO CICD-Apache Ranger, Spark, Kafka, Datahub, Airflow, Trino, Iceberg, Azure DevOps (CI/CD)& Kubernetes **Scope**: - Work with Client’s core platform team on installing inhouse packed on-premises Kubernetes. - Configure Azure...


  • Singapore Meta Full time

    Singapore - Full Time**Meta** **Legal, Finance, Facilities & Admin** **Legal** - **Data Scientist, eDiscovery and Information Governance Responsibilities**Collaborate with a variety of technical and non-technical stakeholders (including engineers, data scientists, and attorneys) to understand and identify data needs, understand business problems and design...


  • Singapore Dataiku Full time

    At Dataiku, we're not just adapting to the AI revolution, we're leading it. Since our beginning in Paris in 2013, we've been pioneering the future of AI with a platform that makes data actionable and accessible. With over 1,000 teammates across 25 countries and backed by a renowned set of investors, we're the architects of Everyday AI, enabling data experts...