Hadoop Administrator

4 weeks ago

Singapur, Singapore Unison Consulting Pte Ltd Full time

 

  • Plan, install, configure, and deploy Hadoop clusters based on business requirements and workload demands.
  • Monitor and manage the health of Hadoop clusters, addressing performance issues and ensuring optimal resource utilization.
  • Implement and maintain security protocols within the Hadoop ecosystem, including authentication, authorization, and encryption.
  • Develop and implement backup and recovery strategies for Hadoop data, ensuring data integrity and availability.
  • Perform capacity planning to anticipate future storage and processing needs, and scale the infrastructure accordingly.
  • Optimize Hadoop cluster performance by fine-tuning configurations, troubleshooting bottlenecks, and implementing best practices.
  • Manage software upgrades, patches, and version updates for Hadoop components to ensure stability and security.
  • Implement monitoring tools to track the performance of Hadoop clusters and set up logging mechanisms for analysis and troubleshooting.
  • Administer user access and permissions to Hadoop clusters, maintaining a secure and controlled environment.
  • Develop and test disaster recovery plans to ensure data availability in case of unexpected events or failures.
  • Maintain comprehensive documentation for configurations, procedures, and troubleshooting guides for the Hadoop environment.
  • Implement automation scripts for routine tasks, making the administration processes more efficient

Requirements

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Hadoop Administrator in large-scale environments.
  • Proficiency in Hadoop distributions like Apache Hadoop, Cloudera, Hortonworks, etc.
  • Strong understanding of Hadoop ecosystem components (HDFS, MapReduce, Hive, HBase, etc.).
  • Knowledge of Linux system administration.
  • Scripting skills (e.g., Shell, Python) for automation.
  • Familiarity with cloud platforms (e.g., AWS, Azure) is a plus.
  • Excellent problem-solving and troubleshooting skills.
    #hadoopadmin #singaporejobs #hadoopadministrator #bigdataadmin #Hadoop #clouderaadmin #ITsingapore

  • Hadoop Admin

    3 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    We are seeking a skilled and experienced Hadoop Administrator to join our team. As a Hadoop Administrator, you will be responsible for the design, implementation, and maintenance of our Hadoop infrastructure. You will work closely with data engineers, data scientists, and other stakeholders to ensure the smooth functioning of our big data...

  • Developer - Hadoop

    3 weeks ago

    Singapur, Singapore Nityo Infotech Full time

    Key Responsibilities •Strong experience in Customization of ADF UI and SOA workflows.•Experience on XML, XSD, SOAP, WSDL, SOA BPEL process, Oracle Business Rule and Human Workflows for request approvals in Approval policy.•Strong experience in integrating OIM with AD, Exchange, RACF, AS400 connectors•Must have Core Java/J2EE knowledge for...

  • Senior System Analyst

    4 weeks ago

    Singapur, Singapore Nityo Infotech Full time

    Key Responsibilities•Work with different technology teams across infrastructure, and other divisions to deliver system solutions for the business.•Involve in development and system integration relevant systems with CDP / CDSW.•Hands-on experiences on Big Data solution and development based on Python technologies stack to design and implement secure,...

  • Senior Network consultants

    4 weeks ago

    Singapur, Singapore ITCAN Full time

    Job Description: Translate business requirements to technical solutions leveraging strong business acumen.Lead implementation teams in the delivery of large-scale enterprise Big Data solutions in client data centres and cloudWork in interdisciplinary teams that combine technical, business and data science competencies that deliver work in waterfall or agile...

  • Credit Analytics

    3 weeks ago

    Singapur, Singapore Nityo Infotech Full time

    Responsibilities:•Collaborate with business and IT to analyse, elicit and review business requirements•Participate and contribute to technical solutioning and architecture reviews with architecture team•Define functional and non-functional requirements and perform impact analysis assessment with the vendor•Perform detailed estimation of projects and...

  • Backend Engineer

    1 week ago

    Singapur, Singapore TikTok Full time

    About The Team The Applied Machine Learning (AML) team is seeking a Machine Learning Platform Engineer to develop and maintain our machine learning platform. The platform supports deep learning models for code development, testing, training scheduling, model deployment, and other core business functions. The team oversees the company's critical machine...

  • Backend Engineer, TikTok Machine Learning Platform

    1 week ago

    Singapur, Singapore TikTok Full time

    About The Team The Applied Machine Learning (AML) team is seeking a Machine Learning Platform Engineer to develop and maintain our machine learning platform. The platform supports deep learning models for code development, testing, training scheduling, model deployment, and other core business functions. The team oversees the company's critical machine...

  • Senior System Analyst

    4 weeks ago

    Singapur, Singapore Nityo Infotech Full time

    Responsibilities:• Collaborate with business and IT to analyse, elicit and review business requirements• Participate and contribute to technical solutioning and architecture reviews with architecture team• Define functional and non-functional requirements and perform impact analysis assessment with the vendor• Perform detailed estimation of projects...

  • Backend Engineer, TikTok Machine Learning Platform

    3 weeks ago

    Singapur, Singapore TIKTOK PTE. LTD. Full time

    Roles & ResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa. TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin,...

  • Backend Engineer

    3 weeks ago

    Singapur, Singapore TIKTOK PTE. LTD. Full time

    Roles & ResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin,...

  • FVP/VP, Data Analytics for Strategic Insights, Group Finance

    3 weeks ago

    Singapur, Singapore United Overseas Bank Full time

    FVP/VP, Data Analytics for Strategic Insights, Group Finance Posting Date: 23-May-2023 Location: Singapore (City Area), Singapore, 048624 Company: United Overseas Bank Ltd About UOB United Overseas Bank Limited (UOB) is a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in...