Hadoop Admin
5 days ago
**ABOUT US**
We are providing Recruitment Services and IT Consulting Services for our Tier-1 Multinational Clients covering following major domains, but not limited to Banking, Financial Services and Insurance, Retail, Airline, Automotive, Energy and Consumer Sector.
**ABOUT CLIENT**
Our client is a Tier-1 System Integrator and global leader in providing IT Services, Consulting and Business Solutions. Our client has been partnering with many of the world’s largest businesses for the past 50 years. Our client believe innovation and collective knowledge can transform all our future with greater purpose.
**ABOUT OPPORTUNITIES**
**Role**: **Hadoop Admin / Developers**
**Experience**:6-9 Years**
**Location: Singapore**
**Hadoop Administrator Responsibilities**:
- Install, configure, and maintain Hadoop clusters, ensuring their availability, performance, and security.
- Monitor and troubleshoot Hadoop cluster performance, resolving any issues or disruptions.
- Implement and enforce security measures and access controls to protect Hadoop clusters and data.
- Collaborate with cross-functional teams to plan and execute Hadoop cluster upgrades, patches, and migrations.
- Manage and optimize data storage and retention strategies in Hadoop clusters.
- Implement and maintain backup and recovery procedures for Hadoop clusters.
- Stay updated with the latest Hadoop technologies, tools, and best practices, and recommend improvements to enhance cluster performance and efficiency.
- Provide training and support to end-users on Hadoop cluster usage and administration.
**Hadoop Developer Responsibilities**:
- Collaborate with data scientists and analysts to understand data requirements and develop data processing solutions.
- Design and implement data ingestion processes, data transformation and cleansing workflows, and data loading mechanisms in Hadoop.
- Develop and maintain data models and schemas in Hadoop, ensuring data compatibility and consistency.
- Optimize Hadoop job performance through code and configuration tuning.
- Develop and maintain data processing scripts and workflows using Hadoop ecosystem tools, such as MapReduce, Hive, Pig, Spark, or HBase.
**Requirements**:
- Proven experience as a Hadoop Administrator, Hadoop Developer, or similar role.
- Strong understanding of Hadoop ecosystem components, such as HDFS, MapReduce, Hive, Pig, Spark, or HBase.
- Proficiency in administering and managing Hadoop clusters, including installation, configuration, and performance tuning.
- Experience with scripting languages, such as Python or Shell scripting, for Hadoop administration and development tasks.
- Familiarity with data ingestion, data transformation, and data loading techniques in Hadoop.
- Knowledge of data modeling and database concepts in the context of Hadoop.
- Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex Hadoop-related issues.
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with stakeholders at all levels.
**Salary**: Up to $10,000.00 per month
Schedule:
- Day shift
Work Location: In person
-
Hadoop Administrator
2 weeks ago
Singapore OX CONSULTANCY PTE. LTD. Full time**Job Description - Person will be responsible to Perform **Big Data Platform **Administration **and Engineering activities on multiple **Hadoop, Kafka, Hbase and Spark clusters** - Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements - Working closely with development, engineering, and operation...
-
Hadoop Admin
1 week ago
Singapore U3 Infotech Pte Ltd. Full timeDesigns, builds, delivers, and maintains Cloudera data platforms, other semi-structured and un-structured data platforms to meet customer requirements, and leads overall efforts in working with cross-functional teams Implements processes, standards, and governance of Cloudera technologies, other semi-structured and un-structured data platforms Evaluates...
-
Resident Engineer
1 day ago
Singapore Peoplebank Full time**Resident Engineer (Cloudera)** - 12 months contract role, with potential extension **Our Client** - Multinational tech company **The Opportunity** We are looking for a Resident Engineer with Hadoop skillset as well as infrastructure support skills. Job Responsibilities: - Cluster configuration and deployment details to integrate with the data center -...
-
Cloudera Admin Engineer
2 weeks ago
Central Singapore Emprego SG Full time**Location** - Singapore, Central Singapore**Job Type** - Full Time**Salary** - $5,500 - $6,500 Per Month**Date Posted** - 3 hours agoAdditional Details **Job ID** - 94637**Job Views** - 1Roles & Responsibilities - Experienced working with CDH 5.x, CDH 6.x or CDP 7.x platform or equivalent platform (Hortonworks, MAPR, etc.) administration experience -...
-
Informatica Admin #sgunitedjobs
9 hours ago
Singapore G2 COMTECH ASIA PTE. LTD. Full time**Responsibilities**: Design, configure and deploy Informatica EDC, EDQ and DEI in the new CDP private cloud environment Plan and execute the migration of all data from the HDP to CDP environment, ensuring data accuracy and completeness Implement and maintain data security and access controls in the CDP environment Monitor and troubleshoot any issues that...
-
Informatica Admin Engineer
1 day ago
Singapore Jobline Resources Pte Ltd Full time**Responsibilities**: - Design, configure and deploy Informatica EDC, EDQ and DEI in the new CDP private cloud environment - Plan and execute the migration of all data from the HDP to CDP environment, ensuring data accuracy and completeness - Implement and maintain data security and access controls in the CDP environment - Monitor and troubleshoot any...
-
Kafka Admin
1 week ago
Singapore CLPS TECHNOLOGY (SINGAPORE) PTE. LTD. Full timeExperienced with one or more scripting languages, Python, Ruby, Bash, and/or NodeJS. - Experience in Kafka, Zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Mirror Maker - Establish best practice standards for configuring Source and Sink connectors. - Good understanding of OS (RHEL/Centos), SAN Storage, Networking technology, load...
-
Kafka / DevOps Admin
1 day ago
Singapore RIDIK PTE. LTD. Full timeMust have work experience with a bachelor’s degree. - Experienced with one or more scripting languages, Python, Ruby, Bash, and/or NodeJS. - Experience in implementing Kafka platform in provisioning, implementing security & authorization on Kafka cluster includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w...
-
Cloud Infrastructure Specialist
2 weeks ago
Singapore TOSS-EX PTE. LTD. Full timeJob OverviewWe are seeking a highly motivated and talented Cloud Infrastructure Specialist to manage the AWS platform activities for smooth business operations and supporting hybrid data platforms with primary focus on AWS administrative tasks alongside managing other Group Data platforms such as Big Data clusters (HADOOP), Informatica, Tableau, and...
-
Senior Technical Account Manager
2 weeks ago
Singapore Dataiku Full timeAt Dataiku, we're not just adapting to the AI revolution, we're leading it. Since our beginning in Paris in 2013, we've been pioneering the future of AI with a platform that makes data actionable and accessible. With over 1,000 teammates across 25 countries and backed by a renowned set of investors, we're the architects of Everyday AI, enabling data experts...
-
Financial Data Analyst
5 days ago
Singapore D L RESOURCES PTE LTD Full timeRoles & ResponsibilitiesWhat we are looking for (Banking Sector Client):- DA Adoption: Candidate to possess knowledge of how data analytics can be deployed the financial strategy (Treasury) space. & to demonstrate the ability to find creative solutions and improvise effectively in dynamic environments- Although preferred, previous experience in...
-
Data Engineer
1 week ago
Singapore RECRUIT EXPRESS PTE LTD Full timeRoles & ResponsibilitiesData Pipeline Construction: Design, develop, and maintain data pipelines, ensuring a smooth flow of data from multiple sources to data warehouses or lakes. Enable, maintain, and support pipelines to provide unified and reliable data sources.Data Architecture Design:Responsible for designing and maintaining data architecture. Use...