Hadoop Operations Engineer

7 days ago


Singapore ENSIGN INFOSECURITY (CYBERSECURITY) PTE. LTD. Full time

**Key Responsibilities**
- As part of the security operation teams, operate, support and maintain a Hadoop Date Lake environment in a dedicated customer environment
- Perform data engineering to extract, transform, load for data science analysis
- Work with customer’s and internal data science team to design effective data models for optimal storage and retrieval
- Ensure data segregation in accordance to role-base access control matrix
- Maintain up-to-date technical documentation for deployed systems

**Qualifications**
- At least 3 years of production experience working with Hadoop data engineering
- Demonstrate production experience in data engineering, data management and/or cluster management
- Experience designing data queries against data in the HDFS environment using tools such as Apache Hive
- Experience in implementing MapReduce, Spark jobs
- Experience maintain and expanding multi-node Hadoop clusters
- Experience in systems administration or DevOps experience with one or more open-source operating systems
- Experience implementing operational best practices such as alerting, monitoring, and metadata management
- Strong understanding with various enterprise security practices and solutions such as LDAP and/or Kerberos
- Familiarity with scripting tools such as bash shell scripts, Python and/or Perl
- Experience with Splunk Enterprise and Isilon storage is an added advantage
- Good verbal and written communications


  • Hadoop Security

    6 days ago


    Singapore ANTAS PTE. LTD. Full time $80,000 - $120,000 per year

    We are seeking a skilled Hadoop Security & Compliance Engineer to design and maintain secure, compliant, and high-performing enterprise data platforms. The role involves implementing and managing Hadoop ecosystem security , ensuring data governance , and supporting regulatory compliance across Cloudera CDP/CDH environments.Key Responsibilities:Configure and...


  • Singapore ANTAS PTE. LTD. Full time

    Key Responsibilities: - Install, configure, and maintain Hadoop clusters (HDFS, YARN, Hive, Spark, Kafka, Zookeeper). - Perform capacity planning, performance tuning, upgrades, and patch management. - Manage user access, Kerberos authentication, Ranger/Sentry policies, and data security controls. - Monitor system health and troubleshoot performance or...


  • Singapore ANTAS PTE. LTD. Full time

    We are seeking a Hadoop Cloud Integration Specialist to design, implement, and manage hybrid data platforms integrating on-premise Hadoop clusters with cloud environments (AWS, Azure, or GCP). The role focuses on data migration, automation, and performance optimization across distributed systems. **Key Responsibilities**: - Integrate and migrate...


  • Singapore RIDIK PTE. LTD. Full time

    Requirements: - Strong understanding and hands on experience of Big Data technologies like CDH, Hadoop/HDFS, S3, Colibra, Claudera Workbench, etc. - Technical proficiency on data mining techniques and performance optimization - Adequate knowledge of database systems (RDBMS, MariaDB, SQL, NOSQL) - Experience on SAS will be beneficial but not mandatory -...


  • Singapore ANTAS PTE. LTD. Full time $80,000 - $120,000 per year

    We are looking for an experienced Hadoop Administrator to manage, optimize, and support enterprise-level Big Data platforms running on Cloudera or Hortonworks distributions. The ideal candidate will ensure platform stability, performance, and security across complex data ecosystems.Key Responsibilities:Install, configure, and maintain Hadoop clusters (HDFS,...


  • Singapore Cloud Kinetics Full time

    Cloud Kinetics Technology Solutions Private Ltd | Full time Cloudera Hadoop Administrator Singapore, Singapore | Posted on 10/08/2024Responsibilities Administering large scale Cloudera Hadoop environments build and support including design, cluster set up, performance tuning and monitoring in an enterprise environment. Installing, administering, and...


  • Singapore ANTAS PTE. LTD. Full time $120,000 - $180,000 per year

    We are seeking a Hadoop Cloud Integration Specialist to design, implement, and manage hybrid data platforms integrating on-premise Hadoop clusters with cloud environments (AWS, Azure, or GCP). The role focuses on data migration, automation, and performance optimization across distributed systems.Key Responsibilities:Integrate and migrate Hadoop/Cloudera...


  • Singapore Trinity Consulting Services (“TRINITY”) Full time

    Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Trinity Consulting Services (\"TRINITY\")Professional Consulting | Empowering PEOPLE & BUSINESS | Servant Leader | Diversity & Inclusion Leader | Character before Credentials | We Are Hiring... · Must have minimum 3 - 5 years of software development experience....

  • Software Developer

    7 days ago


    Singapore QUESSCORP HOLDINGS PTE. LTD. Full time

    **Responsibilities**: - Responsible for Hadoop development and implementation for data ingestion on Hadoop technologies - Required to have sound knowledge and implementation experience to build Data warehouse / Data Mart using structured / unstructured data for both near real-time & batch processing - Hands on experience in complex code development and...

  • Data Engineer

    3 days ago


    Singapore NEPTUNEZ SINGAPORE PTE. LTD. Full time

    **Responsibilities**: - Design, implement, and maintain data pipelines for the migration of data from on-premises systems to Hadoop-based platforms. - Develop and optimize data processing jobs using Spark, Hive, and Python. - Manage job orchestration and scheduling using Control-M, ensuring timely and accurate data delivery. - Collaborate with...