Big Data Infrastructure Specialist

1 month ago


Singapur, Singapore Unison Consulting Pte Ltd Full time

We are seeking a skilled and experienced Hadoop Administrator to join our team at Unison Consulting Pte Ltd. As a Hadoop Administrator, you will be responsible for the design, implementation, and maintenance of our Hadoop infrastructure. You will work closely with data engineers, data scientists, and other stakeholders to ensure the smooth functioning of our big data ecosystem.

Key Responsibilities:

  1. Design and Implement Hadoop Clusters: Install, configure, and maintain Hadoop clusters to ensure high availability and optimal performance.
  2. Monitor and Troubleshoot: Monitor Hadoop cluster performance and troubleshoot any issues that arise.
  3. Data Security and Access: Manage and maintain data security and access controls within the Hadoop environment.
  4. Data Retention and Storage: Implement and manage data retention policies to ensure efficient use of storage resources.
  5. Collaboration and Optimization: Collaborate with data engineers and data scientists to optimize Hadoop infrastructure for data processing and analysis.
  6. Documentation and Support: Develop and maintain documentation related to Hadoop configuration, processes, and procedures. Provide technical support and guidance to users of the Hadoop platform.
  7. Vendor Evaluation and Implementation: Work with vendors to evaluate and implement new Hadoop-related technologies and tools.

Requirements:

  1. Education: Bachelor's degree in Computer Science, Information Technology, or a related field.
  2. Experience: Proven experience as a Hadoop Administrator or similar role in a production environment.
  3. Hadoop Knowledge: Strong understanding of Hadoop architecture and ecosystem components (HDFS, YARN, MapReduce, Hive, Pig, etc.).
  4. Cluster Setup and Configuration: Experience with Hadoop cluster setup, configuration, and tuning for performance and scalability.
  5. Linux System Administration: Proficiency in Linux system administration and shell scripting.
  6. Hadoop Security: Experience with Hadoop security frameworks such as Kerberos and LDAP.
  7. Problem-Solving Skills: Excellent problem-solving and troubleshooting skills.


  • Singapur, Singapore TikTok Full time

    About the TeamTikTok's Tea platform is a cutting-edge analytics platform used by over 10,000 employees globally. As a key member of our global engineering team, you will be responsible for deploying, configuring, and maintaining big data platforms, as well as implementing and optimizing infrastructure for big data storage, processing, and computation.**Key...

  • Big Data Engineer

    1 month ago


    Singapur, Singapore Virtusa Full time

    Job Title: Big Data EngineerAt Virtusa, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...


  • Singapur, Singapore TikTok Full time

    About the team :Tea(Toutiao Event Analyze) is an in-house analytics platform that is heavily used by more than 10,000 employees globally. This is a data middle platform product built on user behavior data, providing data analysis services for various domestic and international businesses within ByteDance/TikTok, including Douyin, Toutiao, Xigua, TikTok,...


  • Singapur, Singapore NTT DATA Full time

    Job DescriptionMake a difference with NTT DATANTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.Your role at NTT DATAThe Network Infrastructure Support Specialist is responsible for...


  • Singapur, Singapore DBS Bank Full time

    Job Title: Big Data Delivery LeadDBS Bank is seeking a highly skilled Big Data Delivery Lead to join our Consumer Banking Group Technology team. As a key member of our team, you will be responsible for driving the delivery of big data solutions that meet the strategic goals of the bank.Responsibilities:Collaborate with cross-functional teams to design and...

  • Big Data Engineer

    1 month ago


    Singapur, Singapore TikTok Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our Data Platform Business Partnering team at TikTok. As a key member of our team, you will be responsible for designing and implementing data tools and applications that drive business growth.Key ResponsibilitiesTranslate business requirements into technical implementation for building...

  • Big Data Engineer

    6 months ago


    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 123101 Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. • Good understanding of analytics and data warehouse implementations. • Ability to troubleshoot complex issues ranging from system resource to application stack traces. • Strong SQL, data modelling and data...


  • Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    1 month ago


    Singapur, Singapore IITMatrix Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at IITMatrix. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL...


  • Singapur, Singapore Nityo Infotech Full time

    Job Title: Big Data Solutions EngineerWe are seeking a highly skilled Big Data Solutions Engineer to join our team at Nityo Infotech. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable...

  • Data Engineer

    1 month ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Implement data transformation, aggregation, and enrichment processes...


  • Singapur, Singapore U3 Full time

    Job SummaryThe Enterprise Data Solutions Architect is responsible for designing and implementing scalable data processing architectures in hybrid cloud environments. This includes defining architecture and strategy for batch workloads, enabling multitenancy, and capacity planning at enterprise scale.Key ResponsibilitiesDesign and develop batch data...

  • Data Engineer

    1 month ago


    Singapur, Singapore Nityo Infotech Full time

    Job Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:* Design and develop scalable and efficient data...


  • Singapur, Singapore TikTok Full time

    About the RoleTikTok's data business model relies heavily on a large volume of high-quality labeled data. The Data Solutions team is responsible for understanding data strategically at scale for all Global Business Solution (GBS) business needs. As a Lead Data Engineer, you will be responsible for building and leading a high-performing data engineering team,...

  • AVP, Big Data Engineer

    6 months ago


    Singapur, Singapore DBS Bank Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our...

  • Big Data Engineer

    1 month ago


    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking a highly skilled Big Data Engineer to join our Group Technology and Operations team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications using Hadoop, Spark, and other related technologies.Key ResponsibilitiesDesign and develop scalable Big Data...

  • Software Engineer

    4 months ago


    Singapur, Singapore Epam Full time

    Description We are looking for a Big Data Engineer to join our team! The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs as...


  • Singapur, Singapore Unison Consulting Pte Ltd Full time

    Senior Spark Scala DeveloperWe are seeking a highly skilled Spark Scala Developer to collaborate with our dynamic team in delivering cutting-edge data processing solutions. The ideal candidate will possess a deep understanding of big data technologies, particularly Apache Spark, and expertise in Scala programming.Key ResponsibilitiesDesign and Development:...

  • Specialist, HR Data

    15 hours ago


    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Developer Big Data

    4 months ago


    Singapur, Singapore Crédit Agricole CIB Full time

    Description du poste Summary of the position: CMTP is Cash Management Core Transformation Program, primarily responsible for Processing of Payments, Generation of various client reports [Accounting, Payment Status Reports, Transactional Debit Credit Advices]. CMTP is vast with functional scope & complex code base which requires more to study,...