Big Data Infrastructure Specialist
1 month ago
We are seeking a skilled and experienced Hadoop Administrator to join our team at Unison Consulting Pte Ltd. As a Hadoop Administrator, you will be responsible for the design, implementation, and maintenance of our Hadoop infrastructure. You will work closely with data engineers, data scientists, and other stakeholders to ensure the smooth functioning of our big data ecosystem.
Key Responsibilities:
- Design and Implement Hadoop Clusters: Install, configure, and maintain Hadoop clusters to ensure high availability and optimal performance.
- Monitor and Troubleshoot: Monitor Hadoop cluster performance and troubleshoot any issues that arise.
- Data Security and Access: Manage and maintain data security and access controls within the Hadoop environment.
- Data Retention and Storage: Implement and manage data retention policies to ensure efficient use of storage resources.
- Collaboration and Optimization: Collaborate with data engineers and data scientists to optimize Hadoop infrastructure for data processing and analysis.
- Documentation and Support: Develop and maintain documentation related to Hadoop configuration, processes, and procedures. Provide technical support and guidance to users of the Hadoop platform.
- Vendor Evaluation and Implementation: Work with vendors to evaluate and implement new Hadoop-related technologies and tools.
Requirements:
- Education: Bachelor's degree in Computer Science, Information Technology, or a related field.
- Experience: Proven experience as a Hadoop Administrator or similar role in a production environment.
- Hadoop Knowledge: Strong understanding of Hadoop architecture and ecosystem components (HDFS, YARN, MapReduce, Hive, Pig, etc.).
- Cluster Setup and Configuration: Experience with Hadoop cluster setup, configuration, and tuning for performance and scalability.
- Linux System Administration: Proficiency in Linux system administration and shell scripting.
- Hadoop Security: Experience with Hadoop security frameworks such as Kerberos and LDAP.
- Problem-Solving Skills: Excellent problem-solving and troubleshooting skills.
-
Big Data Development Engineer
1 month ago
Singapur, Singapore TikTok Full timeAbout the TeamTikTok's Tea platform is a cutting-edge analytics platform used by over 10,000 employees globally. As a key member of our global engineering team, you will be responsible for deploying, configuring, and maintaining big data platforms, as well as implementing and optimizing infrastructure for big data storage, processing, and computation.**Key...
-
Big Data Engineer
1 month ago
Singapur, Singapore Virtusa Full timeJob Title: Big Data EngineerAt Virtusa, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...
-
Big Data Development Engineer
6 months ago
Singapur, Singapore TikTok Full timeAbout the team :Tea(Toutiao Event Analyze) is an in-house analytics platform that is heavily used by more than 10,000 employees globally. This is a data middle platform product built on user behavior data, providing data analysis services for various domestic and international businesses within ByteDance/TikTok, including Douyin, Toutiao, Xigua, TikTok,...
-
Network Infrastructure Support Specialist
1 month ago
Singapur, Singapore NTT DATA Full timeJob DescriptionMake a difference with NTT DATANTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.Your role at NTT DATAThe Network Infrastructure Support Specialist is responsible for...
-
Big Data Delivery Lead
1 month ago
Singapur, Singapore DBS Bank Full timeJob Title: Big Data Delivery LeadDBS Bank is seeking a highly skilled Big Data Delivery Lead to join our Consumer Banking Group Technology team. As a key member of our team, you will be responsible for driving the delivery of big data solutions that meet the strategic goals of the bank.Responsibilities:Collaborate with cross-functional teams to design and...
-
Big Data Engineer
1 month ago
Singapur, Singapore TikTok Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our Data Platform Business Partnering team at TikTok. As a key member of our team, you will be responsible for designing and implementing data tools and applications that drive business growth.Key ResponsibilitiesTranslate business requirements into technical implementation for building...
-
Big Data Engineer
6 months ago
Singapur, Singapore Virtusa Full timeBig Data Engineer - 123101 Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. • Good understanding of analytics and data warehouse implementations. • Ability to troubleshoot complex issues ranging from system resource to application stack traces. • Strong SQL, data modelling and data...
-
Engineer, Data Center Infrastructure Management
4 weeks ago
Singapur, Singapore NTT DATA Full timeJob Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...
-
Data Engineer
1 month ago
Singapur, Singapore IITMatrix Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at IITMatrix. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL...
-
Big Data Solutions Engineer
1 month ago
Singapur, Singapore Nityo Infotech Full timeJob Title: Big Data Solutions EngineerWe are seeking a highly skilled Big Data Solutions Engineer to join our team at Nityo Infotech. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable...
-
Data Engineer
1 month ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Implement data transformation, aggregation, and enrichment processes...
-
Big Data Platform Architect
1 month ago
Singapur, Singapore U3 Full timeJob SummaryThe Enterprise Data Solutions Architect is responsible for designing and implementing scalable data processing architectures in hybrid cloud environments. This includes defining architecture and strategy for batch workloads, enabling multitenancy, and capacity planning at enterprise scale.Key ResponsibilitiesDesign and develop batch data...
-
Data Engineer
1 month ago
Singapur, Singapore Nityo Infotech Full timeJob Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:* Design and develop scalable and efficient data...
-
Senior Data Infrastructure Engineer
1 month ago
Singapur, Singapore TikTok Full timeAbout the RoleTikTok's data business model relies heavily on a large volume of high-quality labeled data. The Data Solutions team is responsible for understanding data strategically at scale for all Global Business Solution (GBS) business needs. As a Lead Data Engineer, you will be responsible for building and leading a high-performing data engineering team,...
-
AVP, Big Data Engineer
6 months ago
Singapur, Singapore DBS Bank Full timeBusiness Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our...
-
Big Data Engineer
1 month ago
Singapur, Singapore DBS Bank Full timeJob SummaryDBS Bank is seeking a highly skilled Big Data Engineer to join our Group Technology and Operations team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications using Hadoop, Spark, and other related technologies.Key ResponsibilitiesDesign and develop scalable Big Data...
-
Software Engineer
4 months ago
Singapur, Singapore Epam Full timeDescription We are looking for a Big Data Engineer to join our team! The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs as...
-
Senior Big Data Engineer
1 month ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeSenior Spark Scala DeveloperWe are seeking a highly skilled Spark Scala Developer to collaborate with our dynamic team in delivering cutting-edge data processing solutions. The ideal candidate will possess a deep understanding of big data technologies, particularly Apache Spark, and expertise in Scala programming.Key ResponsibilitiesDesign and Development:...
-
Specialist, HR Data
15 hours ago
Singapur, Singapore NTT DATA Full timeJob Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...
-
Developer Big Data
4 months ago
Singapur, Singapore Crédit Agricole CIB Full timeDescription du poste Summary of the position: CMTP is Cash Management Core Transformation Program, primarily responsible for Processing of Payments, Generation of various client reports [Accounting, Payment Status Reports, Transactional Debit Credit Advices]. CMTP is vast with functional scope & complex code base which requires more to study,...