Hadoop Engineer

**Job Requirements**: - 10+ consecutive years in the software engineering profession, in which 3+ years of hands-on experience in Hadoop eco system. - Must have 2+ years experience as a Hadoop Technical Lead / Architect. - Must have strong experience with design, development, and analytical skills in handling both structured and unstructured data. - Should...

**Location** Singapore, Central Singapore **Job Type** Full Time **Salary** $4,000 - $7,500 Per Month **Date Posted** 4 hours ago Additional Details **Job ID** 133918 **Job Views** 1 **Job Description**: Roles & Responsibilities - Develop processes for optimizing database security. Manage database access. - Performance tuning of database...

Design, implement, and maintain scalable and efficient data pipelines using Spark, Python, and PySpark. Ensure the smooth flow of data from various sources to destination systems. Utilize SAS, Spark, Python, and PySpark for efficient data processing. Design and implement data models to support business requirements. Work closely with data architects to...

**Responsibilities**: - Design, develop, and deploy backend services and job orchestration workflows on AWS (EMR, EC2, S3, Step Functions), ensuring high performance, scalability, and fault tolerance. - Implement and maintain automation solutions using RPA tools such as Automation Anywhere, integrating Python and Shell scripts to streamline business...

Job DescriptionWe are seeking a highly skilled Data Engineer to join our project team with a leading bank. The successful candidate will gain valuable exposure to banking data systems while working on large-scale enterprise data projects.The role requires hands-on experience in building and optimizing Spark-based applications within a Hadoop ecosystem.

**Responsibilities**: - Architect and implement robust ETL/ELT pipelines to ingest and transform large volumes of data from heterogeneous systems (e.g., Mainframe, Oracle, SQL Server, DB2, Teradata) into distributed data platforms such as Hadoop and cloud-based data lakes. - Utilize tools such as Apache Spark, PySpark, and Hive for batch and stream data...

**Requirements**: - University Graduate in Computer Science or Related discipline - 8 years of experience in developing, maintaining and supporting Enterprise Class Big Data Applications, preferably in banking environment - Expertise in **Big Data technologies/tools/platforms such as Hadoop, HDFS, Hive, Impala, HDFS, Presto, Spark, Hive, Impala,Zeppelin,...

**Job Description**: - Software design, Bigdata,Scala & Spark development, automated testing of new and existing components in an Agile, DevOps and dynamic environment - Promoting development standards, code reviews, mentoring, and knowledge sharing - Production support & troubleshooting. - Implement the tools and processes, handling performance, scale,...

**Responsibilities - Join the data migration project, including transitioning legacy systems to more modern system - Design, build, and maintain data pipelines to enable seamless data extraction, transformation, and loading (ETL) while ensuring high data quality throughout the process. - Identify and resolve data quality issues by implementing governance...

**Resident Engineer (Cloudera)** - 12 months contract role, with potential extension **Our Client** - Multinational tech company **The Opportunity** We are looking for a Resident Engineer with Hadoop skillset as well as infrastructure support skills. Job Responsibilities: - Cluster configuration and deployment details to integrate with the data center -...