Cloudera & Big Data Engineer

1 week ago

Singapore MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD Full time
Roles & Responsibilities

Job scopes

· Design, build, deployment, of ETL/ELT data pipelines within big data ecosystems ( Impala, Hue, Spark, Talend and Cloudera)

· Develop technical design, and ETL specification documents

· Manage, monitor and fine tune Hadoop cluster architecture (HDFS) jobs for performance, security and resource management.

· Create detailed designs and POCs to enable new workloads and technical capabilities on the Platform.

· Work with the platform and infrastructure engineers to implement these capabilities in production

Job requirement

· Bachelor's degree in computer science or any equivalent

· Around 5-8 years of experience with development to centered around big data applications, and adhoc transformation of unstructured raw data

· Experience with Talend and Cloudera Manager, Navigator, and Data Science Workbench.

· At least 5 years Relational DBA experience, preferably with experience in SQLServer and/or MySQL.

· Design, build, and maintain Big Data workflows/pipelines to process continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines.

· Demonstrated work experience in the following with Big Data and distributed programming models and technologies

· Knowledge of database structures, theories, principles and practices (both SQL and NoSQL).

· Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL/data pipelines

· Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive, Hadoop

· Understanding of Map Reduce and other Data Query and Processing and aggregation models

· Understanding of challenges of transforming data across distributed clustered environment

· Experience with techniques for consuming, holding and aging out continuous data streams

Thank you for your interest

We respect your privacy and all communication will be treated with confidentiality. If you wish to know more about this position or explore other roles, please prepare your updated profile and get in touch with our consultant at cristina.malijan@manpower.com.sg

Cristina Malabuyoc Malijan EA License No. 02C3423 Personnel Registration No. R1111547

Please note that your response to this advertisement and communications with us pursuant to this advertisement will constitute informed consent to the collection, use and/or disclosure of personal data by ManpowerGroup Singapore for the purpose of carrying out its business, in compliance with the relevant provisions of the Personal Data Protection Act 2012. To learn more about ManpowerGroup's Global Privacy Policy, please visit https://www.manpower.com.sg/privacy-policy

Tell employers what skills you have

Talend
Workbench
Scala
Big Data
Pipelines
Hadoop
MySQL
ETL
Data Engineering
SQL
Python
Data Science
Resource Management
Java
Technical Design

  • Big Data Engineer

    2 weeks ago

    Singapore INFINITE COMPUTER SOLUTIONS PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big...

  • Cloudera Data Platform Engineer

    2 weeks ago

    Singapore TECH AALTO PTE. LTD. Full time

    Roles & ResponsibilitiesJob Overview:We are looking for a skilled Cloudera Data Platform Engineer to join our dynamic team. The ideal candidate will have hands-on experience with Cloudera Data Platform components such as HDFS, YARN, HIVE, Spark, Impala, Ranger, along with strong knowledge of operating systems, security, and networking. You will be...

  • Big Data Engineer

    2 weeks ago

    Singapore INFINITE COMPUTER SOLUTIONS PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big...

  • Cloudera Data Platform Engineer

    2 weeks ago

    Singapore TECH AALTO PTE. LTD. Full time

    Roles & ResponsibilitiesJob Overview:We are looking for a skilled Cloudera Data Platform Engineer to join our dynamic team. The ideal candidate will have hands-on experience with Cloudera Data Platform components such as HDFS, YARN, HIVE, Spark, Impala, Ranger, along with strong knowledge of operating systems, security, and networking. You will be...

  • Senior Systems Engineer

    4 weeks ago

    Singapore EPAM SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesAbout EPAMEPAM is a leading global provider of digital platform engineering and development services. EPAM has been expanding in Singapore since 2013 and delivering the best solutions to our customers. As a recognized leader, EPAM Singapore achieved Great Place to Work® Certification in 2023 and is committed to providing our team...

  • Senior Systems Engineer

    4 weeks ago

    Singapore EPAM SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesAbout EPAMEPAM is a leading global provider of digital platform engineering and development services. EPAM has been expanding in Singapore since 2013 and delivering the best solutions to our customers. As a recognized leader, EPAM Singapore achieved Great Place to Work® Certification in 2023 and is committed to providing our team...

  • Cloudera Platform Engineer

    2 weeks ago

    Singapore KRIS INFOTECH PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:Oversee day-to-day operations of big data platform to ensure high availability, reliability and performance. Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health. Manage configuration, upgrades, and...

  • Cloudera Platform Engineer

    2 weeks ago

    Singapore KRIS INFOTECH PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description: Oversee day-to-day operations of big data platform to ensure high availability, reliability and performance. Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health. Manage configuration, upgrades, and...

  • Cloudera Platform Engineer

    2 weeks ago

    Singapore AVN DIGITAL PTE. LTD. Full time

    Roles & ResponsibilitiesAVN-Digital is an expert in providing technology-enabled business solutions and services. Since inception, AVN-Digital has helped clients Cyber-security, Data Analytics and Robotic Process Automation to improve their operations and profitability, focus on core competencies and achieve business results such as increased agility,...

  • Cloudera Platform Engineer

    2 weeks ago

    Singapore AVN DIGITAL PTE. LTD. Full time

    Roles & ResponsibilitiesAVN-Digital is an expert in providing technology-enabled business solutions and services. Since inception, AVN-Digital has helped clients Cyber-security, Data Analytics and Robotic Process Automation to improve their operations and profitability, focus on core competencies and achieve business results such as increased agility,...

  • Big Data Engineer

    4 weeks ago

    Singapore MINDMAP TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities· Perform the role of a Data engineer on the Enterprise Data Architecture and Governance (EDAG) Programs, to ensure the business requirements and deliverables are aligned to business priorities· Design develop data pipelines on EDAG platform to support Wholesale bank data model.· Perform assessments and analysis on...

  • Big Data Engineer

    2 weeks ago

    Singapore MINDMAP TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities· Perform the role of a Data engineer on the Enterprise Data Architecture and Governance (EDAG) Programs, to ensure the business requirements and deliverables are aligned to business priorities· Design develop data pipelines on EDAG platform to support Wholesale bank data model.· Perform assessments and analysis on...

  • Cloudera Platform Engineer

    2 weeks ago

    Singapore AVENSYS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesAvensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service...

  • Cloudera Platform Engineer

    2 weeks ago

    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJob DescriptionResponsibilities Oversee day-to-day operations of big data platform to ensure high availability, reliability and performance. Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health Manage configuration,...

  • Cloudera Platform Engineer

    2 weeks ago

    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJob DescriptionResponsibilitiesOversee day-to-day operations of big data platform to ensure high availability, reliability and performance. Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health Manage configuration,...

  • Data Engineer

    4 weeks ago

    Singapore U3 INFOTECH PTE. LTD. Full time

    Roles & ResponsibilitiesPosition: Data Engineer Location: CentralDuration: 12 months(renewable)We are seeking a highly skilled and experienced Big Data Engineer to join our linet's team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful...

  • Data Engineer

    4 weeks ago

    Singapore U3 INFOTECH PTE. LTD. Full time

    Roles & ResponsibilitiesPosition: Data Engineer Location: CentralDuration: 12 months(renewable)We are seeking a highly skilled and experienced Big Data Engineer to join our linet's team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful...

  • Big Data Architect

    2 hours ago

    Singapore HAYS SPECIALIST RECRUITMENT PTE. LTD. Full time

    Roles & ResponsibilitiesAbout the jobOur client in TMT sector is looking for an experienced Big Data Pre-sales (Architect) to join their team.Your new companyYou will be working with a leading global provider of information and communications technology (ICT) infrastructure and smart devices.Your new roleAs Pre-sales (Big Data Architect), you will be...

  • Data Engineer

    4 weeks ago

    Singapore VY SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities: Oversee big data platform operations, ensuring high availability, reliability, and security. Monitor, troubleshoot, and optimize platform components (HDFS, YARN, Hive, Spark, Impala, Ranger). Manage upgrades, patching, and security to maintain system integrity. Develop automation scripts (Bash, Python, Shell) for...

  • Data Engineer

    4 weeks ago

    Singapore VY SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities: Oversee big data platform operations, ensuring high availability, reliability, and security. Monitor, troubleshoot, and optimize platform components (HDFS, YARN, Hive, Spark, Impala, Ranger). Manage upgrades, patching, and security to maintain system integrity. Develop automation scripts (Bash, Python, Shell) for...