Data Engineer

4 weeks ago


Singapore U3 INFOTECH PTE. LTD. Full time
Roles & Responsibilities

Position: Data Engineer

Location: Central

Duration: 12 months(renewable)


We are seeking a highly skilled and experienced Big Data Engineer to join our linet's team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big data platforms.


Responsibilities:
• Oversee day-to-day operations of big data platform to ensure high availability, reliability and performance.
• Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health
• Manage configuration, upgrades, and patching of big data platform, ensuring all services are up to date
• Work with the Authority’s technical teams to ensure smooth deployment and adoption of new solution to support data ingestions, process and workflows
• Maintain clear and detailed documentation of platform configuration, troubleshooting steps and incident resolution.
• Continuously monitor for and address platform security vulnerabilities. Implement patching strategies to resolve identified vulnerabilities and maintain a secure environment.
• Develop automation script to streamline administrative tasks, platform health and ensure operational consistency.
• Ensure the smooth operations and service level of IT solutions.
• Support production issues

What we are looking for:
• Hands-on experience, knowledge and troubleshooting of Cloudera Data Platform such as HDFS, YARN, HIVE, Spark, Impala, Ranger, operating systems, security and network.
• Hands on experience with monitoring tools like Cloudera Manager, Zabbix, Grafana, Splunk, SyslogNG
• Familiarity with middleware applications i.e. Informatica, Denodo and scripting languages like bash, python, or shell scripting for automation
• Experience with cloud technology i.e. AWS, Azure is a plus
• Ability to troubleshoot complex issues ranging from system resource to application stack traces.
• Track record in implementing systems with high availability, high performance, high security hosted at various data centres or hybrid cloud environments will be an added advantage.
• Cloudera Certified Administrator or similar certification are a plus.
• Excellent communication skill to work with cross-functional teams
• Ability to handle high-pressure situations and manage critical incidents


Please refer to U3’s Privacy Notice for Job Applicants/Seekers at https://u3infotech.com/privacy-notice-job-applicants/. When you apply, you voluntarily consent to the collection, use and disclosure of your personal data for recruitment/employment and related purposes.


Tell employers what skills you have

Troubleshooting
Azure
Big Data
Pipelines
High Availability
Hadoop
Informatica
Scripting
ETL
Service Level
Reliability
Data Engineering
Python
Operating Systems
Zabbix
Databases
  • Data Engineer

    2 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Cloud Data Architect

    4 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic SolutionsAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to...

  • Cloud Data Architect

    4 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic SolutionsAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to...

  • Data Engineer

    2 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Data engineer

    3 weeks ago


    Singapore TOTAL EBIZ SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesJD for Software Engineer (Data Engineering) for Tech Stack Products -Design, develop, and maintain scalable data pipelines.-Collaborate with cross-functional teams to integrate data systems.-Ensure data quality and integrity across platforms.-Optimize workflows for efficiency and performance.-Perform other miscellaneous duties as...

  • Data Engineer

    2 weeks ago


    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:We are looking for a skilled Data Engineer to join our team and support our data-driven initiatives. The ideal candidate should have strong technical expertise in Informatica, SQL, and .NET, along with experience in data engineering, migration, and analysis.Key Responsibilities:Design, develop, and maintain data...

  • Data Engineer

    2 weeks ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesJob DescriptionBachelor's Degree in Computer Science or equivalent; Minimum 5 years of experience in data engineering or software engineering; Possess a solid foundation in Computer Science concepts such as Distributed Computing, High-velocity Data Processing, and Lambda Architecture; Proficient in Data modeling and managing...

  • Data Engineer

    1 day ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesSummaryYou will be developing banking applications and supporting production environments.Responsibilities:Bachelor's Degree in Computer Science or equivalent; Minimum 4+ years of experience in data engineering or software engineering. Possess a solid foundation in Computer Science concepts such as Distributed Computing,...

  • Data Engineer

    2 days ago


    Singapore INNOCELLENCE SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data scientists and...

  • Data Engineer

    2 weeks ago


    Singapore GREEN LINK DIGITAL BANK PTE. LTD. Full time

    Roles & ResponsibilitiesAbout UsGreen Link Digital Bank is Singapore's inaugural wholesale digital bank focusing on supply chain finance, mainly serving MSMEs and aiming to help MSMEs grow and improve digitization.We are seeking a talented and driven Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Data Engineer

    1 week ago


    Singapore MAESTRO HUMAN RESOURCE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description & RequirementsWe are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and...

  • Data Engineer

    2 weeks ago


    Singapore TALENTSIS PTE. LTD. Full time

    Roles & ResponsibilitiesCompany's Profile:Our client is an international technology and engineering company that specialises in providing innovative digital and security solutions to their esteemed clients. They are well-known for their dedication of quality delivery standards with more than 15,000 engineers globally supporting projects. They have an...

  • Data Engineer

    3 weeks ago


    Singapore SYNAPXE PTE. LTD. Full time

    Roles & ResponsibilitiesPosition Summary / Project DescriptionData Engineer for cloud migration projects (Primarily utilizing AWS, IDMC, Databricks and Tableau)Role and Responsibilities• Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark...

  • Data Engineer

    4 weeks ago


    Singapore PERSOLKELLY SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled Data Engineer to join the Insights, Digitalization & Analytics team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions that drive analytics, machine learning, and business insights. Key responsibilities include building data pipelines, APIs, and...

  • Data Engineer

    4 weeks ago


    Singapore PERSOLKELLY SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled Data Engineer to join the Insights, Digitalization & Analytics team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions that drive analytics, machine learning, and business insights. Key responsibilities include building data pipelines, APIs, and...

  • Data Engineer

    1 week ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    Roles & ResponsibilitiesJob Title: Data Engineer - Mid-level/SeniorLocation: Singapore (CBD)Job Type: Full-Time PermanentKey Responsibilities:Design and maintain scalable ETL pipelines using Informatica. Optimize SQL queries and stored procedures for data manipulation. Lead data migration projects ensuring data integrity and quality. Collaborate with...

  • Data Engineer

    2 weeks ago


    Singapore YOUZU (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and motivated Data Engineer to join our team. You will play a key role in designing, maintaining, and expanding our data pipelines while actively shaping the future of our BI system. If you are passionate about data engineering, ETL processes, and driving business insights, we'd love to hear from...

  • Data Engineer

    2 weeks ago


    Singapore YOUZU (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and motivated Data Engineer to join our team. You will play a key role in designing, maintaining, and expanding our data pipelines while actively shaping the future of our BI system. If you are passionate about data engineering, ETL processes, and driving business insights, we’d love to hear from you! ...

  • Data Engineer

    2 weeks ago


    Singapore PERCEPT SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesDuties:Data Domain business workflow interpretation, data requirement study, data exploration, creation of entity relationship diagram, data model creation, data extraction, transformation, and loading ("ETL"), pipeline creation and servicing data requests. Data Platform Operations, setup, installation, access controls and pipeline...

  • Data Engineer

    2 weeks ago


    Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:We are looking for a skilled and motivated Data Engineer with expertise in Scala, SQL, and Hadoop to join our dynamic team. In this role, you will design, develop, and optimize scalable data pipelines and systems, collaborating with cross-functional teams to drive high-quality data solutions.Key ResponsibilitiesData...