Big Data Engineer

2 days ago

Singapore Unison Group Full time $120,000 - $180,000 per year

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs. Candidate will also be integrating data sets to provide seamless data access to users.

SKILLS SET AND TRACK RECORD

* Good understanding and completion of projects using waterfall/Agile methodology.

* Analytical, conceptualisation and problem-solving skills.

* Good understanding of analytics and data warehouse implementations

* Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica

* Strong SQL and data analysis skills. Hands-on experience in data virtualisation tools like Denodo will be an added advantage

* Hands-on experience in a reporting or visualization tool like SAP BO and Tableau is preferred

* Track record in implementing systems using Cloudera Data Platform will be an added advantage.

* Motivated and self-driven, with ability to learn new concepts and tools in a short period of time

* Passion for automation, standardization, and best practices

* Good presentation skills are preferred

The developer is responsible to:

* Analyse the Client data needs and document the requirements.

* Refine data collection/consumption by migrating data collection to more efficient channels

* Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.

* Develop test plan and scripts for system testing, support user acceptance testing.

* Work with the Client technical teams to ensure smooth deployment and adoption of new solution.

* Ensure the smooth operations and service level of IT solutions.

* Support production issues

  • Big Data Engineer

    7 days ago

    Singapore ALMR CONSULTING PTE. LTD. Full time

    Job Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...

  • Big Data Engineer

    2 weeks ago

    Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Job Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...

  • Big Data Engineer

    1 week ago

    Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per year

    Job Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...

  • Big Data Engineer

    1 week ago

    Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per year

    Roles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...

  • Platform Engineer – Big Data

    2 weeks ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per year

    We are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...

  • Big Data Test Engineer

    7 days ago

    Singapore Patsnap Full time

    About PatSnap PatSnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...

  • Senior Engineer

    5 days ago

    Singapore Reeracoen Singapore Pte Ltd Full time

    Our client is a dynamic technology consulting company specializing in digital transformation and innovative solutions. They are currently looking for a Senior Engineer (Big Data) to join their tech engineering team. - 【 What you will be doing 】- Responsible for designing, creating, and managing large-scale data processing systems. - Ensure that systems...

  • Big Data Engineer

    2 weeks ago

    Singapore Baidu, Inc. Full time

    Build the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....

  • Big Data Engineer

    2 weeks ago

    Singapore Baidu, Inc. Full time

    Build the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and...

  • Big Data Test Engineer

    1 week ago

    Singapore Patsnap Full time $90,000 - $120,000 per year

    About PatSnapPatsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, deliversactionable insights...