Big Data Expert

2 weeks ago


Singapore beBeeData Full time $80,000 - $120,000
Big Data Engineer Position

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 4 years of experience managing data engineering jobs in Big Data environment e.g., Cloudera Data Platform.

Job Description

The successful candidate will be responsible for designing, developing and maintaining data ingestion and processing jobs. This role involves working closely with cross-functional teams to deliver high-quality solutions that meet business requirements.

Key Responsibilities
  • Analyze and document client data requirements to inform and guide project initiatives.
  • Streamline data pipelines and refine data collection by migrating to more efficient channels.
  • Design and implement data engineering solutions, from ETL jobs to analytical reporting.
  • Develop comprehensive test plans and scripts and support user acceptance testing (UAT).
  • Build custom reports and dashboards that align with user needs.
  • Collaborate with client technical teams to ensure seamless solution deployment and adoption.
  • Maintain the operational health and service levels of IT solutions.
  • Troubleshoot and resolve production issues in a timely manner.
Requirements
  • Proven experience completing projects using Waterfall or Agile methodologies.
  • Expert-level skills in SQL, data modeling and data analysis.
  • Hands-on experience with big data engineering using Python, PySpark, Linux, and ETL tools like Informatica.
  • Proficiency in a reporting or visualization tool such as SAP BusinessObjects or Tableau.
  • Familiarity with DevOps deployment and data virtualization tools like Denodo is a plus.
  • Track record of implementing systems using Hive, Impala, and Cloudera Data Platform.
  • Strong understanding of analytics and data warehouse architectures.
  • Ability to troubleshoot complex issues, from system resources to application stack traces.
  • Experience with high-availability, high-performance, and secure system implementations in on-premise or cloud environments is an advantage.
  • A passion for automation, standardization and best practices.
Benefits

By choosing our organization, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023. We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey. At our organization, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.

Life at Our Organization
  • Our organization is a leading global provider of digital platform engineering and development services.
  • You will have the opportunity to work with fellow talented technologists and accelerate your career by participating in our numerous upskilling, training, and certification programs.
Seniority Level and Employment Type

Associate Seniority level. Full-time employment type.


  • Big Data Expert

    2 weeks ago


    Singapore beBeeDataEngineer Full time $150,000 - $200,000

    Job Title: Data ExpertDescription:We are seeking an experienced professional to manage data engineering jobs in big data environment e.g., Cloudera Data Platform.The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform.The successful candidate will be responsible for...


  • Singapore beBeeData Full time $900,000 - $1,200,000

    Big Data Solution ExpertThis role entails a deep understanding of customers' needs and pain points regarding Big Data products and solutions, designing overall Big Data product solutions tailored to customer business scenarios and technical requirements.The ideal candidate will have strong analytical skills, be able to communicate complex ideas effectively,...


  • Singapore beBeeData Full time $80,000 - $120,000

    Big Data Architect Job DescriptionWe are seeking a seasoned Big Data Architect to join our team. The ideal candidate will have expertise in designing and implementing scalable big data architectures.The successful candidate will analyze and resolve complex system performance and stability issues, develop and maintain technical documentation, and collaborate...


  • Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Job OverviewWe are seeking an experienced Big Data Engineer to design, develop, and maintain data ingestion and processing jobs. The ideal candidate will have a minimum of 4 years of experience managing data engineering jobs in big data environment.Key Responsibilities:Analyse data needs and document the requirements.Refine data collection/consumption by...

  • Big Data Engineer

    2 weeks ago


    Singapore Unison Consulting Full time

    Get AI-powered advice on this job and more exclusive features. We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing,...


  • Singapore beBeeData Full time $80,000 - $120,000

    Job TitlePlatform ArchitectWe are seeking a skilled and experienced Platform Architect to design, build, and manage scalable big data platforms.",


  • Singapore beBeeDataExpert Full time $180,000 - $260,000

    Job OpportunityWe are seeking a seasoned Data Solutions Expert to join our team. In this role, you will collaborate with clients on short to medium term customer engagements solving their big data challenges using Apache Spark and a leading data intelligence platform.Main Responsibilities:Provide comprehensive guidance to customers through end-to-end...


  • Singapore beBeeDataEngineer Full time $80,000 - $120,000

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 4 years of experience managing data engineering jobs in Big Data environment e.g., Cloudera Data Platform. Job DescriptionThe successful candidate will be responsible for designing, developing and maintaining data ingestion and...


  • Singapore beBeeData Full time $40,000 - $80,000

    Big Data Development ExpertWe are seeking an experienced data engineer to join our team and lead the development of big data applications.Key Responsibilities:Design, develop, and maintain ETL processes for finance regulatory reporting projects and applications.Develop and implement big data applications using agile methodologies.Enhance existing...


  • Singapore beBeeData Full time

    Big Data Development Expert We are seeking an experienced data engineer to join our team and lead the development of big data applications. Key Responsibilities: Design, develop, and maintain ETL processes for finance regulatory reporting projects and applications. Develop and implement big data applications using agile methodologies. Enhance...