Senior Big Data Developer

1 week ago

Singapore beBeeDataEngineer Full time $80,000 - $120,000
Job Description

Develop and Maintain Big Data Applications

As a Data Engineer with expertise in Spark development, you will be responsible for developing and maintaining ETL processes for finance regulatory reporting projects and applications. You will also develop Big Data applications using the Agile Software development life cycle and collaborate with the Tech BA and Scrum Master on project delivery and issue resolution.

Key Responsibilities

  • Develop and maintain ETL processes for finance regulatory reporting projects and applications.
  • Develop Big Data applications using the Agile Software development life cycle.
  • Enhance existing applications based on mapping specifications provided by the Tech BA.
  • Collaborate with the Tech BA and Scrum Master on project delivery and issue resolution.
  • Contribute to the coding, testing, and Level 2/3 support of the data warehouse.
  • Partner with business stakeholders to ensure requirements are met and collaborate with other technology teams (QA, Production Support) for effective implementation.
  • Provide technical expertise to assist in designing, testing, and implementing software code and infrastructure to support data infrastructure and governance activities.
  • Troubleshoot and resolve technical problems in applications or processes, providing effective solutions.
  • Perform performance tuning using execution plans and other relevant tools.
  • Continuously explore and evaluate evolving tools within the Hadoop ecosystem and apply them to relevant business challenges.
  • Analyze and debug existing shell scripts, and enhance them as needed.
  • Must have a background in Spark development.

Required Skills and Qualifications

Technical Requirements

  • 3+ years experience as a Data Engineer with expertise in Spark development.
  • Bachelor's degree in Computer Science or a related field.
  • Experience with Spark, HDFS, MapReduce, Hive, Impala, Sqoop, and Linux/Unix technologies.
  • Hands-on experience with RDBMS technologies (e.g., Oracle, MariaDB).
  • Strong analytical and problem-solving skills.
  • Experience working with a Big Data implementation in a production environment.
  • Familiarity with Unix shell scripting.
  • Understanding of Agile methodology and experience working in an Agile development environment.

Benefits

What We Offer

You will have the opportunity to work on challenging projects, collaborate with experienced professionals, and continuously learn and grow in your career.

Others

How to Apply

To be considered for this role, please submit your resume and cover letter explaining how you meet the required qualifications and why you are interested in this position.

  • Senior Big Data Developer

    6 days ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Big Data Engineer OpportunityWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining large-scale data systems.Key ResponsibilitiesDesign, develop, and maintain big data systems using technologies such as Hadoop, Spark, and Hive.Work closely with senior engineers to...

  • Senior Big Data Developer

    2 weeks ago

    Singapore beBeeData Full time $90,000 - $120,000

    Are you looking for a challenging opportunity to leverage your technical expertise and drive business growth?This role is a key member of our team, responsible for designing, building, and maintaining scalable, reliable big data platforms.As a senior technical professional, you will bridge the gap between data engineering and DevOps, ensuring seamless data...

  • Big Data Developer

    1 week ago

    Singapore DADACONSULTANTS PTE. LTD. Full time

    **Responsibilities** **1、**Design and develop scalable, high-performance data processing systems using Hadoop, Flink, and other Big Data technologies. 2、Develop and maintain data pipelines for data ingestion, processing, and analysis. 3、Design and implement data models to optimize data storage and retrieval efficiency. 4、Collaborate with...

  • Big Data Developer

    2 weeks ago

    Singapore ALMR CONSULTING PTE. LTD. Full time $90,000 - $120,000 per year

    Responsibilities Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. Developing and deploying data processing applications using Big Data...

  • Big Data Developer

    5 days ago

    Singapore SURPASS STAFFING PTE. LTD. Full time

    **Overview**: **Key Responsibilities**: - Design, develop, and optimize scalable data processing systems leveraging Hadoop, Flink, and other Big Data technologies. - Build and manage robust data pipelines for data ingestion, transformation, and analysis. - Create and implement efficient data models to support effective data storage and retrieval. -...

  • Senior Big Data Developer

    1 week ago

    Singapore beBeeData Full time $40,000 - $80,000

    Big Data Development ExpertWe are seeking an experienced data engineer to join our team and lead the development of big data applications.Key Responsibilities:Design, develop, and maintain ETL processes for finance regulatory reporting projects and applications.Develop and implement big data applications using agile methodologies.Enhance existing...

  • Senior Big Data Developer

    1 week ago

    Singapore beBeeData Full time

    Big Data Development Expert We are seeking an experienced data engineer to join our team and lead the development of big data applications. Key Responsibilities: Design, develop, and maintain ETL processes for finance regulatory reporting projects and applications. Develop and implement big data applications using agile methodologies. Enhance...

  • Big Data Developer

    4 days ago

    Singapore ALMR CONSULTING PTE. LTD. Full time

    **Responsibilities**: - Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions - Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. - Write efficient and optimised code in programming languages...

  • Big Data Innovator

    6 days ago

    Singapore beBeeData Full time $180,000 - $240,000

    As a Senior Big Data Solution Architect, you will design and develop data-driven solutions to drive business growth.Key ResponsibilitiesDeeply understand customer needs and pain points regarding big data products and solutions.Recommend the core advantages and capabilities of our big data products and solutions to customers.Thoroughly understand customer...

  • Big Data Engineer

    2 weeks ago

    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...