Big Data Developer

1 day ago

Singapore beBeeDataEngineer Full time $80,000 - $120,000
Job Description">

We are seeking a skilled Data Engineer to design, develop and maintain ETL processes for finance regulatory reporting projects.

  • The ideal candidate will have expertise in Spark development, experience with Big Data applications using Agile methodologies, and the ability to collaborate effectively with cross-functional teams.
  • This role requires collaboration with Tech BAs and Scrum Masters on project delivery and issue resolution, as well as contributing to the coding, testing, and Level 2/3 support of data warehouses.
  • The successful candidate will partner with business stakeholders to ensure requirements are met and collaborate with other technology teams (QA, Production Support) for effective implementation.
  • The Data Engineer will provide technical expertise to assist in designing, testing, and implementing software code and infrastructure to support data infrastructure and governance activities.
  • Troubleshooting and resolving technical problems in applications or processes is also a key responsibility of this role.
  • Performance tuning using execution plans and other relevant tools is essential.
  • The Data Engineer must continuously explore and evaluate evolving tools within the Hadoop ecosystem and apply them to relevant business challenges.
Required Skills">

The following skills are required:

  • 3+ years experience as a Data Engineer with expertise in Spark development.
  • Bachelor's degree in Computer Science or a related field.
  • Experience with Spark, HDFS, MapReduce, Hive, Impala, Sqoop, and Linux/Unix technologies.
  • Hands-on experience with RDBMS technologies (e.g. Oracle, MariaDB).
  • Strong analytical and problem-solving skills.
  • Experience working with a Big Data implementation in a production environment.
  • Familiarity with Unix shell scripting.
  • Understanding of Agile methodology and experience working in an Agile development environment.
Key Responsibilities">

The Data Engineer will be responsible for:

  1. Designing, developing, and maintaining ETL processes for finance regulatory reporting projects.
  2. Collaborating with cross-functional teams to deliver project results.
  3. Providing technical expertise to assist in designing, testing, and implementing software code and infrastructure.
  4. Troubleshooting and resolving technical problems in applications or processes.
  5. Performing performance tuning using execution plans and other relevant tools.

  • Big Data Developer

    1 day ago

    Singapore DADACONSULTANTS PTE. LTD. Full time

    **Responsibilities** **1、**Design and develop scalable, high-performance data processing systems using Hadoop, Flink, and other Big Data technologies. 2、Develop and maintain data pipelines for data ingestion, processing, and analysis. 3、Design and implement data models to optimize data storage and retrieval efficiency. 4、Collaborate with...

  • Big Data Developer

    5 days ago

    Singapore ALMR CONSULTING PTE. LTD. Full time $90,000 - $120,000 per year

    Responsibilities Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. Developing and deploying data processing applications using Big Data...

  • Big Data Developer

    1 week ago

    Singapore Zone IT Solutions Full time

    We are looking for Big Data Developers in the vibrant city of Singapore. This is a fantastic opportunity for someone who is passionate about big data and wants to take their career to new heights. **Requirements**: - Minimum of 5 years of experience as a Big Data Developer - Strong knowledge and experience with Big Data technologies such as Hadoop, Spark,...

  • Big Data Developer

    2 weeks ago

    Singapore Zenith Infotech Pte Ltd. Full time

    Join to apply for the Big Data Developer role at Zenith Infotech . Get AI-powered advice on this job and more exclusive features. This range is provided by Zenith Infotech. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Job Scope: Using the Talend ETL toolset, to create new and maintain...

  • Big Data Development Expert

    7 days ago

    Singapore beBeeData Full time $60,000 - $80,000

    Job Overview:We are seeking a highly skilled professional to fill the role of Assistant Big Data Development Engineer. As a key contributor to our big data development team, you will be responsible for designing and building robust data warehouses and performing data analysis based on business requirements.Key Responsibilities:Develop and implement big data...

  • Big Data Developer

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Job Type** Permanent **Seniority** Mid **Years of Experience** At least 3 years **Tech Stacks** ETL AWS Analytics R EMR pySpark Glue Athena RedShift Flume Presto Java Hive Spark kafka Flink SQL Scala Python **Responsibility**: - Designing and build scalable data pipelines to extract, transform, and load data from a variety of sources...

  • Big Data Developer

    2 weeks ago

    Singapore ROADGET BUSINESS PTE. LTD. Full time

    **Responsibilities**: - Responsible for analyzing data requirements and provide data technology solution for business departments. - Responsible for data integration between the business system and big data platform, build data warehouse. - Responsible for business data ETL development, offline and real-time data development on the current big data...

  • Senior Big Data Developer

    2 days ago

    Singapore beBeeData Full time $40,000 - $80,000

    Big Data Development ExpertWe are seeking an experienced data engineer to join our team and lead the development of big data applications.Key Responsibilities:Design, develop, and maintain ETL processes for finance regulatory reporting projects and applications.Develop and implement big data applications using agile methodologies.Enhance existing...

  • Senior Big Data Developer

    11 minutes ago

    Singapore beBeeData Full time

    Big Data Development Expert We are seeking an experienced data engineer to join our team and lead the development of big data applications. Key Responsibilities: Design, develop, and maintain ETL processes for finance regulatory reporting projects and applications. Develop and implement big data applications using agile methodologies. Enhance...

  • BIg Data Developer

    5 days ago

    Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    Roles & Responsibilities ABOUT THE COMPANY Zenith Infotech (S) Pte Ltd. was started in 1997, primarily with the vision of offering state-of-the-art IT Professionals and solutions to various organizations and thereby helping them increase their productivity and competitiveness. From deployment of one person to formation of whole IT teams, Zenith Infotech...