Senior Big Data Specialist

2 weeks ago

Singapore beBeeDataEngineer Full time

We are seeking a seasoned data engineer to develop and maintain ETL processes, big data applications, and contribute to the coding, testing, and support of our data warehouse.

Key Responsibilities:

  • Develop and maintain robust ETL pipelines for finance regulatory reporting projects and applications.
  • Design and implement big data applications using Agile software development methodologies.
  • Enhance existing applications based on detailed specifications provided by technical analysts.
  • Collaborate with technical analysts and scrum masters on project delivery and issue resolution.
  • Contribute to the coding, testing, and level 2/3 support of our data warehouse.
  • Partner with business stakeholders to ensure requirements are met and collaborate with other technology teams (QA, production support) for effective implementation.
  • Provide technical expertise to assist in designing, testing, and implementing software code and infrastructure to support data infrastructure and governance activities.
  • Troubleshoot and resolve complex technical problems in applications or processes, providing effective solutions.
  • Perform performance tuning using execution plans and other relevant tools.
  • Continuously explore and evaluate emerging technologies within the Hadoop ecosystem and apply them to relevant business challenges.
  • Analyze and debug existing shell scripts, and enhance them as needed.

Requirements:

  • Bachelor's degree in computer science or a related field.
  • Experience with Spark, HDFS, MapReduce, Hive, Impala, Sqoop, and Linux/Unix technologies.
  • Hands-on experience with RDBMS technologies (e.g., Oracle, MariaDB).
  • Strong analytical and problem-solving skills.
  • Experience working with big data implementations in production environments.
  • Familiarity with Unix shell scripting.
  • Understanding of Agile methodology and experience working in an Agile development environment.

  • Big Data Specialist

    2 weeks ago

    Singapore beBeeData Full time $60,000 - $120,000

    The role of Big Data Specialist is to lead the design and development of cutting-edge data solutions. The successful candidate will possess a strong foundation in computer science, mathematics, or a related field, with expertise in programming languages such as C/C++, JAVA, or Python.Key Responsibilities:Design and develop big data technology components or...

  • Big Data Migration Specialist

    7 days ago

    Singapore beBeeMigration Full time $80,000 - $120,000

    Job Title: Big Data Migration SpecialistMission Statement:We are seeking a skilled professional to lead the migration of our existing data warehouse and data model from MariaDB to the Hadoop Big Data Cloudera on-premise platform.The ideal candidate must be proficient in SQL, Hive SQL, Spark, and data modeling. They should possess a strong understanding of...

  • Senior Big Data Infrastructure Specialist

    2 weeks ago

    Singapore beBeeEngineer Full time $180,000 - $250,000

    The role of a Senior Big Data Platform Staff Engineer is pivotal in managing and optimizing our Big Data infrastructure platform. The ideal candidate will possess an in-depth understanding of Big Data technologies, architectures, and systems, as well as experience with managing large-scale data processing and analytics environments.Key ResponsibilitiesWe are...

  • Application Management Senior Specialist

    2 weeks ago

    Singapore NTT DATA Full time

    **Req ID**: 335858 We are currently seeking a Application Management Senior Specialist to join our team in Singapore, Central Singapore (SG-01), Singapore (SG). - Strong in data engineering concepts and programming - Experience in building and optimizing 'big data' data pipelines, architectures and data sets. - Experience performing root cause analysis on...

  • Big Data Engineer Specialist

    7 days ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Big Data Engineer SpecialistWe are seeking a skilled Big Data Engineer to join our team. The successful candidate will be responsible for designing, maintaining and optimizing large-scale distributed systems.Key Responsibilities:Design and implement ETL/ELT pipelines using Spark for batch and streaming data.Manage and optimize Hadoop clusters (HDFS, YARN)...

  • Data Architect

    1 week ago

    Singapore beBeeData Full time $120,000 - $150,000

    Big Data Platform SpecialistWe are seeking a highly skilled Big Data Platform Specialist to join our team. As a key member, you will design and implement big data platforms built on Hadoop, Spark, and Hive.About the RoleDesign and implement big data platforms using Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage...

  • Big Data Innovator

    1 week ago

    Singapore beBeeData Full time $180,000 - $240,000

    As a Senior Big Data Solution Architect, you will design and develop data-driven solutions to drive business growth.Key ResponsibilitiesDeeply understand customer needs and pain points regarding big data products and solutions.Recommend the core advantages and capabilities of our big data products and solutions to customers.Thoroughly understand customer...

  • Senior Big Data Architect

    1 week ago

    Singapore beBeeDataEngineer Full time $120,000 - $180,000

    Big Data EngineerWe are seeking a highly motivated and skilled Big Data Engineer to join our dynamic team.Responsibilities:Data Engineering: Design, develop, and maintain complex big data systems for efficient data processing.Data Management: Implement and manage large-scale data storage solutions using relational databases and NoSQL technologies.Apache...

  • Senior Engineer

    7 days ago

    Singapore Reeracoen Singapore Pte Ltd Full time

    Our client is a dynamic technology consulting company specializing in digital transformation and innovative solutions. They are currently looking for a Senior Engineer (Big Data) to join their tech engineering team. - 【 What you will be doing 】- Responsible for designing, creating, and managing large-scale data processing systems. - Ensure that systems...

  • Big Data Engineer

    3 weeks ago

    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...