Big Data Engineer

4 days ago


Singapore Baidu, Inc. Full time

Direct message the job poster from Baidu, Inc.

Responsibilities

  • Build the company's big data warehouse system, including batch and stream data flow construction;
  • In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance
  • Responsible for data integration and ETL architecture design and development
  • Research cutting-edge big data technologies, optimize big data platforms continuously

Job requirements

  • Bachelor degree or above in computer, database, machine learning and other related majors, more than 3 years of data development work;
  • Have a keen understanding of business data, and can analyze business data quickly;
  • Proficient in SQL language, familiar with MySQL, very familiar with Shell, Java (Scala), Python;
  • Familiar with common ETL technologies and principles; proficient in data warehouse database design specifications and practical operations; rich experience in spark, MR task tuning
  • Familiar with Hadoop, Hive, HBase, Spark, Flink, Kafka and other big data components;
  • Proficient in the use of mainstream analytical data systems such as ClickHouse, Doris, TiDB; tuning experience is preferred

Seniority level

  • Mid-Senior level

Employment type

  • Full-time

Job function

  • Information Technology and Engineering

Industries

  • Software Development, Technology, Information and Media, and Information Services
#J-18808-Ljbffr
  • Big Data Engineer

    1 week ago


    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...

  • Big Data Engineer

    1 week ago


    Singapore IITMATRIX Full time

    We are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...

  • Big Data Engineer

    6 days ago


    Singapore AlgoriX Technology Pte. Ltd. Full time

    **Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...

  • Big Data Engineer

    4 days ago


    Singapore INCOME INSURANCE LIMITED Full time

    Responsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...

  • Big Data Engineer

    2 weeks ago


    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...

  • Big Data Engineer

    1 week ago


    Singapore UNISON Group Full time $104,000 - $130,878 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    1 week ago


    Singapore Unison Consulting Full time

    Get AI-powered advice on this job and more exclusive features. We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing,...

  • Big Data Engineer

    1 week ago


    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...

  • Big Data Engineer

    1 week ago


    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...

  • Big Data Engineer

    1 week ago


    Singapore beBeeDataEngineer Full time

    About the Data Management Suite Team The Data Management Suite team is focused on building scalable products that cover the entire lifecycle of data pipeline, including data ingestion and integration, data development, data catalog, data security, and data governance. These products support various businesses, allowing data engineers and scientists to...