
Big Data Engineer
4 days ago
Direct message the job poster from Baidu, Inc.
Responsibilities
- Build the company's big data warehouse system, including batch and stream data flow construction;
- In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance
- Responsible for data integration and ETL architecture design and development
- Research cutting-edge big data technologies, optimize big data platforms continuously
Job requirements
- Bachelor degree or above in computer, database, machine learning and other related majors, more than 3 years of data development work;
- Have a keen understanding of business data, and can analyze business data quickly;
- Proficient in SQL language, familiar with MySQL, very familiar with Shell, Java (Scala), Python;
- Familiar with common ETL technologies and principles; proficient in data warehouse database design specifications and practical operations; rich experience in spark, MR task tuning
- Familiar with Hadoop, Hive, HBase, Spark, Flink, Kafka and other big data components;
- Proficient in the use of mainstream analytical data systems such as ClickHouse, Doris, TiDB; tuning experience is preferred
Seniority level
- Mid-Senior level
Employment type
- Full-time
Job function
- Information Technology and Engineering
Industries
- Software Development, Technology, Information and Media, and Information Services
-
Big Data Engineer
1 week ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...
-
Big Data Engineer
1 week ago
Singapore IITMATRIX Full timeWe are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...
-
Big Data Engineer
6 days ago
Singapore AlgoriX Technology Pte. Ltd. Full time**Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...
-
Big Data Engineer
4 days ago
Singapore INCOME INSURANCE LIMITED Full timeResponsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...
-
Big Data Engineer
2 weeks ago
Singapore Baidu, Inc. Full timeDirect message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...
-
Big Data Engineer
1 week ago
Singapore UNISON Group Full time $104,000 - $130,878 per yearWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...
-
Big Data Engineer
1 week ago
Singapore Unison Consulting Full timeGet AI-powered advice on this job and more exclusive features. We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing,...
-
Big Data Engineer
1 week ago
Singapore AXPARA SOLUTIONS PTE. LTD. Full timeJob Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...
-
Big Data Engineer
1 week ago
Singapore AXPARA SOLUTIONS PTE. LTD. Full timeJob Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...
-
Big Data Engineer
1 week ago
Singapore beBeeDataEngineer Full timeAbout the Data Management Suite Team The Data Management Suite team is focused on building scalable products that cover the entire lifecycle of data pipeline, including data ingestion and integration, data development, data catalog, data security, and data governance. These products support various businesses, allowing data engineers and scientists to...