Big Data Software Engineer

1 week ago

Singapore Shopee Full time

DepartmentEngineering and Technology- LevelExperienced (Individual Contributor)- LocationSingaporeThe Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit ourselves on what we can or can't do; we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed the most "innocent" problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do. Browse our Engineering and Technology team openings to see how you can make an impact with us.

**About the Team**:

- Shopee Paid ads team was established in 2016 to provide an e-commerce advertising platform by relying on Shopee’s massive data. Our expertise covers data, high performance AI-based online services, distributed systems, machine learning algorithms, and ads business strategies. The team places a strong emphasis on technology and strives to achieve innovation.- Design, build and maintain the ingestion system to support various types of data (e.g. user behavior, RDS, NoSQL DB and others) to be ingested to the data warehouse more timely and accurately
- Translate data requirements into scalable technical data service with low latency and high concurrency
- Design, build and maintain the batch or real-time data pipeline in production using Hadoop big data technology
- Analyse and improve efficiency, scalability, and stability of the system
- Define and manage service level agreement and data quality for all data sets in allocated areas of ownership

**Requirements**:

- Minimum Bachelor’s degree in Computer Science or a related technical field
- 2+ years of working experience in programming languages, such as Java, Scala, Python, Golang & C++, SQL is optional
- Familiar with Hadoop, Spark and Flink data processing; experience with TB data processing experience is a plus
- Understand data mining or machine learning, excited to work with data, passionate, self-motivated, and takes ownership
- Familiar with designing and operating of a robust distributed system is a plus

  • Software Engineer

    3 days ago

    Singapore EPAM Systems Full time

    Join to apply for the Software Engineer (Big Data)role at EPAM Systems 3 days ago Be among the first 25 applicants Join to apply for the Software Engineer (Big Data)role at EPAM Systems We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 4 years of experience managing data...

  • Big Data Engineer

    2 weeks ago

    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...

  • Big Data Platform Engineer

    3 days ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) 1 week ago Be among the first 25 applicants Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) Data processing is an essential part of national security in the modern world. As an engineer in...

  • Big Data Engineer

    1 week ago

    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...

  • Big Data Engineer

    7 days ago

    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...

  • Expert Big Data Engineer

    1 week ago

    Singapore beBeeData Full time $80,000 - $120,000

    Big Data Architect Job DescriptionWe are seeking a seasoned Big Data Architect to join our team. The ideal candidate will have expertise in designing and implementing scalable big data architectures.The successful candidate will analyze and resolve complex system performance and stability issues, develop and maintain technical documentation, and collaborate...

  • Big Data Engineer

    1 week ago

    Singapore beBeeDataEngineer Full time

    About the Data Management Suite Team The Data Management Suite team is focused on building scalable products that cover the entire lifecycle of data pipeline, including data ingestion and integration, data development, data catalog, data security, and data governance. These products support various businesses, allowing data engineers and scientists to...

  • Big Data System Engineer

    2 weeks ago

    Singapore beBeeDataEngineer Full time

    Job Title: Big Data System Engineer About the TeamThe data management team is working on building products that handle every stage of the big data pipeline, from ingestion and integration to development, cataloging, security, and governance.These solutions support various businesses, allowing data engineers and scientists to significantly boost their...

  • Big Data Engineer

    1 week ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...

  • Big Data Engineering Specialist

    2 weeks ago

    Singapore beBeeData Full time $90,000 - $120,000

    Job Opportunity: Become a Big Data Engineer and Contribute to Large-Scale System DevelopmentThe data management team at our company is focused on creating solutions that handle the entire big data pipeline, from ingestion and integration to development, cataloging, security, and governance. Our mission is to design, build, optimize, and scale one of the...