Big Data Software Engineer

2 weeks ago

Singapore Shopee Full time

DepartmentEngineering and Technology- LevelExperienced (Individual Contributor)- LocationSingaporeThe Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit ourselves on what we can or can't do; we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed most "innocent" problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do.

**About the Team**:

- Shopee Paid ads team was established in 2016 to provide an e-commerce advertising platform by relying on Shopee’s massive data. Our expertise covers data, high performance AI-based online services, distributed systems, machine learning algorithms, and ads business strategies. The team places a strong emphasis on technology and strives to achieve innovation.- Design, build and maintain the ingestion system to support various types of data (e.g. user behavior, RDS, NoSQL DB and others) to be ingested to the data warehouse more timely and accurately
- Translate data requirements into scalable technical data service with low latency and high concurrency
- Design, build and maintain the batch or real-time data pipeline in production using Hadoop big data technology
- Analyse and improve efficiency, scalability, and stability of the system
- Define and manage service level agreement and data quality for all data sets in allocated areas of ownership

**Requirements**:

- Minimum Bachelor’s degree in Computer Science or a related technical field
- 2+ years of working experience in programming languages, such as Java, Scala, Python, Golang & C++, SQL is optional
- Familiar with Hadoop, Spark and Flink data processing; experience with TB data processing experience is a plus
- Understand data mining or machine learning, excited to work with data, passionate, self-motivated, and takes ownership
- Familiar with designing and operating of a robust distributed system is a plus

  • Data Engineer

    3 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Data Engineer, Big Data

    1 week ago

    Singapore Grab Full time

    **Job Description**: **Life at Grab**: At Grab, every Grabber is guided by The Grab Way, which spells out our mission, how we believe we can achieve it, and our operating principles - the 4Hs: Heart, Hunger, Honour and Humility. These principles guide and help us make decisions as we work to create economic empowerment for the people of Southeast...

  • Big Data Engineer

    9 hours ago

    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...

  • Principal Big Data Engineer

    4 days ago

    Singapore QUESSCORP HOLDINGS PTE. LTD. Full time

    **Job Description**: - Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. - Ensure data quality, integrity, and consistency across various data sources. - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that...

  • Big Data Platform Engineer

    5 days ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...

  • Big Data Engineer

    1 hour ago

    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...

  • Big Data Software Engineer

    1 week ago

    Singapore TIKTOK PTE. LTD. Full time

    TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Mumbai, Singapore, Jakarta, Seoul and Tokyo. TikTok Live client team focus has been focusing on delivery engaging and the best live streaming experience to...

  • Big Data Engineer

    2 days ago

    Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time

    **Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...

  • Big Data Test Engineer

    1 hour ago

    Singapore PatSnap Full time

    About PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...

  • Big Data Engineer Lead

    5 days ago

    Singapore Maltem Asia-Pacific Full time

    Maltem Singapore is seeking a Big Data Engineer Lead for our Media Communications Client. Summary: We are looking for a highly skilled Lead Big Data Engineer to join our data team. The candidate will design, develop, and maintain scalable big data solutions and provide technical leadership. This role will support Data Governance initiatives, ensuring...