Big Data Engineer, TikTok ShortText Recommendation Architecture

7 months ago


Singapur, Singapore TikTok Full time

About the team

Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities. Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness. Responsibilities- Design and implement a reasonable offline data architecture for large-scale recommendation systems- Design and implement flexible, scalable, stable and high-performance storage and computing systems- Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system- Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive date and large-scale business systems- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software- Applying data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets- Visualise, interpret, and report data findings and may create dynamic data reports as well

Minimum Qualifications- Bachelor's degree or above, majoring in Computer Science, or related fields, with at least 1 year of experience- Familiar with many open source frameworks in the field of big data, . Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, etc.- Experience in programming, including but not limited to, the following programming languages: c, C++, Java or Golang- Effective communication skills and a sense of ownership and drive- Experience of Peta Byte level data processing is a plus
  • Big Data Engineer

    7 months ago


    Singapur, Singapore TikTok Full time

    About the team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities....


  • Singapur, Singapore TikTok Full time

    About the team Our Search Architecture Team is responsible for building up and optimizing the architecture for our Search Engine to provide the most stable and best experience for our TikTok Search users. This person will be responsible for the design and development of the search system architecture, ensuring system stability and high availability;...

  • Backend Engineer

    3 months ago


    Singapur, Singapore TikTok Full time

    About the team Our Search Architecture Team is responsible for building up and optimizing the architecture for our Search Engine to provide the most stable and best experience for our TikTok Search users. This person will be responsible for the design and development of the search system architecture, ensuring system stability and high availability;...


  • Singapur, Singapore TikTok Full time

    About the team Our Search Architecture Team is responsible for building up and optimizing the architecture for our Search Engine to provide the best experience for our TikTok Shop Search users. This person will be responsible for the design and development of the global e-commerce search system architecture, ensuring system stability and high availability;...


  • Singapur, Singapore TikTok Full time

    About the team :Tea(Toutiao Event Analyze) is an in-house analytics platform that is heavily used by more than 10,000 employees globally. This is a data middle platform product built on user behavior data, providing data analysis services for various domestic and international businesses within ByteDance/TikTok, including Douyin, Toutiao, Xigua, TikTok,...

  • Backend Engineer

    7 months ago


    Singapur, Singapore TikTok Full time

    About the team Our Search Architecture Team is responsible for building up and optimizing the architecture for our Search Engine to provide the most stable and best experience for our TikTok Shop Search users. This person will be responsible for the design and development of the global e-commerce search system architecture, ensuring system stability and...


  • Singapur, Singapore TikTok Full time

    About the team Our Compute Platform SRE team supports all Big Data services and products across the company. We are a newly established team and waiting for talents like you to shape the team's future together. We are responsible for the reliability of all the company's major data warehouse products, services, and query engines. We serve business needs...


  • Singapur, Singapore TikTok Full time

    About the team The Search Growth E-commerce team is at the forefront of developing the search recommendation algorithm for TikTok's rapidly expanding global e-commerce enterprise. Utilizing cutting-edge machine learning technology, advanced NLP, CV, recommendation, and multi-modal technology, we're shaping a pioneering engine within the industry. Our...

  • Data Engineer

    5 months ago


    Singapur, Singapore TikTok Full time

    About the team The success of TikTok's data business model hinges on the supply of a large volume of high quality labeled data that will grow exponentially as our business scales up. However, the current cost of data labeling is excessively high. The Data Solutions team is built to understand data strategically at scale for all Global Business Solution...


  • Singapur, Singapore Hireio, Inc. Full time

    Design and develop high-performance online services for recommendation system. Construct efficient and reliable data pipelines for candidate generation, profile generation, training examples, and real-time online training. Build and maintain a globalized, large-scale recommendation system. Develop high-performance computing frameworks and storage systems....

  • Lead Data Engineer

    6 months ago


    Singapur, Singapore TikTok Full time

    About the team The success of TikTok's data business model hinges on the supply of a large volume of high quality labeled data that will grow exponentially as our business scales up. However, the current cost of data labeling is excessively high. The Data Solutions team is built to understand data strategically at scale for all Global Business Solution...


  • Singapur, Singapore TikTok Full time

    About the team Our team works on large-scale recommendation systems for various offerings under TikTok and its affiliates, focusing on developing recommendation algorithms/models/strategies. We are committed to developing cutting-edge solutions for e-commerce recommendation systems. Responsibilities- Work on recommendation systems, involving contents of...


  • Singapur, Singapore TikTok Full time

    About the team :Tea(Toutiao Event Analyze) is an in-house analytics platform that is heavily used by more than 10,000 employees globally. This is a data middle platform product built on user behavior data, providing data analysis services for various domestic and international businesses within ByteDance/TikTok, including Douyin, Toutiao, Xigua, TikTok,...


  • Singapur, Singapore TikTok Full time

    Team Introduction TikTok RTC is a world-leading Real-Time Communication service that provides instant and quality multimedia interaction among our customers across the globe. TikTok Live is a cutting edge streaming media technical team which provides a giant amount of live services to our customers. Live event team is comprised of Priority Event...


  • Singapur, Singapore Hireio, Inc. Full time

    About TikTokTikTok is the leading platform for short-form mobile videos, dedicated to inspiring creativity and bringing joy to over 1 billion users. With global offices in cities like Los Angeles, New York, London, and Singapore, we prioritize innovation and collaboration.Why Join Us?At TikTok, our team is humble, intelligent, compassionate, and creative. We...

  • Data Science

    7 months ago


    Singapur, Singapore TikTok Full time

    About The Team :The mission of the TikTok Eng-AI Innovation Center is to explore cutting-edge AGI technologies, including but not limited to LLM, multi-modal LLM (video/image/audio/text/code), etc., to let machine better understand user creations on Tiktok platform. Regarding to video/image/audio/text, enhanced content understanding can bring better user...


  • Singapur, Singapore TikTok Full time

    About The Team :The mission of the TikTok Eng-AI Innovation Center is to explore cutting-edge AGI technologies, including but not limited to LLM, multi-modal LLM (video/image/audio/text/code), etc., to let machine better understand user creations on TikTok platform. Regarding to video/image/audio/text, enhanced content understanding can bring better user...


  • Singapur, Singapore TikTok Full time

    Team Introduction The mission of the Data Platform Singapore Business Partnering (DPSG BP) team is to empower the TikTok Business with data. Our goal is to build a Data Warehouse that can cater to batch and streaming data, Data Products that provide useful information to build efficient data metrics & dashboards which will be used to make smarter business...

  • Big Data Engineer

    4 months ago


    Singapur, Singapore TikTok Full time

    Team Introduction We are an incredible team with passion. We enjoy learning new things and taking on challenges. Team culture here is open and inclusive. Everyone can make things happen, good ideas will always win.Today, we are continuously increasing investment in AI technology to make content creation much easier for everyone, and we always take the...

  • Big Data Engineer

    6 months ago


    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 123101 Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. • Good understanding of analytics and data warehouse implementations. • Ability to troubleshoot complex issues ranging from system resource to application stack traces. • Strong SQL, data modelling and data...