Big Data Engineer, Scalable Architecture

2 weeks ago


Singapur, Singapore TikTok Full time
About the Team

Our Data Architecture Team is responsible for designing and implementing the architecture for recommendation systems to provide the most stable and best experience for our users.

We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, video-related search bars, and comment entities.

Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness.

Responsibilities
  • Design and implement a reasonable offline data architecture for large-scale recommendation systems.
  • Design and implement flexible, scalable, stable, and high-performance storage and computing systems.
  • Troubleshoot the production system, design, and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system.
  • Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems.
  • Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualization software.
  • Apply data mining, data modeling, natural language processing, and machine learning to extract and analyze information from large structured and unstructured datasets.
  • Visualize, interpret, and report data findings and may create dynamic data reports.
Requirements
  • Bachelor's degree or above, majoring in Computer Science, or related fields, with at least 1 year of experience.
  • Familiar with many open-source frameworks in the field of big data, including Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, and ElasticSearch.
  • Experience in programming, including but not limited to, C, C++, Java, or Golang.
  • Effective communication skills and a sense of ownership and drive.
  • Experience of Peta Byte level data processing is a plus.


  • Singapur, Singapore TikTok Full time

    About the TeamOur Data Architecture Team is responsible for designing and implementing the architecture for recommendation systems to provide the most stable and best experience for our users.We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, video-related search bars, and comment entities.Our recommendation system...

  • Data Engineer

    6 days ago


    Singapur, Singapore DBS Bank Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at DBS Bank. As a Data Engineer, you will play a key role in designing, building, and maintaining our Big Data platform.Key ResponsibilitiesDesign and implement scalable data pipelines using Big Data tools and technologiesCollaborate with cross-functional teams to define and deliver...

  • Data Engineer

    6 days ago


    Singapur, Singapore Nityo Infotech Full time

    Job Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable and efficient data processing...

  • Data Engineer

    6 days ago


    Singapur, Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Big Data Engineer to lead our data engineering efforts. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably.Key...

  • Big Data Engineer

    6 days ago


    Singapur, Singapore DBS Bank Full time

    About the RoleDBS Bank is seeking a highly skilled Big Data Engineer to join our Group Technology and Operations team. As a key member of our team, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications.Key ResponsibilitiesDesign and implement scalable Big Data architectures using Hadoop, Spark, and other...


  • Singapur, Singapore TikTok Full time

    About the team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities....

  • Big Data Engineer

    4 months ago


    Singapur, Singapore TikTok Full time

    About the team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities....


  • Singapur, Singapore TikTok Full time

    About the team This role is a member of our Data Platform team focusing on Data products and solutions to enterprise services, leveraging TikTok's cutting-edge data infrastructure and data application. You will be helping enterprise customers to build their next generation data warehouse and data analytics, enabling them to do things that were not possible...


  • Singapur, Singapore TikTok Full time

    About the TeamThis role is a key member of our Data Platform team, focusing on delivering innovative data products and solutions to support TikTok's business growth. As a Big Data Global Manager, you will leverage our cutting-edge data infrastructure and expertise to empower enterprise customers with next-generation data warehousing and analytics...

  • Data Engineer

    7 days ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will be responsible for designing, developing, and implementing Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.Key Responsibilities:Design and develop...

  • Data Engineer

    2 weeks ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key ResponsibilitiesData Transformation and Aggregation: Implement data...

  • Data Engineer

    2 weeks ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will play a critical role in designing, developing, and implementing large-scale data processing pipelines using Spark Scala applications.Key ResponsibilitiesData Processing and IntegrationDesign and develop efficient data...


  • Singapur, Singapore Helius Full time

    Job Title: Senior Data Engineer - Big DataHelius is seeking a highly skilled Senior Data Engineer - Big Data to join our team. As a Senior Data Engineer - Big Data, you will be responsible for designing, developing, and deploying large-scale data processing systems using Talend Big Data version 7+ and Hadoop.Key Responsibilities:Design and develop...

  • Big Data Engineer

    2 hours ago


    Singapur, Singapore Virtusa Full time

    Big Data EngineerVirtusa is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines using ETL tools...

  • Data Engineer

    3 weeks ago


    Singapur, Singapore NTT Data Singapore Full time

    Requirements Bachelor's degree in Computer Science or a related field.  At least 7 years of IT experience of which at least 5 years' experience in similar role, ideally in a Big Data tools Proficient understanding of distributed computing principles Strong experience of Hadoop, Spark, Iceberg and Spring Boot Experience with building stream-processing...

  • Big Data Architect

    2 weeks ago


    Singapur, Singapore TikTok Full time

    **About the Team** Our **Recommendation Architecture Team** is responsible for building and optimizing the architecture for recommendation systems to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment...

  • AVP, Data Engineer

    2 weeks ago


    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking a highly skilled Data Engineer to join our team in Group Technology and Operations (T&O). As a Data Engineer, you will play a critical role in enabling and empowering the bank with an efficient, nimble, and resilient infrastructure through a strategic focus on productivity, quality, and control, technology, people capability,...

  • Data Engineer

    1 month ago


    Singapur, Singapore Centre for Strategic Infocomm Technologies Full time

    About this roleWe are seeking a Data Engineer to join our Data & Systems Engineering team. In this role, you will be responsible for enhancing and optimizing the data flow between our systems and refining our data pipeline architecture. You will collaborate closely with cross-functional teams to gather requirements, design scalable solutions, and implement...

  • Data Engineer

    2 hours ago


    Singapur, Singapore Centre for Strategic Infocomm Technologies Full time

    About this role at Centre for Strategic Infocomm TechnologiesWe are seeking a highly skilled Data Engineer to enhance and optimize our data flow between systems and refine our data pipeline architecture. As a key member of our Data & Systems Engineering team, you will collaborate closely with cross-functional teams to gather requirements, design scalable...


  • Singapur, Singapore TikTok Full time

    **About the Team**This role is a member of our Data Platform team focusing on Data products and solutions to enterprise services, leveraging TikTok's cutting-edge data infrastructure and data application.You will be helping enterprise customers to build their next generation data warehouse and data analytics, enabling them to do things that were not possible...