Big Data Engineer, Scalable Architecture
2 weeks ago
Our Data Architecture Team is responsible for designing and implementing the architecture for recommendation systems to provide the most stable and best experience for our users.
We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, video-related search bars, and comment entities.
Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness.
Responsibilities- Design and implement a reasonable offline data architecture for large-scale recommendation systems.
- Design and implement flexible, scalable, stable, and high-performance storage and computing systems.
- Troubleshoot the production system, design, and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system.
- Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems.
- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualization software.
- Apply data mining, data modeling, natural language processing, and machine learning to extract and analyze information from large structured and unstructured datasets.
- Visualize, interpret, and report data findings and may create dynamic data reports.
- Bachelor's degree or above, majoring in Computer Science, or related fields, with at least 1 year of experience.
- Familiar with many open-source frameworks in the field of big data, including Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, and ElasticSearch.
- Experience in programming, including but not limited to, C, C++, Java, or Golang.
- Effective communication skills and a sense of ownership and drive.
- Experience of Peta Byte level data processing is a plus.
-
Big Data Engineer, Scalable Architecture
2 weeks ago
Singapur, Singapore TikTok Full timeAbout the TeamOur Data Architecture Team is responsible for designing and implementing the architecture for recommendation systems to provide the most stable and best experience for our users.We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, video-related search bars, and comment entities.Our recommendation system...
-
Data Engineer
6 days ago
Singapur, Singapore DBS Bank Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at DBS Bank. As a Data Engineer, you will play a key role in designing, building, and maintaining our Big Data platform.Key ResponsibilitiesDesign and implement scalable data pipelines using Big Data tools and technologiesCollaborate with cross-functional teams to define and deliver...
-
Data Engineer
6 days ago
Singapur, Singapore Nityo Infotech Full timeJob Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable and efficient data processing...
-
Data Engineer
6 days ago
Singapur, Singapore NTT Data Singapore Full timeJob SummaryWe are seeking a highly skilled and experienced Big Data Engineer to lead our data engineering efforts. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably.Key...
-
Big Data Engineer
6 days ago
Singapur, Singapore DBS Bank Full timeAbout the RoleDBS Bank is seeking a highly skilled Big Data Engineer to join our Group Technology and Operations team. As a key member of our team, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications.Key ResponsibilitiesDesign and implement scalable Big Data architectures using Hadoop, Spark, and other...
-
Singapur, Singapore TikTok Full timeAbout the team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities....
-
Big Data Engineer
4 months ago
Singapur, Singapore TikTok Full timeAbout the team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities....
-
Big Data Global Manager
4 months ago
Singapur, Singapore TikTok Full timeAbout the team This role is a member of our Data Platform team focusing on Data products and solutions to enterprise services, leveraging TikTok's cutting-edge data infrastructure and data application. You will be helping enterprise customers to build their next generation data warehouse and data analytics, enabling them to do things that were not possible...
-
Big Data Global Manager
6 days ago
Singapur, Singapore TikTok Full timeAbout the TeamThis role is a key member of our Data Platform team, focusing on delivering innovative data products and solutions to support TikTok's business growth. As a Big Data Global Manager, you will leverage our cutting-edge data infrastructure and expertise to empower enterprise customers with next-generation data warehousing and analytics...
-
Data Engineer
7 days ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will be responsible for designing, developing, and implementing Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.Key Responsibilities:Design and develop...
-
Data Engineer
2 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeAbout the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key ResponsibilitiesData Transformation and Aggregation: Implement data...
-
Data Engineer
2 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will play a critical role in designing, developing, and implementing large-scale data processing pipelines using Spark Scala applications.Key ResponsibilitiesData Processing and IntegrationDesign and develop efficient data...
-
Senior Data Engineer
2 days ago
Singapur, Singapore Helius Full timeJob Title: Senior Data Engineer - Big DataHelius is seeking a highly skilled Senior Data Engineer - Big Data to join our team. As a Senior Data Engineer - Big Data, you will be responsible for designing, developing, and deploying large-scale data processing systems using Talend Big Data version 7+ and Hadoop.Key Responsibilities:Design and develop...
-
Big Data Engineer
2 hours ago
Singapur, Singapore Virtusa Full timeBig Data EngineerVirtusa is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines using ETL tools...
-
Data Engineer
3 weeks ago
Singapur, Singapore NTT Data Singapore Full timeRequirements Bachelor's degree in Computer Science or a related field. At least 7 years of IT experience of which at least 5 years' experience in similar role, ideally in a Big Data tools Proficient understanding of distributed computing principles Strong experience of Hadoop, Spark, Iceberg and Spring Boot Experience with building stream-processing...
-
Big Data Architect
2 weeks ago
Singapur, Singapore TikTok Full time**About the Team** Our **Recommendation Architecture Team** is responsible for building and optimizing the architecture for recommendation systems to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment...
-
AVP, Data Engineer
2 weeks ago
Singapur, Singapore DBS Bank Full timeJob SummaryDBS Bank is seeking a highly skilled Data Engineer to join our team in Group Technology and Operations (T&O). As a Data Engineer, you will play a critical role in enabling and empowering the bank with an efficient, nimble, and resilient infrastructure through a strategic focus on productivity, quality, and control, technology, people capability,...
-
Data Engineer
1 month ago
Singapur, Singapore Centre for Strategic Infocomm Technologies Full timeAbout this roleWe are seeking a Data Engineer to join our Data & Systems Engineering team. In this role, you will be responsible for enhancing and optimizing the data flow between our systems and refining our data pipeline architecture. You will collaborate closely with cross-functional teams to gather requirements, design scalable solutions, and implement...
-
Data Engineer
2 hours ago
Singapur, Singapore Centre for Strategic Infocomm Technologies Full timeAbout this role at Centre for Strategic Infocomm TechnologiesWe are seeking a highly skilled Data Engineer to enhance and optimize our data flow between systems and refine our data pipeline architecture. As a key member of our Data & Systems Engineering team, you will collaborate closely with cross-functional teams to gather requirements, design scalable...
-
Big Data Global Manager
2 weeks ago
Singapur, Singapore TikTok Full time**About the Team**This role is a member of our Data Platform team focusing on Data products and solutions to enterprise services, leveraging TikTok's cutting-edge data infrastructure and data application.You will be helping enterprise customers to build their next generation data warehouse and data analytics, enabling them to do things that were not possible...