Big Data, Streaming Computing Engineer

1 week ago

Singapore TikTok Full time

Responsibilities
TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us
At TikTok, our people are humble, intelligent, compassionate and creative. We create to inspire - for you, for us, and for more than 1 billion users on our platform. We lead with curiosity and aim for the highest, never shying away from taking calculated risks and embracing ambiguity as it comes. Here, the opportunities are limitless for those who dare to pursue bold ideas that exist just beyond the boundary of possibility. Join us and make impact happen with a career at TikTok.

Team Introduction
TikTok's Recommendation Architecture Team is responsible for real-time computing direction, handling the design and development of real-time computing systems for TikTok videos, live streams, e-commerce, and a billion-user product recommendation system. Their main focus is ensuring system stability and high availability. They abstract general real-time computing systems, build a unified recommendation feature middleware, and implement a flexible and scalable high-performance storage system and computing model. This enables advanced real-time data systems for deduplication, counting, feature services, and other recommendation-related business needs.
- Design and implement real-time (streaming computing) data systems for large-scale recommendation systems.
- Create flexible, scalable, stable, and high-performance storage systems and computing models.
- Troubleshoot production system failures, design and implement necessary mechanisms and tools to ensure overall stability of the production systems
- Construct industry-leading streaming computing frameworks and other distributed systems to provide reliable infrastructure for massive data and large-scale business systems

**Qualifications**:

- Proficient in programming languages like Java, C++, Scala, Python.
- Strong coding and troubleshooting skills.
- At least 1 year of relevant experience
- Deep understanding of streaming computing systems, with formal production experience in developing TB-level Flink real-time computing systems. Proficient in modules like FlinkDataStream, FlinkSQL, FlinkCheckpoint, FlinkState, and preferably with experience in reading Flink source code.
- Experience in data lake development is preferred. Familiar with at least one data lake technology such as Hudi, Iceberg, DeltaLake, and preferably with experience in reading their source code.
- Willingness to tackle problems without clear answers, with a strong passion for learning new technologies.
- Experience in handling PB-level data is a plus.
- Familiarity with other big data systems is preferred, including YARN, K8S, Spark, SparkSQL, Kudu, and others.
- Experience in storage systems such as Hbase, Cassandra, RocksDB.

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

  • Software Engineer

    18 hours ago

    Singapore TIKTOK PTE. LTD. Full time

    About TikTokTikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.Why Join UsInspiring creativity is at the core of...

  • Software Engineer

    18 hours ago

    Singapore TIKTOK PTE. LTD. Full time

    About TikTokTikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.Why Join UsInspiring creativity is at the core of...

  • Software Engineer

    2 weeks ago

    Singapore TikTok Full time

    Join to apply for the Software Engineer (Big Data), Application Computing - 2025 Start role at TikTok 6 days ago Be among the first 25 applicants Join to apply for the Software Engineer (Big Data), Application Computing - 2025 Start role at TikTok Get AI-powered advice on this job and more exclusive features. Responsibilities TikTok will be prioritizing...

  • Big Data Engineer

    2 weeks ago

    Singapore Baidu, Inc. Full time

    Build the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....

  • Avp, Big Data Engineer, Data Technology, Technology

    7 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$13,160 - S$22,080 / Monthly EST **Job Type** Permanent **Seniority** Director **Years of Experience** At least 7 years **Tech Stacks** ETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDB - We are looking for a Big Data Engineer that will work on developing frameworks using...

  • Big Data Engineer

    7 days ago

    Singapore BASIL TECHNOLOGIES PTE. LTD. Full time

    Develop data processing pipelines for ingestion, modelling, analysis, mining and reporting with Enterprise Big Data Lake - Responsible for the code writing of the core module of the system - Develop POC and build data pipeline architecture using of the overall technical framework of the software - Work closely with teams ensure timely delivery of...

  • Data Engineer

    2 weeks ago

    Singapore PALO IT SINGAPORE PTE. LTD. Full time

    **About Us** PALO IT is an innovation & agile development company. From Design Research to DevOps, we are in the business of end-to-end development of breakthrough digital experiences. As a community of innovators and developers, we also aim at renewing the way organizations operate, promoting sustainable business agility, user-centricity, and open...

  • Avp, Big Data Engineer, Data Technology, Technology

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$11,700 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 7 years **Tech Stacks** ETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDB **Business Function** Group Technology and Operations (T&O) enables and empowers the bank with an...

  • Big Data Engineering Lead

    2 days ago

    Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. **Key Responsibilities**: - Design and...

  • Big Data Engineer

    1 week ago

    Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per year

    Roles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...