Llm Platform R&d Engineer

Responsibilities
TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including San Jose, Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imagination thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

**About The Team**:
The mission of the TikTok Eng-AI Innovation Center is to explore cutting-edge AGI technologies, including but not limited to LLM, multi-modal LLM (video/image/audio/text/code), etc., to let machine better understand user creations on Tiktok platform. Regarding to video/image/audio/text, enhanced content understanding can bring better user experience of searching, recommendation, and can more accurately identify and defend internet abuse and fraud on our platform. Regarding to code, our developed LLM aims to automatically re-organize/optimize Tiktok codebase, and make the code/coding become more accessible for Tiktok engineers.

**The main job directions include**:
1. Participate in the design and implementation of a high-availability, scalable, distributed large-model machine learning platform to support the development and efficient iteration of large models for TikTok;
2. Explore cutting-edge technologies related to large-model engineering(LLMOps), covering areas such as data processing, model training, inference services, evaluation system, automated orchestration, prompt engineering, and resource scheduling;
3. Construct a high-performance, cost-effective large-model inference service architecture that ensures high service availability.;

**Qualifications**:
1. Bachelor's degree or higher in Computer Science or related fields, with good communication and teamwork skills;
2. Solid programming foundation, good coding style, familiar with multi-thread programming, distributed computing, network communication, memory management, and design patterns;
3. Experience in engineering R&D or infrastructure, proficient in at least one of the following development languages: C/C++, Python, Golang;
- Experience in developing and deploying large-scale models, including data processing, training, deployment, and evaluation.
- Experience with DevOps/MLOps;
- Experience in large-model service deployment and optimization;
- Familiarity with deep learning frameworks such as TensorFlow, PyTorch, and understanding of large-model engineering frameworks like vllm/langchain.
- Experience with distributed scheduling, computing, and storage projects like K8s, Ray, Hadoop, Spark, HDFS;
Preferred Qualifications
1. Passion for technology, good communication skills and team spirit

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.