Research Scientist, Multimodal Interaction

Join to apply for the
Research Scientist, Multimodal Interaction & World Model - 2025 Start
role at
ByteDance
2 weeks ago Be among the first 25 applicants
Responsibilities
Explore and research multi-modal understanding, generative, machine learning, reinforcement learning, AIGC, computer vision, artificial intelligence and other cutting-edge technologies.
Explore the basic model of large-scale/ultra-large-scale multi-modal understanding and generation interweaving, and carry out extreme system optimization; Data construction, instruction fine-tuning, preference alignment, model optimization; Improve the ability of data synthesis, scalable oversight, model reasoning and planning, build a comprehensive, objective and accurate evaluation system, and explore and improve the ability of large models.
Explore and break through the advanced capabilities of multi-modal models and world models, including but not limited to multi-modal RAG, visual COT and Agent, and build a universal multi-modal Agent for GUI/ games and other virtual worlds.
Use pre-training, simulation and other technologies to model various environments in the virtual/real world, provide the basic ability of multi-modal interactive exploration, promote application landing, and develop new technologies and new products with artificial intelligence technology as the core.
About The Team
Welcome to the Multimodal Interaction & World Model team. Our mission is to solve the challenge of multimodal intelligence, virtual reality world interaction in AI. We conduct cutting-edge research on areas such as Foundations and applications of multimodal understanding models, Multimodal agent and inference, Unified models for generation and understanding, World Model. The team comprises experienced research scientists and engineers dedicated to developing models with human-level multimodal understanding and interaction capabilities. We foster a feedback-driven environment to continuously enhance our foundation technologies. Come join us in shaping the future of AI and transforming the product experience for users worldwide.
We are looking for talented individuals to join us in 2025. As a graduate, you will get opportunities to kickstart your career, pursue bold ideas and explore growth opportunities. Co-create a future driven by your inspiration with ByteDance.
Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance and its affiliates\' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.
Minimum Qualifications
Final year Ph.D or recent Ph.D graduates in Computer Science, engineering or quantitative field. Computer, Electronics, Mathematics and other related majors.
Have in-depth research in one or more fields such as computer vision, multimodal, AIGC, machine learning, rendering generation, etc.
Excellent analytical and problem solving skills; Ability to solve large model training and application problems; Ability to explore solutions independently.
With good communication and collaboration skills, proactive work, able to harmoniously cooperate with the team to explore new technologies and promote technological progress.
Preferred Qualifications
With excellent basic algorithms, solid foundation of machine learning, familiar with CV, AIGC, NLP, RL, ML and other fields of technology. Publications at CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH or SIGGRAPH Asia and other top conferences/journals are preferred.
With excellent coding ability, proficient in C/C++ or Python. ACM/ICPC, NOI/IOI, Top Coder, Kaggle and other competition winners preferred.
In the fields of multimodal, large model, basic model, world model, RL, rendering generation, leading projects with significant impact is preferred.
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here:
If you have any questions, please reach out to us at
We’re excited to consider your application for ByteDance roles that match your profile.
#J-18808-Ljbffr