Research Engineer, Multimodal Model

1 day ago

Singapore BYTEDANCE PTE. LTD. Full time
Roles & Responsibilities

Responsibilities

Established in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress. With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. It has labs and researcher roles in China, Singapore, and the US. Leveraging substantial data and computing resources and through continued investment in these domains, our team has built a proprietary general-purpose model with multimodal capabilities. In the market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and was launched to external enterprise clients through Volcano Engine. The Doubao app is the most used AIGC app in China.


Why Join Us

Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never . Courage? Always.


At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us.


About the team

Welcome to the GAI-Vision team, where we lead the way in developing foundational models for multi-modal visual understanding and generation. Our mission is to solve the challenge of visual intelligence in AI. We conduct cutting-edge research on areas such as vision and language, large-scale vision models, and generative foundation models. Comprising experienced research scientists and engineers, our team is dedicated to pushing the boundaries of foundation model research and implementing our innovations across diverse application scenarios. We foster a feedback-driven environment to continuously enhance our foundation technologies. Come join us in shaping the future of AI and transforming the product experience for users worldwide.


Responsibilities

- Explore large-scale/ultra-large-scale visual models and perform system optimization. Data construction, instruction fine-tuning, preference alignment, model optimization.

- Conduct cutting-edge research and development in computer vision, natural language processing, machine learning and general artificial intelligence, especially in the areas of multi-modality, vision and language, etc.

- Publish our latest research results, and help to build our brand in the research community.

- Explore vision/multi-modality application models, and contribute to the development of new technologies and products leveraging artificial intelligence.


Qualifications

Minimum Qualifications

- Possess research and practical experience in one or more areas of computer vision, encompassing multi-modal understanding, vision-language models (eg, video captioning, VQA, Text-to-video retrieval, and other related topics), large- scale training, RLHF, multimodal generation (eg, text-to-image, image, video, 3D generation and editing), diffusion models, GANs, transformers for generation tasks.

- Experience with vision-language models and apply them in various downstream tasks .

- Possess coding skills in C/C++ and Python.

- Collaborate effectively with team members.

- Ability to work independently.


Preferred Qualifications

- Work with large-scale datasets, and build large-scale datasets to scale up foundation models.

- Demonstrate impactful publications in leading AI conferences (eg, CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH, SIGGRAPH Asia) and journals (eg, TPAMI, JMLR).

- Achievement as a winner in international academic competitions.

- Proficiency in one of the differentiable programming frameworks such as PyTorch, TensorFlow, JAX, etc.


ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.


Tell employers what skills you have

TensorFlow
Machine Learning
Construction
Ability To Work Independently
Natural Language Processing
Artificial Intelligence
Computer Vision
3D
Research and Development
PyTorch
Speech Recognition
Python
Publications
Team Player
Able To Work Independently

  • Research Engineer

    2 months ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilitiesEstablished in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress.With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas...

  • Research Scientist

    1 day ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceEstablished in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress.With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas...

  • Research Scientist, Multimodal Foundation Model

    1 day ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceEstablished in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress.With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas...

  • Large Language Model Algorithm Engineer

    21 hours ago

    Singapore BYTEDANCE PTE. LTD. Full time

    About the RoleByteDance PTE. LTD. is seeking a talented AI researcher to join our Machine Learning Platform team. As a key member of our team, you will contribute to the advancement of next-generation artificial intelligence technologies, including large models, multimodal capabilities, text comprehension, generation algorithms, and reinforcement learning...

  • Research Fellow

    5 months ago

    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    The School of Electrical and Electronic Engineering is seeking to hire a talented Research Fellow in natural language processing and large language models to work with a team from multiple disciplines of machine learning and artificial intelligence to develop multimodal large language models with capabilities such as conversational information retrieval,...

  • Research Fellow

    5 months ago

    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    The School of Electrical and Electronic Engineering is seeking to hire a talented Research Fellow in natural language processing and large language models to work with a team from multiple disciplines of machine learning and artificial intelligence to develop multimodal large language models with capabilities such as conversational information retrieval,...

  • Research Fellow

    5 months ago

    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    The School of Electrical and Electronic Engineering is seeking to hire a talented Research Fellow in natural language processing and large language models to work with a team from multiple disciplines of machine learning and artificial intelligence to develop multimodal large language models with capabilities such as conversational information retrieval,...

  • Research Associate

    6 months ago

    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    The College of Computing & Data Science (CCDS) invites applications for the position of Research Associate.Key Responsibilities: Conduct research in the field of neural networks, natural language processing (NLP), and multimodal learning (ML).Critically evaluate existing literature and propose new ideas under supervisionWrite papers and present the research...

  • CV/Multimodal/Generative AI Algorithm Engineer, TikTok Global E-Commerce

    1 day ago

    Singapore TIKTOK PTE. LTD. Full time

    Roles & ResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok sponsorship of a visa.About TikTokTikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore,...

  • Postdoctoral Researcher in AI and Robotics

    21 hours ago

    Singapore SINGAPORE-MIT ALLIANCE FOR RESEARCH AND TECHNOLOGY CENTRE Full time

    Postdoctoral Researcher in AI and RoboticsWe are seeking a highly qualified postdoctoral researcher to join our team at the SINGAPORE-MIT ALLIANCE FOR RESEARCH AND TECHNOLOGY CENTRE. The successful candidate will contribute to the development of novel AI models and techniques for embedded execution of embodied AI and spatial intelligence.The postdoctoral...

  • AI Research Scientist

    21 hours ago

    Singapore BIGO TECHNOLOGY PTE. LTD. Full time

    Job Title: AI Research ScientistOverview:At BIGO TECHNOLOGY PTE. LTD., we are seeking a highly skilled AI Research Scientist to join our team. As an AI Research Scientist, you will be responsible for researching and developing image generation technologies, including the development of foundational models for text-to-image generation, image editing...

  • Research Associate

    4 weeks ago

    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    LKCMedicine seeks a Research Associate (RA) to lead innovative research in medical image processing, 3D organ reconstruction, large-scale model applications, and AI integration with surgical robotics. The RA will design advanced algorithms and develop AI tools tailored for medical applications, bridging computational solutions with practical use. These tools...

  • Research Engineer II

    4 months ago

    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    The Early Mental Potential & Wellbeing Research Centre's mission is to maximise every child's mental and emotional capital by uplifting neurodevelopmental trajectories during early sensitive periods through interdisciplinary discovery science and translational technologies.Toward this aim, we engage in 3 major activities and thrusts: 1) Core Discovery...

  • Large Language Model Algorithm Engineer

    2 months ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Scientist / Senior Scientist, Aural & Language Intelligence (ALI), I2R

    1 day ago

    Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesJob Description:The candidate needs to research and develop cutting-edge multimodal (speech-text) foundation model, define, develop novel deep learning techniques to achieve and advance SOTA accuracy with real-time performance. The candidate will have to collaborate with other research scientists and engineers to apply the foundation...

  • Research Scientist

    1 month ago

    Singapore BYTEDANCE PTE. LTD. Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our team at ByteDance PTE. LTD. as a Research Engineer. The successful candidate will be responsible for conducting cutting-edge research and development in computer vision, natural language processing, machine learning, and general artificial intelligence.Key ResponsibilitiesExplore...

  • Research Engineer II

    3 weeks ago

    Singapore NTU (Nanyang Technology University- Main Office-HR) Full time

    A Corp Lab in NTU is looking for a Research Engineer to work on the NLP project.Key Responsibilities: Research and develop novel ML-based methodologies and algorithms for multilingual and multimodal LLMs.Working closely with other Postdoc/RA/PhD students to discuss the ideas and implement the system.Publications in top-tier international conferences and...

  • Machine Learning Engineer

    1 day ago

    Singapore LIGHT ROBOTICS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities Train and test multi-modal foundation models for our robots. Collaborate with hardware engineers to push the frontiers of robotics research. Invent a new paradigm of robotic foundation models for human-like end to end perception and control.Qualifications Experience with multimodal foundation models, either in...

  • (Senior) Lead Research Engineer,ARTC

    2 months ago

    Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesThe Advanced Remanufacturing and Technology Centre (ARTC) is a public-private partnership consortium of more than 80 industry members. Our core mission is to develop and deploy advanced manufacturing solutions and upskill the workforce to drive local industry competitiveness.Smart Virtual Systems (SVS) Group is seeking a highly...

  • Robotics Engineer Lead

    4 hours ago

    Singapore Careers@Gov Full time

    About the PositionAs a key member of our engineering team, you will play a pivotal role in advancing robotics and AI technologies to Technology Readiness Levels 5 to 7, contributing significantly to Singapore's digital future.Key Responsibilities:Develop and implement prototype strategies for robotics in alignment with our organization's mission.Lead a small...