Research Scientist, Multimodal Foundation Model

22 hours ago

Singapur, Singapore BYTEDANCE PTE. LTD. Full time
Roles & Responsibilities

About ByteDance

Established in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress.

With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. It has labs and researcher roles in China, Singapore, and the US.

Leveraging substantial data and computing resources and through continued investment in these domains, our team has built a proprietary general-purpose model with multimodal capabilities. In the market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and was launched to external enterprise clients through Volcano Engine. The Doubao app is the most used AIGC app in China.


Why Join Us

Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible.

Together, we inspire creativity and enrich life - a mission we aim towards achieving every day.

To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.

At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve.

Join us.


About the team

Welcome to the GAI-Vision team, where we lead the way in developing foundational models for multi-modal visual understanding and generation. Our mission is to solve the challenge of visual intelligence in AI. We conduct cutting-edge research on areas such as vision and language, large-scale vision models, and generative foundation models. Comprising experienced research scientists and engineers, our team is dedicated to pushing the boundaries of foundation model research and implementing our innovations across diverse application scenarios. We foster a feedback-driven environment to continuously enhance our foundation technologies. Come join us in shaping the future of AI and transforming the product experience for users worldwide.


Responsibilities

- Conduct research on computer vision, deep learning and AI, addressing a wide range of challenges in deep learning, computer vision, AIGC, graphics, large multi-modality models, diffusion models, video generation, 3D generation, video understanding, self-supervised learning, and autoregressive models.

- Explore the application of large-scale/super-large-scale visual foundation models, and contribute to the development of new technologies and products leveraging artificial intelligence.


Qualifications

Minimum Qualifications

- Hold a Ph.D. degree in computer science, electrical engineering, statistics, applied mathematics, data science or related disciplines.

- Possess research and practical experience in one or more areas of computer vision, encompassing multimodal generation (e.g., text-to-image, image, video, 3D generation and editing), diffusion models, GANs, transformers for generation tasks, vision-language models, large-scale training and RLHF.

- Proven track record of high-impact research.

- Collaborate effectively with team members.

- Ability to work independently.


Preferred Qualifications

- Demonstrate impactful publications in leading AI conferences (e.g., CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH, SIGGRAPH Asia) and journals (e.g., TPAMI, JMLR).

- Achievement as a winner in international academic competitions.

- Proficiency in one of the differentiable programming frameworks such as PyTorch, TensorFlow, JAX, etc.

- Possess coding skills in C/C++ and Python.


ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.


Tell employers what skills you have

TensorFlow
Ability To Work Independently
Natural Language Processing
Artificial Intelligence
Computer Vision
3D
PyTorch
Speech Recognition
Python
Statistics
Publications
Data Science
Graphics
Electrical Engineering

  • Research Scientist, Multimodal AI Foundation Model

    19 hours ago

    Singapur, Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDanceByteDance PTE. LTD. is a leading technology company that specializes in AI research and development. Our mission is to create innovative products and services that inspire creativity and enrich life.We are committed to pushing the boundaries of AI research and fostering a culture of innovation and collaboration. Our team of experienced...

  • Research Scientist

    22 hours ago

    Singapur, Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceEstablished in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress.With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas...

  • Research Engineer

    22 hours ago

    Singapur, Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilitiesEstablished in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress.With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas...

  • Research Engineer, Multimodal Model

    22 hours ago

    Singapur, Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilitiesEstablished in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress. With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas...

  • Research Scientist

    19 hours ago

    Singapur, Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDanceByteDance PTE. LTD. is a leading technology company that specializes in AI research and development. Our mission is to create innovative products and services that inspire creativity and enrich life.We are committed to pushing the boundaries of AI research and implementing our innovations across diverse application scenarios. Our team is...

  • Principal Scientist, Foundation Models

    5 months ago

    Singapur, Singapore TikTok Full time

    Team Introduction Our Business Integrity team has a strong user focus and a dedication to technical excellence. We aim to meet our users’ needs with reliable and high-performing platforms and services. We are looking for strong algorithm scientist who are excited to grow their business understanding, build highly scalable machine learning/algorithm...

  • Scientist / Senior Scientist, I2R

    3 months ago

    Singapur, Singapore A*STAR Full time

    Job Description: The candidate is required to research and develop advanced multimodal foundational model, with initial focus on speech and text. The work involves defining and implementing novel deep learning methodologies to achieve state-of-the-art performance for different spoken language tasks. The candidate is also expected to collaborate with...

  • Senior Audio Research Scientist

    2 weeks ago

    Singapur, Singapore Hireio, Inc. Full time

    About the TeamWe are a team of innovators at Hireio, Inc. dedicated to empowering content understanding, interaction, and creation across our global popular app and other products using speech and audio related technologies.We focus on cutting-edge R&D in areas like speech and audio, music processing, natural language understanding, and multimodal deep...

  • Project Officer

    2 weeks ago

    Singapur, Singapore Nanyang Technological University Full time

    The Nanyang Technological University is seeking a highly skilled Project Officer to join its team in the School of Electrical and Electronic Engineering. The successful candidate will work on a project to develop multimodal large language models with capabilities such as conversational information retrieval, multimodal sensemaking, question answering, and...

  • Research Scientist

    2 weeks ago

    Singapur, Singapore Nanyang Technological University Full time

    Research Associate PositionThe School of Electrical and Electronic Engineering at Nanyang Technological University is seeking a highly skilled Research Associate to contribute to the development of multimodal large language models. This role will involve working with a team of experts in machine learning and artificial intelligence to create innovative...

  • Research Scientist

    1 week ago

    Singapur, Singapore Nanyang Technological University Full time

    The School of Electrical and Electronic Engineering at Nanyang Technological University is seeking a highly skilled Research Associate to contribute to the development of cutting-edge multimodal large language models.The successful candidate will work on a project to advance the field of natural language processing and large language models, with a focus on...

  • Engineering Leader, Foundation Models

    4 months ago

    Singapur, Singapore TikTok Full time

    Team Introduction Our Business Integrity team has a strong user focus and a dedication to technical excellence. We aim to meet our users’ needs with reliable and high-performing platforms and services. We are looking for strong algorithm scientist/lead who are excited to grow their business understanding, build highly scalable machine learning/algorithm...

  • Research Scientist

    3 weeks ago

    Singapur, Singapore Nanyang Technological University Full time

    Position Title: Research ScientistNanyang Technological University is seeking a Research Scientist for a contract role focused on a project dedicated to neuroprotective playful learning strategies for early childhood education. The ideal candidate will possess a Master's degree in fields such as education, psychology, or related disciplines, with a strong...

  • Research Scientist

    3 weeks ago

    Singapur, Singapore Nanyang Technological University Full time

    Position Title: Research ScientistNanyang Technological University is seeking a Research Scientist for a contract role focused on a project aimed at enhancing neuroprotective playful learning strategies for early childhood education. The ideal candidate will possess a Master's degree in education, psychology, or a related discipline, with a strong foundation...

  • Research Scientist

    3 weeks ago

    Singapur, Singapore Nanyang Technological University Full time

    Position Title: Research ScientistNanyang Technological University is seeking a Research Scientist for a contract role. The selected individual will collaborate with a team on a project centered around playful learning interventions aimed at enhancing neuroprotection in early childhood education. We are looking for candidates who possess a Master's degree in...

  • Research Scientist, I2R

    4 months ago

    Singapur, Singapore A*STAR Full time

    Researchers must be willing to work on multi-disciplinary research projects at the intersection of computational neuroscience and AI.  This includes designing human behavioral experiments and collecting human responses, alongside developing computational models of cognitive functions. ? Requirements: 1.Ph.D degree in computer science/engineering,...

  • Research Scientist

    1 week ago

    Singapur, Singapore Thales Full time

    Job Title: Research EngineerLocation: SingaporeThales is a global leader in aerospace, transportation, defence, security, and space. We are seeking a highly skilled Research Engineer to join our team in Singapore.Job Summary:We are looking for a talented Research Engineer to contribute to the development of innovative solutions for equatorial weather...

  • Research Scientist

    19 hours ago

    Singapur, Singapore NANYANG TECHNOLOGICAL UNIVERSITY Full time

    Research AssociateWe are seeking a highly skilled Research Associate to join our team at the College of Computing & Data Science (CCDS) at Nanyang Technological University. The successful candidate will contribute to our project titled "Tamper Detection with Invisible Watermark and Anti-Tampering for Protecting Face or Body Images/Videos".Key...

  • Research Scientist

    2 weeks ago

    Singapur, Singapore Nanyang Technological University Full time

    Nanyang Technological University is seeking a highly motivated Research Scientist to lead cutting-edge research in Green Cloud Computing. The successful candidate will develop innovative physics-based and data-driven models to minimize carbon usage in interconnected data center systems. Key responsibilities include developing optimization algorithms,...

  • Research Scientist/Engineer

    3 weeks ago

    Singapur, Singapore Singapore Institute of Technology Full time

    Job SummaryWe are seeking a highly skilled Research Fellow/Engineer to join our team at the Singapore Institute of Technology. As a key member of our research project, you will be responsible for participating in and managing the research project with the Principal Investigator (PI), Co-PI, and research team members to ensure all project deliverables are...