Research Engineer

4 weeks ago


Singapore BYTEDANCE PTE. LTD. Full time
Roles & Responsibilities

About ByteDance

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok and Helo as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.


Why Join Us

Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible.

Together, we inspire creativity and enrich life - a mission we aim towards achieving every day.

To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.

At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve.

Join us.


About the Team

The Seed Foundation Machine Learning (ML) Systems team provides end-to-end (E2E) machine learning experience and machine learning resources for the company. The team builds heterogeneous ML training and inference systems based on GPU and AI chips and advances the state-of-the-art of ML systems technology to accelerate models such as stable diffusion and LLM.

The team is also responsible for research and development of hardware acceleration technologies for AI and cloud computing, via technologies such as distributed systems, compilers, HPC, and RDMA networking. The team is reinventing the ML infra for large scale language models. We have published papers at top tier conferences such as SIGCOMM, NSDI, EuroSys, OSDI, SOSP, MLSys, NeurIPS, etc.


Responsibilities:

- Optimizing large scale parallel training for state of the art deep learning algorithms such as large language models, multi-modality models, diffusion, reinforcement learning, etc

- Research and develop our machine learning systems, including accelerated computing architecture, management and monitoring

- Deploy the machine learning systems, distributed machine learning training and inference

- Manage cross-layer optimization of system and AI algorithms and hardware for machine learning (GPU, ASIC)


Qualifications

Minimum Qualification:

- Bachelor or above degree in distributed, parallel computing principles and know the recent advances in computing, storage, networking, and hardware technologies;

- Familiar with machine learning algorithms, platforms and frameworks such as PyTorch and Jax.

- Have basic understanding of how GPU and/or ASIC works;

- Expert in at least one or two programming languages in Linux environment: C/C++, CUDA, Python;


Preferred Qualifications:

The following experiences will be a big plus:

- GPU based high performance computing, RDMA high performance network (MPI, NCCL, ibverbs);

-Distributed training framework optimizations such as DeepSpeed, FSDP, Megatron, GSPMD - AI compiler stacks such as torch.fx, XLA and MLIR;

- Large scale data processing and parallel computing;

- Experiences in designing and operating large scale systems in cloud computing or machine learning;

- Experiences in in-depth CUDA programming and performance tuning (cutlass, triton)


ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.


Tell employers what skills you have

TensorFlow
Machine Learning
Sampling
Natural Language Processing
Architecture Management
PyTorch
Distributed Systems
CUDA
Python
High Performance Computing
Performance Tuning
Parallel Computing

  • Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesThe Advanced Remanufacturing and Technology Centre (ARTC) is a public-private partnership consortium ofmore than 80 industry members. Our core mission is to develop and deploy advanced manufacturingsolutions and upskill the workforce to drive local industry competitiveness.Smart Virtual Systems (SVS) Group is seeking a highly...

  • Research Engineer

    4 weeks ago


    Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesJoin the Institute of Microelectronics (IME) to be immersed in cutting-edge semiconductor research. As a research institute within the Agency for Science, Technology and Research (A*STAR), IME bridges the gap between academia and industry. Our mission is to accelerate innovation in advanced packaging, piezoMEMS, SiC, RF/mmWave...


  • Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesJob DescriptionAs a (Senior) Research Engineer in our Robotics & Automation R&D team, you will play a role in conceptualizing, designing, and implementing intelligent robotics solutions that solve challenges across various industries. Leveraging your expertise in robotics, computer vision, AI, and ROS, etc., you will contribute to the...


  • Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesWe are seeking a talented and ambitious candidate to join our team in developing next-generation quantum sensors. The position focuses on the analysis and feedback control of a diamagnetically levitated ferromagnetic particle.This levitated, freely precessing particle represents a system of correlated spins, capable of rapidly...

  • Research Engineer

    4 weeks ago


    Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesWe seek a passionate research engineer to work on the development of novel ultrathin liquid metal oxides for applications in two-dimensional material heterostructure nano-electronics. This project aims to develop scalable techniques to create atomically smooth dielectric interfaces with 2D semiconductors to enable next-generation...


  • Singapore Kronos Research Full time

    The individual in this role will be a part of a new Alpha Research team, which is focused on generating quantitative predictive signals across a variety of markets and asset classes (spot, futures, options; traditional markets and cryptocurrencies). The ideal candidate has experience in a quantitative signal generation process and understands the workflow...


  • Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesThe Advanced Remanufacturing and Technology Centre (ARTC) is a public-private partnership consortium of more than 80 industry members. Our core mission is to develop and deploy advanced manufacturing solutions and upskill the workforce to drive local industry competitiveness.Smart Virtual Systems (SVS) Group is seeking a highly...


  • Singapore Qube Research & Technologies Full time

    Join Our Team as a Quantitative Researcher/TraderAt Qube Research & Technologies, we are a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. Our team is driven by a passion for innovation and a commitment to delivering high-quality returns for our investors.Your RoleWe are seeking a highly skilled...


  • Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesSIMTech is looking for a highly motivated, independent, and innovative Software / DevOps engineer to join Sustainability Informatics & Strategy (SIS) Group. The successful candidate is expected to be creative and team-oriented, finding innovative solutions to new challenges and managing the software development life-cycle using...


  • Singapore Qube Research & Technologies Full time

    Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. We are a technology and data driven group implementing a scientific approach to investing. Combining data, research, technology, and trading expertise has shaped our collaborative mindset, which enables us to...

  • Research Scientist

    3 weeks ago


    Singapore CHUGAI PHARMABODY RESEARCH PTE. LTD. Full time

    Cell Biology and Technology Unit RoleChugai Pharmabody Research Pte. Ltd. is a leading biotechnology company that aims to generate new antibody drugs based on proprietary antibody engineering technologies. As a Research Assistant, you will be part of the Cell Biology and Technology Unit, working on tool generation, drug screening, and cell culture.Key...


  • Singapore Agency For Science, Technology And Research Full time

    JOB DESCRIPTION Research Scientist/Senior research scientist (Catalysis/AI scientist with process and chemistry background) The Emerging Technologies Division is looking for a proactive, highly motivated, and creative scientist to lead and contribute to research in carbon capture and utilization, sustainable processes for the environment, energy, and...


  • Singapore Agency For Science, Technology And Research Full time

    JOB DESCRIPTION Research Scientist/Senior research scientist (Catalysis/AI scientist with process and chemistry background)The Emerging Technologies Division is looking for a proactive, highly motivated, and creative scientist to lead and contribute to research in carbon capture and utilization, sustainable processes for the environment, energy, and...


  • Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesWe are looking for a talented and ambitious candidate to join our team in developing next-generation quantum sensors. The position will focus on modeling the dynamics and fabricating cryogenic components for the superconducting levitation of ferromagnetic particles.This levitated, freely precessing particle forms a system of...


  • Singapore Agency For Science, Technology And Research Full time

    Job Overview: The Deputy Director of the Strategic Planning Team will play a pivotal role in shaping and driving the strategic initiatives of A*STAR Science and Engineering Research. This position requires a dynamic and forward-thinking individual who can work closely with senior leadership to develop and implement strategies that enhance the research and...


  • Singapore ILLINOIS ADVANCED RESEARCH CENTER AT SINGAPORE LTD. Full time

    Roles & ResponsibilitiesIntroduction to The Centre for Precision Fermentation and Sustainability:The Centre for Precision Fermentation and Sustainability (PreFerS) is a research program hosted by the Illinois Advanced Research Center at Singapore Ltd. (Illinois ARCS). The program aims to develop advanced fundamental sciences and technologies to implement...


  • Singapore A*STAR RESEARCH ENTITIES Full time

    Roles & ResponsibilitiesCandidate will be required to develop, secure and manage industry partnerships for the NGTC. Candidate should stay updated on RF/mmWave GaN market trends and conduct thorough market research and competitive analysis on companies, competitors and the market for actionable insights. This may involve conducting SWOT analyses to ...


  • Singapore Lam Research Full time

    The RoleLam Research is seeking a skilled Field Service Engineer to join our team. As a Field Service Engineer, you will be responsible for providing quality repair and preventive maintenance services for Lam etch/clean/deposition equipment at customer sites.Key ResponsibilitiesInstall and relocate equipment at customer sites, conducting associated start-up,...


  • Singapore Qube Research & Technologies Full time

    Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. We are a technology and data driven group implementing a scientific approach to investing. Combining data, research, technology, and trading expertise has shaped our collaborative mindset, which enables us to...


  • Singapore Blackbox Research Pte Ltd Full time

    About the Company Blackbox is Southeast Asia’s leading decision intelligence provider, delivering decision science solutions and community-wide perspectives on contemporary problems and challenges. As a sophisticated provider of data insights, we work closely with businesses, governments, regulators, and non-profit organizations. We monitor emerging...