Production System Engineer, Infrastructure Engineering

Overview

Get AI-powered advice on this job and more exclusive features.

The Infrastructure Engineering team supports the company's fast growth by building and operating hyperscale datacenters. The team manages the end-to-end lifecycle of the server fleet, providing cloud solutions and various infrastructure services to ensure they are scalable and reliable. Embark on an expedition to ByteDance's rapidly expanding domain in the United States, Europe, and Asia. The Infrastructure Engineering team is crafting data centers that shelter hundreds of thousands of servers. As the operator of production systems, you will manage the lifecycle of these servers from initial deployment (OS installation, service provisioning, inventory management) through on-call troubleshooting, to decommissioning and recycling, contributing to ByteDance’s technological evolution.

• Operation: Contribute to the stability, efficiency, effectiveness, and scalability of data center and server operations, platform, and services on a worldwide scale.
• Lifecycle Enhancement: Participate in and improve the entire lifecycle of the server fleet—from design/introduction to launch reviews, deployment, operation, and retirement.
• Automation: Develop and deploy tools to enhance automation, reliability, scalability, and operability of servers in the datacenter.
• Monitoring: Develop tools to improve availability, latency, and overall health of datacenter infrastructure, servers, and networks.
• Disaster Recovery: Troubleshoot complex technical issues in a high-pressure environment, perform root-cause analysis, and implement preventive measures; conduct incident response and postmortems.
• Cross-team Collaboration: Work with infrastructure architects, project managers, data center operations engineers, platform developers, supply chain teams, and internal customers; design and implement solutions for Core IDCs and CDN/Edge.
• On-call: Participate in on-call support across regions and incident response teams for production issues.

• Minimum Qualifications:
  • Bachelor’s degree in Computer Science, Electronic Engineering, a relevant technical field, or equivalent practical experience.
  • At least 3 years of experience in areas such as server operations (Linux administration, scripting in Bash and Python), server hardware troubleshooting, and experience in planning, delivering, and operating large-scale data centers in multiple countries.
  • Proficiency in customizing and deploying tooling for monitoring, provisioning, fault management, and maintenance of new server hardware.
  • Experience developing and maintaining monitoring software for more than 10,000 servers.
• Preferred Qualifications:
  • Data Center: Experience with OS installations, break-fix operations, and end-to-end infrastructure lifecycle projects, including new design-build or retrofit activities.
  • GPU server operation and maintenance proficiency strongly preferred.
  • Full Stack Software Development: Experience with RESTful APIs (Flask), JavaScript/Node.js, SQL (including Redis), and Ansible for configuration management and deployment.

Founded in 2012, ByteDance’s mission is to inspire creativity and enrich life. With products including TikTok, Lemon8, CapCut, Pico, Toutiao, Douyin, and Xigua, ByteDance connects people to content across global markets.

Inspiring creativity is at the core of ByteDance’s mission. Our teams are global and diverse, working together to create value for communities and users. We encourage curiosity, humility, and impact, fostering an "Always Day 1" mindset to achieve meaningful breakthroughs for employees, the company, and users. Join us.

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. We celebrate diverse voices and aim to reflect the communities we reach.

• Seniority level: Mid-Senior level
• Employment type: Full-time
• Job function: Information Technology
• Industries: Technology, Information and Internet