
Big Data System Engineer
2 days ago
Job Title: Big Data System Engineer
About the Team
The data management team is working on building products that handle every stage of the big data pipeline, from ingestion and integration to development, cataloging, security, and governance.
These solutions support various businesses, allowing data engineers and scientists to significantly boost their productivity.
As a software engineer in the data management suite team, you will have the opportunity to build, optimize, and scale one of the largest data platforms worldwide.
You'll gain hands-on experience with core systems within the data platform ecosystem.
Our work will directly and greatly impact the company's core products as well as hundreds of millions of users.
Job Responsibilities:
- Be accountable for production stability for big data development and governance systems.
- Engage in and enhance the entire lifecycle of services, from inception and design through deployment, operation, and refinement.
- Maintain services once they are live by measuring and monitoring availability, latency, and overall system health. Practice sustainable incident response and blameless postmortems.
- Design and implement reliable, scalable, robust, and extensible big data systems that support core products and business.
Qualifications:
- Bachelor's degree in Computer Science or a related technical field involving software or systems engineering, or equivalent practical experience.
- Experience with site reliability engineering, monitoring, and alerting for big data-related systems.
- Experience writing code in Java, Go, Python, or a similar language.
Preferred Qualifications:
- Knowledge about a variety of strategies for ingesting, modeling, processing, and persisting data, ETL design, job scheduling, and dimensional modeling.
- Familiarity with running production-grade services at scale and understanding cloud-native technologies and networking.
- Experience developing tools and APIs to reduce human interaction with systems and applications using a variety of coding and scripting standards.
- Expertise in designing, analyzing, and troubleshooting large-scale distributed systems is a plus (Hadoop, M/R, Hive, Spark, Presto, Flume, Kafka, ClickHouse, Flink, or comparable solutions).
- Systematic problem-solving approach, coupled with effective communication skills and a sense of drive.
Why ByteDance
Inspiring creativity is at the core of our mission. Our innovative products help people authentically express themselves, discover, and connect – all made possible by our global and diverse teams.
Together, we create value for our communities, inspire creativity, and enrich life – our daily mission.
As part of our team, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make an impact in a rapidly growing tech company.
By constantly iterating and fostering an 'Always Day 1' mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users.
When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
We're committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives.
Our platform connects people from across the globe, and so does our workplace.
At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we're committed to celebrating our diverse voices and creating an environment that reflects the many communities we reach.
We're passionate about this and hope you are too.
Job Highlights
- Industry experts
- Meals provided
- Competitive compensation
- Flexible hours
-
Big Data System Engineer
2 weeks ago
Singapore beBeeDataEngineer Full timeJob Title: Big Data System Engineer About the TeamThe data management team is working on building products that handle every stage of the big data pipeline, from ingestion and integration to development, cataloging, security, and governance.These solutions support various businesses, allowing data engineers and scientists to significantly boost their...
-
Big Data Systems Engineer
2 weeks ago
Singapore beBeeData Full time $180,000 - $240,000Job DescriptionData processing plays a vital role in national security in today's world.Develop and maintain real-time high-volume data processing, querying, and persistence solutions using Big Data technologies.Implement highly available, resilient, scalable, and sustainable Big Data platforms.Administer Big Data platform services running across multiple...
-
Big Data System Engineer
1 week ago
Singapore beBeeDataEngineer Full timeJob Title: Big Data System Engineer About the Team The data management team is working on building products that handle every stage of the big data pipeline, from ingestion and integration to development, cataloging, security, and governance. These solutions support various businesses, allowing data engineers and scientists to significantly boost their...
-
Big Data Engineer
7 days ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...
-
Big Data Engineer
4 days ago
Singapore AlgoriX Technology Pte. Ltd. Full time**Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...
-
Big Data Engineer
2 weeks ago
Singapore Baidu, Inc. Full timeDirect message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...
-
Big Data Engineer
7 days ago
Singapore beBeeDataEngineer Full timeAbout the Data Management Suite Team The Data Management Suite team is focused on building scalable products that cover the entire lifecycle of data pipeline, including data ingestion and integration, data development, data catalog, data security, and data governance. These products support various businesses, allowing data engineers and scientists to...
-
Big Data Engineer
2 days ago
Singapore INCOME INSURANCE LIMITED Full timeResponsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...
-
Big Data Engineer
7 days ago
Singapore IITMATRIX Full timeWe are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...
-
Big Data Engineer
7 days ago
Singapore UNISON Group Full time $104,000 - $130,878 per yearWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...