Big Data Software Engineer
3 days ago
**Job Summary**:
**Salary**
S$11,000 - S$22,000 / Monthly
**Job Type**
**Seniority**
Mid
**Years of Experience**
At least 5 years
**Tech Stacks**
ETL C++ Java Hive Spark SQL Hadoop Python
TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.
**Why Join Us**
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.
**Team Introduction**
Ad Data is the cornerstone of every business decision that millions of advertisers make every day on Bytedance. Therefore, we are tasked with innovating on daily basis to create and maintain complex systems at large scale and continue expanding the capacity to better serve advertisers growing at exponential pace.
You will share in the ownership of the technical vision and direction for advanced Ad Data products. You will be a part of a team of top notch technical professionals developing scalable systems and with a focus on sustained operational excellence. Members of this team will be challenged to innovate using cutting edge technologies. We are looking for people who are highly motivated by aiming for the highest, moving fast, and changing the way customers use data to drive profitability.
**Responsibilities**
- Work with product managers and data analysts to design data-related products.
- Communicate with engineers, product managers and product analysts to understand data needs.
- Buildup data expertise and own data quality for allocated areas.
- Design, build and launch new data ETL processes in production.
- Support existing streaming and batch system in production, solve the on-call issues.
- Define and manage SLA for all data sets in allocated areas.
- Work with data infrastructure to triage infra issues and drive to resolution.
- Support daily project management, assist junior engineers in business and technical problems.
**Qualifications**
- Bachelor's degree in technical field, Computer Science or Mathematics.
- At least 5 years of experience in the data warehouse space.
- At least 5 years of experience in custom ETL design, implementation and maintenance.
- At least 3 years of experience working with big data technologies such as Hadoop, Hive, Spark, etc.
- At least 3 years of experience with schema design and dimensional data modeling.
- At least 3 years of experience with SQL statements.
- Proficient in one of the programming languages such as Python, Java or C++.
- Good communication skills, including the ability to identify and communicate data driven insights.
- Ability to manage and communicate data warehouse plans with internal clients.
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
-
Principal Big Data Engineer
5 days ago
Singapore QUESSCORP HOLDINGS PTE. LTD. Full time**Job Description**: - Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. - Ensure data quality, integrity, and consistency across various data sources. - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that...
-
Big Data Platform Engineer
6 days ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time**SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...
-
Software Engineer
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies Full timeCSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of use-cases, including but not limited to Counter-terrorism and Computer Network Defence. We are looking for talented software engineers to lead and build mission-critical products that identify, analyse and investigate threats. Role As a...
-
Big Data Engineer
3 days ago
Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time**Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...
-
Big Data Engineer
2 weeks ago
Singapore Baidu, Inc. Full timeBuild the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....
-
Big Data Test Engineer
1 week ago
Singapore Patsnap Full time $80,000 - $120,000 per yearAbout PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...
-
Big Data Test Engineer
1 week ago
Singapore Patsnap Full time $90,000 - $120,000 per yearAbout PatSnapPatsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, deliversactionable insights...
-
Big Data Engineer
1 week ago
Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per yearRoles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...
-
Big Data Engineer
1 week ago
Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per yearJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...
-
Big Data Engineer
5 days ago
Singapore SAKSOFT PTE LIMITED Full timeExperience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...