Big Data Engineer

2 weeks ago


Singapore TIKTOK PTE. LTD. Full time
Roles & Responsibilities

About Tiktok

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo.


Why Join Us

Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.

Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.

To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.

At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.

Join us.


About the team:

Libra is a large-scale online one-stop A/B testing platform developed by TikTok Data Platform . Provide experimental evaluation services for all product lines within the company, covering solutions for complex scenarios such as recommendation, algorithm, function, UI, marketing, advertising, operation, social isolation, causal inference, etc. Provide services throughout the entire experimental lifecycle from experimental design, experimental creation, indicator calculation, statistical analysis to final evaluation launch. Support the entire company's business on the road of rapid iterative trial and error, boldly assuming and carefully verifying. What you'll be doing: - Construct PB-level data warehouses, participate in and be responsible for data warehouse design, modeling, and development, etc. - Build ETL data pipelines and automated ETL data pipeline systems. - Build an expert system for metric data processing that combines offline and real-time processing.

Qualifications

  • Bachelor degree in Computer Science or related field
  • 5 years of experience in Data Engineering
  • At least 1 year experience with big data frameworks such as Presto, Hive, Spark, Flink, Clickhouse, Hadoop, and have experience in large-scale data processing.
  • At least 1 year experience in programming languages such as Python, SQL, Java, Scala, and have strong coding abilities.
  • At least 1 year experience with data warehouse implementation methodologies, and have supported actual business scenarios.
  • Willing to try new technologies and frameworks, and accept new ideas in the field of big data processing.

Preferred Qualifications:

  • Past working or internship experience in internet companies, and those with big data processing experience are preferred.
  • At least 3 year experience with big data frameworks such as Presto, Hive, Spark, Flink, Clickhouse, Hadoop, and have experience in large-scale data processing.
  • At least 3 year experience in programming languages such as Python, SQL, Java, Scala, and have strong coding abilities.
  • At least 3 year experience with data warehouse implementation methodologies, and have supported actual business scenarios.

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.


Tell employers what skills you have

Requirements Gathering
Scala
Modeling
Big Data
Pipelines
ClickHouse
Hadoop
ETL
UI
Data Engineering
SQL
Experimental Design
Python
Continuous Integration
Ab Testing
Java

  • Singapore Shopee Full time

    Job Description:Lead the Big Data SRE team and oversee the development and maintenance of the big data ops automation platform, and improve the operation and maintenance management level of big dataMonitor the performance and system stability of big data system in Shopee such as Hadoop/Spark/Storm/KafkaProvide technical expertise on big data-related...

  • Big Data Architect

    2 weeks ago


    Singapore IKIGAI ENABLERS PTE. LTD. Full time

    Roles & Responsibilities Plan, design, implement, deliver, and maintain big data platforms to support the organization's data infrastructure needs. Develop real-time and offline data collection, calculation, storage, and processing solutions using advanced data technologies while ensuring adherence to standards and metrics. Establish standardized data...


  • Singapore TIKTOK PTE. LTD. Full time

    Roles & ResponsibilitiesAbout TiktokTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo.Why Join UsCreation is the core of TikTok's purpose. Our platform is built to help...

  • Big Data Architect

    2 weeks ago


    Singapore Ikigai Enablers Pte. Ltd. Full time

    Plan, design, implement, deliver, and maintain big data platforms to support the organization's data infrastructure needs.Develop real-time and offline data collection, calculation, storage, and processing solutions using advanced data technologies while ensuring adherence to standards and metrics.Establish standardized data services within the data system...

  • Data Engineer

    3 weeks ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates, please email your resume to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits: Renewable contract (Performance-based, with possibility of conversion to...

  • Big Data Engineer

    2 weeks ago


    Singapore QUESSCORP SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesRole Designing, developing, and maintaining Hadoop applications Developing and optimizing Spark applications for batch and stream processing Writing efficient MapReduce, Hive, Pig, and HBase queries, etc Implementing data ingestion and processing pipeline Optimizing performance and scalability of Hadoop clusters Troubleshooting...

  • Big Data Engineer

    4 weeks ago


    Singapore BYTEPLUS PTE. LTD. Full time

    Roles & ResponsibilitiesByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa. Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to...

  • Big Data Engineer

    4 weeks ago


    Singapore BYTEPLUS PTE. LTD. Full time

    Roles & ResponsibilitiesByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa.Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the...

  • Data Engineer

    3 weeks ago


    Singapore Ntt Data Singapore Pte. Ltd. Full time

    ' EMAIL ID : Interested candidates, please email your resume to [HIDDEN TEXT]Only shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits:Renewable contract (Performance-based, with possibility of conversion to perm)Medical Insurance CoverageLeave...

  • Big Data Engineer

    4 weeks ago


    Singapore Byteplus Pte. Ltd. Full time

    ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa. Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market,...

  • Big Data Engineer

    4 weeks ago


    Singapore Byteplus Pte. Ltd. Full time

    ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa.Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including...

  • Data Engineer

    3 weeks ago


    Singapore H2 GAMES PTE. LTD. Full time

    Roles & ResponsibilitiesWe are seeking for a Big Data Engineer/Data Architect to join our dynamic data support team. This candidate will be responsible for various professional fields including big data, data warehousing, and data analytics, supporting the company's petabyte-level data services. Maintain overseas data centers, including ensuring database...

  • Data Engineer

    3 weeks ago


    Singapore H2 Games Pte. Ltd. Full time

    We are seeking for a Big Data Engineer/Data Architect to join our dynamic data support team. This candidate will be responsible for various professional fields including big data, data warehousing, and data analytics, supporting the company's petabyte-level data services.Maintain overseas data centers, including ensuring database stability and high...

  • Big Data Engineer

    1 week ago


    Singapore Quesscorp Singapore Pte. Ltd. Full time

    RoleDesigning, developing, and maintaining Hadoop applicationsDeveloping and optimizing Spark applications for batch and stream processingWriting efficient MapReduce, Hive, Pig, and HBase queries, etcImplementing data ingestion and processing pipelineOptimizing performance and scalability of Hadoop clustersTroubleshooting and debugging Hadoop ecosystem...

  • Data Engineer

    2 weeks ago


    Singapore ES RECRUITMENT PTE. LTD. Full time

    Roles & ResponsibilitiesSeeking Data Engineer for 1 yr contract assignmentJobscop & requirements:· Min Degree in IT / Technology . Min 6 to 10 years of experience in analyzing, designing, developing, and maintaining quality applications within a big data framework, utilizing Hadoop concepts and frameworks.· Proficiency in essential Pythonlibraries such as...

  • Data Engineer

    4 weeks ago


    Singapore Fpt Asia Pacific Pte. Ltd. Full time

    Develop and support enterprise data services, and ensure operational stability and performance through continuous optimization. * Work hand-in-glove the product owners and various stakeholders Develop and support enterprise data services, and ensure operational stability and performance through continuous optimization. Work hand-in-glove the product owners...

  • Data Engineer

    3 weeks ago


    Singapore SUNRAY WOODCRAFT CONSTRUCTION PTE LTD Full time

    Roles & ResponsibilitiesResponsibilities:● Design, construct, install, test, and maintain highly scalable data management systems.● Ensure systems meet business requirements and industry practices.● Build high-performance algorithms, prototypes, predictive models, and proof of concepts.● Research opportunities for data acquisition and new uses for...

  • Data Engineer

    1 week ago


    Singapore Es Recruitment Pte. Ltd. Full time

    Seeking Data Engineer for 1 yr contract assignmentJobscop & requirements:. Min Degree in IT / Technology . Min 6 to 10 years of experience in analyzing, designing, developing, and maintaining quality applications within a big data framework, utilizing Hadoop concepts and frameworks.. Proficiency in essential Pythonlibraries such as NumPy, Pandas, and...

  • Data Engineer

    1 week ago


    Singapore CAPGEMINI SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesPosition Overview:As a PySpark Data Engineer, you will be responsible for designing, implementing, and maintaining data processing pipelines using PySpark. You will work closely with our data scientists and analysts to understand requirements, transform raw data into usable formats, and optimize data workflows for performance and...


  • Singapore AVALLIS FINANCIAL PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Senior Data Engineer with a deep expertise in software development/programming and a keen passion for building data-driven solutions, you are at the forefront of evolving Big Data and Data Warehouse technologies. Avallis Financial is committed to establishing industry-leading capabilities in analytics, information management, and...