Big Data Engineer

1 week ago


Singapore TIKTOK PTE. LTD. Full time
Roles & Responsibilities

TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us

Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.

Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.

To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.

At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.

Join us.

About the Team

E-commerce is a new and fast growing business that aims at connecting all customers to excellent sellers and quality products on TikTok Shop, through E-commerce live-streaming, E-commerce short videos, and commodity recommendation. Our E-ecommerce Recommendation Infra team is responsible for building up and optimizing the infrastructure for such recommendation systems, so as to provide the most stable and best experience for our users. We work closely with applied machine learning engineers and build scalable systems to support all kinds of innovative algorithms and techniques.

The team is responsible for system stability and high availability, online services and offline data flow performance optimization, solving system bottlenecks, reducing cost overhead, building data and service mid-platform, realizing flexible and scalable high-performance storage and computing systems.

Responsibilities

Design and implement a reasonable offline data architecture for large-scale recommendation systems

Design and implement flexible, scalable, stable and high-performance storage and computing systems

Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system

Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems

Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software

Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets

Visualise, interpret, and report data findings and may create dynamic data reports as well

Qualifications

Bachelor's degree or above in computer science, software engineering, or a related field

Familiar with many open source frameworks in the field of big data, e.g.Hadoop, Hive,Flink, FlinkSQL,Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.

Familiar with Java, C ++ and other programming languages

Strong coding and trouble shooting ability

Willing to challenge questions that have no obvious answers, and have a strong enthusiasm for learning new technologies

Experience of Peta Byte level data processing is a plus

At least 3 years of relevant experience

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Tell employers what skills you have

Commodity
Machine Learning
Sponsorship
MASSIVE
Troubleshooting
Big Data
Natural Language Processing
High Availability
Software Engineering
Open Source
Data Mining
System Design
Distributed Systems
Data Architecture
Java

  • Singapore Grab Full time

    Job Description:Life at Grab:At Grab, every Grabber is guided by The Grab Way, which spells out our mission, how we believe we can achieve it, and our operating principles - the 4Hs: Heart, Hunger, Honour and Humility. These principles guide and help us make decisions as we work to create economic empowerment for the people of Southeast Asia.Get to know our...

  • Big Data Engineer

    1 week ago


    Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesPosition Type: Contract deputed to ClientRequired skillsMinimum 4 years of experience in Data Engineering Experience in Cloudera Data Platform Experience in computing, distributed, big data systems: Hadoop, HDFS, Nginx, Kubernetes, Docker, OpenStack, Spark, Flink Understands Linux operating system, storage, network IO and other...

  • Big Data Engineer

    1 week ago


    Singapore D L RESOURCES PTE LTD Full time

    BIG DATA ENGINEER / DATA SCIENTIST, FCC ANALYTICSJob Description:Big Data EngineeringCreate, build and maintain the data infrastructure required for Extraction, Transformation and Loading of data from a wide variety of sources.Ensure high-quality data is delivered to support Compliance / FCC model development.Support the implementation of Data Analytics /...

  • Big Data Engineer

    4 weeks ago


    Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesPosition Type: Contract deputed to ClientRequired skills Minimum 4 years of experience in Data Engineering Experience in Cloudera Data Platform Experience in computing, distributed, big data systems: Hadoop, HDFS, Nginx, Kubernetes, Docker, OpenStack, Spark, Flink Understands Linux operating system, storage, network IO and other...

  • Senior Data Engineer

    4 weeks ago


    Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesWorking in a large Big data and datawarehouse team of a bank, you will be responsible for carrying out the following Understand functional requirements translate user specs to FSD Carrying out solution design Carrying out data analysis and mapping carrying out development of DW and Big data solutionsRequirements MIn 7 years of...

  • Big Data Engineer

    1 week ago


    Singapore NodeFlair Full time

    Job Summary:SalaryS$6,500 - S$13,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 1 yearTech StacksETL ClickHouse Presto Java Hive Spark Flink SQL Scala Hadoop Python**ResponsibilitiesAbout TikTokTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$6,500 - S$13,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 1 yearTech StacksETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQLResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.TikTok is the...


  • Singapore DBS Bank Limited Full time

    Business Function Group Technology and Operations department at the bank ensures the existence of a strong, agile, and reliable infrastructure by focusing on productivity, quality, technology, skilled individuals, and innovation. Within Group T&O, we handle most of the Bank's operational procedures and strive to impress our business partners through...

  • Big Data Engineer

    1 week ago


    Singapore BYTEPLUS PTE. LTD. Full time

    ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa.Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including...


  • Singapore DBS Bank Limited Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business...


  • Singapore TIKTOK PTE. LTD. Full time

    Roles & ResponsibilitiesTikTok is the top platform for short-form mobile video content. Their mission is to spark creativity and spread happiness. TikTok has numerous global offices, including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo. Why Consider UsTikTok is all about creativity. Their platform is designed to...


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesA large financial institution with large data team is looking for Application Development Manager / Lead with the following responsibilities : Managing an applicaiton development team of around 20+ members Managing the solutioning of Big Data and enterprise BI applications Building frameworks, best practices for the engineering...


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesA large financial institution with large data team is looking for Application Development Manager / Lead with the following responsibilities : Managing an applicaiton development team of around 20+ members Managing the solutioning of Big Data and enterprise BI applications Building frameworks, best practices for the engineering...


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesA well-established financial organization with a robust data team is in search of an Application Development Manager/Lead to take on the following key responsibilities:Overseeing an application development team consisting of over 20 membersSupervising the design of Big Data and enterprise BI applicationsEstablishing frameworks and top...

  • Big Data Engineer

    1 week ago


    Singapore TikTok Full time

    ResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai,...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$13,160 - S$22,080 / Monthly ESTJob TypePermanentSeniorityDirectorYears of ExperienceAt least 7 yearsTech StacksETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDB We are looking for a Big Data Engineer that will work on developing frameworks using Spark and Spring Boot microservices to...

  • Big Data Developer

    1 week ago


    Singapore Pan Asia Group Resources Full time

    JD: Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python; Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc. Experience with Banking domain is preferable. Strong understanding of SDLC processes including all the project documentations. Ability to work under...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$6,500 - S$11,700 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 7 yearsTech StacksETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDBBusiness FunctionGroup Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure...

  • Big Data Developer

    1 month ago


    Singapore Robert Walters Full time

    A global financial services company is seeking a Big Data Developer (12-month renewable contract). About the Big Data Developer (12-month renewable contract) Role: In this job, you will build data capabilities for multiple financial systems.Key Responsibilities: Study, evaluate and provide feedback on functional specifications. Provide detailed estimation...

  • Big Data Developer

    1 week ago


    Singapore Robert Walters Full time

    A global financial services company is seeking a Big Data Developer (12-month renewable contract). About the Big Data Developer (12-month renewable contract) Role: In this job, you will build data capabilities for multiple financial systems.Key Responsibilities: Study, evaluate and provide feedback on functional specifications. Provide detailed estimation...