Big Data Engineer

4 weeks ago


Singapore TIKTOK PTE. LTD. Full time
Roles & Responsibilities

TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.


TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.


Why Join Us

Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.

Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.

To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.

At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.

Join us.


About the Team

E-commerce is a new and fast growing business that aims at connecting all customers to excellent sellers and quality products on TikTok Shop, through E-commerce live-streaming, E-commerce short videos, and commodity recommendation. Our E-ecommerce Recommendation Infra team is responsible for building up and optimizing the infrastructure for such recommendation systems, so as to provide the most stable and best experience for our users. We work closely with applied machine learning engineers and build scalable systems to support all kinds of innovative algorithms and techniques.


The team is responsible for system stability and high availability, online services and offline data flow performance optimization, solving system bottlenecks, reducing cost overhead, building data and service mid-platform, realizing flexible and scalable high-performance storage and computing systems.


Responsibilities

- Design and implement a reasonable offline data architecture for large-scale recommendation systems

- Design and implement flexible, scalable, stable and high-performance storage and computing systems

- Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system

- Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems

- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software

- Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets

- Visualise, interpret, and report data findings and may create dynamic data reports as well


Qualifications

- Bachelor's degree or above in computer science, software engineering, or a related field

- Familiar with many open source frameworks in the field of big data, e.g.Hadoop, Hive,Flink, FlinkSQL,Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.

- Familiar with Java, C ++ and other programming languages

- Strong coding and trouble shooting ability

- Willing to challenge questions that have no obvious answers, and have a strong enthusiasm for learning new technologies

- Experience of Peta Byte level data processing is a plus

- At least 3 years of relevant experience


TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.


Tell employers what skills you have

Commodity
Machine Learning
Sponsorship
MASSIVE
Troubleshooting
Big Data
Natural Language Processing
High Availability
Software Engineering
Open Source
Data Mining
System Design
Distributed Systems
Data Architecture
Java

  • Singapore NTT Data Singapore Full time

    Job Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Key Responsibilities • Proficient understanding of distributed computing...

  • Big Data Engineer

    2 weeks ago


    Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole: Contract (1 year, Renewable)Position: Big Data Support EngineerMandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 6 - 8 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data...


  • Singapore NTT DATA Services Full time

    About NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...


  • Singapore Virtusa Full time

    We are seeking an experienced Big Data Engineer to join our team at Virtusa in Moulmein-Kallang, Central Singapore. The successful candidate will have a strong background in big data engineering and experience working with Python, PySpark, Linux, and ETL tools like Informatica.ResponsibilitiesDesign and implement scalable big data solutions using Hive,...


  • Singapore ITCAN Full time

    About ITCANWe are a leading technology company that delivers innovative solutions to our clients.Job Title: Senior Big Data EngineerSalary Range:$170,000 - $220,000 per yearAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have extensive experience in designing and implementing large-scale big...


  • Singapore Unison Consulting Pte Ltd Full time

    About UsUnison Consulting Pte Ltd is a leading consulting firm that specializes in data engineering solutions.We are seeking a highly skilled Big Data Engineering Specialist to join our team.Job DescriptionJob Title: Big Data Engineering SpecialistEstimated Salary: $120,000 - $180,000 per annumAs a Big Data Engineering Specialist at Unison Consulting Pte...


  • Singapore TikTok Full time

    About the teamByteDance/TikTok's Tea analytics platform is a leading in-house data platform used by over 10,000 employees globally. As a key member of our global engineering team, you will be responsible for building and maintaining the platform that supports exabyte-level data, trillion-level events, and millisecond-level response...


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesAs a Data Framework Engineer at TANGSPAC CONSULTING PTE LTD, you will be responsible for creating frameworks and technical features that enable faster operationalisation of data models, analytical models, and user-generated contents. This includes partnering with data scientists to enable faster adoption of AL/ML model-based systems,...


  • Singapore U3 Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team at U3 Infotech. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines and data services modules with robustness in mind to support the growing demands from business users.Key ResponsibilitiesDesign and implement...


  • Singapore Unison Consulting Pte Ltd Full time

    Unison Consulting Pte Ltd is seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have 5+ years of experience in designing, developing, and implementing Spark Scala applications and data processing pipelines.About the RoleThis is a key role that requires expertise in integrating Elasticsearch with Spark to enable efficient...

  • Big Data Developer

    4 weeks ago


    Singapore PRIMESTAFF MANAGEMENT SERVICES PTE LTD Full time

    Roles & ResponsibilitiesOur client is looking for an experienced and highly skilled Senior Big Data Developer to join the dynamic team. The ideal candidate will have over 10 years of extensive working knowledge and hands-on expertise in big data technologies, especially in Spark on Scala or PySpark, and Hive. This role will involve the design, development,...

  • Big Data Engineer

    7 days ago


    Singapore Unison Consulting Pte Ltd Full time

    Job Title: Big Data Engineer - Scala ExpertWe are seeking a highly skilled Scala Developer with expertise in Apache Spark to join our dynamic team at Unison Consulting Pte Ltd. The ideal candidate will have a deep understanding of big data technologies and experience in designing, developing, and optimizing high-performance data processing pipelines using...

  • Data Engineer

    7 days ago


    Singapore Crédit Agricole CIB Full time

    About the JobCrédit Agricole CIB is seeking a highly skilled Data Engineer to join its team. As a key member of our Big Data department, you will be responsible for designing and implementing data solutions using cutting-edge technologies.Key Responsibilities:Develop and maintain large-scale data processing systems using Storm, Hadoop, and Elastic Search...


  • Singapore Unison Consulting Pte Ltd Full time

    About UsAt Unison Consulting Pte Ltd, we are a forward-thinking consulting firm that provides expert solutions to businesses in the digital age.Job Title: Senior Big Data ArchitectJob DescriptionWe are seeking an experienced Senior Big Data Architect to join our team. The ideal candidate will have a strong background in big data engineering and architecture,...


  • Singapore Careers@Gov Full time

    Careers@Gov: Lecturer - Data Engineering ITE College WestEstimated Salary: SGD $80,000 - $120,000 per annumAbout the RoleWe are seeking an experienced Lecturer in Data Engineering to join our team at ITE College West. As a key member of our faculty, you will play a critical role in shaping the next generation of data professionals.About YouTo be successful...


  • Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Job DescriptionWe are seeking an experienced Senior Big Data Engineer to join our team at RAPSYS TECHNOLOGIES PTE. LTD.Responsibilities:Design and develop data applications using Python and other programming languages, ensuring efficient data processing on big data systems.Create APIs using Python to handle structured and unstructured data, with a strong...


  • Singapore SPRINGFIELD CONSULTING PTE. LTD. Full time

    Job Title: Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team at Springfield Consulting PTE. LTD.The estimated salary for this role is around SGD 120,000 - 180,000 per annum, depending on experience and qualifications.About the Job:Company Overview:Springfield Consulting PTE. LTD. is a reputable consulting firm that specializes...

  • Big Data Engineer

    3 days ago


    Singapore Nityo Infotech Full time

    Nityo Infotech seeks an experienced Big Data Engineer to join our team in Singapore. As a key member of our IT department, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.About the RoleThis is a contract position with a competitive salary range of SGD 120,000 - 180,000 per...


  • Singapore Nityo Infotech Full time

    As a key member of our data engineering team at Nityo Infotech, you will play a crucial role in designing, building, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.The ideal candidate will have a solid understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL, as well as experience integrating and working...


  • Singapore Prudential plc Full time

    About Prudential plcWe are a leading international financial services group with operations in Asia, the US and Europe. Our purpose is to be partners for every life and protectors for every future. We strive to create a culture of diversity and inclusion where our people can grow and succeed.Job Description: Big Data Engineer for Health Pillar SetupWe are...