Big Data Engineer

3 weeks ago

Singapore TIKTOK PTE. LTD. Full time
Roles & Responsibilities

TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us

Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.

Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.

To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.

At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.

Join us.

About the Team

E-commerce is a new and fast growing business that aims at connecting all customers to excellent sellers and quality products on TikTok Shop, through E-commerce live-streaming, E-commerce short videos, and commodity recommendation. Our E-ecommerce Recommendation Infra team is responsible for building up and optimizing the infrastructure for such recommendation systems, so as to provide the most stable and best experience for our users. We work closely with applied machine learning engineers and build scalable systems to support all kinds of innovative algorithms and techniques.

The team is responsible for system stability and high availability, online services and offline data flow performance optimization, solving system bottlenecks, reducing cost overhead, building data and service mid-platform, realizing flexible and scalable high-performance storage and computing systems.

Responsibilities

- Design and implement a reasonable offline data architecture for large-scale recommendation systems

- Design and implement flexible, scalable, stable and high-performance storage and computing systems

- Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system

- Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems

- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software

- Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets

- Visualise, interpret, and report data findings and may create dynamic data reports as well

Qualifications

- Bachelor's degree or above in computer science, software engineering, or a related field

- Familiar with many open source frameworks in the field of big data, e.g.Hadoop, Hive,Flink, FlinkSQL,Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.

- Familiar with Java, C ++ and other programming languages

- Strong coding and trouble shooting ability

- Willing to challenge questions that have no obvious answers, and have a strong enthusiasm for learning new technologies

- Experience of Peta Byte level data processing is a plus

- At least 3 years of relevant experience

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Tell employers what skills you have

Commodity
Machine Learning
MASSIVE
Troubleshooting
Big Data
Natural Language Processing
High Availability
Software Engineering
Open Source
Data Mining
System Design
Distributed Systems
Data Architecture
Java

  • Big Data Engineer

    3 weeks ago

    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesAre you passionate about big data and love working with cutting-edge technologies? Join our team as a Big Data Engineer and help us build scalable data solutions What You'll Do: Design, develop, and optimize big data pipelines Work with Apache Spark, Scala, Hadoop, Hive, Kafka, and more Manage and process large datasets efficiently...

  • Big Data Engineer

    3 weeks ago

    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesAre you passionate about big data and love working with cutting-edge technologies? Join our team as a Big Data Engineer and help us build scalable data solutions! What You’ll Do:✔ Design, develop, and optimize big data pipelines✔ Work with Apache Spark, Scala, Hadoop, Hive, Kafka, and more✔ Manage and process large datasets...

  • Big Data Engineer

    3 weeks ago

    Singapore INFINITE COMPUTER SOLUTIONS PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big...

  • Big Data Engineer

    4 weeks ago

    Singapore ITCAN PTE. LIMITED Full time

    Roles & Responsibilities· Bachelor's or master's degree in computer science, Engineering, or a related field.· Proven experience as a Big Data Engineer or similar role.· Strong proficiency in Apache Spark and Scala programming.· Experience with big data technologies such as Hadoop, Hive, Kafka, etc.· Familiarity with data warehousing concepts and...

  • Big Data Engineer

    2 weeks ago

    Singapore ITCAN PTE. LIMITED Full time

    Roles & Responsibilities· Bachelor's or master's degree in computer science, Engineering, or a related field.· Proven experience as a Big Data Engineer or similar role.· Strong proficiency in Apache Spark and Scala programming.· Experience with big data technologies such as Hadoop, Hive, Kafka, etc.· Familiarity with data warehousing concepts and...

  • Big Data Engineer

    3 weeks ago

    Singapore INFINITE COMPUTER SOLUTIONS PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big...

  • Big Data Engineer

    3 weeks ago

    Singapore DADACONSULTANTS PTE. LTD. Full time

    Roles & ResponsibilitiesMy ClientIt is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the...

  • Big Data Engineer

    3 weeks ago

    Singapore DADACONSULTANTS PTE. LTD. Full time

    Roles & ResponsibilitiesMy ClientIt is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the...

  • Big Data Engineer

    3 weeks ago

    Singapore MICHAEL PAGE INTERNATIONAL PTE LTD Full time

    Roles & ResponsibilitiesOrganisation is a global leader in the technology and telecoms industry. Fast-paced environment, rapidly growing organisation.About Our ClientThe organisation is a global leader in the technology and telecoms industry. They are well-known for their innovative approach to tackling complex technical challenges and their commitment to...

  • Big Data

    2 weeks ago

    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities:Collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient big data platform solutions. Design and architect robust big data platforms, ensuring high performance, reliability, and scalability. Implement end-to-end data processing workflows, from data...

  • Senior Big Data Engineer

    5 days ago

    Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesJob Description & RequirementsWorking in a large Big data and datawarehouse team of a bank, you will be responsible for carrying out the followingUnderstand functional requirements Carrying out data analysis, data mapping development of data pipeline, back end services performing data management and data transformation Ensuring...

  • Big Data Engineer

    3 weeks ago

    Singapore MINDMAP TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities· Perform the role of a Data engineer on the Enterprise Data Architecture and Governance (EDAG) Programs, to ensure the business requirements and deliverables are aligned to business priorities· Design develop data pipelines on EDAG platform to support Wholesale bank data model.· Perform assessments and analysis on...

  • Cloudera & Big Data Engineer

    2 weeks ago

    Singapore MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD Full time

    Roles & ResponsibilitiesJob scopes· Design, build, deployment, of ETL/ELT data pipelines within big data ecosystems ( Impala, Hue, Spark, Talend and Cloudera)· Develop technical design, and ETL specification documents· Manage, monitor and fine tune Hadoop cluster architecture (HDFS) jobs for performance, security and resource management.· Create detailed...

  • Big Data Engineer

    2 weeks ago

    Singapore DADACONSULTANTS PTE. LTD. Full time

    Roles & ResponsibilitiesKey Responsibilities: Ensure seamless deployment, configuration, and operation of applications on cloud servers and container platforms. Collaborate with development teams to design scalable and highly available system architectures. Contribute to the development and maintenance of internal platforms and tools. Perform daily...

  • Big Data Engineer with Kubernetes Expertise

    5 days ago

    Singapore Tangspac Full time

    Company Overview:Tangspac is a leading provider of innovative solutions for the financial industry.We are seeking an experienced Big Data Engineer to join our team and contribute to the development of our cutting-edge big data applications.

  • Big Data Engineer

    3 weeks ago

    Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...

  • Senior Big Data Engineer

    3 weeks ago

    Singapore PALO IT SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesWHO WE ARE:Build. Scale. Sustain.PALO IT is a global technology consultancy that crafts tech as a force for good. We design, develop and scale digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We do the right thing, and we do it right. We're proud to be a World...

  • Senior Big Data Engineer

    2 days ago

    Singapore PALO IT SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesWHO WE ARE:Build. Scale. Sustain.PALO IT is a global technology consultancy that crafts tech as a force for good. We design, develop and scale digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We do the right thing, and we do it right. We're proud to be a World...

  • Big Data Developer

    2 weeks ago

    Singapore RESOURCE HUNT PTE. LTD. Full time

    Roles & ResponsibilitiesBig Data Developer  Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS file formats and...

  • Big Data Developer

    3 weeks ago

    Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJD:Big Data Developer (3 – 10 Years) Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS...