Big Data Engineer

4 months ago


Singapur, Singapore TikTok Full time

Team Introduction

We are an incredible team with passion. We enjoy learning new things and taking on challenges. Team culture here is open and inclusive. Everyone can make things happen, good ideas will always win.Today, we are continuously increasing investment in AI technology to make content creation much easier for everyone, and we always take the protection of user privacy and data security very seriously. In CapCut , our goal is to build a Data Warehouse that can cater to batch and streaming data, Data Products that provide useful information to build efficient data metrics & dashboards which will be used to make smarter business decisions to support business growth. If you're looking for a challenging ground to push your limits, this is the team for you - Translate business requirements & end to end designs into technical implementations and responsible for building batch and real-time data warehouse- Manage data modeling design, writing, and optimizing ETL jobs- Collaborate with the business team to building data metrics based on data warehouse- Responsible for building and maintaining data products - Involvement in rollouts, upgrades, implementation, and release of data system changes as required for streamlining of internal practices- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software. - Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets. - Visualise, interpret, and report data findings and may create dynamic data reports as well.

Minimum qualifications- 5 years in software engineering and 2 years of relevant experience in data engineering.- Proficient in creating and maintaining complex ETL pipeline end-to-end while maintaining high reliability and security. Preferred qualifications- Familiar with data warehouse concept and have production experience in modeling design.- Familiar with at least 1 distributed computing engine (. Hive, Spark, Flink).- Familiar with at least 1 NoSQL database is a plus (. HBase).- Excellent interpersonal and communication skills with the ability to engage and managing internal and external stakeholders across all levels of seniority .- Strong collaboration skills with the ability to build rapport across teams and stakeholders.
  • Big Data Engineer

    6 months ago


    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 123101 Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. • Good understanding of analytics and data warehouse implementations. • Ability to troubleshoot complex issues ranging from system resource to application stack traces. • Strong SQL, data modelling and data...


  • Singapur, Singapore TikTok Full time

    About the TeamTikTok's Tea platform is a cutting-edge analytics platform used by over 10,000 employees globally. As a key member of our global engineering team, you will be responsible for deploying, configuring, and maintaining big data platforms, as well as implementing and optimizing infrastructure for big data storage, processing, and computation.**Key...

  • Software Engineer

    4 months ago


    Singapur, Singapore Epam Full time

    Description We are looking for a Big Data Engineer to join our team! The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs as...


  • Singapur, Singapore TikTok Full time

    About the team :Tea(Toutiao Event Analyze) is an in-house analytics platform that is heavily used by more than 10,000 employees globally. This is a data middle platform product built on user behavior data, providing data analysis services for various domestic and international businesses within ByteDance/TikTok, including Douyin, Toutiao, Xigua, TikTok,...


  • Singapur, Singapore Unison Consulting Pte Ltd Full time

    Senior Spark Scala DeveloperWe are seeking a highly skilled Spark Scala Developer to collaborate with our dynamic team in delivering cutting-edge data processing solutions. The ideal candidate will possess a deep understanding of big data technologies, particularly Apache Spark, and expertise in Scala programming.Key ResponsibilitiesDesign and Development:...


  • Singapur, Singapore PatSnap Full time

    About PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can makefaster decisions with more confidence. Founded in 2007, Patsnap is the global leaderin AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on ourextensive proprietary innovation data, coupled with Hiro, our AI assistant, deliversactionable insights...

  • Java Developer with

    5 months ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    We are seeking an experienced Java Developer with expertise in Google Cloud Platform (GCP) and Big Data technologies. The ideal candidate will have a strong background in Java development, cloud computing, and data engineering to help us build and maintain scalable, high-performance systems.Key Responsibilities: Design, develop, and maintain Java-based...

  • Data Engineer

    2 months ago


    Singapur, Singapore Epam Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to design, develop, and maintain data ingestion and processing jobs in our big data environment. The ideal candidate will have a strong understanding of analytics, data warehousing, and data modeling, as well as experience with big data technologies such as Python, PySpark, and ETL tools like...

  • Data Engineer

    5 months ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    We are seeking a skilled and motivated Data Engineer with expertise in Google Cloud Platform tools such as BigQuery, Composer, Dataproc, and ETL processes. The ideal candidate will have a strong background in designing, implementing, and optimizing data pipelines and workflows. You will play a key role in ensuring our data infrastructure is scalable,...


  • Singapur, Singapore Careers@Gov Full time

    [What the role is] Senior/Lecturer (Big Data and Analytics) /School of Informatics & IT [What you will be working on] Conduct lessons and carry out all relevant responsibilities related to the teaching role in full-time and part-time course offerings in areas related to Data Analytics, Machine Learning, Data Engineering and Data Management, and other...


  • Singapur, Singapore United Overseas Bank Full time

    VP, Data Scientist, Big Data Analytics Centre, Data Management Office Posting Date: 18-May-2023 Location: Singapore (City Area), Singapore, 048624 Company: United Overseas Bank Ltd About UOB United Overseas Bank Limited (UOB) is a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and...


  • Singapur, Singapore Careers@Gov Full time

    [What the role is] Senior/Lecturer/ School of Informatics & IT (Big Data and Analytics) [What you will be working on] Conduct lessons and carry out all relevant responsibilities related to the teaching role in full-time and part-time course offerings in areas related to Data Analytics, Machine Learning, Data Engineering and Data Management, and other...


  • Singapur, Singapore Careers@Gov Full time

    [What the role is] Senior/Lecturer (Big Data and Analytics) /School of Informatics & IT [What you will be working on] Conduct lessons and carry out all relevant responsibilities related to the teaching role in full-time and part-time course offerings in areas related to Data Analytics, Machine Learning, Data Engineering and Data Management, and other...


  • Singapur, Singapore U3 Full time

    Job SummaryThe Enterprise Data Solutions Architect is responsible for designing and implementing scalable data processing architectures in hybrid cloud environments. This includes defining architecture and strategy for batch workloads, enabling multitenancy, and capacity planning at enterprise scale.Key ResponsibilitiesDesign and develop batch data...

  • Data Engineer

    5 months ago


    Singapur, Singapore TikTok Full time

    About the team The success of TikTok's data business model hinges on the supply of a large volume of high quality labeled data that will grow exponentially as our business scales up. However, the current cost of data labeling is excessively high. The Data Solutions team is built to understand data strategically at scale for all Global Business Solution...

  • Senior Data Engineer

    4 weeks ago


    Singapur, Singapore Rapsys Technologies Pte Ltd. Full time

    Senior Data EngineerExperience Required: 5-10 YearsPosition Summary:We are seeking an experienced Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools, big data ecosystems, and programming...

  • Data Engineer

    5 months ago


    Singapur, Singapore Virtusa Full time

    Data Engineer - 128869 Description Job Description: We are seeking a highly motivated Junior Consultant Data Engineer to join our dynamic data engineering team. The ideal candidate will have experience in data engineering technologies and be eager to learn and grow within the role. This position will involve working with .NET, ETL processes, Python,...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore Centre for Strategic Infocomm Technologies Full time

    RoleAs a senior data engineer in a team that is responsible for mission-critical data analytics systems, you will contribute to the development and maintenance of high-performance data pipelines and systems related to national security. You will be involved in complex technical projects to collect, parse and process large datasets with the aim to turn them...

  • Data Engineer

    8 months ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Build and optimizing ‘big data’ data pipelines, architectures and data sets. Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. To support and develop Data modeling, Implementation activities. Strong analytic skills related to working with...

  • Data Engineer

    2 months ago


    Singapur, Singapore TapTalent.ai Full time

    We have an Attractive Data engineer(Big Data) Opening for Singapore Based Client Job Description:Requirement:- TEAM Architecture (Big Data) -5+ years of experience with application development in Big Data Ecosystem (such as Cloudera, Elastic Search, Spark, Presto, Hive, Impala, Kibana, Logstash, Hbase, Kafka), Expertise in building applications using Scala,...