Big Data Engineer

4 months ago

Singapur, Singapore TikTok Full time

About the team

Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities. Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness. Responsibilities- Design and implement a reasonable offline data architecture for large-scale recommendation systems- Design and implement flexible, scalable, stable and high-performance storage and computing systems- Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system- Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive date and large-scale business systems- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software- Applying data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets- Visualise, interpret, and report data findings and may create dynamic data reports as well

Minimum Qualifications- Bachelor's degree or above, majoring in Computer Science, or related fields, with at 3+ years of experience- Familiar with many open source frameworks in the field of big data, . Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, etc.- Experience in programming, including but not limited to, the following programming languages: c, C++, Java or Golang- Effective communication skills and a sense of ownership and drive- Experience of Peta Byte level data processing is a plus

  • Data Engineer

    2 weeks ago

    Singapur, Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Big Data Engineer to lead our data engineering efforts. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably.Key...

  • Data Engineer with Big Data Expertise

    4 days ago

    Singapur, Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Big Data Engineer to lead our data engineering team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably. The...

  • Big Data Engineer

    7 days ago

    Singapur, Singapore Virtusa Full time

    Big Data EngineerVirtusa is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines using ETL tools...

  • Big Data Engineer

    4 months ago

    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 123101 Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. • Good understanding of analytics and data warehouse implementations. • Ability to troubleshoot complex issues ranging from system resource to application stack traces. • Strong SQL, data modelling and data...

  • Senior Data Engineer

    1 week ago

    Singapur, Singapore Helius Full time

    Job Title: Senior Data Engineer - Big DataHelius is seeking a highly skilled Senior Data Engineer - Big Data to join our team. As a Senior Data Engineer - Big Data, you will be responsible for designing, developing, and deploying large-scale data processing systems using Talend Big Data version 7+ and Hadoop.Key Responsibilities:Design and develop...

  • Data Engineer

    2 weeks ago

    Singapur, Singapore DBS Bank Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at DBS Bank. As a Data Engineer, you will play a key role in designing, building, and maintaining our Big Data platform.Key ResponsibilitiesDesign and implement scalable data pipelines using Big Data tools and technologiesCollaborate with cross-functional teams to define and deliver...

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore Singtel Full time

    About the RoleWe are seeking a highly skilled Software Development Expert to join our team at Singtel. As a key member of our engineering team, you will be responsible for designing and implementing cloud native solutions, big data platforms, and distributed systems.Key ResponsibilitiesDesign and develop cloud native applications using Kubernetes, Docker,...

  • Data Engineer

    2 months ago

    Singapur, Singapore NTT Data Singapore Full time

    Job Summary We are seeking a highly skilled and experienced Big Data Engineer to join our team.. Key Responsibilities Analyze the Authoritys data needs and document the requirements. Refine data collection/consumption by migrating data collection to more efficient channels. Plan, design and implement data engineering jobs and reporting solutions to meet...

  • Data Engineer

    2 weeks ago

    Singapur, Singapore Nityo Infotech Full time

    Job Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable and efficient data processing...

  • Data Engineer

    1 day ago

    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking a highly skilled Data Engineer to join our Group Technology and Operations team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures to support our business operations.Key ResponsibilitiesDesign and develop data pipelines and architectures to support...

  • Data Engineer

    4 weeks ago

    Singapur, Singapore NTT Data Singapore Full time

    Requirements Bachelor's degree in Computer Science or a related field.  At least 7 years of IT experience of which at least 5 years' experience in similar role, ideally in a Big Data tools Proficient understanding of distributed computing principles Strong experience of Hadoop, Spark, Iceberg and Spring Boot Experience with building stream-processing...

  • Big Data Engineer

    2 weeks ago

    Singapur, Singapore DBS Bank Full time

    About the RoleDBS Bank is seeking a highly skilled Big Data Engineer to join our Group Technology and Operations team. As a key member of our team, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications.Key ResponsibilitiesDesign and implement scalable Big Data architectures using Hadoop, Spark, and other...

  • Software Engineer

    2 months ago

    Singapur, Singapore Epam Full time

    Description We are looking for a Big Data Engineer to join our team! The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs as...

  • Big Data Specialist

    3 weeks ago

    Singapur, Singapore Epam Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data ingestion and processing jobs in big data environments.Key ResponsibilitiesAnalyze and document business data requirements to ensure seamless data access to...

  • AVP, Data Engineer

    3 weeks ago

    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking a highly skilled Data Engineer to join our team in Group Technology and Operations (T&O). As a Data Engineer, you will play a critical role in enabling and empowering the bank with an efficient, nimble, and resilient infrastructure through a strategic focus on productivity, quality, and control, technology, people capability,...

  • Data Engineer

    2 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will be responsible for designing, developing, and implementing Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.Key Responsibilities:Design and develop...

  • Big Data Global Manager

    4 months ago

    Singapur, Singapore TikTok Full time

    About the team This role is a member of our Data Platform team focusing on Data products and solutions to enterprise services, leveraging TikTok's cutting-edge data infrastructure and data application. You will be helping enterprise customers to build their next generation data warehouse and data analytics, enabling them to do things that were not possible...

  • Reporting and Analytics Developer/Data Engineer

    2 months ago

    Singapur, Singapore NTT Data Singapore Full time

    Job Summary We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/ Senior Consultant preferably. The successful candidate will...

  • Data Engineer

    3 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will play a critical role in designing, developing, and implementing large-scale data processing pipelines using Spark Scala applications.Key ResponsibilitiesData Processing and IntegrationDesign and develop efficient data...

  • Data Engineer

    3 weeks ago

    Singapur, Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team at NTT Data Singapore. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably.Key...