Data Engineer

2 weeks ago


Singapur, Singapore Shopee Full time
Data Engineer - Search & Recommendation (Campus Recruitment 2024) DepartmentEngineering and TechnologyLevelEntry LevelLocationSingapore

The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit ourselves on what we can or can't do; we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed most "innocent" problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do.

Job Description: Design, build and maintain the real-time streaming system to support timely and accurate ingestion of various types of data (e.g. User behavior, RDS, NoSQL DB, and others) into storage  Design, build and maintain data warehouse for Shopees e-commerce search and recommendation  Translate data requirements into scalable technical data service with low latency and high concurrency Design, build and maintain batch or real-time data pipeline for algorithm, analytics and operational purpose using Hadoop big data technology Analyze and improve the efficiency, scalability, and stability of the data pipelines and related platforms or tools Define and manage service level agreement and data quality for all data sets Requirements: Minimum Bachelors degree in Computer Science or a related technical field Proficient in working with programming languages, such as Java and/or Scala Proficient in Hadoop, Spark, MapReduce, and Hive/Spark/Presto SQL, experience with PB batch data processing is a plus Familiar with data warehouse standard, experience with live system data warehouse is a big plus Familiar with streaming data processing using Flink and Kafka Experience in designing and operating a robust distributed system is a plus Understanding data mining or machine learning is a plus Having a passion to work intimately with data Self-motivated and takes ownership

  • Singapur, Singapore OnLoop Full time

    We are seeking a motivated and talented Data Engineering Intern with a special focus on prompt engineering to join our growing team. This internship offers an exciting opportunity to gain hands-on experience in the field of data engineering while contributing to the development of cutting-edge natural language processing (NLP) models. The ideal candidate is...

  • Data Engineer

    2 weeks ago


    Singapur, Singapore ST Engineering Full time

    Title: Data Engineer Job ID: Location: Aero - Airport Road, SG Description: Job Description Develop web applications using ASP.Net MVC and ASP.Net Web API, following the development standards and technical design provided Understanding of best practices in software development process (SDLC) including coding standards, code reviews,...

  • Data Engineer

    2 weeks ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Build and optimizing ‘big data’ data pipelines, architectures and data sets. Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. To support and develop Data modeling, Implementation activities. Strong analytic skills related to working with...

  • Big Data Engineer

    2 weeks ago


    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 111170 Description Job Summary We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment , Cloudera Data Platform. Overall experience can be 5 to 10 years.. The successful candidate will...

  • Data Engineer

    3 weeks ago


    Singapur, Singapore NodeFlair Full time

    1. Key Outputs:  Collaborate with both non-technical and technical team members from cross-functional business and IT teams to gather, elicit and document data requirements and translate them into: Data Models and Mapping Specifications Develop and govern data modeling standards, best practices, and guidelines to ensure consistency and maintainability...

  • Azure Data Engineer

    3 weeks ago


    Singapur, Singapore SMRT Corporation Ltd Full time

    Job Purpose We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you will create and maintain optimal data pipelines architecture in cloud. Overall, you will strive for efficiency by aligning data systems with business goals.  To succeed in this...


  • Singapur, Singapore Synpulse Schweiz AG Full time

    We are an established, globally active management consulting company with offices in Switzerland, Germany, Austria, Great Britain, USA, Singapore, Hong Kong, the Philippines, Australia, Indonesia and India. We are a valued partner to many of the world‘s largest international financial services and insurance firms. We support our clients at all project...

  • Data Engineer Intern

    3 weeks ago


    Singapur, Singapore Razer Full time

    Job Responsibilities :Intern will be playing a key role in the revamp of existing data pipelines and building new pipelines that are essential for data analyst/data scientist to perform analytics.By studying and understanding the data and pipelines, the intern will perform data profiling, data processing, automation and deployment to ensure that data is...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore Helius Full time

    Responsibilities Design and develop data pipelines and data infrastructure to support efficient and scalable data processing and analytics. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions. Implement and maintain data integration and ETL (Extract, Transform,...


  • Singapur, Singapore Twelve Data Full time

    What we need An experienced front-end developer is required in the core development team. The team develops products that automate processes within the company, develops pages and components of the twelvedata.com site, improves site performance and customer experience. We make a high-quality intranet, meeting the high requirements of our users - Twelve Data...


  • Singapur, Singapore JLL Full time

    JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and...


  • Singapur, Singapore StarHub Full time

    Job Description Purpose: ⦁ The Data Platform Team is responsible for conceptualisation, implementation and management of organisation-wide data platform and solutions. ⦁ You will be part of the team responsible for data management to solve business problems, build and maintain data infrastructure to address business requirements and improve...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore BBGC Full time

    Job Description: Senior Data EngineerPosition Overview: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The Senior Data Engineer will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure to support our organization's data needs. The ideal candidate will have a...


  • Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...


  • Singapur, Singapore TikTok Full time

    About the team The mission of the Data Business Partner (BP) Quality Assurance Team is to build a highly mature (standardized/professional/efficient) data quality system, ensuring the better delivery of data. Our goal is to safeguard the quality of data throughout the entire lifecycle in terms of timeliness, accuracy, and stability, empowering the...


  • Singapur, Singapore Twelve Data Full time

    Summary Twelve Data’s Backend team is looking for a high-energy Golang backend developer with a passion for creating impactful FinTech products. This team is responsible for developing stable systems that process terabytes of financial quotes daily. The tools we develop will be used by thousands of users creating their own financial worlds that altogether...


  • Singapur, Singapore NTT Data Singapore Full time

    Job Responsibilities ・ Leads as the subject matter expert, to design, plan and deploy the right functional technical solution accordance with the specification and service levels of business and/or system requirements include multi-region routing across regional DCs Cisco SDWAN controller and Internet Gateway disaster recovery. ・ ...


  • Singapur, Singapore MISC Berhad Full time

    Description KEY ACCOUNTABILITIES Manage, plan and maintain the facilitation of support for data analysis across Eaglestar’s growing global fleet . Project-manage and deliver on data-related implementations ensuring that deliverables are met within agreed scope and timelines Manage, develop, and provide Eaglestar’s internal/external stakeholders...

  • Lead Data Engineer

    2 weeks ago


    Singapur, Singapore Helius Full time

    Our goal is to transform the entire hiring process by making it simple, efficient, and enjoyable for recruiters, hiring managers, and candidates alike Our mission is to offer the best-in-class AI-powered technologies to empower small, medium, and large businesses in their staffing & recruitment transformation. Responsibilities Set, define, and own...