Backend Software Engineer, Data Lake

3 weeks ago


Singapur, Singapore TikTok Full time

About The Team

The batch processing team is responsible for the company's offline data processing and distributed training, supporting various business scenarios such as offline ETL and machine learning within the company. The components involved include the offline computing engine Spark, the in-house distributed training framework Primus, feature storage solutions like Iceberg and Hudi, as well as Ray, a next-generation distributed application framework. Faced with massive-scale scenarios, extensive functional and performance optimizations have been carried out in Spark, Primus, Feature Store, and support for the adoption of the new-generation distributed application framework Ray in relevant company scenarios. What you will be doing:- Responsible for the development and performance optimisation of the in-house Feature Store functionality based on Iceberg;- Participant in optimisation of the integration of Iceberg with various upper-level computing engines;- Involve in platform-related infrastructure development.

What you should have:1. Bachelor's Degree or above, majoring in Computer Science, or related fields, with 2+ years of relevant development experience in the field with a strong programming ability, and proficiency in Java, Python, C++, with the ability to develop and optimize large-scale distributed systems;2. In-depth research and relevant experience in one or more data lake formats such as Delta, Hudi, or Iceberg;3. In-depth research or practical experience in open-source big data computing frameworks and scenarios like Hadoop, Spark, Flink, Presto, and more.

  • Singapur, Singapore Aztech Technologies Full time

    Software Engineer – Cloud Backend Opportunity for a R&D Software Engineer to be part of our dynamic R&D team, to work on the frontend and back development for IOT/ Cloud solutions. The candidate should have prior experience in developing a web-based IOT device management platform. If you are passionate about working on IoT solutions, familiar with Cloud...


  • Singapur, Singapore Singapore Airlines Full time

    Job DescriptionAt its core, this is a principal software architect position - with prior working experience as a software developer implementing, e.g., modern distributed systems, cloud-based data lakes, and open-source data engineering platforms. The successful candidate will play a lead role in the Data Engineering and Analytics team of Scoot’s...


  • Singapur, Singapore SHIELD Full time

    SHIELD is a device-first risk AI platform that helps digital businesses worldwide eliminate fake accounts and stop all fraudulent activities. SHIELD identifies the root of fraud with the global standard for device identification (SHIELD Device ID) and actionable risk intelligence, empowering businesses to stay ahead of new and unknown fraud threats. We are...

  • Software Engineer

    3 weeks ago


    Singapur, Singapore Epam Full time

    Description As a Dot Net Developer, you will be responsible for the backend solutions and development of software and web applications. You will be part of an agile team responsible for products used by financial industry officers for financial supervision functions. What Youll Do Design, develop, and maintain microservices architecture using...


  • Singapur, Singapore Twelve Data Full time

    Summary Twelve Data’s Backend team is looking for a high-energy Golang backend developer with a passion for creating impactful FinTech products. This team is responsible for developing stable systems that process terabytes of financial quotes daily. The tools we develop will be used by thousands of users creating their own financial worlds that altogether...


  • Singapur, Singapore TikTok Full time

    About the team :Mirror is a one-stop marketing data platform that is widely used by Bytedance product lines and also serves for other enterprises. Help our customers break data silos and build a customer-wide data center for business growth. The system supports data integration, preprocessing, ID Mapping, label production, label management, crowd...

  • Backend Engineer

    3 weeks ago


    Singapur, Singapore Helius Full time

    As a Backend Developer - Spring Boot, you'll be an integral member of the software engineering team that designs and develops world-class applications with Spring Boot, PostgreSQL or MySQL, and AWS. You'll be working on mission-critical software applications that are relied on by our customers to be highly reliable and performant. You'll be working closely...


  • Singapur, Singapore GXS Full time

    We are living in dynamic times. Technology is reshaping how we live, and we want to use it to redefine how financial services are offered. Grab is the leading technology company in Southeast Asia offering everyday services to the masses. Singtel is Asia’s leading communications group connecting millions of consumers and enterprises to essential digital...


  • Singapur, Singapore TikTok Full time

    About the team :Libra is a large-scale online one-stop A/B testing platform developed by TikTok Data Platform .Provide experimental evaluation services for all product lines within the company, covering solutions for complex scenarios such as recommendation, algorithm, function, UI, marketing, advertising, operation, social isolation, causal inference,...


  • Singapur, Singapore TikTok Full time

    About the team :Libra is a large-scale online one-stop A/B testing platform developed by TikTok Data Platform .Provide experimental evaluation services for all product lines within the company, covering solutions for complex scenarios such as recommendation, algorithm, function, UI, marketing, advertising, operation, social isolation, causal inference,...

  • Senior Data Engineer

    3 weeks ago


    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...


  • Singapur, Singapore Sea Full time

    Job Description Work with and materialize practical product ideas atop the latest technologies, bridging the gap between the forefront of technological advancement and people’s needs.Server-side design, development and deployment of the services/systems/platforms used by our products and our usersResearch the latest technologies and development trends in...

  • Software Engineer

    3 weeks ago


    Singapur, Singapore SHIELD Full time

    SHIELD is a device-first risk AI platform that helps digital businesses worldwide eliminate fake accounts and stop all fraudulent activities. SHIELD identifies the root of fraud with the global standard for device identification (SHIELD Device ID) and actionable risk intelligence, empowering businesses to stay ahead of new and unknown fraud threats. We are...

  • Data Program Lead

    4 weeks ago


    Singapur, Singapore Infosys Singapore & Australia Full time

    We are looking for a highly experienced Subject Matter Expert (SME) in Data Management (FS) to join our team. The ideal candidate will have 12-15 years of experience in data governance, financial service data solutions, and data engineering. They will also have strong solution and delivery skills, as well as a view on business growth and managing...


  • Singapur, Singapore Consultz Full time

    Azure Data Platform Design and Implementation:Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions. Implement and optimize data storage, processing, and analytics solutions on Azure, leveraging services such as Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics.Infrastructure...

  • Software Engineer

    3 weeks ago


    Singapur, Singapore ZENDESK SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesJob SummaryZendesk is searching for a highly motivated Software Engineer to join our Messaging team based in our Singapore office. This team is dedicated to empowering our customers by delivering the best possible messaging experiences to their end users. The chosen candidate will play a vital role in enhancing our customer messaging...


  • Singapur, Singapore TikTok Full time

    About the team This role is a member of our Data Platform team focusing on Data products and solutions to enterprise services, leveraging TikTok's cutting-edge data infrastructure and data application. You will be helping enterprise customers to build their next generation data warehouse and data analytics, enabling them to do things that were not possible...


  • Singapur, Singapore TikTok Full time

    About the team The team is responsible for developing all of TTS South East Asia businesses - which will involve exciting projects covering user growth, homepage, discovery channel. You'll be tasked with creating a Global e-Commerce Shopping Platform, collaborating closely with engineers around the globe. ---Responsibilities1. Develop efficient, highly...


  • Singapur, Singapore TikTok Full time

    About the team The team is responsible for developing all of TTS South East Asia businesses - which will involve exciting projects covering user growth, homepage, discovery channel. You'll be tasked with creating a Global e-Commerce Shopping Platform, collaborating closely with engineers around the globe. ---Responsibilities1. Develop efficient, highly...

  • Senior Data Engineer

    3 weeks ago


    Singapur, Singapore Helius Full time

    Responsibilities Design and develop data pipelines and data infrastructure to support efficient and scalable data processing and analytics. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions. Implement and maintain data integration and ETL (Extract, Transform,...