Data Platform Engineer

3 days ago


Singapore ALAN PARTNERS SG PTE. LTD. Full time

**Responsibilities**:
As a key contributor to our team, you will help build a robust Data Platform that powers analytics and AI-driven solutions. Your responsibilities include:

- Building and maintaining **end-to-end data systems**using tools like Python, Scala, or similar.
- Designing, developing, and managing **data pipelines**for real-time decision-making, reporting, and data collection.
- Implementing processes to ensure **data quality, governance, and security.**:

- Developing **ETL/ELT processes**and working with structured, semi-structured, and unstructured data.
- Creating and optimizing **data models**and workflows to support data transformation and storage.
- Leveraging **cloud data technologies**and services, including Azure, for scalable and efficient data solutions.
- Collaborating with cross-functional teams to produce high-quality, well-tested, and secure code.
- Utilizing tools such as **Spark Streaming**, **Delta Tables**, and **Databricks**for handling large datasets.
- Managing diverse data stores, including data warehouses, RDBMS, and in-memory caches.
- Supporting **data-driven decision-making**with innovative solutions and advanced analytics.

**Qualifications**:
**Required Skills**:

- **Education**:BS/MS in Computer Science, Information Systems, Data Analytics, or equivalent experience.
- At least **2+ years of experience**in:Building pipelines and incorporating workflow tools into data system designs.
**ETL/ELT, Data Warehousing, or Business Intelligence Development.**
Leveraging **SQL**for data investigations and problem-solving.
Working with **cloud platforms**and services for data processing and storage.
Handling structured, semi-structured, and unstructured data across diverse storage systems.
- Hands-on experience with**:Large datasets**and tools like Databricks or PySpark.
Storage systems such as **Azure Data Lakes**or other cloud-native solutions.
**Spark Streaming**and creating Delta (Live) Tables.
- Strong background in **design, implementation, and testing**for scalable data solutions.
- Proficiency in developing for **continuous integration and automated deployments.**:

- Ability to work in a collaborative environment with excellent communication skills.

**Preferred Skills**:

- Experience with **microservices platforms**like Kubernetes, Docker, and Helm Charts.
- Familiarity with **event-driven streaming systems**(Kafka, Event Hub, Event Grid, Apache Flink).
- Knowledge of advanced tools such as **DBT**or **Data Vault**methodologies.
- Experience with **Microsoft Fabric**or administering **BI tools.**:

- Proficiency in additional programming languages like JavaScript, Java, or C#.
- Ability to guide and mentor other developers, providing technical leadership and expertise.



  • Singapore GIC Investment Full time

    Location: Singapore, SG Job Function: Data & Technology **Job Type**: Permanent Req ID: 14641 **Data Strategy Group** The Data Strategy Group (DSG) harnesses and leverages GIC’s most valuable asset - Data - to drive insights, results and solve real business challenges. We ingest, analyse, and combine data with context across all industries and asset...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$7,000 - S$8,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake Oracle Shell Script Shell Java MSSQL Linux Python **COMPANY DESCRIPTION** Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the...


  • Singapore Trust Bank Singapore Limited Full time

    Trust is the first of a new breed of banks in Singapore - digitally native and focused on delivering a delightful customer experience. You will work in a fast-paced and collaborative environment to solve new and interesting challenges each day. Together with our Trust team, you will help shape the future of our bank and be able to work on and solve many...

  • Data Engineer

    3 days ago


    Singapore TikTok Full time

    Responsibilities TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Mumbai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us At TikTok, our people are humble, intelligent, compassionate and creative. We...


  • Singapore NodeFlair Full time

    **Job Summary**: **Job Type** **Seniority** **Years of Experience** Information not provided As an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure seamless integration with other IT...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$7,000 - S$14,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 2 years As an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure...


  • Singapore Nityo Infotech Full time

    Nityo Infotech is looking for a highly skilled Data Platform Engineer to design and implement scalable big data platforms using Hadoop Clusters, Elastic Search, Spark, Kafka, and Hive.The successful candidate will have strong knowledge of big data ecosystems, including Hadoop, HDFS, YARN, Hive, HBase, Spark, Kafka, and Elastic Search. Proficiency in...


  • Singapore Amaris Consulting Full time

    **Who are we?**:**Amaris Consulting** is an independent technology consulting firm providing guidance and solutions to businesses. With more than 1,000 clients across the globe, we have been rolling out solutions in major projects for over a decade - this is made possible by an international team of 7,600 people spread across 5 continents and more than 60...


  • Singapore amaris Full time

    Job description ABOUT THE JOB Work closely with the data product team and business end-users to implement and support data platforms using best-of-breed technology and methodology. Collaborate with product vendors to design, deploy, and integrate different data platforms within the organization’s ecosystem. Ensure that deployed platforms follow IT security...


  • Singapore minden Full time

    At Minden, our culture is built on teamwork and collaboration. We believe in continuous learning to drive positive change in the industry. Our mission is to redefine engagement between brands and consumers in Southeast Asia.Job DescriptionWe are seeking a Senior Data Engineer to contribute to the design and implementation of a scalable and reliable data...


  • Singapore Ensign InfoSecurity Full time

    Ensign is hiring ! Reporting to the Director of Platforms and Data Engineering, the Senior Platform and Data Engineer will work closely with Data Scientists, Threat Researchers/Analysts and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and...


  • Singapore ITCAN PTE. LIMITED Full time

    About the RoleWe are seeking a highly skilled Cloud Data Platform Engineer to join our team. The successful candidate will be responsible for designing and implementing scalable data integration patterns and implementing data mesh architectures.Key Responsibilities:Design and implement data governance frameworks including data lineage, metadata management,...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,000 - S$11,300 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 6 years **Tech Stacks** Container Docker play Analytics Windows Server Microsoft IIS Tomcat Apache Azure Java Spark Linux Kubernetes Scala Hadoop Python As a member of Team Central Provident Fund (CPF), you will play a crucial...

  • Data Engineer

    7 days ago


    Singapore TRIVI DATA CONSULTING PTE. LTD. Full time

    Key Responsibilities - Design, implement, and maintain ETL workflows for managing large-scale datasets. - Develop cloud-based data pipelines (AWS, Azure) for scalable and real-time analytics delivery. - Optimize data models to ensure high performance and reliable reporting. - Create advanced dashboards and visualizations using tools like Qlik Sense and...


  • Singapore ENSIGN INFOSECURITY (CYBERSECURITY) PTE. LTD. Full time

    **Responsibilities**: - Lead the design, development, testing, deployment of efficient and reliable big data processing workflows that follow secure SDLC practices - Design, develop, manage data warehouse architecture and relational databases - Provide monitoring, maintenance and support for system operations as part of M&S as required in commercial...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,000 - S$8,500 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Docker Go Cloudera HDFS Shell Java Spark Linux Kubernetes Flink Ansible Hadoop Python openstack Zenith Infotech (s) is a Tech Recruitmetn firm with 27 years of history locally and more than 15 years in...


  • Singapore Adecco Personnel Pte Ltd. Full time

    Adecco Personnel Pte Ltd. - Trusted Provider of Homeland Security SolutionsWe are seeking an experienced Data Platform Engineer to join our team. As a trusted provider of homeland security solutions, we offer secure and reliable technologies. With extensive expertise and industry recognition, we deliver comprehensive services from design and development to...


  • Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    Roles & ResponsibilitiesResponsibilities• Oversee day-to-day operations of big data platform to ensure high availability, reliability and performance.• Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health• Manage configuration, upgrades, and...


  • Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesBig Data Platform Engineer6 years of experience in building or designing large-scale, fault-tolerant, distributed systems, (for example: data lakes, delta lakes, data meshes, data lake houses, data platforms, data streaming solutions…) In-depth knowledge and experience in one or more large scale distributed technologies including...