Data Platform Engineer
1 week ago
**Responsibilities**:
As a key contributor to our team, you will help build a robust Data Platform that powers analytics and AI-driven solutions. Your responsibilities include:
- Building and maintaining **end-to-end data systems**using tools like Python, Scala, or similar.
- Designing, developing, and managing **data pipelines**for real-time decision-making, reporting, and data collection.
- Implementing processes to ensure **data quality, governance, and security.**:
- Developing **ETL/ELT processes**and working with structured, semi-structured, and unstructured data.
- Creating and optimizing **data models**and workflows to support data transformation and storage.
- Leveraging **cloud data technologies**and services, including Azure, for scalable and efficient data solutions.
- Collaborating with cross-functional teams to produce high-quality, well-tested, and secure code.
- Utilizing tools such as **Spark Streaming**, **Delta Tables**, and **Databricks**for handling large datasets.
- Managing diverse data stores, including data warehouses, RDBMS, and in-memory caches.
- Supporting **data-driven decision-making**with innovative solutions and advanced analytics.
**Qualifications**:
**Required Skills**:
- **Education**:BS/MS in Computer Science, Information Systems, Data Analytics, or equivalent experience.
- At least **2+ years of experience**in:Building pipelines and incorporating workflow tools into data system designs.
**ETL/ELT, Data Warehousing, or Business Intelligence Development.**
Leveraging **SQL**for data investigations and problem-solving.
Working with **cloud platforms**and services for data processing and storage.
Handling structured, semi-structured, and unstructured data across diverse storage systems.
- Hands-on experience with**:Large datasets**and tools like Databricks or PySpark.
Storage systems such as **Azure Data Lakes**or other cloud-native solutions.
**Spark Streaming**and creating Delta (Live) Tables.
- Strong background in **design, implementation, and testing**for scalable data solutions.
- Proficiency in developing for **continuous integration and automated deployments.**:
- Ability to work in a collaborative environment with excellent communication skills.
**Preferred Skills**:
- Experience with **microservices platforms**like Kubernetes, Docker, and Helm Charts.
- Familiarity with **event-driven streaming systems**(Kafka, Event Hub, Event Grid, Apache Flink).
- Knowledge of advanced tools such as **DBT**or **Data Vault**methodologies.
- Experience with **Microsoft Fabric**or administering **BI tools.**:
- Proficiency in additional programming languages like JavaScript, Java, or C#.
- Ability to guide and mentor other developers, providing technical leadership and expertise.
-
Platform and Data Engineer
2 days ago
Singapore Ensign InfoSecurity Full timeEnsign is hiring ! Reporting to Head, Platforms and Data Engineering, the Platforms and Data Engineer will work closely with Data Scientists, Threat/Malware Researchers, Project Managers and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and...
-
Data Engineer
4 days ago
Singapore DOZER DATA PTE. LTD. Full time**About the job**: This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data. This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers. **Responsibilities**: In...
-
Azure Data engineer
2 weeks ago
Singapore NTT Data Singapore Full timeJob Responsibilities: Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...
-
Singapore Airwallex Full timeAbout Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...
-
Data Engineer
1 week ago
Singapore TikTok Full timeResponsibilities TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Mumbai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us At TikTok, our people are humble, intelligent, compassionate and creative. We...
-
Data Platform Engineer
2 weeks ago
Singapore Trust Bank Singapore Limited Full timeTrust is the first of a new breed of banks in Singapore - digitally native and focused on delivering a delightful customer experience. You will work in a fast-paced and collaborative environment to solve new and interesting challenges each day. Together with our Trust team, you will help shape the future of our bank and be able to work on and solve many...
-
Data Platform Engineer
1 week ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$7,000 - S$14,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 2 years As an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure...
-
Data Engineer
2 days ago
Singapore Bayer Full time**Data Engineer APAC** The Data Engineer (RAD Platform) is responsible to design and deliver comprehensive technical data platforms providing reliable and consistent data to Bayer internal and external radiology customers. He/She will also focus on Deliver the ‘Deep Customer Knowledge’ platform to the business stakeholders including visualization of...
-
Associate Platform and Data Engineer
2 weeks ago
Singapore Ensign Services Full time $60,000 - $120,000 per yearEnsign is hiring
-
Big Data Engineer, Data Platform
4 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...