Big Data Architect

Plan, design, implement, deliver, and maintain big data platforms to support the organization's data infrastructure needs. - Develop real-time and offline data collection, calculation, storage, and processing solutions using advanced data technologies while ensuring adherence to standards and metrics. - Establish standardized data services within the data...

Key Competencies • Define reusable design patterns e.g. data movement (in/outbound) processes, data validation, data load & extraction processes etc.• Create re-usable connections to different targets (DB/Hadoop etc.)• Setup metadata repository for connections, schemas and contexts to be used across jobs• Define / Develop foundational components -...

Develop data processing pipelines for ingestion, modelling, analysis, mining and reporting with Enterprise Big Data Lake - Responsible for the code writing of the core module of the system - Develop POC and build data pipeline architecture using of the overall technical framework of the software - Work closely with teams ensure timely delivery of...

About the RoleWe are seeking a Databricks Architect to play a pivotal role in shaping and delivering enterprise-level data architecture and scalable solutions that support business-critical operations. This position offers the opportunity to work on innovative data initiatives and contribute to the development of cloud-native architectures for a diverse...

DFS Group is the world’s leading luxury travel retailer. Established in Hong Kong in 1960, DFS Group continues to be a pioneer in global luxury travel retail, offering its customers a carefully curated selection of exceptional products from over 750 of the most desired brands. Its network consists of 54 duty free stores located in 13 major global airports...

We are looking for a highly experienced and skilled Data Architect to join our team. The ideal candidate will have 12-15 years of experience in architecting solutions of data engineering, focusing on ELT and PySpark/Hadoop workloads. In addition to strong solution and delivery skills, the ideal candidate will also have a view on business growth and managing...

**Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...

Responsibilities Provide consulting service to the key customers of Singdata Lakehouse. Work with local sales team to ensure that our products can meet the customer’s business needs. Solution and reference build-up and reproduce, develop technical expertise and deliver cloud based Bigdata solutions. Knowledge sharing with customers and partners, for...

8+ years of specific technology domain areas (e.g. software development, cloud computing, systems engineering, infrastructure, security, networking, data & analytics) experience - 10+ years of IT development or implementation/consulting in the software or Internet industries experience Are you passionate about building Big Data analytics solutions? Amazon...

**Overview**: **Key Responsibilities**: - Design, develop, and optimize scalable data processing systems leveraging Hadoop, Flink, and other Big Data technologies. - Build and manage robust data pipelines for data ingestion, transformation, and analysis. - Create and implement efficient data models to support effective data storage and retrieval. -...