Lead Engineer/ Engineer, Data Platform

What the role is: The Home Team Science and Technology Agency (HTX) is a statutory board under the Ministry of Home Affairs (MHA), which aims to pioneer innovative solutions and develop world‐class science and technology capabilities to transform and empower the Home Team in delivering safety and security for Singapore. The HTxAI movement is aligned with Singapore's National AI Strategy to position Singapore as a global leader in AI by 2030. As part of its AI strategy, the HTxAI movement will leverage partnerships and collaborations with industry and academia to strengthen HTX's internal AI capabilities and advance its AI research and development (R&D). As an Engineer, Data Platform & Engineering, you will play a critical role in developing and managing data pipelines, engineering data infrastructure, that supports AI model development and deployment, ensuring data governance, quality and security. This position requires a strong foundation in data engineering and data architecture, with a passion for solving complex data challenges. What you will be working on: Objective: Design, develop and manage data pipelines and data architectures to enable seamless ETL and ELT processes, ensuring data flows efficiently between Home Team Departments (HTD), Whole Of Government (WOG), and Next Generation Infrastructure (NGINE) to support AI use cases and products. Design, build and deploy data platform using tools (e.g. React web framework, S3 API‐compatible object store i.e. MinIO) that will support AI initiatives e.g. model training, streaming data for real‐time inferencing/training. Design, build, and maintain data pipelines using ETL and orchestration tools (e.g., Apache Spark, Talend, Apache Airflow) and data processing frameworks (e.g., Spark) to streamline data ingestion, transformation, and loading. Implement workflows to operationalize data processes within HTD, enabling real‐time and batch data operations. Ensure high data availability, reliability, and integrity by leveraging SQL and programming languages such as Python and Java. What we are looking for: Education Bachelor's/Master's degree in Computer Science, Data Engineering, Information Systems, or related fields. Experience Minimum 3 years of professional experience as a data engineer or in a related field. Hands‐on experience with ETL and orchestration tools (e.g., Apache Spark, Talend, Apache Airflow) and big data ecosystems/platforms (e.g., Hadoop, Databricks). Proven experience in designing and implementing a data platform and working with data lakes. Strong programming skills in Python, Java, and SQL. Experience with cloud platforms (e.g., AWS, Azure, GCP) and modern data stack tools. Technical Skills Proficiency in data modelling, pipeline orchestration, and data pipeline performance optimization. Proficiency in Kubernetes, Terraform and Ansible. Familiarity with data governance frameworks and data cataloguing tools. Knowledge of AI/ML integration with data platforms is a strong advantage. Knowledge of React web frameworks e.g. Next.js is a strong advantage. Key Competencies Strong analytical and problem‐solving skills with attention to detail. Excellent communication skills to engage with technical and non‐technical stakeholders. Ability to work collaboratively in a dynamic and fast‐paced environment. All new hires are appointed on a two‐year contract in the first instance and will be assessed and considered for permanent tenure over time, based on performance. As part of the shortlisting process for this role, you may be required to complete a medical declaration and/or undergo further assessment. All applicants will be updated on the status of their applications within 4 weeks upon closing of the advertisement. About Home Team Science and Technology Agency (HTX)HTX is the world's first Science and Technology agency that integrates a diverse range of scientific and engineering capabilities to innovate and deliver transformative and operationally‐ready solutions for homeland security. As a statutory board of the Ministry of Home Affairs and integral to the Home Team, HTX works at the forefront of science and technology to empower Singapore's frontline of security. Our shared mission is to amplify, augment and accelerate the Home Team's advantage and secure Singapore as the safest place on planet earth. #J-18808-Ljbffr