Data Engineer, Xdata Fixed Terms Closing Today

Description What the role is: HTX is the world's first Science and Technology agency that integrates a diverse range of scientific and engineering capabilities to innovate and deliver transformative and operationally ready solutions for homeland security. As a statutory board of the Ministry of Home Affairs and integral to the Home Team, HTX works at the forefront of science and technology to empower Singapore's frontline of security. Our shared mission is to amplify, augment and accelerate the Home Team's advantage and secure Singapore as the safest place on planet earth. The jobholder will be part of the Data Engineering for xData within the Enterprise Group. The team is dedicated to building robust systems that support critical operations which team thrives on innovation, collaboration, and the relentless pursuit of excellence. As the Lead Data Engineer at xData, you will be at the forefront of designing, developing, and optimizing data architectures and pipelines that support AI and machine learning projects. You will lead/learn a team of data engineers, ensuring the effective integration, processing, and management of data from various sources. Your role is crucial for enabling the development of solutions that can handle complex, confidential, and large-scale datasets. We are looking for highly technical individuals who are passionate about tech, love to solve problems, must be able to code and have a sound engineering mind. The ideal candidate is one who dares to innovate, takes ownership, a great team player, inspires excellence, is a skilled learner and one who embraces failures. What you will be working on: Work with external agencies and/or Home Team Departments (HTDs) to bring in the necessary data through proper technical interface agreements. Build and manage data ingestion and processing pipelines to collect, clean, harmonise, merge and consolidate data sources for analysis, machine learning and visualisation purposes. Build scalable and data-driven products and assist with data-related technical issues. Participate in the application of machine learning/AI techniques to various problem statements. Keep abreast of technological advances in Big Data Technologies, database designs & architecture and government policies & recommendations. What we are looking for: Bachelor's / Master's degree in STEM disciplines. Applicants with system architecture design and product deployment experience will be considered for more senior positions. Strong understanding in one or more of the following areas. Proficiency in the following technologies:- Database design and operations (e.g., SQL, NoSQL) Big Data technologies (e.g., Apache Hadoop, Spark, Kafka) ETL and orchestration tools (e.g., Apache NiFi, Talend, Airflow) Cloud technologies (e.g., AWS, Google Cloud, Microsoft Azure) Version Control (e.g., Git, GitHub, GitLab) Knowledge on data repository concepts (e.g., Data Mart, Data Warehouse, Data Lake) Data modelling and schema design Familiar with one or more of these languages: Python, Scala and Java Understand clean code practices and application of appropriate software design pattern **** All new hires are appointed on a two-year contract in the first instance and will be assessed and considered for permanent tenure over time, based on performance. As part of the shortlisting process for this role, you may be required to complete a medical declaration and/or undergo further assessment. All applicants will be updated on the status of their applications within 4 weeks upon closing of the advertisement. About Home Team Science and Technology Agency (HTX)HTX is the world's first Science and Technology agency that integrates a diverse range of scientific and engineering capabilities to innovate and deliver transformative and operationally-ready solutions for homeland security. As a statutory board of the Ministry of Home Affairs and integral to the Home Team, HTX works at the forefront of science and technology to empower Singapore's frontline of security. Our shared mission is to amplify, augment and accelerate the Home Team's advantage and secure Singapore as the safest place on planet earth. #J-18808-Ljbffr Industry Other Category IT & Technology Sub Category Software Architecture & Engineering