Data Engineering Team Lead

2 weeks ago

Singapore DKatalis Full time

**Job specification**:
We are seeking a hands-on team lead for our data solutions or business delivery data team encompassing data engineers, data analysts and data scientists. The role will involve leading team members to deliver business critical data workloads with a focus on serving the needs of primarily internal consumers from areas such as growth, customer engagement, business performance management, risk, fraud, AML and compliance as well as external stakeholders such as those from our partner Gojek. The team will work alongside the data infrastructure and machine learning infrastructure teams to leverage tooling created by these teams to accelerate and scale delivery in a fast paced environment.

The individual will also need to be able to work with technical leadership to make well informed architectural choices when required. A high degree of empathy is required for the needs of the downstream consumers of the data artefacts produced by the data team, i.e. the software engineers, data scientists, business intelligence analysts, etc and the individual needs to be able to produce transparent and easily navigable data pipelines. Value should be assigned to consistently producing high quality metadata to support discoverability and consistency of calculation and interpretation.

**At a high-level, responsibilities will extend to**:

- Empowering the team to build and optimize key ETL pipelines on both batch and streaming data
- Working with data scientists to create models to both embed within the product and operational fabric of the organisation as well as to inform planning decisions
- Ensuring data quality is high by maintaining our data quality framework as well as ensuring thorough test coverage of code in an automated fashion
- Ensuring data governance tooling is implemented and policies thereby adhered to
- Collaborating with data security team members
- Helping overhaul systems not configured for massive scale while maintaining business continuity

**On a day to day basis, responsibilities include**:

- Working with the data product owner to groom the backlog and assign work to team members
- Reviewing pull/merge requests in order to conduct code quality checks
- Handling the deployment lifecycle
- Collaborating with the team and various stakeholders to identify technical problems, design solutions for them and help implement where required. This involves collaborating with both technical and non-technical staff
- Assisting in growing the team in terms of quality and quantity
- Taking responsibility for upskilling team members

**Experience with the following is required**:

- Ideally GCP, but strong experience in another platform such as AWS or Azure will suffice
- Scala and Python
- Visualisation tools such as Google Data Studio, Tableau, Power BI, etc
- Workflow scheduler such as Apache Airflow
- Cloud data warehouses such as BigQuery, Redshift or Snowflake
- Event streaming platforms such as Kafka
- Writing detailed design documents and holding design meetings

**Experience with the following is desired, but not required**:

- CDC technology such as Debezium
- Stream analytics frameworks such as Flink, Spark, GCP Dataflow, etc
- Kubernetes
- Infrastructure as Code tools such as Terraform

  • Data Engineering Team Lead

    1 day ago

    Singapore ETHOS SEARCH ASSOCIATES PTE. LTD. Full time

    **Scope of Work** - Lead the data engineering team - Design and build resilient and efficient data pipelines for both batch and real-time streaming data - Architecture and design of data infrastructure on cloud by leveraging on Infrastructure-as-Code tools - Be a practitioner of Agile methodology - Develop software frameworks to solve data problems at...

  • Lead Data Scientist

    7 days ago

    Singapore Data Analytics Full time

    Get to Know the Team At Grab, the Market Insights team drives impactful data-driven decisions by uncovering insights about the region's users, merchants, and driver partners. By analysing vast datasets across transactional and behavioural activities, we bridge the gap between raw data science capabilities and actionable business strategies. Our work is...

  • Dataset Team Lead

    5 days ago

    Singapore PitchBook Data Full time

    At PitchBook, we are always looking forward. We continue to innovate, evolve, and invest in ourselves to bring out the best in everyone. We're deeply collaborative and thrive on the excitement, energy, and fun that reverberates throughout the company. Our extensive learning programs and mentorship opportunities help us create a culture of curiosity that...

  • Data Engineer

    3 days ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...

  • (Entry/senior/lead) Data Engineer

    1 day ago

    Singapore ABOITIZ DATA INNOVATION PTE. LTD. Full time

    **Job Overview** Aboitiz Data Innovation (ADI) is one of the leading up and coming start-ups in the field of Data Science and Artificial Intelligence. We believe data can drive change for a better world by advancing businesses across industries and communities. We are seeking talented (Entry/Senior/Lead) Data Engineers who are passionate about defining and...

  • Asia Data Visualization Team Leader

    1 week ago

    Singapore Data X Full time

    Asia Data Visualization Team Leader - Singapore Location Business Area News and Media Ref # Description & Requirements Bloomberg News is one of the biggest financial and business news organizations in the world. We lead the way in breaking news and providing analysis on financial markets, from intraday coverage through in-depth features. We are...

  • Data Engineer

    2 weeks ago

    Singapore DOZER DATA PTE. LTD. Full time

    **About the job**: This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data. This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers. **Responsibilities**: In...

  • Lead Engineer/Engineer, AI

    1 week ago

    Singapore HTX (Home Team Science & Technology Agency) Full time

    Join to apply for the Lead Engineer/Engineer, AI & Data Engineering, xData role at HTX (Home Team Science & Technology Agency)Join to apply for the Lead Engineer/Engineer, AI & Data Engineering, xData role at HTX (Home Team Science & Technology Agency)Get AI-powered advice on this job and more exclusive features. The Home Team Science and Technology Agency...

  • Lead Data Engineer

    1 week ago

    Singapore UARROW PTE. LTD. Full time

    Key Responsibilities: - Lead the design and implementation of large-scale data processing systems using Spark and Scala. - Architect, develop, and optimize data pipelines for efficient data transformation, aggregation, and processing of large datasets. - Work with cross-functional teams to define data engineering solutions that meet business and operational...

  • Data Engineer(Cloud Migration)

    2 weeks ago

    Singapore NTT DATA Full time

    Requirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...