Lead Data Engineer

1 week ago


Singapore VANGUARD SOFTWARE PTE. LTD. Full time

**JOB SUMMARY**

**JOB DUTIES**
- Lead the design, development, and implementation of scalable and efficient data pipelines, databases, and data infrastructure.
- Mentor, coach, and guide a team of data engineers, providing technical leadership and support.
- Collaborate with data scientists, product managers, and business stakeholders to understand data requirements, facilitate data-driven decision-making, and deliver actionable insights.
- Optimize database schemas, tables, and queries to support data storage, retrieval, and analysis.
- Integrate and optimize analytical tools such as Tableau, Power BI, or Looker to enable advanced data analysis, visualization, and reporting capabilities.
- Develop and enforce data engineering best practices, standards, and guidelines to ensure the quality, performance, and reliability of our data solutions.
- Implement ETL processes to integrate data from various sources, ensuring data quality, consistency, and integrity.
- Optimize data pipelines, queries, and infrastructure for performance, scalability, and cost-efficiency.
- Monitor and troubleshoot data pipelines and infrastructure issues, and provide timely resolutions.
- Stay up-to-date with the latest data engineering technologies, analytical tools, and best practices, and drive their adoption within the team.
- Ensure data security, compliance with data governance and privacy regulations, and adherence to analytical tool licensing agreements.
- Work closely with cross-functional teams to identify data needs and requirements, and deliver data solutions that meet business objectives.
- Document data pipelines, processes, and best practices, and contribute to the development of data engineering documentation and standards.Stay up-to-date with the latest data engineering technologies, tools, and best practices, and recommend their adoption as appropriate.

**JOB REQUIREMENTS**
- Bachelor’s degree in Computer Science, Information Systems, or equivalent work experience.
- 8+ years of experience in data engineering, with at least 3 years in a lead or senior engineering role.
- Proven leadership skills with experience in mentoring, coaching, and guiding a team of data engineers.
- Strong technical background in designing and implementing data pipelines, databases, and analytical tools.
- Proficiency in programming languages commonly used in data engineering such as Python, Java.
- Hands-on experience with big data technologies and frameworks such as Hadoop, Spark, Kafka, and Hive.
- Hands-on experience with analytical tools such as Tableau, Power BI, Looker, or similar platforms.
- Solid understanding of relational and NoSQL databases, and experience with database design, optimization, and SQL querying.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
- Experience with real-time data processing and streaming technologies (e.g., Apache Flink, Kafka Streams).
- Excellent analytical and reasoning skills with an ability to anticipate outcomes of a solution.
- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
- Strong sense of responsibility, initiative, and commitment.
- Self-motivated, proactive, and able to work independently with mínimal supervision.
- Knowledge of data governance, data security, and compliance standards and best practices.
- Maintain confidentiality of information processed or prepared.
- Ability to lead, convince and inspire team members in a fast-paced environment.
- Willingness to travel to meet and work with offshore team members.
- Fluency in written and spoken English and Mandarin is highly desirable to liaise with Chinese speaking clients and counterparts.



  • Singapore NTT DATA Full time

    Requirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...

  • Data Engineer

    2 weeks ago


    Singapore DOZER DATA PTE. LTD. Full time

    **About the job**: This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data. This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers. **Responsibilities**: In...

  • Azure Data engineer

    12 hours ago


    Singapore NTT Data Singapore Full time $60,000 - $180,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...

  • DevSecOps Lead

    2 days ago


    Singapore NTT DATA Full time $120,000 - $200,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe DevSecOps...


  • Singapore Capgemini Full time $120,000 - $180,000 per year

    Job Description We are looking for an experienced Data Engineering Lead (Vendor) to support our platform modernization program. The resource will work with internal teams to migrate applications from Cloudera CDH to a Kubernetes-based global data platform and ensure timely delivery of high-quality data engineering solutions.Key ResponsibilitiesProvide...

  • Lead Data Engineer

    5 days ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    **Your Role**: As a **Lead Data Engineer**, you will spearhead the development and optimization of our data infrastructure to enable advanced analytics capabilities. Collaborating with cross-functional teams, you will ensure seamless integration and delivery of robust, scalable, and efficient data solutions. In this leadership role, you will mentor and guide...


  • Singapore NUS Information Technology Full time

    **Posting Start Date**:12/12/2024 About NUS ITWe drive a culture that is forward-looking. With a strong passion for IT, our people are always striving to improve, push boundaries and innovate with a "can-do" attitude. We embrace collaboration, open communication and knowledge sharing. If you see yourself thriving in a dynamic environment and breaking new...

  • Lead Data Engineer

    5 days ago


    Singapore JERA Global Markets Pte. Ltd. Full time

    COMPANY DESCRIPTION **About the Company** JERA Global Markets (JERAGM) is a leading utility-backed seaborne energy trader specialising in LNG, Coal and Freight with a platform to trade across all key markets worldwide. JERAGM is a joint venture between majority shareholder JERA Inc. (JERA) and EDF Trading. JERAGM operates one of the largest seaborne...

  • Lead Data Engineer

    6 days ago


    Singapore Hays Full time

    **Your new company** Your new role is a leading technology business looking for a Lead Data Engineer to join one of their business units focusing on multiple data projects. **Your new role** You will: - Partner with business users to understand and translate them into technical requirements - Design and build resilient and efficient data pipelines for both...

  • Data Engineer Lead

    2 weeks ago


    Singapore Unison Consulting Pte Ltd Full time

    5 years of experience in data management, data engineering, or data visualization. Experience with Python, AWS, Glue, spark, redshift, Lambda, S3 and strong Sql (DWH). Excellent with AWS side of data engineering. Amazon S3 for storage, AWS Glue for ETL, Amazon Redshift for data warehousing, Amazon Kinesis for real-time data processing, and AWS Lambda for...