Data Engineer Lead

2 weeks ago


Singapore AMPOL MANAGEMENT SERVICES PTE. LTD. Full time

About Ampol Trading & Shipping

Our purpose at Ampol is to power better journeys today and tomorrow. Our Trading and Shipping team is key to achieving this, not only supplying our customer’s needs today, but evolving as the energy transition takes place to supply our customers well into the future.

We take pride in our people and value innovation, sustainability, and customer satisfaction. If you’re a professional committed to excellence, Ampol is looking for you.

About the role

This position will be responsible for working with large and disparate data sets, internal and external, quantitative, and qualitative, structured and unstructured to support the management of data across the entire data lifecycle. This role requires a combination of technical expertise, leadership skills and strong focus on data governance practices to ensure the successful delivery of the Data Product Roadmap.

The data engineer brings expert understanding of data and modern data processing technologies to prepare and deliver data assets which support high priority projects.

This position is a part of theData Product Team, which is responsible to delivering on the prioritised T&S Data roadmap to meet strategic objectives. aligned to the Trading & Shipping organisation.

Key responsibilities
- Working with the key stakeholders to define data requirements for projects
- Perform data acquisition/ingestion from internal and external sources, including both structured and unstructured data sources (incl. multi-dimension data, text/documents, geospatial data and graph)
- Performing descriptive analytics and data visualisation to share data insights or validate data with stakeholders. Prepare data quality reports
- Develop data transformations and modelling to prepare data sets for consumption for various end uses including reporting or advanced analytics.
- Develop and maintain productionised data outputs/products to support ongoing uses
- Working in a highly agile and flexible environment to deliver outputs in short time frames
- Document technical specifications of data pipelines and technical products delivered
- Develop working understanding of Ampol systems, data, and uses, as a data SME
- Data Strategy and Planning
- Continuously develop and enhance Ampol data strategy and architecture and roadmap to ensure alignment to business requirements and overall company vision.
- Data Exploration and Analysis
- Explore data to identify patterns, trends and insights. Perform quantitative and qualitative analysis to answer specific business questions and to gain a deeper understanding of data.
- Data Pipeline Development
- Build and maintain data pipelines to move and transform data from various sources into Snowflake with assurance that data ingestion is reliable, scalable and optimized for performance.
- Data Modelling and Design
- With requirements from business, design and implement data models within Snowflake, including schema design, table structures and data partitioning to support high performance, low latency querying and analytics.
- Data Quality and Integrity
- Enforce data quality checks and validation during data ingestion process to ensure accuracy and integrity of data in Snowflake.
- Support Continuous Improvement in Data Product
- Support the Commercial Analytics in advancing continuous improvement in the data space, including team engagement to generate awareness of initiatives and track progress.
- Monitoring and Maintenance
- Proactively monitor data pipelines and the overall health of Snowflake data infrastructure to identify and resolve issues.
- Automation and Orchestration
- Automate data workflows and orchestrate data processes to minimize manual intervention and improve operational efficiency.
- Collaboration with Data Users
- Work closely with data analysts, data engineers, and business users to understand their data requirements and provide necessary data support.

Capabilities
- Big Data Engineering - familiarity in designing and developing data processes on cloud based big data platforms
- Data Quality - experience in managing data quality controls to support the completeness and accuracy of data
- Strong understanding of data structures and designing conceptual, logical and physical data models
- Understanding of Information Management, Data Governance, Data Security and Privacy concepts (covered by respective Ampol policies)

Qualifications & experience
- Tertiary qualifications in Computer Science or similar.
- Qualifications or experience in mathematics or statistics highly regarded
- 2+ years of industry experience working as a data engineer to develop data products using SQL, Python, and Spark
- Data modelling experience including ETL
- Data quality management
- Experience with a range of Data platforms (Hadoop, Spark, SQL Databases)
- Experience performing descriptive analytics and developing data visualisation (Power BI, Tableau, Shiny, etc)
- Experience working to support advanced analytics product



  • Singapore NTT DATA Singapore PTE Ltd Full time

    Job Description - About Us - Roles and Responsibility **Job scopes**: - The Data Engineer will lead the enterprise-wide data transformations projects. The person will involve in developing and automating data processing pipelines for financial and Investment data modelling, analysis, and reporting from various data sources systems; The primary...


  • Singapore NTT DATA Full time

    Requirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...

  • Data Engineer

    1 week ago


    Singapore DOZER DATA PTE. LTD. Full time

    **About the job**: This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data. This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers. **Responsibilities**: In...


  • Singapore KEPPEL DATA CENTRES HOLDING PTE. LTD. Full time

    We are seeking an experienced Cybersecurity Solutions Developer to join our team. In this role, you will have the opportunity to apply your knowledge of data science languages like Python, R, and SQL to engineering or business problems during software development and integration.

  • Lead Data Engineer

    1 week ago


    Singapore GoTo Group Full time

    About The JobTechnical Leadership RoleThis is a unique opportunity to lead our data engineering efforts as a Lead Data Engineer. You will design and implement scalable data services and pipelines, as well as manage data engineering infrastructure.Liaising with stakeholders, managing team members, and ensuring that data engineering and machine learning...

  • Lead Data Engineer

    6 days ago


    Singapore UARROW PTE. LTD. Full time

    Key Responsibilities: - Lead the design and implementation of large-scale data processing systems using Spark and Scala. - Architect, develop, and optimize data pipelines for efficient data transformation, aggregation, and processing of large datasets. - Work with cross-functional teams to define data engineering solutions that meet business and operational...


  • Singapore OX CONSULTANCY PTE. LTD. Full time

    Engineering Lead for DataOX CONSULTANCY PTE. LTD. is seeking an experienced Engineering Lead for Data to join our team. In this role, you will lead the design and implementation of our data infrastructure, leveraging your expertise in Snowflake and data engineering best practices.Responsibilities:Develop and maintain large-scale data pipelines using...

  • Data Engineer

    3 weeks ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...

  • Lead Data Engineer

    3 days ago


    Singapore VANGUARD SOFTWARE PTE. LTD. Full time

    Roles & ResponsibilitiesJOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data...


  • Singapore R Systems (Singapore) Pte Ltd Full time

    At least 3 full end to end project delivery experience in last 5+ years as Senior Data engineer as mentioned in the Qualifications and Job descriptions section above. - Have lead, at least 2 full projects as senior or lead data engineer - Familiarity with agile and DevOps principles, test-driven development, continuous integration, and other Software...


  • Singapore Evolution Recruitment Solutions PTE. LTD. Full time

    Evolution Recruitment Solutions PTE. LTD. is seeking a highly skilled Data Engineering Lead to join our team.This role will involve leading the development and production deployment of enterprise-level analytic data products, determining appropriate design strategies and methodologies.You will be responsible for finding creative solutions to challenging...


  • Singapore Manpower Singapore Full time

    Join us at Manpower Singapore as a Data Engineering Lead where you will oversee the design, development, and maintenance of our large-scale data platforms.In this senior-level position, you will lead a team of engineers to ensure the smooth operation of our big data systems.Responsibilities:Oversee the installation, monitoring, and operation of big data...


  • Singapore The Chemical Engineer Full time

    The Chemical Engineer has an exciting opportunity for a Chemical Process Optimization Engineer to join their team in Singapore. This is a challenging role that requires a strong understanding of chemical processes and a passion for optimization.Key Responsibilities:• Develop and refine process formulations, methods, and controls to meet high-quality...

  • Lead Data Engineer

    7 days ago


    Singapore VANGUARD SOFTWARE PTE. LTD. Full time

    **JOB SUMMARY** **JOB DUTIES** - Lead the design, development, and implementation of scalable and efficient data pipelines, databases, and data infrastructure. - Mentor, coach, and guide a team of data engineers, providing technical leadership and support. - Collaborate with data scientists, product managers, and business stakeholders to understand data...

  • Lead Data Engineer

    3 days ago


    Singapore Hays Full time

    **Your new company** Your new role is a leading technology business looking for a Lead Data Engineer to join one of their business units focusing on multiple data projects. **Your new role** You will: - Partner with business users to understand and translate them into technical requirements - Design and build resilient and efficient data pipelines for both...

  • Lead Data Engineer

    17 hours ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    **Your Role**: As a **Lead Data Engineer**, you will spearhead the development and optimization of our data infrastructure to enable advanced analytics capabilities. Collaborating with cross-functional teams, you will ensure seamless integration and delivery of robust, scalable, and efficient data solutions. In this leadership role, you will mentor and guide...

  • Lead Data Engineer

    16 hours ago


    Singapore JERA Global Markets Pte. Ltd. Full time

    COMPANY DESCRIPTION **About the Company** JERA Global Markets (JERAGM) is a leading utility-backed seaborne energy trader specialising in LNG, Coal and Freight with a platform to trade across all key markets worldwide. JERAGM is a joint venture between majority shareholder JERA Inc. (JERA) and EDF Trading. JERAGM operates one of the largest seaborne...

  • Lead Data Engineer

    2 weeks ago


    Singapore Hays Full time

    **Your new company** Your new company is a leading retail player with a regional presence, and is looking to grow their Data team due to expansion. This new position has been created to allow business users to adopt more data-driven decisions within the Singapore office and APAC regions. **Your new role** You will: - Lead data engineering strategy and...


  • Singapore The Chemical Engineer Full time

    Pfizer Singapore is recruiting a Production Engineering Expert to support the expansion of their manufacturing site. In this role, you will develop and refine process formulations, methods, and controls to meet high-quality standards.Key Responsibilities:• Develop and refine process formulations, methods, and controls to meet high-quality standards.•...


  • Singapore This is an IT support group Full time

    Dynamite Games is seeking a highly skilled IT Manager to lead our corporate IT initiatives and data engineering efforts. In this role, you will be responsible for managing financial and operational data processing, ensuring the stability and security of our IT systems, and collaborating with cross-functional teams.Responsibilities:Lead the development and...