Senior Data Engineer

3 weeks ago


Singapore ONE CONSULTING (GLOBAL) PTE. LTD. Full time
Roles & Responsibilities

Summary

The Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other digital use cases.


Job Requirements:

  • Design, develop, and maintain robust, scalable and sustainable data products and build & optimize data pipeline and infrastructure.
  • Collaborate with stakeholders to understand their data requirements and translate them into technical solutions.
  • Identify and implement data quality monitoring and validation processes to ensure data integrity.
  • Implement data quality frameworks and ensure data governance best practices including data lineage, data documentation and data security.
  • Build out the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using Synapse, ADF, Spark, Kafka or similar technologies.
  • Work closely with Data Analysts and Data Architect to support their data needs and enable advanced analytics and machine learning initiatives.
  • Contribute to the development of the organization's data strategy including evaluating new technologies, tools, and frameworks to enhance the data engineering ecosystem.

Educational Qualification & Experience:

  • Degree in Computer Science, Computer Engineering, Electrical Engineering or related technical field
  • Min 4- 8 years of IT experience preferably in field of data engineering
  • 4+ years’ experience with Azure services including IAM, Synapse, DataLake, SQL Server, ADF etc.
  • 2+ years’ experience in creating and deploying docker containers on Kubernetes.
  • 2+ years’ experience in supporting development teams on Kubernetes best practices, troubleshooting and performance optimization.
  • 2+ years’ experience with CI/CD pipelines toll such as Jenkins and GitHub Actions
  • 2+ years’ experience with Synapse data warehousing and data lake solutions
  • Strong programming skill in Python, PySpark and SQL
  • 4+ years of experience in scripting and automation using languages such as Bash, Python or Go
  • 2+ years of experience with infrastructure-as-code tools such as Terraform, Ansible or CloudFormation and containerization technologies (e.g., Docker, Kubernetes).
  • Knowledge of Agile methodologies and software development lifecycle processes
  • Proven experience in designing and implementing large-scale data solutions including data pipelines and ETL processes on Azure.

Required Knowledge:

  • Troubleshoot and resolve data-related issues, performance bottlenecks, and scalability challenges on Azure
  • Solid understanding of DevOps principles and experience with infrastructure automation using tools like Terraform or CloudFormation.
  • Hands-on experience with cloud platforms - Azure, and related services (e.g Synapse, Data Lake, etc.).
  • Understandings of data warehousing concepts and best practices
  • Work closely with stakeholders to understand business requirements and translate them into data solution designs.
  • Strong understanding of data architecture principles, data modelling techniques and data integration patterns.

Interested applicants, please send your resume to: rachel@oneconsulting-global.sg

EA Personnel R1109773

Agency no 07C3676


Tell employers what skills you have

Machine Learning
PySpark
Scalability
Kubernetes
Azure
Pipelines
Agile
Scripting
ETL
Data Integration
Data Quality
Data Governance
Data Engineering
SQL
Python
Data Architecture
Docker
Data Warehousing

  • Singapore Bridge Data Centres (international) Pte. Ltd. Full time

    Key Responsibilities:. Conduct in-depth design reviews and oversee the commissioning/Integrated Systems Testing (IST) processes for new data centre projects, as well as modifications and expansions to existing data centres. Enhance and standardize data centre operation and maintenance policies and procedures to ensure efficiency and compliance. Perform...

  • Senior Data Engineer

    3 weeks ago


    Singapore Airswift Full time

    Airswift is inviting an experienced Senior Data Engineerto work on large scale high value projects in the oil and gas marine industry. The Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other...

  • Data Engineer

    3 weeks ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates, please email your resume to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits: Renewable contract (Performance-based, with possibility of conversion to...

  • Data Engineer

    3 weeks ago


    Singapore Ntt Data Singapore Pte. Ltd. Full time

    ' EMAIL ID : Interested candidates, please email your resume to [HIDDEN TEXT]Only shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits:Renewable contract (Performance-based, with possibility of conversion to perm)Medical Insurance CoverageLeave...

  • Senior Data Engineer

    3 weeks ago


    Singapore MINDEN INTERNATIONAL PTE. LTD. Full time

    Roles & ResponsibilitiesWho we are:minden.ai is a technology venture founded by Temasek in strategic partnership with DFI Retail Group and coalition partners BreadTalk Group, DBS Bank, PAssion Card, Mandai Wildlife Group, Singtel, FoodPanda, GoJek and Great Eastern. We are on a mission to redefine the engagement between brands and consumers in Southeast...

  • Senior Data Engineer

    4 weeks ago


    Singapore Minden International Pte. Ltd. Full time

    Who we are:minden.ai is a technology venture founded by Temasek in strategic partnership with DFI Retail Group and coalition partners BreadTalk Group, DBS Bank, PAssion Card, Mandai Wildlife Group, Singtel, FoodPanda, GoJek and Great Eastern. We are on a mission to redefine the engagement between brands and consumers in Southeast Asia.The way we work:At...

  • Senior Data Engineer

    3 weeks ago


    Singapore One Consulting (global) Pte. Ltd. Full time

    SummaryThe Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other digital use cases.Job Requirements:Design, develop, and maintain robust, scalable and sustainable data products and build &...

  • Senior Data Engineer

    4 weeks ago


    Singapore Technology Services Group Pte. Ltd. Full time

    Our company is at the forefront of innovation in financial technology. Our mission is to develop an AI-driven platform that predicts market trends, empowering retail investors with the tools previously only accessible to professionals. We're looking for a talented Senior Data Engineer with an interest in finance to join our growing team in our Singapore...

  • Senior Data Engineer

    3 weeks ago


    Singapore Ntuc Enterprise Nexus Co-operative Limited Full time

    Job DescriptionWe are looking for an experienced data engineer (DE) with a strong sense of social mission. This role is seconded to NTUC Health (NHealth), as a part of NHealth's multidisciplinary data team consisting of data engineer, data scientist and data analyst. You will report to the Head of Data & Analytics, who is accountable to the NHealth and NTUC...

  • Senior Data Engineer

    3 weeks ago


    Singapore NTUC ENTERPRISE NEXUS CO-OPERATIVE LIMITED Full time

    Roles & ResponsibilitiesJob DescriptionWe are looking for an experienced data engineer (DE) with a strong sense of social mission. This role is seconded to NTUC Health (NHealth), as a part of NHealth’s multidisciplinary data team consisting of data engineer, data scientist and data analyst. You will report to the Head of Data & Analytics, who is...

  • Senior Data Engineer

    3 weeks ago


    Singapore SAKSOFT PTE LIMITED Full time

    Roles & ResponsibilitiesRole: Senior Data EngineerJob level: More than 10 years of relevant experience (L4)Key skills:AS400, Hadoop, Data Lake, SQL, InformaticaKey Responsibilities:· Design, develop, and implement data processing pipelines to process large volumes of structured and unstructured data· Should have good knowledge and working experience in...

  • Senior Data Engineer

    3 weeks ago


    Singapore Saksoft Pte Limited Full time

    Role: Senior Data EngineerJob level: More than 10 years of relevant experience (L4)Key skills:AS400, Hadoop, Data Lake, SQL, InformaticaKey Responsibilities:. Design, develop, and implement data processing pipelines to process large volumes of structured and unstructured data. Should have good knowledge and working experience in Database and Hadoop (Hive,...


  • Singapore PRECISELY SOFTWARE AND DATA SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesPrecisely is seeking a technically adept, seasoned Senior Pre-Sales Consultant to join their expanding APAC Data Governance and Data Quality team. You must have experience in solutions that focus on data governance, data quality, data integration and data enrichment strategies. Engage with prospects to understand their business and...


  • Singapore Ntt Data Singapore Pte. Ltd. Full time

    Responsibilities:. Collaborates and works with Engineering team to develop technical solutions, plans and configuration, in response to requirements from Business and Application teams.. Plan and build efficient data platforms, systems and infrastructure for intelligent engines which empower business critical features leveraging background of distributed...


  • Singapore Vanguard Software Pte. Ltd. Full time

    JOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data engineering, expertise in...


  • Singapore VANGUARD SOFTWARE PTE. LTD. Full time

    Roles & ResponsibilitiesJOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data...


  • Singapore Sasco Senior Citizens' Home Full time

    Roles & ResponsibilitiesAs part of the Corporate Planning team, you will support the strategy development, corporate planning and corporate communications processes relating to the overall SASCO Senior Citizens' Home, incorporating a Sheltered Home, four (4) day-care centres and two (2) Senior Activity Centres. This includes coordinating inputs from relevant...


  • Singapore SASCO SENIOR CITIZENS' HOME Full time

    Roles & ResponsibilitiesRoles & ResponsibilitiesAs part of the Corporate Planning team, you will support the strategy development, corporate planning and corporate communications processes relating to the overall SASCO Senior Citizens’ Home, incorporating a Sheltered Home, four (4) day-care centres and two (2) Senior Activity Centres. This includes...


  • Singapore ACHIEVE TECHNOLOGY ASIA PACIFIC PTE LTD Full time

    Roles & ResponsibilitiesJob Description & Requirements:As a Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks. Designing and delivering software using an agile and iterative approach based on Scrum or Kanban Following and contributing to improvement of client's...


  • Singapore Ntt Data Singapore Pte. Ltd. Full time

    ' EMAIL ID : Interested candidates, please email your resume to [HIDDEN TEXT]Only shortlisted candidates would be contacted for interview.Role: Senior Micro-frontend Engineer - 12 months Renewable contractExperience: Minimum of 5 yearsLocation : Marina Bay Financial CentreBenefits:Renewable contract (Performance-based, with possibility of conversion to...