Senior Data Engineer

3 weeks ago

Singapore AVENSYS CONSULTING PTE. LTD. Full time
Roles & Responsibilities

Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation, and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail, and supply chain.

We are currently looking to hire a Data Engineer. This is an exciting opportunity to expand your skill set, and achieve job satisfaction and work-life balance. More details as below.

We are seeking a highly skilled Data Engineer with a strong background to join our dynamic team.

Responsibilities:

Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.
Data Integration: Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.
Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.
Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.
Implement data governance in line with company standards.
Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionalising analytic pipelines.
Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Databricks, others).
Monitoring and Support: Monitor data pipelines and data systems to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error handling mechanisms to ensure data integrity and system reliability.

Requirements:

Must haves

Proven experience as a Data Engineering role (8 years +), with a strong track record of delivering scalable data pipelines.
Extensive experience designing data solutions including data modelling is required.
Extensive hands-on experience developing data processing jobs (PySpark / SQL) that demonstrate a strong understanding of software engineering principles is needed.
Experience orchestrating data pipelines using technology like ADF, Airflow etc is necessary.
Experience working with both real-time and batch data is important.
Experience building data pipelines on Azure is crucial. AWS data pipelines will be beneficial.
Fluency in SQL (any flavour), with experience using Window functions and more advanced features is required.
Understanding of DevOps tools, Git workflow and building CI/CD pipelines is essential.

Nice to Have

Domain knowledge of commodities, covering Sales, Trading, Risk, Supply Chain, Customer Interaction, etc. is highly desirable.
Familiarity with Scrum methodology and experience working in a Scrum team can be advantageous. This includes understanding of Scrum roles, events, artifacts, and rules, and the ability to apply them in a practical context.
Experience with streaming data processing technologies such as Apache Kafka, Apache Flink, or AWS Kinesis can be beneficial. This includes the ability to design and implement real-time data processing pipelines.

WHAT’S ON OFFER

You will be remunerated with an excellent base salary and entitled to attractive company benefits. Additionally, you will get the opportunity to enjoy a fun and collaborative work environment, alongside a strong career progression.

To submit your application, please apply online or email your UPDATED CV in Microsoft Word format to Meenakshi@aven-sys.com. Your interest will be treated with strict confidentiality.

CONSULTANT DETAILS

Consultant Name: Meenakshi

Avensys Consulting Pte Ltd

EA License 12C5759

Privacy Statement: Data collected will be used for recruitment purposes only. Personal data provided will be used strictly in accordance with the relevant data protection law and Avensys' personal information and privacy policy.


Tell employers what skills you have

Machine Learning
PySpark
Business Intelligence
Azure
Pipelines
Data Structures
Data Transformation
Software Engineering
Data Integration
Data Governance
Reliability
Data Engineering
SQL
Data Analytics
Apache
Databases

  • Data Centre Operations Technology

    4 weeks ago

    Singapore Bridge Data Centres (international) Pte. Ltd. Full time

    Key Responsibilities:. Conduct in-depth design reviews and oversee the commissioning/Integrated Systems Testing (IST) processes for new data centre projects, as well as modifications and expansions to existing data centres. Enhance and standardize data centre operation and maintenance policies and procedures to ensure efficiency and compliance. Perform...

  • Senior Data Engineer

    3 weeks ago

    Singapore Airswift Full time

    Airswift is inviting an experienced Senior Data Engineerto work on large scale high value projects in the oil and gas marine industry. The Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other...

  • Data Engineer

    3 weeks ago

    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates, please email your resume to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits: Renewable contract (Performance-based, with possibility of conversion to...

  • Data Engineer

    3 weeks ago

    Singapore Ntt Data Singapore Pte. Ltd. Full time

    ' EMAIL ID : Interested candidates, please email your resume to [HIDDEN TEXT]Only shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits:Renewable contract (Performance-based, with possibility of conversion to perm)Medical Insurance CoverageLeave...

  • Senior Data Engineer

    3 weeks ago

    Singapore MINDEN INTERNATIONAL PTE. LTD. Full time

    Roles & ResponsibilitiesWho we are:minden.ai is a technology venture founded by Temasek in strategic partnership with DFI Retail Group and coalition partners BreadTalk Group, DBS Bank, PAssion Card, Mandai Wildlife Group, Singtel, FoodPanda, GoJek and Great Eastern. We are on a mission to redefine the engagement between brands and consumers in Southeast...

  • Senior Data Engineer

    4 weeks ago

    Singapore Minden International Pte. Ltd. Full time

    Who we are:minden.ai is a technology venture founded by Temasek in strategic partnership with DFI Retail Group and coalition partners BreadTalk Group, DBS Bank, PAssion Card, Mandai Wildlife Group, Singtel, FoodPanda, GoJek and Great Eastern. We are on a mission to redefine the engagement between brands and consumers in Southeast Asia.The way we work:At...

  • Senior Data Engineer

    4 weeks ago

    Singapore One Consulting (global) Pte. Ltd. Full time

    SummaryThe Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other digital use cases.Job Requirements:Design, develop, and maintain robust, scalable and sustainable data products and build &...

  • Senior Data Engineer

    4 weeks ago

    Singapore Technology Services Group Pte. Ltd. Full time

    Our company is at the forefront of innovation in financial technology. Our mission is to develop an AI-driven platform that predicts market trends, empowering retail investors with the tools previously only accessible to professionals. We're looking for a talented Senior Data Engineer with an interest in finance to join our growing team in our Singapore...

  • Senior Data Engineer

    3 weeks ago

    Singapore Ntuc Enterprise Nexus Co-operative Limited Full time

    Job DescriptionWe are looking for an experienced data engineer (DE) with a strong sense of social mission. This role is seconded to NTUC Health (NHealth), as a part of NHealth's multidisciplinary data team consisting of data engineer, data scientist and data analyst. You will report to the Head of Data & Analytics, who is accountable to the NHealth and NTUC...

  • Senior Data Engineer

    4 weeks ago

    Singapore ONE CONSULTING (GLOBAL) PTE. LTD. Full time

    Roles & ResponsibilitiesSummaryThe Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other digital use cases.Job Requirements: Design, develop, and maintain robust, scalable and sustainable...

  • Senior Data Engineer

    3 weeks ago

    Singapore NTUC ENTERPRISE NEXUS CO-OPERATIVE LIMITED Full time

    Roles & ResponsibilitiesJob DescriptionWe are looking for an experienced data engineer (DE) with a strong sense of social mission. This role is seconded to NTUC Health (NHealth), as a part of NHealth’s multidisciplinary data team consisting of data engineer, data scientist and data analyst. You will report to the Head of Data & Analytics, who is...

  • Senior Data Engineer

    4 weeks ago

    Singapore SAKSOFT PTE LIMITED Full time

    Roles & ResponsibilitiesRole: Senior Data EngineerJob level: More than 10 years of relevant experience (L4)Key skills:AS400, Hadoop, Data Lake, SQL, InformaticaKey Responsibilities:· Design, develop, and implement data processing pipelines to process large volumes of structured and unstructured data· Should have good knowledge and working experience in...

  • Senior Data Engineer

    3 weeks ago

    Singapore Saksoft Pte Limited Full time

    Role: Senior Data EngineerJob level: More than 10 years of relevant experience (L4)Key skills:AS400, Hadoop, Data Lake, SQL, InformaticaKey Responsibilities:. Design, develop, and implement data processing pipelines to process large volumes of structured and unstructured data. Should have good knowledge and working experience in Database and Hadoop (Hive,...

  • Senior Sales Engineer

    3 days ago

    Singapore PRECISELY SOFTWARE AND DATA SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesPrecisely is seeking a technically adept, seasoned Senior Pre-Sales Consultant to join their expanding APAC Data Governance and Data Quality team. You must have experience in solutions that focus on data governance, data quality, data integration and data enrichment strategies. Engage with prospects to understand their business and...

  • Senior / Lead Data Engineer

    3 weeks ago

    Singapore Vanguard Software Pte. Ltd. Full time

    JOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data engineering, expertise in...

  • Senior / Lead Data Engineer

    3 weeks ago

    Singapore VANGUARD SOFTWARE PTE. LTD. Full time

    Roles & ResponsibilitiesJOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data...

  • Executive / Senior Executive / Assistant Manager (Corporate Planning)

    3 days ago

    Singapore Sasco Senior Citizens' Home Full time

    Roles & ResponsibilitiesAs part of the Corporate Planning team, you will support the strategy development, corporate planning and corporate communications processes relating to the overall SASCO Senior Citizens' Home, incorporating a Sheltered Home, four (4) day-care centres and two (2) Senior Activity Centres. This includes coordinating inputs from relevant...

  • Executive / Senior Executive / Assistant Manager (Corporate Planning)

    4 days ago

    Singapore SASCO SENIOR CITIZENS' HOME Full time

    Roles & ResponsibilitiesRoles & ResponsibilitiesAs part of the Corporate Planning team, you will support the strategy development, corporate planning and corporate communications processes relating to the overall SASCO Senior Citizens’ Home, incorporating a Sheltered Home, four (4) day-care centres and two (2) Senior Activity Centres. This includes...

  • Senior Data Engineer

    1 week ago

    Singapore ACHIEVE TECHNOLOGY ASIA PACIFIC PTE LTD Full time

    Roles & ResponsibilitiesJob Description & Requirements:As a Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks. Designing and delivering software using an agile and iterative approach based on Scrum or Kanban Following and contributing to improvement of client's...

  • Senior Micro-frontend Engineer

    7 days ago

    Singapore Ntt Data Singapore Pte. Ltd. Full time

    ' EMAIL ID : Interested candidates, please email your resume to [HIDDEN TEXT]Only shortlisted candidates would be contacted for interview.Role: Senior Micro-frontend Engineer - 12 months Renewable contractExperience: Minimum of 5 yearsLocation : Marina Bay Financial CentreBenefits:Renewable contract (Performance-based, with possibility of conversion to...