Data Engineer

1 month ago


Singapore IKAS INTERNATIONAL (ASIA) PTE. LTD. Full time
Roles & Responsibilities

We are looking to speak with Data Engineers:


Responsibilities:


· Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.

· Data Integration: Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.

· Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.

· Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.

· Implement data governance in line with company standards.

· Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionalising analytic pipelines.

· Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Databricks, others).

· Monitoring and Support: Monitor data pipelines and data systems to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error handling mechanisms to ensure data integrity and system reliability.


Requirements


· Proven experience as a Data Engineering role with a strong track record of delivering scalable data pipelines.

· Extensive experience designing data solutions including data modelling is required.

· Extensive hands-on experience developing data processing jobs (PySpark / SQL) that demonstrate a strong understanding of software engineering principles is needed.

· Experience orchestrating data pipelines using technology like ADF, Airflow etc is necessary.

· Experience working with both real-time and batch data is important.

· Experience building data pipelines on Azure is crucial. AWS data pipelines will be beneficial.

· Fluency in SQL (any flavour), with experience using Window functions and more advanced features is required.

· Understanding of DevOps tools, Git workflow and building CI/CD pipelines is essential.


iKas International (Asia) Pte Ltd

“Sanderson-iKas” is the brand name for iKas International (Asia) Pte Ltd

EA Licence No: 16S8086 | EA Registration No. R1988468

We regret to inform you that only shortlisted candidates will be notified /contacted.


Tell employers what skills you have

Machine Learning
Git
PySpark
Airflow
Azure
Pipelines
Data Structures
Data Transformation
Software Engineering
Data Integration
Data Governance
Reliability
Data Engineering
SQL
Data Analytics
Databases
  • Data Engineer

    5 days ago


    Singapore DOZER DATA PTE. LTD. Full time

    About the job:This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data.This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers.Responsibilities:In this role,...

  • Data Engineer

    3 weeks ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates, please email your resume to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Marina Bay Financial CentreBenefits: Renewable contract (Performance-based, with possibility of...

  • Data Engineer

    2 months ago


    Singapore Ntt Data Singapore Pte. Ltd. Full time

    ' EMAIL ID : Interested candidates, please email your resume to [HIDDEN TEXT]Only shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits:Renewable contract (Performance-based, with possibility of conversion to perm)Medical Insurance CoverageLeave...


  • Singapore Bridge Data Centres (international) Pte. Ltd. Full time

    Key Responsibilities:. Conduct in-depth design reviews and oversee the commissioning/Integrated Systems Testing (IST) processes for new data centre projects, as well as modifications and expansions to existing data centres. Enhance and standardize data centre operation and maintenance policies and procedures to ensure efficiency and compliance. Perform...

  • Data Science Intern

    6 days ago


    Singapore DATA MART Consulting GmbH Full time

    About FactoremFactorem is Southeast Asia's first on-demand manufacturing platform for global companies looking to get low volume custom parts from the region. Our manufacturing network includes the best CNC Machining, Sheet Metal, and 3D printing partners with capacity for any quick turnaround and volume in the region. Factorem is backed by SEEDS Capital,...


  • Singapore DATA DISTINCTION Full time

    b'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...


  • Singapore DATA DISTINCTION Full time

    b'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...


  • Singapore DATA DISTINCTION Full time

    b'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...


  • Singapore DATA DISTINCTION Full time

    b'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...

  • Data Engineer

    5 days ago


    Singapore ANTAES ASIA PTE. LTD. Full time

    Contribute to IT projects in the Energy industry for Antaes clients The Data Engineer is responsible for developing methods that transform raw data from different sources into useful, consistent, and machinereadable formats The Data Engineer will also develop, test, and optimize architectures that enable data extraction and transformation for modeling and...

  • Data Engineer

    5 days ago


    Singapore INFOCEPTS PTE. LTD. Full time

    Roles & ResponsibilitiesInfoCepts is a global leader of end-to-end data & analytics solutions with nearly 20 years of experience, also named as Gartner's 2020, 2021 and 2022 customers' choice for Data & Analytics providers. We continue to grow rapidly year over year, now employing more than 1,200 people in offices across the globe. As we have grown, we have...

  • Data Engineer

    5 days ago


    Singapore CDG ZIG PTE. LTD. Full time

    In this role, the Data Engineer will be exposed to many aspects of data collection and data pipeline to serve stakeholders requirements. Stakeholders can range from Business Analysts, Product Analysts, Data Analyst to Data Scientists who need datasets for modelling, visualization and decision making.The Engineer, Data should have a proven track record of...

  • Data Engineer

    2 months ago


    Singapore ASE SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Engineer assigned to the Test/Product Department, you will be working with various internal teams to develop Smart Engineering solutions through Artificial Intelligence and Machine Learning.Responsibilities: Work with Test/Product Engineers, Process and Equipment Engineers, IT and other relevant departments collaboratively...

  • Data Engineer

    3 weeks ago


    Singapore ASE SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Engineer assigned to the Test/Product Department, you will be working with various internal teams to develop Smart Engineering solutions through Artificial Intelligence and Machine Learning.Responsibilities: Work with Test/Product Engineers, Process and Equipment Engineers, IT and other relevant departments collaboratively...

  • Data Engineer

    6 days ago


    Singapore INFOCEPTS PTE. LTD. Full time

    **What is a Data Engineer?The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale.Roles and Responsibilities: Drive the maintenance of data engineering pipelines Implement data engineering pipelines as per business needs and technical specifications...


  • Singapore NTT Data Singapore Full time

    Job Description: Conduct reviews for compliance of the ML models in accordance with overall platform governance principles such as versioning, data / model lineage, code best practices and provide feedback to data scientists for potential improvements Develop pipelines for continuous operation, feedback and monitoring of ML models leveraging best practices...

  • Data Engineer

    6 days ago


    Singapore WSH EXPERTS PTE LTD Full time

    Job Description & RequirementsResponsibilities Architect and/or review technical solutions for the deployment of AI models, along with the data pipelines and visualization interfaces Utilize DevOps tools and automate model deployment / tuning via orchestration Provide guidance for maintenance, support and enhancements to model deployment platforms Analyze,...

  • Data Engineer

    1 month ago


    Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesThe Role:In 2024, the global data team is actively scaling up, and we're eager to explore more talents to join our R&D centers in Singapore and Shanghai. Your contribution will play a pivotal role in steering the data team into the next step - the era of AI in Airwallex.As a data engineering expert, you'll delve into various facets of...

  • Data Engineer

    3 weeks ago


    Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesThe Role:In 2024, the global data team is actively scaling up, and we're eager to explore more talents to join our R&D centers in Singapore and Shanghai. Your contribution will play a pivotal role in steering the data team into the next step - the era of AI in Airwallex.As a data engineering expert, you'll delve into various facets of...

  • Data Engineer

    6 days ago


    Singapore JONDAVIDSON PTE. LTD. Full time

    Job Title: Data Engineer (Python, Java or Scala)Welcome to our company! We are currently looking for a skilled Data Engineer to join our team. In this role, you will play a key part in designing, constructing, and managing data pipelines to support our data analytics and business intelligence projects. Collaboration with various teams is essential to create...