Data Platform Engineer- Contract

2 months ago


Singapore NTT SINGAPORE PTE. LTD. Full time
Roles & Responsibilities

  • Proven experience as a Data Engineering role with a strong track record of delivering scalable data pipelines.
  • Extensive experience designing data solutions including data modelling is required.
  • Extensive hands-on experience developing data processing jobs (PySpark / SQL) that demonstrate a strong understanding of software engineering principles is needed.
  • Experience orchestrating data pipelines using technology like ADF, Airflow etc is necessary.
  • Experience working with both real-time and batch data is important.
  • Experience building data pipelines on Azure is crucial. AWS data pipelines will be beneficial.
  • Fluency in SQL (any flavour), with experience using Window functions and more advanced features is required.

Responsibilities:

  • Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.
  • Data Integration: Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.
  • Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.
  • Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.
  • Implement data governance in line with company standards.
  • Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionalising analytic pipelines.
  • Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Databricks, others).



Tell employers what skills you have

Machine Learning
Requirements Gathering
PySpark
Airflow
Azure
Pipelines
Data Structures
Data Transformation
Software Engineering
Data Integration
Data Governance
Data Engineering
SQL
Ruby
Data Analytics
Databases

  • Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    Roles & ResponsibilitiesZenith Infotech (s) is a Tech Recruitmetn firm with 27 years of history locally and more than 15 years in Malaysia. We support our clients from government agenceis and also corporate sectors. We are now seeking for Data Platform Engineer with hands on experience in Cloudera Data Lake solutions. Qualfied candidates whom are comfortable...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$7,000 - S$14,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 2 yearsAs an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure seamless integration with other IT...


  • Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    Roles & ResponsibilitiesZenith Infotech (s) is a Tech Recruitmetn firm with 27 years of history locally and more than 15 years in Malaysia. We support our clients from government agenceis and also corporate sectors. We are now seeking for Data Platform Engineer with hands on experience in Cloudera Data Lake solutions. Qualfied candidates whom are comfortable...

  • Data Engineer

    2 weeks ago


    Singapore DOZER DATA PTE. LTD. Full time

    About the job:This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data.This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers.Responsibilities:In this role,...


  • Singapore FULLERTON FUND MANAGEMENT COMPANY LTD. Full time

    Roles & ResponsibilitiesRole SummaryThis role will report to Chief Technology Officer.Key Duties and Responsibilities Design, build, test and maintain end to end data pipelines that efficiently and reliably process and transform data captured across various data sources Ensure that every component of the data platform is implemented according to the...


  • Singapore FULLERTON FUND MANAGEMENT COMPANY LTD. Full time

    Roles & ResponsibilitiesRole SummaryThis role will report to Chief Technology Officer.Key Duties and Responsibilities Design, build, test and maintain end to end data pipelines that efficiently and reliably process and transform data captured across various data sources Ensure that every component of the data platform is implemented according to the...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$6,000 - S$8,500 / MonthlyJob TypeSeniorityMidYears of ExperienceAt least 5 yearsTech StacksDocker Go Cloudera HDFS Shell Java Spark Linux Kubernetes Flink Ansible Hadoop Python openstackZenith Infotech (s) is a Tech Recruitmetn firm with 27 years of history locally and more than 15 years in Malaysia. We support our clients from government...


  • Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    Roles & ResponsibilitiesZenith Infotech is a Tech Recruitment Company in Singapore for the last 27 years.We are looking for a suitable candidate for the position of Cloudera Data Platform Engineer with our client.Description: • Perform operation, installation, and monitoring of big data platforms • Ensure the reliability and normal operation of multiple...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$6,500 - S$13,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 1 yearTech StacksETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQLResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.TikTok is the...


  • Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesPerform operation, installation, and monitoring of big data platforms• Ensure the reliability and normal operation of multiple core systems for big data and online computing, resolving issues within the agreed SLA• Evaluate infrastructure requirements for deployments and upgrade activities• Develop and maintain technical...


  • Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesPerform operation, installation, and monitoring of big data platforms• Ensure the reliability and normal operation of multiple core systems for big data and online computing, resolving issues within the agreed SLA• Evaluate infrastructure requirements for deployments and upgrade activities• Develop and maintain technical...


  • Singapore Airwallex Full time

    If you're excited to do the most ambitious work of your career and change the way money moves around the world - join usWho You Are? Role Overview:In this data engineering role, we are seeking engineers with a background in data engineering to join us in various aspects of data engineering, leveraging your past experiences in the field.In this role, you...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...


  • Singapore BYTEDANCE PTE. LTD. Full time

    Roles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...

  • DevOps Engineer

    3 weeks ago


    Singapore TIKTOK PTE. LTD. Full time

    About TikTokTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo. Why Join UsCreation is the core of TikTok's purpose. Our platform is built to help imaginations thrive....


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$6,500 - S$13,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 2 yearsTech StacksETL yarn Go HDFS Java Spark SQL PythonReponsibilitiesTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris,...


  • Singapore ALPHAEUS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities:Perform platform admin support for Power BI as well as Informatica Admin includes deployment of objects, security setup, server management, creation/maintenance of cronjobs to schedule Informatica jobs etc. on Linux platform Set up and maintain best practice for Informatica Familiar with PBI Fabric – Create and...


  • Singapore Ensign InfoSecurity Full time

    Ensign is hiring Responsibilities: Involve in the design, development, testing, deployment of efficient and reliable big data processing workflows Directly provide monitoring, maintenance and support for system operations as part of M&S as required in commercial projects Embrace the challenge of dealing with terabytes to petabytes of data on a daily basis...


  • Singapore Airwallex Full time

    Data Platform Engineering Director, SGAirwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world's most powerful payments infrastructure, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single...

  • Big Data Engineer

    3 weeks ago


    Singapore TIKTOK PTE. LTD. Full time

    ResponsibilitiesAbout TikTokTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo. Why Join UsCreation is the core of TikTok's purpose. Our platform is built to help...