![NTT SINGAPORE PTE. LTD.](https://media.trabajo.org/img/noimg.jpg)
Data Platform Engineer- Contract
2 months ago
- Proven experience as a Data Engineering role with a strong track record of delivering scalable data pipelines.
- Extensive experience designing data solutions including data modelling is required.
- Extensive hands-on experience developing data processing jobs (PySpark / SQL) that demonstrate a strong understanding of software engineering principles is needed.
- Experience orchestrating data pipelines using technology like ADF, Airflow etc is necessary.
- Experience working with both real-time and batch data is important.
- Experience building data pipelines on Azure is crucial. AWS data pipelines will be beneficial.
- Fluency in SQL (any flavour), with experience using Window functions and more advanced features is required.
Responsibilities:
- Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.
- Data Integration: Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.
- Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.
- Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.
- Implement data governance in line with company standards.
- Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionalising analytic pipelines.
- Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Databricks, others).
Tell employers what skills you have
Machine Learning
Requirements Gathering
PySpark
Airflow
Azure
Pipelines
Data Structures
Data Transformation
Software Engineering
Data Integration
Data Governance
Data Engineering
SQL
Ruby
Data Analytics
Databases
-
Data Platform Engineer
2 weeks ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeRoles & ResponsibilitiesZenith Infotech (s) is a Tech Recruitmetn firm with 27 years of history locally and more than 15 years in Malaysia. We support our clients from government agenceis and also corporate sectors. We are now seeking for Data Platform Engineer with hands on experience in Cloudera Data Lake solutions. Qualfied candidates whom are comfortable...
-
Data Platform Engineer
2 weeks ago
Singapore NodeFlair Full timeJob Summary:SalaryS$7,000 - S$14,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 2 yearsAs an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure seamless integration with other IT...
-
Data Platform Engineer
4 weeks ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeRoles & ResponsibilitiesZenith Infotech (s) is a Tech Recruitmetn firm with 27 years of history locally and more than 15 years in Malaysia. We support our clients from government agenceis and also corporate sectors. We are now seeking for Data Platform Engineer with hands on experience in Cloudera Data Lake solutions. Qualfied candidates whom are comfortable...
-
Data Engineer
2 weeks ago
Singapore DOZER DATA PTE. LTD. Full timeAbout the job:This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data.This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers.Responsibilities:In this role,...
-
Data (Platform) Engineer
4 weeks ago
Singapore FULLERTON FUND MANAGEMENT COMPANY LTD. Full timeRoles & ResponsibilitiesRole SummaryThis role will report to Chief Technology Officer.Key Duties and Responsibilities Design, build, test and maintain end to end data pipelines that efficiently and reliably process and transform data captured across various data sources Ensure that every component of the data platform is implemented according to the...
-
Data (Platform) Engineer
2 months ago
Singapore FULLERTON FUND MANAGEMENT COMPANY LTD. Full timeRoles & ResponsibilitiesRole SummaryThis role will report to Chief Technology Officer.Key Duties and Responsibilities Design, build, test and maintain end to end data pipelines that efficiently and reliably process and transform data captured across various data sources Ensure that every component of the data platform is implemented according to the...
-
Data Platform Engineer
2 weeks ago
Singapore NodeFlair Full timeJob Summary:SalaryS$6,000 - S$8,500 / MonthlyJob TypeSeniorityMidYears of ExperienceAt least 5 yearsTech StacksDocker Go Cloudera HDFS Shell Java Spark Linux Kubernetes Flink Ansible Hadoop Python openstackZenith Infotech (s) is a Tech Recruitmetn firm with 27 years of history locally and more than 15 years in Malaysia. We support our clients from government...
-
Cloudera Data Platform Engineer
4 weeks ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeRoles & ResponsibilitiesZenith Infotech is a Tech Recruitment Company in Singapore for the last 27 years.We are looking for a suitable candidate for the position of Cloudera Data Platform Engineer with our client.Description: • Perform operation, installation, and monitoring of big data platforms • Ensure the reliability and normal operation of multiple...
-
Big Data Engineer, Data Platform
2 weeks ago
Singapore NodeFlair Full timeJob Summary:SalaryS$6,500 - S$13,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 1 yearTech StacksETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQLResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.TikTok is the...
-
Cloudera Data Platform Engineer
4 weeks ago
Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesPerform operation, installation, and monitoring of big data platforms• Ensure the reliability and normal operation of multiple core systems for big data and online computing, resolving issues within the agreed SLA• Evaluate infrastructure requirements for deployments and upgrade activities• Develop and maintain technical...
-
Cloudera Data Platform Engineer
2 weeks ago
Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesPerform operation, installation, and monitoring of big data platforms• Ensure the reliability and normal operation of multiple core systems for big data and online computing, resolving issues within the agreed SLA• Evaluate infrastructure requirements for deployments and upgrade activities• Develop and maintain technical...
-
Senior Data Platform Engineer
2 weeks ago
Singapore Airwallex Full timeIf you're excited to do the most ambitious work of your career and change the way money moves around the world - join usWho You Are? Role Overview:In this data engineering role, we are seeking engineers with a background in data engineering to join us in various aspects of data engineering, leveraging your past experiences in the field.In this role, you...
-
Data Quality Assurance Engineer
4 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
Data Quality Assurance Engineer
2 months ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with,...
-
DevOps Engineer
3 weeks ago
Singapore TIKTOK PTE. LTD. Full timeAbout TikTokTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo. Why Join UsCreation is the core of TikTok's purpose. Our platform is built to help imaginations thrive....
-
Data Quality Assurance Engineer, Data Platform
2 weeks ago
Singapore NodeFlair Full timeJob Summary:SalaryS$6,500 - S$13,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 2 yearsTech StacksETL yarn Go HDFS Java Spark SQL PythonReponsibilitiesTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris,...
-
Data Platform Administrator
2 weeks ago
Singapore ALPHAEUS PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities:Perform platform admin support for Power BI as well as Informatica Admin includes deployment of objects, security setup, server management, creation/maintenance of cronjobs to schedule Informatica jobs etc. on Linux platform Set up and maintain best practice for Informatica Familiar with PBI Fabric – Create and...
-
Associate Platform and Data Engineer
2 weeks ago
Singapore Ensign InfoSecurity Full timeEnsign is hiring Responsibilities: Involve in the design, development, testing, deployment of efficient and reliable big data processing workflows Directly provide monitoring, maintenance and support for system operations as part of M&S as required in commercial projects Embrace the challenge of dealing with terabytes to petabytes of data on a daily basis...
-
Data Platform Engineering Director, Sg
2 weeks ago
Singapore Airwallex Full timeData Platform Engineering Director, SGAirwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world's most powerful payments infrastructure, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single...
-
Big Data Engineer
3 weeks ago
Singapore TIKTOK PTE. LTD. Full timeResponsibilitiesAbout TikTokTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo. Why Join UsCreation is the core of TikTok's purpose. Our platform is built to help...