Data Engineer
4 weeks ago
Responsibilities:
- Work closely with data stewards, data analysts, and business end users to implement and support data solutions.
- Design and build robust and scalable data ingestion and data management solutions for batch loading and streaming data sources using Python.
- Familiar with SDLC process: Requirement gathering, design and development, SIT testing, support UAT and CICD deployment for enhancement and new ingestion pipeline.
- Ensure compliance with IT security standards, policies, and procedures.
- Provide BAU support in terms of production job monitoring, issue resolution, and bug fixes.
- Enable ingestion checks and data quality checks for all data sets in the data platform and ensure the data issues are actively detected, tracked, and fixed without breaching SLA.
Skills
- Possess a degree in Computer Science/Information Technology or related fields.
- At least 3 years of experience in a role focusing on development and support of data injection pipelines.
- Experience with building on data platforms using Snowflake.
- Proficient in 【SQL and Python】
- Experience with continuous integration and continuous deployment (CICD).
- Experience with Software Development Life Cycle (SDLC) methodology.
- Experience with data warehousing concepts.
- Strong problem solving and troubleshooting skills.
- Strong communication and collaboration skills.
- Able to design and implement solution and perform code review. Agile, fast learner and able to adapt to change.
Skills (good to have):
- Cloud environment (e.g. AWS).
- Experience in ETL tools (such as Informatica), and data virtualization platforms such as Denodo is preferred.
- Experience in Java.
Tell employers what skills you have
UAT
Pipelines
Hadoop
Informatica
Data Management
Agile
ETL
SDLC
Data Quality
Adapt to Change
Python
Continuous Integration
Java
Data Warehousing
Virtualization
Software Development
We have other current jobs related to this field that you can find below
-
Data Engineer
2 weeks ago
Singapore DOZER DATA PTE. LTD. Full timeAbout the job:This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data.This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers.Responsibilities:In this role,...
-
Data Science Intern
2 weeks ago
Singapore DATA MART Consulting GmbH Full timeAbout FactoremFactorem is Southeast Asia's first on-demand manufacturing platform for global companies looking to get low volume custom parts from the region. Our manufacturing network includes the best CNC Machining, Sheet Metal, and 3D printing partners with capacity for any quick turnaround and volume in the region. Factorem is backed by SEEDS Capital,...
-
Nlp And Text Classfication Ml Engineering
4 weeks ago
Singapore DATA DISTINCTION Full timeb'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...
-
Nlp And Text Classfication Ml Engineering
2 months ago
Singapore DATA DISTINCTION Full timeb'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...
-
Nlp And Text Classfication Ml Engineering
4 weeks ago
Singapore DATA DISTINCTION Full timeb'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...
-
Data Engineer
2 weeks ago
Singapore ANTAES ASIA PTE. LTD. Full timeContribute to IT projects in the Energy industry for Antaes clients The Data Engineer is responsible for developing methods that transform raw data from different sources into useful, consistent, and machinereadable formats The Data Engineer will also develop, test, and optimize architectures that enable data extraction and transformation for modeling and...
-
Data Engineer
2 weeks ago
Singapore INFOCEPTS PTE. LTD. Full timeRoles & ResponsibilitiesInfoCepts is a global leader of end-to-end data & analytics solutions with nearly 20 years of experience, also named as Gartner's 2020, 2021 and 2022 customers' choice for Data & Analytics providers. We continue to grow rapidly year over year, now employing more than 1,200 people in offices across the globe. As we have grown, we have...
-
Data Engineer
2 weeks ago
Singapore CDG ZIG PTE. LTD. Full timeIn this role, the Data Engineer will be exposed to many aspects of data collection and data pipeline to serve stakeholders requirements. Stakeholders can range from Business Analysts, Product Analysts, Data Analyst to Data Scientists who need datasets for modelling, visualization and decision making.The Engineer, Data should have a proven track record of...
-
Data Engineer
4 weeks ago
Singapore ASE SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesAs a Data Engineer assigned to the Test/Product Department, you will be working with various internal teams to develop Smart Engineering solutions through Artificial Intelligence and Machine Learning.Responsibilities: Work with Test/Product Engineers, Process and Equipment Engineers, IT and other relevant departments collaboratively...
-
Data Engineer
2 months ago
Singapore ASE SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesAs a Data Engineer assigned to the Test/Product Department, you will be working with various internal teams to develop Smart Engineering solutions through Artificial Intelligence and Machine Learning.Responsibilities: Work with Test/Product Engineers, Process and Equipment Engineers, IT and other relevant departments collaboratively...
-
Data Engineer
2 weeks ago
Singapore INFOCEPTS PTE. LTD. Full time**What is a Data Engineer?The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale.Roles and Responsibilities: Drive the maintenance of data engineering pipelines Implement data engineering pipelines as per business needs and technical specifications...
-
Data Engineer
2 weeks ago
Singapore WSH EXPERTS PTE LTD Full timeJob Description & RequirementsResponsibilities Architect and/or review technical solutions for the deployment of AI models, along with the data pipelines and visualization interfaces Utilize DevOps tools and automate model deployment / tuning via orchestration Provide guidance for maintenance, support and enhancements to model deployment platforms Analyze,...
-
Machine Learning Engineer
2 weeks ago
Singapore NTT Data Singapore Full timeJob Description: Conduct reviews for compliance of the ML models in accordance with overall platform governance principles such as versioning, data / model lineage, code best practices and provide feedback to data scientists for potential improvements Develop pipelines for continuous operation, feedback and monitoring of ML models leveraging best practices...
-
Data Engineer
4 weeks ago
Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full timeRoles & ResponsibilitiesThe Role:In 2024, the global data team is actively scaling up, and we're eager to explore more talents to join our R&D centers in Singapore and Shanghai. Your contribution will play a pivotal role in steering the data team into the next step - the era of AI in Airwallex.As a data engineering expert, you'll delve into various facets of...
-
Data Engineer, Big Data
2 weeks ago
Singapore Grab Full timeJob Description:Life at Grab:At Grab, every Grabber is guided by The Grab Way, which spells out our mission, how we believe we can achieve it, and our operating principles - the 4Hs: Heart, Hunger, Honour and Humility. These principles guide and help us make decisions as we work to create economic empowerment for the people of Southeast Asia.Get to know our...
-
Data Engineer
2 weeks ago
Singapore JONDAVIDSON PTE. LTD. Full timeJob Title: Data Engineer (Python, Java or Scala)Welcome to our company! We are currently looking for a skilled Data Engineer to join our team. In this role, you will play a key part in designing, constructing, and managing data pipelines to support our data analytics and business intelligence projects. Collaboration with various teams is essential to create...
-
Data Engineer
2 weeks ago
Singapore Progression Search Full timeCLIENT SUMMARYOur client is an innovative start-up specializing in ESG data collection & reporting. They offer a modular & customizable ESG Platform for the Financial Sector, Supply Chains, Corporate Sustainability and Investment Funds.We are looking for a skilled Data Engineer to join our ESG service delivery team. As a member of this team, you would be...
-
Data Engineer
2 months ago
Singapore INNOCELLENCE SYSTEMS PTE. LTD. Full timeRoles & ResponsibilitiesJob Description:We are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data...
-
Data Engineer
2 months ago
Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...
-
Data Engineer
2 weeks ago
Singapore QUANTUM INFOSECURITY PTE. LTD. Full timeRoles & ResponsibilitiesJob Description: Data Pipeline Development: Design and maintain ETL (extract, transform, load) data pipelines from various sources into centralized storage systems like data warehouses or data lakes.Data Integration: Combine data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external...