G06 - Data Engineer
3 weeks ago
Responsibilities
- Support data engineering tasks, including the implementation and enhancement of data pipelines, as well as the rectification of broken pipelines.
- Manage the data platform and perform regular software version upgrades across all environments, ensuring thorough testing and detailed documentation.
- Support daily operational needs by handling application configuration changes, managing user access request to application, addressing general function queries, and troubleshooting on issues.
- Perform source code review and configuration review periodically to ensure code quality and verify that sensitive information, such as secrets, is not hardcoded or embedded in source codes or configuration files.
Periodic patching of Azure Cloud Servers
- Develop business processes by engaging stakeholders to understand use cases for building data pipelines, performing data modeling, completing data collection forms, documenting use cases, defining data attributes within various data quality zones, and establishing naming conventions for datasets.
Requirements:
- Degree in Computer Science, Engineering, or related disciplines
- Experienced in data engineering, including the implementation of data pipelines, development of data models and schemas, and pipeline monitoring and management.
- Experienced in architecting, designing, and developing data platform.
Experience with:
- Python, PySpark, or similar programming languages
- Python packages for data manipulation and analysis (e.g. Pandas, GeoPandas, Shapely)
- Database design and management (e.g. PostgreSQL, MS SQL, Oracle, Geodatabase)
- SQL programming (e.g. writing complex queries, optimizing performance, data manipulation)
- Scripting and version control (e.g. Bash, PowerShell, Git)
- ETL (Extract, Transform, Load) processes
- Technologies such as JupyterHub, RStudio, PowerBI
- CI/CD tools such as Jenkins, GitLab, YAML
- GIS technology (e.g. ArcGIS Server, PostGIS)
- API development and SFTP for secure data transfer
- Cloud Platforms (e.g. Microsoft Azure, AWS)
- Cloud Technologies (e.g. Azure Data Factory, Databricks, Azure Functions, Azure Key Vault, AWS Lambda)
- Containerization technologies (e.g. Docker, Kubernetes)
Added advantage with the following:
- Infrastructure-as-code Tools Terraform, CloudFormation
- Log Management tools (e.g. Azure Monitor, AWS CloudWatch, Splunk)
- Agile Management Tools Confluence, Jira, Kanban board
PySpark
Factory
Pandas
Kubernetes
PostgreSQL
Azure
Data Modeling
Pipelines
Scripting
ETL
Data Quality
Data Engineering
SQL
Python
Docker
API
-
Data Engineer
1 week ago
Singapore NTT DATA SINGAPORE PTE. LTD. Full timeRoles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...
-
Data Engineer
24 minutes ago
Singapore TRIVI DATA CONSULTING PTE. LTD. Full timeKey Responsibilities - Design, implement, and maintain ETL workflows for managing large-scale datasets. - Develop cloud-based data pipelines (AWS, Azure) for scalable and real-time analytics delivery. - Optimize data models to ensure high performance and reliable reporting. - Create advanced dashboards and visualizations using tools like Qlik Sense and...
-
Ts Implementation Engineer
21 minutes ago
Singapore NTT DATA Full time**Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...
-
Data Engineer
4 weeks ago
Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...
-
Data Engineer
1 week ago
Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities•Bachelor's Degree in Computer Science or equivalent;•Minimum 4+ years of experience in data engineering or software engineering.•Possess a solid foundation in Computer Science concepts such as Distributed Computing, High-Velocity Data Processing, and Lambda Architecture;•Proficient in Data modeling and...
-
Data Engineer
4 weeks ago
Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...
-
Developer Relations Engineer
24 minutes ago
Singapore Pyth Data Association Full timeThe **Pyth Data Association** is a Swiss-based organization established by participants of the Pyth Network to drive its growth and development. At the heart of its mission is revolutionizing access to latency-sensitive financial data—typically locked within the "walled gardens" of centralized institutions. As a pivotal contributor to the Pyth Network,...
-
Data Engineer
4 weeks ago
Singapore APAR TECHNOLOGIES PTE. LTD. Full timeRoles & ResponsibilitiesJob Description:We are looking for a skilled Data Engineer to join our team and support our data-driven initiatives. The ideal candidate should have strong technical expertise in Informatica, SQL, and .NET, along with experience in data engineering, migration, and analysis.Key Responsibilities:Design, develop, and maintain data...
-
Data Engineer
4 weeks ago
Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full timeRoles & ResponsibilitiesJob DescriptionBachelor's Degree in Computer Science or equivalent; Minimum 5 years of experience in data engineering or software engineering; Possess a solid foundation in Computer Science concepts such as Distributed Computing, High-velocity Data Processing, and Lambda Architecture; Proficient in Data modeling and managing...
-
Data Engineer
2 weeks ago
Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full timeRoles & ResponsibilitiesSummaryYou will be developing banking applications and supporting production environments.Responsibilities:Bachelor's Degree in Computer Science or equivalent; Minimum 4+ years of experience in data engineering or software engineering. Possess a solid foundation in Computer Science concepts such as Distributed Computing,...
-
Data Engineer
4 weeks ago
Singapore GREEN LINK DIGITAL BANK PTE. LTD. Full timeRoles & ResponsibilitiesAbout UsGreen Link Digital Bank is Singapore's inaugural wholesale digital bank focusing on supply chain finance, mainly serving MSMEs and aiming to help MSMEs grow and improve digitization.We are seeking a talented and driven Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...
-
Data Engineer
2 weeks ago
Singapore INNOCELLENCE SYSTEMS PTE. LTD. Full timeRoles & ResponsibilitiesWe are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data scientists and...
-
System Engineer
25 minutes ago
Singapore Tech Data Full time**Responsibilities**: - Determine the scope based on requirements, including stating the scope of work, calculating the resources required in delivering the service and advising the senior system engineer preparing the quotation - Install and configure services as per the approved implementation plan - Carry out technology, professional and maintenance...
-
Data Engineer
3 weeks ago
Singapore MAESTRO HUMAN RESOURCE PTE. LTD. Full timeRoles & ResponsibilitiesJob Description & RequirementsWe are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and...
-
Data Engineer
12 minutes ago
Singapore Fullerton Fund Management Company Full time**Role Overview** In this position, you will report to the Head of Technology & Transformation and play a pivotal role in Fullerton’s Digital Transformation Journey, which encompasses enhancing our enterprise data warehouse. As a Data Engineer, you will utilize your data engineering expertise to spearhead comprehensive data projects in a dynamic and...
-
Data Engineer
4 weeks ago
Singapore TALENTSIS PTE. LTD. Full timeRoles & ResponsibilitiesCompany's Profile:Our client is an international technology and engineering company that specialises in providing innovative digital and security solutions to their esteemed clients. They are well-known for their dedication of quality delivery standards with more than 15,000 engineers globally supporting projects. They have an...
-
Data Engineer
3 weeks ago
Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full timeRoles & ResponsibilitiesJob Title: Data Engineer - Mid-level/SeniorLocation: Singapore (CBD)Job Type: Full-Time PermanentKey Responsibilities:Design and maintain scalable ETL pipelines using Informatica. Optimize SQL queries and stored procedures for data manipulation. Lead data migration projects ensuring data integrity and quality. Collaborate with...
-
Data Engineer
4 weeks ago
Singapore YOUZU (SINGAPORE) PTE. LTD. Full timeRoles & ResponsibilitiesWe are looking for a skilled and motivated Data Engineer to join our team. You will play a key role in designing, maintaining, and expanding our data pipelines while actively shaping the future of our BI system. If you are passionate about data engineering, ETL processes, and driving business insights, we'd love to hear from...
-
Data Engineer
4 weeks ago
Singapore YOUZU (SINGAPORE) PTE. LTD. Full timeRoles & ResponsibilitiesWe are looking for a skilled and motivated Data Engineer to join our team. You will play a key role in designing, maintaining, and expanding our data pipelines while actively shaping the future of our BI system. If you are passionate about data engineering, ETL processes, and driving business insights, we’d love to hear from you! ...
-
Data Engineer
3 weeks ago
Singapore PERCEPT SOLUTIONS PTE. LTD. Full timeRoles & ResponsibilitiesDuties:Data Domain business workflow interpretation, data requirement study, data exploration, creation of entity relationship diagram, data model creation, data extraction, transformation, and loading ("ETL"), pipeline creation and servicing data requests. Data Platform Operations, setup, installation, access controls and pipeline...