
Data Engineer
1 week ago
Client Description:
Job Description:
**Position: Data Engineer (Spark Scala DevOps)**
**Employment Type: 1-year Agency Contract (Highly Renewable)**
**Location: Alexandra**
**Job Objectives**
We are seeking a skilled and motivated Data Engineer with expertise in Hadoop, Spark, OpenShift Container Platform (OCP), and DevOps practices. As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient data pipelines, processing large-scale datasets. Your expertise in Hadoop, Spark, OCP, and DevOps will be crucial in ensuring the availability, scalability, and reliability of our ML Solutions.
**Key Responsibilities**
- Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives
- Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions
- Ensure data quality and integrity throughout the data processing lifecycle
- Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques
- Optimize data engineering workflows for containerized deployment and efficient resource utilization
- Collaborate with DevOps teams to streamline deployment processes, implement CI/CD pipelines, and ensure platform stability
- Implement data governance practices, data lineage, and metadata management to ensure data accuracy, traceability, and compliance
- Monitor and optimize data pipeline performance, troubleshoot issues, and implement necessary enhancements
- Implement monitoring and logging mechanisms to ensure the health, availability, and performance of the data infrastructure
- Document data engineering processes, workflows, and infrastructure configurations for knowledge sharing and reference
- Stay updated with emerging technologies, industry trends, and best practices in data engineering and DevOps
- Provide technical leadership, mentorship, and guidance to junior team members to foster a culture of continuous learning and innovation to the continuous improvement of the analytics capabilities within the bank
Job Requirements:
- Bachelor's degree in Computer Science, Information Technology, or a related field
- Proven experience as a Data Engineer, working with Hadoop, Spark, and data processing technologies in large-scale environments
- Strong expertise in designing and developing data infrastructure using Hadoop, Spark, and related tools (HDFS, Hive, Pig, etc)
- Experience with containerization platforms such as OpenShift Container Platform (OCP) and container orchestration using Kubernetes
- Proficiency in programming languages commonly used in data engineering, such as Spark, Python, Scala, or Java
- Knowledge of DevOps practices, CI/CD pipelines, and infrastructure automation tools (e.g., Docker, Jenkins, Ansible, BitBucket)
- Experience with Graphana, Prometheus, Splunk will be an added benefit
- Strong problem-solving and troubleshooting skills with a proactive approach to resolving technical challenges
- Excellent collaboration and communication skills to work effectively with cross-functional teams
- Ability to manage multiple priorities, meet deadlines, and deliver high-quality results in a fast-paced environment
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services is a plus
If you are interested in the role above please get in touch directly with Stefan Olsem for further discussion or Click APPLY NOW Below.
Job Reference number 4708
Data provided is for recruitment purposes only.
Tangspac Consulting Pte Ltd
03-02 The Octagon, 105 Cecil Street, Singapore 069534
EA Personnel Name: Olsem Stefanus Emmanuel
EA License: 07C3635 | EA Registration: R2094432
-
Data Engineer
2 weeks ago
Singapore NTT DATA, Inc. Full timeJoin to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...
-
Data Engineer
7 days ago
Singapore NTT Data Singapore Full time**The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...
-
Azure Data engineer
4 hours ago
Singapore NTT Data Singapore Full time $120,000 - $180,000 per yearJob Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...
-
Data Engineer
1 week ago
Singapore NTT Data Singapore Full time**Competency Required**: - Possess a degree in Computer Science/Information Technology or related fields. - At least 3 years of experience in a role focusing on development and support of data ingestion pipelines. - **Experience with building on data platforms, e.g. Snowflake.**: - **Proficient in SQL and Python.**: - Experience in continuous integration...
-
Electrical Systems Technical Specialist
1 week ago
Singapore beBeeelectrical engineer Full time $80,000 - $120,000Job Title: Electrical Systems SpecialistAn Electrical Engineer plays a vital role in the conceptualization, design, and development of electrical engineering projects.This position involves performing prototype testing, troubleshooting, and compiling detailed analysis reports. The successful candidate will be responsible for generating electrical schematics...
-
Data Scientist
1 week ago
Singapore Data Analytics Full time $90,000 - $120,000 per yearGet to Know the TeamGFin Analytics team supports the GFin product and business organisations, across Payments Core, Payments Experience, Lending, Insurance, and Kios. As a Data Scientist (Analytics), you'll be part of the Lending tech family where we strive to be the best FinTech company in the region. Our team is focused on understanding user experiences...
-
Systems Optimization Expert
3 days ago
Singapore beBee Engineer Full time $80,000 - $120,000Role Description:">">We are seeking an Engineer to join our team, responsible for monitoring and maintaining critical information-communication systems.">">About the Role:">As a key member of our team, you will work alongside fellow engineers to ensure the reliability and functionality of our communication systems. Your expertise in advanced technologies...
-
Senior Data Scientist
4 days ago
Singapore Data Analytics Full time $104,000 - $130,878 per yearGet to Know the TeamOur Search and Personalisation Team focuses on advancing scalable machine learning and experimentation frameworks that power search relevance, ranking, and recommendations across Grab. By leveraging cutting-edge analytics and statistical methods, we continuously optimize how users connect with merchants, services, and content.Get to Know...
-
Data Engineer
2 weeks ago
Singapore COMMUNITY DATA LABS PTE. LTD. Full timeWe are a San Francisco and Singapore based stealth startup developing a new framework for data on the internet powered by data interoperability and new economic systems. We are a stealth startup where everyone directly contributes to the core product. You’ll need to be comfortable wearing many hats and managing projects end-to-end independently. We are...
-
Lead Data Scientist
1 week ago
Singapore Data Analytics Full time $150,000 - $200,000 per yearGet to Know the TeamAt Grab, the Market Insights team drives impactful data-driven decisions by uncovering insights about the region's users, merchants, and driver partners. By analysing vast datasets across transactional and behavioural activities, we bridge the gap between raw data science capabilities and actionable business strategies. Our work is...