Enterprise Analytics – Lead Data Engineer
1 day ago
Your Role
As a Lead Data Engineer, you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics need of the bank. You will oversee a team of data engineers, working closely with data analysts, DevOps team, infrastructure engineers, and other stakeholders to deliver high-quality data solution.
Your main responsibilities will include:
· Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.
· Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data.
· Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch.
· Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions.
· Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques.
· Optimize data engineering workflows for containerized deployment and efficient resource utilization.
· Collaborate with DevOps teams to streamline deployment processes, implement CI/CD pipelines, and ensure platform stability.
· Monitor and optimize data pipeline performance, troubleshoot issues, and implement necessary enhancements.
· Implement monitoring and logging mechanisms to ensure the health, availability, and performance of the data infrastructure.
· Document data engineering processes, workflows, and infrastructure configurations for knowledge sharing and reference.
· Stay updated with emerging technologies, industry trends, and best practices in data engineering and DevOps.
· Provide technical leadership, mentorship, and guidance to junior team members to foster a culture of continuous learning and innovation to the continuous improvement of the analytics capabilities within the bank.
Requirements
· Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field.
· At least 10 years of experience as a Data Engineer, working with Hadoop, Spark, and data processing technologies in large-scale environments.
· Strong expertise in designing and developing data infrastructure using Hadoop, Spark, and related tools (HDFS, Hive, Ranger, etc)
· Experience with containerization platforms such as OpenShift Container Platform (OCP) and container orchestration using Kubernetes.
· Proficiency in programming languages commonly used in data engineering, such as Spark, Python, Scala, or Java.
· Knowledge of DevOps practices, CI/CD pipelines, and infrastructure automation tools (e.g., Docker, Jenkins, Ansible, BitBucket)
· Experience with Grafana, Prometheus, Splunk will be an added benefit
· Strong problem-solving and troubleshooting skills with a proactive approach to resolving technical challenges.
· Excellent collaboration and communication skills to work effectively with cross-functional teams.
· Ability to manage multiple priorities, meet deadlines, and deliver high-quality results in a fast-paced environment.
· Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services is a plus.
Tell employers what skills you have
Scala
Kubernetes
OpenShift
Azure
Hadoop
Automation Tools
Data Engineering
Spark
Logging
Configuration Management
Python
Containerization
Continuous Integration
Ansible
Java
Technical Leadership
Grafana
Orchestration
-
Data Engineering Lead
17 hours ago
Singapore REAL ESTATE ANALYTICS PTE. LTD. Full timeData Engineering LeadAt REAL ESTATE ANALYTICS PTE. LTD., we are seeking a highly skilled Data Engineering Lead to join our team.Key Responsibilities:We are looking for someone with strong experience in SQL programming, database design, and dealing with large volumes of data.The ideal candidate will have a solid understanding of data modeling, indexing...
-
Data Analytics Lead
2 weeks ago
Singapore The Edge Partnership Full timeJob Title: Data Analytics LeadAt The Edge Partnership, we are seeking a highly skilled Data Analytics Lead to join our team. As a key member of our organization, you will be responsible for leading the development of our Information & Analytics products, leveraging your expertise in data preparation, insight generation, and visualization.Key...
-
Data Analytics Lead
2 weeks ago
Singapore The Edge Partnership Full timeJob Title: Analytics Platform LeadAs an Analytics Platform Lead at The Edge Partnership, you will be responsible for leading the development of the Bank's Information & Analytics products, leveraging a proven track record of delivering these solutions across global organizations with varying levels of business analytics maturity.Key Responsibilities:Engage...
-
Cloud Data
2 months ago
Singapore AMPLIFY HEALTH ASIA PTE. LIMITED Full timeRoles & ResponsibilitiesDo meaningful work with us. Every day.At Amplify Health, we’re looking for individuals with ambition, resilience and passion for healthcare, insurance, wellness and digital technology. As a fast-growing business with the ambition of making people and communities across Asia healthier, we have exciting career opportunities available...
-
Data Analytics Lead
17 hours ago
Singapore NETWORK GUARD PTE. LTD. Full timeAbout the RoleWe are seeking a skilled Data Analytics Lead to join our team at NETWORK GUARD PTE. LTD. The successful candidate will be responsible for leading a group of data analysts, identifying skill gaps, and developing a team that can independently deliver high-quality advice, experimentation, analytics, and dashboards.Key Responsibilities:Manage,...
-
Data Analytics Lead
17 hours ago
Singapore SMRT TRAINS LTD. Full timeJob SummaryAt SMRT TRAINS LTD., we are looking for a highly skilled Data Analytics Lead who can leverage Artificial Intelligence (AI) and data-driven insights to enhance workplace safety and operational efficiency. The ideal candidate will oversee the development and implementation of AI-integrated analytics strategies to optimize safety processes, identify...
-
Data Engineer
4 weeks ago
Singapore NTT Data Singapore Full timeJob SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team at NTT Data Singapore.Key ResponsibilitiesAnalyze the Authority's data needs and document the requirements.Refine data collection/consumption by migrating data collection to more efficient channels.Plan, design and implement data engineering jobs and reporting solutions...
-
Data Engineer
4 weeks ago
Singapore NTT Data Singapore Full timeJob SummaryWe are seeking a highly skilled and experienced Big Data Engineer to join our team at NTT Data Singapore. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably.Key...
-
Data Analytics Lead
1 day ago
Singapore NETWORK GUARD PTE. LTD. Full timeRoles & ResponsibilitiesAbout this roleAre you a people manager and data professional passionate about growing and empowering a team of analysts to enhance data-driven decision-making across the business, we’d like to meet you!Kape is a leading SaaS and cybersecurity company. We’re building a world-class culture that leverages data to provide accurate...
-
Data Engineer
1 day ago
Singapore JCO ANALYTICS PTE. LTD. Full timeRoles & ResponsibilitiesJob Title: Data EngineerLocation: Tai Seng, SingaporeJob Type: Full-TimeOverview:We are looking for a fresh graduate (degree or diploma) Data Engineer to join our growing team. In this role, you will design, build, and maintain data pipelines and infrastructure to support the collection, storage, and analysis of large volumes of data....
-
Data Architect, Data Analytics
2 weeks ago
Singapore Suntory Holdings Limited Full timeData Architect, Data Analytics Requisition ID: 8049 Job Summary Suntory is a global leader in consumer-packaged goods, renowned for producing and distributing a uniquely diverse portfolio of beverages, premium spirits, beer, wine, and wellness products throughout the world. With a history dating back to 1899, we are driven by a profound purpose: To inspire...
-
Data Architect, Data Analytics
2 weeks ago
Singapore Suntory Holdings Limited Full timePress Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Data Architect, Data Analytics Requisition ID: 8049 Job Summary Suntory is a global leader in consumer-packaged goods, renowned for producing and distributing a uniquely diverse portfolio of beverages, premium spirits, beer, wine, and wellness products throughout...
-
Enterprise Engineering Manager
4 months ago
Singapore FACEBOOK SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesMeta Enterprise Engineering team is responsible for building integrated, scalable, and robust enterprise applications. We are currently looking for an experienced, insightful, forward-thinking Engineer Manager with a strong ability to design and execute products that power the enterprise. As a member of Enterprise Engineering, you...
-
Machine Learning Engineer
2 months ago
Singapore D L RESOURCES PTE LTD Full timeRoles & ResponsibilitiesWho we areEnterprise Analytics (EA) stands at the forefront of Bank's vision, aiming to establish the bank as a leader in deploying cutting-edge Machine Learning models. Comprising a team of experts, we focus on enhancing the bank's capabilities in supporting key areas such as Risk, Wealth, Retail, etc., with a strong emphasis on...
-
Data Analytics Visionary
5 days ago
Singapore The Edge Partnership Full timeAbout the RoleThe Edge Partnership is seeking a highly skilled Data Analytics Visionary to lead the development of the Bank's Information & Analytics products. As a key member of our team, you will leverage a proven track record of delivering these solutions across global organizations with varying levels of business analytics maturity.Key...
-
Sr. Solutions Engineer
1 day ago
Singapore DATABRICKS ASIAPAC UNIFIED ANALYTICS PTE. LTD. Full timeRoles & ResponsibilitiesAs a Pre-sales Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help...
-
Senior Data Engineer
1 day ago
Singapore REAL ESTATE ANALYTICS PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities:- Continually review and build robust infrastructure to cater for long term growth of the company- Build robust program for data extraction with failure retry with various queries (restful API, GraphQL, etc.)- MUST have strong experience in SQL Programming, database design and dealing with large volume of data.- Set...
-
Lead Consultant, Data
3 months ago
Singapore Singtel Group Full timeAbout the job Are you looking for value adding and impactful work? Do you want to make a difference with your expertise? With us, you’ll be able to make it happen. NCS is the leading technology services firm, operating across Asia Pacific in over 20 cities, providing services and solutions in consulting, digital services,...
-
Senior Data Engineering Lead
5 days ago
Singapore Singtel Group Full timeWe are seeking a seasoned Data Engineering Lead to join our team at Singtel Group. As a key member of our Data Analytics Practice, you will be responsible for overseeing the implementation of data analytics strategies for our clients, providing team leadership, and guiding and coaching a Data & AI delivery squad.Key Responsibilities:Oversee the...
-
Analytics Platform Lead
2 weeks ago
Singapore The Edge Partnership Full timeJob Responsibilities: Lead the development of the Bank’s Information & Analytics products, leveraging a proven track record of delivering these solutions across global organizations with varying levels of business analytics maturity. Engage with analytics leaders to embed advanced analytics into decision-making processes. Serve as a thought leader in...