Lead Data Engineer
6 days ago
- Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.
- Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data.
- Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch.
- Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions.
- Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques.
- Optimize data engineering workflows for containerized deployment and efficient resource utilization.
- Collaborate with DevOps teams to streamline deployment processes, implement CI/CD pipelines, and ensure platform stability.
- Monitor and optimize data pipeline performance, troubleshoot issues, and implement necessary enhancements.
- Implement monitoring and logging mechanisms to ensure the health, availability, and performance of the data infrastructure.
Machine Learning
Scalability
Scala
Big Data
Pipelines
Hadoop
ETL
Data Quality
Data Engineering
Logging
SQL
Containerization
Java
Orchestration
Databases
-
Data Engineer
2 days ago
Singapore NTT DATA SINGAPORE PTE. LTD. Full timeRoles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...
-
Lead Data Engineer
3 weeks ago
Singapore VANGUARD SOFTWARE PTE. LTD. Full timeRoles & ResponsibilitiesJOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data...
-
Lead Data Engineer
2 weeks ago
Singapore HAYS SPECIALIST RECRUITMENT PTE. LTD. Full timeRoles & ResponsibilitiesAbout the jobA Software solution company is looking for a highly skilled and experienced Lead Data Engineer to join their dynamic team. The team is passionate about leveraging advanced analytics and data-driven strategies to deliver exceptional solutions to the clients.Your new companyAs a Lead Data Engineer, you will play a pivotal...
-
Quantexa Lead Data Engineer
2 weeks ago
Singapore INFOGAIN SOLUTIONS PTE. LIMITED Full timeRoles & ResponsibilitiesRole: Quantexa Lead Data EngineerJob Requisition Number: IS42654Job Level: More than 6 years of experience (L3/L4)Location: SingaporeKey Responsibilities:As a Lead Data Engineer, you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics need of the...
-
Data Engineer
3 weeks ago
Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...
-
Lead Data Scientist
11 hours ago
Singapore OCBC Full timeAbout the RoleThe Data Science Lead will play a crucial role in driving data-driven decision making across the OCBC Group. You will work closely with business stakeholders to understand their problem statements and transform them into ML and AI challenges when needed. Your expertise will enable the development and deployment of AI and Gen AI applications for...
-
(Lead/Senior) Data Engineer
3 weeks ago
Singapore RANDSTAD PTE. LIMITED Full timeRoles & Responsibilitiesabout the companyA Singapore-based game publisher dedicated to bringing high-quality casual games to a global audience. Seeking a Senior Data Engineer to design and manage data pipelines and infrastructure for our advanced user growth platform. This role will ensure smooth data integration and enable real-time analytics...
-
Data Science Lead
16 hours ago
Singapore OCBC Full timeOVERALL ROLE PURPOSE: • Working within the Group Data Science team, you will leverage huge volumes of Structured and Unstructured data to solve real business problems across the OCBC Group. • You will work closely with business to understand their problem statements and transform them into ML and AI challenges when needed. • You will work on AI and...
-
Data Engineer
2 weeks ago
Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full timeRoles & ResponsibilitiesJob Title: Data Engineer - Mid-level/SeniorLocation: Singapore (CBD)Job Type: Full-Time PermanentKey Responsibilities:Design and maintain scalable ETL pipelines using Informatica. Optimize SQL queries and stored procedures for data manipulation. Lead data migration projects ensuring data integrity and quality. Collaborate with...
-
Data Science Lead
3 days ago
Singapore OCBC Full timeOVERALL ROLE PURPOSE: • Working within the Group Data Science team, you will leverage huge volumes of Structured and Unstructured data to solve real business problems across the OCBC Group. • You will work closely with business to understand their problem statements and transform them into ML and AI challenges when needed. • You will work on AI and...
-
Lead Data Scientist
2 weeks ago
Singapore ARCBLUE SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesCompany OverviewThe hiring company is a leading media company offering an extensive array of digital entertainment platforms. With a strong reputation in Asia and in order to stay ahead of consumer demands, they are currently looking for an experienced Lead Data Scientist to join their Consumer Insights & Analytics team to play a key...
-
Lead Mechanical Engineer – Data Centre
3 weeks ago
Singapore QUINNOX SOLUTIONS PTE. LTD. Full timeRoles & ResponsibilitiesKey Responsibilities:Provide expertise in mechanical systems for data centres, focusing on ACMV, hydraulic systems, and thermodynamics refrigeration cycles. Perform engineering calculations, including cooling load, hydraulic analysis, and equipment sizing (chillers, pumps, cooling towers, air handlers). ...
-
Global Market Development Lead
5 days ago
Singapore Data Intellect Full timeData Intellect is a data and technology consultancy firm that's constantly pushing the boundaries of what's possible. We're seeking an Executive Director of Client Development who can help us drive business expansion in APAC.The ideal candidate will have a strong understanding of the Services industry, particularly Financial Services, and be able to advise...
-
Data Engineer
3 weeks ago
Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...
-
Lead Data Architect
3 weeks ago
Singapore DOCTOR WORLD PTE. LTD. Full timeRoles & ResponsibilitiesKey ResponsibilitiesDesign and implement data management solutions, data models, and database architectures Develop and maintain a comprehensive data strategy aligned with business goals Collaborate with stakeholders to understand data requirements and translate them into technical specifications Architect and implement robust...
-
Lead Data Architect
3 weeks ago
Singapore DOCTOR WORLD PTE. LTD. Full timeRoles & ResponsibilitiesKey Responsibilities Design and implement data management solutions, data models, and database architectures Develop and maintain a comprehensive data strategy aligned with business goals Collaborate with stakeholders to understand data requirements and translate them into technical specifications Architect and implement robust...
-
Test Lead
3 weeks ago
Singapore NTT DATA SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesEmployer: NTT DATA Singapore, 12 months Contract.NTT DATA Singapore (Ranked as the world's 6th most valuable IT services provider)Role : Test Lead (Automation ) Work Location : Shenton Way, SGX CentreSalary : $ 6000 - 8000Client: One of Southeast Asia's leading financial services providers, specializing in digital insurance and...
-
Data Science Lead
2 weeks ago
Singapore TIKTOK PTE. LTD. Full timeRoles & ResponsibilitiesTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join UsAt TikTok, our people are humble, intelligent, compassionate and creative. We create...
-
Data Operations and Management Lead
5 days ago
Singapore Crypto Full timeThe Data Operations and Management Lead at Crypto will be responsible for overseeing the development and maintenance of our data warehouse, ensuring the accuracy, integrity, and availability of our data.This role involves collaborating with cross-functional teams to collect, analyze, and maintain data, driving informed decision-making and business growth.The...
-
Data Engineer
6 days ago
Singapore DELTA SG CONSULTING Full timeRoles & ResponsibilitiesLocation: SingaporeJob Type: Renewable Contract (Work onsite with a leading bank)Experience Level: Associate LevelWe are seeking a Data Engineer to design, develop, and implement data solutions leveraging Quantexa's cutting-edge technology. The ideal candidate will have strong expertise in data engineering, ETL pipelines, and big...