Senior Data Pipeline Engineer
2 weeks ago
Mission Summary:
We are seeking a talented Senior Data Pipeline Engineer to design and implement robust large scale data processing and transformation pipelines in the Data Platform team.
The Data Platform builds a scalable compute platform that is used throughout the company, enabling a diverse set of teams to access data, extract meaningful automated metrics out of the data, and perform various ad-hoc analyses on the data. We deal with data on the petabyte scale and provide critical functions to improve the development of a reliable AV by allowing various researchers and engineers to understand how the AV performs various tasks and scenarios in real world or simulated environments. The Data Platform team is responsible for building automated pipelines to perform extraction of information from the data, transformation of data into different formats that can be consumed by downstream services and for building interfaces to enable easy access to the data.
What You'll Be Doing
- Design, build, maintain and monitor scalable data pipelines in the cloud infra.
- Design and build self-service data platform infrastructure and backend services
- Write high quality, maintainable code
- Mentor junior engineers with high-level system design and code reviews
- Communicate with stakeholders and team leads to identify system requirements
- Take a strong sense of ownership and responsibility for reliable and efficient data pipelines.
What We're Looking For
- 5+ years of professional work experience as a data pipeline engineer.
- BS or MS in Computer Science or related field
- Expertise with distributed data processing frameworks, such as Spark, Flink, Beam
- Expertise with Java, Python or Go
- Experience with AWS services and solutions
- Experience with cloud-native backend software development is a plus
- Experience with Kubernetes is a strong plus
- Strong written and oral communication skills
- Comfortable working in a fast-paced, continuous delivery environment
Oral Communication Skills
Scala
Kubernetes
Big Data
Pipelines
Hadoop
Data Transformation
ETL
Data Engineering
SQL
System Design
Python
AV
Java
Databases
Software Development
-
Data Pipeline Developer Position
3 days ago
Singapore Nicoll Curtin - Singapore Full timeJoin Our TeamWe are seeking an experienced Data Engineer to join our team in Singapore.The successful candidate will design, develop, and maintain data pipelines and backend services for real-time decisioning, reporting, data collecting, and related functions.About Nicoll Curtin - SingaporeNicoll Curtin - Singapore is a leading professional services firm...
-
Data Engineer
7 hours ago
Singapore NTT DATA SINGAPORE PTE. LTD. Full timeRoles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...
-
Senior Data Engineer
3 weeks ago
Singapore JAC RECRUITMENT PTE. LTD. Full timeRoles & ResponsibilitiesCOMPANY OVERVIEWOur client renowned for its exceptional customer experience, innovative facilities, and commitment to sustainability. Key features include a complex with extensive retail and dining options, and unique attractions.We are currently looking for a Senior Data Engineer. JOB RESPONSIBILITIES· Design, implement, and...
-
Senior Data Engineer
3 weeks ago
Singapore JAC RECRUITMENT PTE. LTD. Full timeRoles & ResponsibilitiesCOMPANY OVERVIEWOur client renowned for its exceptional customer experience, innovative facilities, and commitment to sustainability. Key features include a complex with extensive retail and dining options, and unique attractions.We are currently looking for a Senior Data Engineer. JOB RESPONSIBILITIES· Design, implement, and...
-
Senior Data Engineer
7 hours ago
Singapore RANDSTAD PTE. LIMITED Full timeRoles & ResponsibilitiesOur client is a game publisher based in Singapore, dedicated to delivering high-quality casual games worldwide. With a focus on innovation, creativity, and humor, it supports developers from development to launch, creating unforgettable gaming experiences.about the jobDesign, develop, and maintain scalable data pipelines to process...
-
Senior Data Engineer
1 week ago
Singapore EPS COMPUTER SYSTEMS PTE LTD Full timeRoles & ResponsibilitiesAs a Machine Learning Data Engineer, you will be responsible for designing, implementing, and maintaining the data pipelines and infrastructure that support our machine learning projects. You will work closely with data scientists, machine learning engineers, cloud engineer and other cross-functional teams to ensure the availability,...
-
Senior Data Engineer
6 days ago
Singapore EDENRED PTE. LTD. Full timeRoles & ResponsibilitiesRole MissionsThe Senior Data Engineer owns, supports, and improves the data capabilities in terms of collecting, managing, and converting raw data into information that can be interpreted by data analysts and data scientists.The goals will be to define, build and improve the architecture, tools and procedures for data pipelining,...
-
Senior Data Engineer
3 weeks ago
Singapore HAYS SPECIALIST RECRUITMENT PTE. LTD. Full timeRoles & ResponsibilitiesWe are looking for Senior Data Engineer to join Data Engineer team squad. You will be responsible for platform administration, operational support, small change and release management. Larger, more complex changes are delivered by an L3 squad and project teams.Key Responsibilities:Release Management and Support activity (~60%):·...
-
(Lead/Senior) Data Engineer
3 weeks ago
Singapore RANDSTAD PTE. LIMITED Full timeRoles & Responsibilitiesabout the companyA Singapore-based game publisher dedicated to bringing high-quality casual games to a global audience. Seeking a Senior Data Engineer to design and manage data pipelines and infrastructure for our advanced user growth platform. This role will ensure smooth data integration and enable real-time analytics...
-
Data Engineer
1 week ago
Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full timeRoles & ResponsibilitiesJob Title: Data Engineer - Mid-level/SeniorLocation: Singapore (CBD)Job Type: Full-Time PermanentKey Responsibilities:Design and maintain scalable ETL pipelines using Informatica. Optimize SQL queries and stored procedures for data manipulation. Lead data migration projects ensuring data integrity and quality. Collaborate with...
-
Data Engineer
1 week ago
Singapore MAESTRO HUMAN RESOURCE PTE. LTD. Full timeRoles & ResponsibilitiesJob Description & RequirementsWe are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and...
-
Data Engineer
3 weeks ago
Singapore RANDSTAD PTE. LIMITED Full timeRoles & Responsibilitiesabout the companyA Singapore-based game publisher dedicated to bringing high-quality casual games to a global audience. Seeking a Senior Data Engineer to design and manage data pipelines and infrastructure for our advanced user growth platform. This role will ensure smooth data integration and enable real-time analytics...
-
Senior Data Engineer
3 weeks ago
Singapore ACHIEVE CAREER CONSULTANT PTE LTD Full timeRoles & ResponsibilitiesRole Overview:As a Senior Data Engineer, you will be responsible for acquiring, storing, governing, and processing large volumes of structured and unstructured data. You will contribute to designing optimal architecture components, implementing enterprise data foundations such as data lakes, and supporting data-driven decision-making....
-
Senior Data Engineer
3 weeks ago
Singapore ACHIEVE CAREER CONSULTANT PTE LTD Full timeRoles & ResponsibilitiesRole Overview:As a Senior Data Engineer, you will be responsible for acquiring, storing, governing, and processing large volumes of structured and unstructured data. You will contribute to designing optimal architecture components, implementing enterprise data foundations such as data lakes, and supporting data-driven decision-making....
-
Data Engineer
1 week ago
Singapore RANDSTAD PTE. LIMITED Full timeRoles & Responsibilitiesabout company I am currently working with a leading and reputable game studio. HQ in SG. 1,500 employees in China with 30+ employees in Singapore.Salary budget open Base salary + AWS + variable bonus2-3 rounds of interview to offer stage. 5 days in office.about jobDesign, develop, and maintain scalable data pipelines to process and...
-
Senior Data Engineer
2 weeks ago
Singapore IOTALENTS PTE. LTD. Full timeRoles & ResponsibilitiesJoin a leading organization at the forefront of innovation, where data powers critical operations on a massive scale. As a key player in one of the world's most complex and dynamic environments, the company handle vast amounts of real-time data from multiple sources—spanning sensor networks, operational systems, and passenger...
-
Data Engineering Solutions Architect
2 days ago
Singapore Meliora Full timeAt Meliora, we are seeking a highly experienced Senior Director of Data to lead our regional data engineering teams.This role will include the following:Designing and implementing data engineering solutions that meet our business needsOptimising data pipelines for reliability and performanceLiaising with regional and global teams to align with our data...
-
Lead Data Engineer
3 weeks ago
Singapore VANGUARD SOFTWARE PTE. LTD. Full timeRoles & ResponsibilitiesJOB SUMMARYWe are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data...
-
Senior Director of Data
2 days ago
Singapore Meliora Full timeThis role will include the following: Architect, implement and design data engineering solutions Optimise data pipelines for reliability and performance Lead a team of 10 regionally distributed data professionals Liaise with regional and global teams to align with data strategy Work with data management and analytics teams to align...
-
Data Engineer
5 days ago
Singapore INNOCELLENCE SYSTEMS PTE. LTD. Full timeRoles & ResponsibilitiesWe are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data scientists and...