Senior Data Engineer

2 days ago

Singapore PALO IT Full time

Overview

PALO IT is a global technology consultancy that crafts tech as a force for good. We design, develop and scale digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We do the right thing, and we do it right. We are proud to be a World Economic Forum New Champion, and a B Corp-certified company.

We are small enough to care locally, big enough to deliver globally (5 continents, 18 offices, +650 experts from +50 nationalities); robust and resilient (100% independent and 0 debt); entrepreneurs and passionate experts ; positive, courageous, caring, doers and committed to excellence .

Role

The projects involve building and scaling cloud-native data pipelines to handle ingestion, transformation, quality assurance, enrichment, and advanced analytics use cases across multiple industries. We are seeking a Senior Data Engineer to modernize and enhance data platforms, with strong expertise in AWS and GCP .

Responsibilities

  • Design and implement scalable ETL/ELT pipelines on AWS and GCP.
  • Migrate existing on-premises and hybrid workloads into cloud-native services.
  • Build reusable data frameworks for ingestion, quality monitoring, and transformations.
  • Implement robust error handling, recovery mechanisms, and observability into pipelines.
  • Partner with Data Scientists and Architects to enable predictive/GenAI use cases.

Must Have Experience

  • 7+ years in data engineering with end-to-end pipeline design and implementation.
  • AWS expertise : S3, Glue, Lambda, Step Functions, EMR, Athena, Fargate, AWS Batch.
  • GCP expertise : BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Functions.
  • Strong Python and SQL development skills.
  • Proficiency with orchestration tools like Airflow or Cloud Composer.
  • Shell scripting (Linux).
  • Familiarity with data formats (Parquet, ORC, JSON, Avro) and modern storage patterns.

Good to Have

  • Experience integrating AWS GCP cross-cloud pipelines.
  • Knowledge of containerization (Docker, Kubernetes, GKE/EKS).
  • Domain knowledge in Financial Services, Healthcare, Maritime, or Retail .

Equal Opportunity

PALO IT Singapore is an equal opportunity employer. Employment decisions will be based on merit, qualifications and abilities. Palo IT SG does not discriminate in employment opportunities or practices on the basis of race, colour, religion, sex, sexuality, national origin, age, disability, marital status or any other characteristics protected by law.

#J-18808-Ljbffr

  • Data Engineer

    2 weeks ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...

  • Senior Engineer/Engineer, Facility Management

    7 days ago

    Singapore Keppel Data Centres Full time

    Senior Engineer/Engineer, Facility Management Join to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data Centres Senior Engineer/Engineer, Facility Management Join to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data Centres Maintain a positive and professional working relationship with internal and...

  • Senior Engineer/Engineer, Facility Management

    6 days ago

    Singapore Keppel Data Centres Full time

    Senior Engineer/Engineer, Facility Management Join to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data Centres Senior Engineer/Engineer, Facility Management Join to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data Centres Maintain a positive and professional working relationship with internal...

  • Senior Engineer/Engineer, Facility Management

    4 weeks ago

    Singapore Keppel Data Centres Full time

    Senior Engineer/Engineer, Facility ManagementJoin to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data CentresSenior Engineer/Engineer, Facility ManagementJoin to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data CentresMaintain a positive and professional working relationship with internal and...

  • Data Engineer

    7 days ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Senior Backup Engineer SME

    2 days ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the Senior Backup Engineer SME role at NTT DATA, Inc. 2 days ago Be among the first 25 applicants Join to apply for the Senior Backup Engineer SME role at NTT DATA, Inc. Get AI-powered advice on this job and more exclusive features. Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are...

  • Senior Process Engineer

    4 weeks ago

    Singapore The Chemical Engineer Full time

    Wood is currently recruiting for a Process Engineer with extensive experience in the pharmaceutical and bio-pharma industry to support our growing operations in Singapore. You will be responsible for ensuring that process engineering activities on assigned projects are executed within budgeted manhours and approved schedules, in compliance with project...

  • Data Scientist

    2 weeks ago

    Singapore Data Analytics Full time $90,000 - $120,000 per year

    Get to Know the TeamGFin Analytics team supports the GFin product and business organisations, across Payments Core, Payments Experience, Lending, Insurance, and Kios. As a Data Scientist (Analytics), you'll be part of the Lending tech family where we strive to be the best FinTech company in the region. Our team is focused on understanding user experiences...

  • Systems Optimization Expert

    3 days ago

    Singapore beBee Engineer Full time $80,000 - $120,000

    Role Description:">">We are seeking an Engineer to join our team, responsible for monitoring and maintaining critical information-communication systems.">">About the Role:">As a key member of our team, you will work alongside fellow engineers to ensure the reliability and functionality of our communication systems. Your expertise in advanced technologies...

  • Senior Data Scientist

    4 days ago

    Singapore Data Analytics Full time $104,000 - $130,878 per year

    Get to Know the TeamOur Search and Personalisation Team focuses on advancing scalable machine learning and experimentation frameworks that power search relevance, ranking, and recommendations across Grab. By leveraging cutting-edge analytics and statistical methods, we continuously optimize how users connect with merchants, services, and content.Get to Know...