Cloud Native Data Architect

19 hours ago

Singapore beBeeData Full time $100,000 - $150,000
Senior Data Engineer Position Overview

At PALO IT, we are committed to creating a better future for our planet. As a Senior Data Engineer, you will play a vital role in shaping the future of data engineering by designing and implementing scalable cloud-native data pipelines that handle ingestion, transformation, quality assurance, enrichment, and advanced analytics use cases across multiple industries.

  • Develop cutting-edge data solutions using AWS and GCP platforms.
  • Lead the migration of existing on-premises and hybrid workloads into cloud-native services.
  • Design reusable data frameworks for ingestion, quality monitoring, and transformations.
  • Implement robust error handling, recovery mechanisms, and observability into pipelines.
  • Collaborate with Data Scientists and Architects to enable predictive/GenAI use cases.
Key Responsibilities
  1. Cloud-Native Pipeline Design: Design and implement scalable ETL/ELT pipelines on AWS and GCP.
  2. Migrate On-Premises Workloads: Migrate existing on-premises and hybrid workloads into cloud-native services.
  3. Data Framework Development: Build reusable data frameworks for ingestion, quality monitoring, and transformations.
  4. Error Handling and Observability: Implement robust error handling, recovery mechanisms, and observability into pipelines.
  5. Collaboration and Partnership: Partner with Data Scientists and Architects to enable predictive/GenAI use cases.
Requirements
  • 7+ years in data engineering with end-to-end pipeline design and implementation experience.
  • Strong expertise in AWS and GCP, including S3, Glue, Lambda, Step Functions, EMR, Athena, Fargate, AWS Batch, BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Functions.
  • Proficiency in Python and SQL development skills.
  • Orchestration tool expertise, such as Airflow or Cloud Composer.
  • Shell scripting (Linux) and familiarity with data formats (Parquet, ORC, JSON, Avro).
Preferred Qualifications
  • Experience integrating AWS and GCP cross-cloud pipelines.
  • Knowledge of containerization (Docker, Kubernetes, GKE/EKS).
  • Domain knowledge in Financial Services, Healthcare, Maritime, or Retail.
Benefits
  • Stimulating working environments.
  • Unique career path.
  • International mobility.
  • Internal R&D projects.
  • Knowledge sharing.
  • Personalized training.
Equality and Diversity

PALO IT is an equal opportunity employer. We do not discriminate in employment opportunities or practices on the basis of race, colour, religion, sex, sexuality, national origin, age, disability, marital status, or any other characteristics protected by law.

  • Cloud Native Architect

    6 days ago

    Singapore beBeeDataStrategist Full time $90,000 - $120,000

    Cloud Data Architect Position Job Overview: We are seeking an experienced Cloud Data Solutions Architect to design and deliver scalable data architectures that support our business operations. This role offers the chance to work on innovative data projects, contributing to the development of cloud-native data solutions for diverse industries. Main...

  • Cloud Native Architect

    2 weeks ago

    Singapore beBeeSolution Full time $120,000 - $160,000

    Solution Architect RoleAbout the Position:As a seasoned Solution Architect, you will collaborate with our esteemed client to design and develop cloud-native applications from start to finish.You will be part of an agile team that delivers tailored products for the financial sector. Your key responsibility will involve working closely with business teams and...

  • Cloud Native Solutions Architect

    4 days ago

    Singapore beBeeSystem Full time $150,000 - $200,000

    System ArchitectOur organization is looking for a System Architect to lead the design and development of cloud native applications. In this role, you will be responsible for determining client business expectations and needs, designing infrastructure and system architecture, converting system requirements into software architecture and design documentation,...

  • Cloud Native Solutions Architect

    3 days ago

    Singapore beBeeSystem Full time

    System Architect Our organization is looking for a System Architect to lead the design and development of cloud native applications. In this role, you will be responsible for determining client business expectations and needs, designing infrastructure and system architecture, converting system requirements into software architecture and design...

  • Cloud Native Presales Architect

    6 days ago

    Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    Newbridge is currently assisting a prominent software company in identifying a skilled Cloud Presales Architect to join their team. Job Summary: As a Cloud (Native) Presales Architect, you will be a key player in advancing pre-sales activities for our client, a leading software company. Your role involves understanding client requirements, architecting...

  • Internship - Cloud Native Architect and Developer

    7 days ago

    Singapore Dell Technologies Full time

    Cloud Native Architect and Developer Intern (3 to 6 months) There is a paradigm shift towards cloud-native technologies and methodologies calling for new capabilities. We are looking for interns who are passionate about cloud native architecture to join us in our Cloud Native Architecture Centre of Excellence to co-develop and architect cloud native...

  • Cloud Native Solution Architect

    3 days ago

    Singapore beBeeSolution Full time $80,000 - $120,000

    Job Title: Cloud Native Solution ArchitectWe are seeking an experienced and skilled Cloud Native Solution Architect to join our team.Key Responsibilities:Determine and confirm client business expectations and needsDesign the infrastructure and system architecture to support the cloud native solutionConvert system requirements into software architecture and...

  • Cloud Native Architect

    2 weeks ago

    Singapore beBeeSolutions Full time $120,000 - $250,000

    This is a challenging opportunity to work in AI and cloud native technologies.">">As a Solutions Architect, you will be responsible for designing and developing large-scale cloud native applications, leveraging your expertise in AI and machine learning.Your duties will include identifying new opportunities for our technology and solutions, optimally...

  • Cloud Data Architect

    3 days ago

    Singapore beBeeData Full time $120,000 - $180,000

    Cloud Engineering Leader RoleThis is an exceptional opportunity for a highly skilled Cloud Engineering Lead to spearhead our organization's cloud-based data initiatives. The selected individual will be responsible for designing, building, and maintaining scalable data pipelines and platforms in the cloud, enabling advanced analytics and data-driven...

  • Cloud Data Architect

    1 day ago

    Singapore beBeeData Full time

    Cloud Engineering Leader Role This is an exceptional opportunity for a highly skilled Cloud Engineering Lead to spearhead our organization's cloud-based data initiatives. The selected individual will be responsible for designing, building, and maintaining scalable data pipelines and platforms in the cloud, enabling advanced analytics and data-driven...