Senior Cloud Engineer

2 weeks ago

Singapore ITCAN Pte Ltd Full time

Create, manage, and optimize data pipelines for ingesting, processing, and transforming data using AWS services like AWS Glue, AWS Data Pipeline, and AWS Lambda, Databricks for advanced data processing, and Informatica IDMC for data integration and quality.
- Support data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake. Integrate Informatica IDMC for metadata management and data cataloging.
- Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.
- Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
- Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.
- Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring compliance with data privacy regulations. Employ Informatica IDMC for data governance and compliance.
- Implement automation for routine tasks, such as data ingestion, transformation, and monitoring, using AWS services like AWS Step Functions, AWS Lambda, Databricks Jobs, and Informatica IDMC for workflow automation.
- Maintain clear and comprehensive documentation of data infrastructure, pipelines, and configurations in both AWS and Databricks environments, with metadata management facilitated by Informatica IDMC.
- Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver appropriate solutions across AWS, Databricks, and Informatica IDMC.
- Identify and resolve data-related issues and provide support to ensure data availability and integrity in both AWS, Databricks, and Informatica IDMC environments.
- Optimize AWS, Databricks, and Informatica resource usage to control costs while meeting performance and scalability requirements.
- Stay up-to-date with AWS, Databricks, Informatica IDMC services, and data engineering best practices to recommend and implement new technologies and techniques.

Schedule:

- Day shift
- Monday to Friday

  • Senior Cloud Engineer, Cloud

    6 days ago

    Singapore NCS Full time

    **Senior Cloud Engineer, Cloud**: **Date**:2 Dec 2024 **Location**: Singapore, Singapore **Company**:Singtel Group NCS is a leading technology services firm that operates across the Asia Pacific region in over 20 cities, providing consulting, digital services, technology solutions, and more. We believe in harnessing the power of technology to achieve...

  • Senior/ Manager, Sales

    1 week ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    **About ST Engineering** ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...

  • Senior/ Cloud Infra Engineer

    2 weeks ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time $80,000 - $120,000 per year

    About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...

  • Senior Cloud Engineer

    6 days ago

    Singapore LMA Full time

    Join a technology and software development industry who are empowering innovation by offering a dynamic, collaborative environment where your skills can truly shine. As a Senior Cloud Engineer, you’ll be an integral part of a dynamic team, working on cutting-edge cloud solutions to help the organization and clients scale and succeed. In this role, you will...

  • Senior Cloud Engineer

    2 weeks ago

    Singapore EXECUTIVE SEARCH PRIVATE LIMITED Full time

    We are seeking a highly skilled and experienced Senior Cloud Operations Engineer to join our dynamic team. As a Senior Cloud Operations Engineer, you will play a critical role in designing, implementing, and maintaining our cloud infrastructure, with a focus on Microsoft Azure, Kubernetes, Micro Services, Office 365, and Citrix Cloud. Your expertise in...

  • Cloud System Engineer

    2 weeks ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...

  • Cloud System Engineer

    7 days ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...

  • Senior Cloud Engineer

    6 days ago

    Singapore LMA Full time

    Join a technology and software development industry who are empowering innovation by offering a dynamic, collaborative environment where your skills can truly shine. As a Senior Cloud Engineer, you’ll be an integral part of a dynamic team, working on cutting-edge cloud solutions to help the organization and clients scale and succeed. In this role, you will...

  • Senior Cloud Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,000 - S$8,000 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 5 years **Tech Stacks** API Gateway AWS Terraform Docker Jenkins API CI Helm Puppet Kubernetes Ansible Key Requirement - 5 - 7 years of experience in a Cloud/DevOps Engineering role - Strong knowledge of Cloud principles,...

  • Senior Software Engineer

    3 days ago

    Singapore UBS Full time

    Join to apply for the Senior Software Engineer (Cloud)role at UBS Get AI-powered advice on this job and more exclusive features. Job Reference #BR Job Type Full Time Your role We are looking for a highly skilled Cloud Engineer to join our team. In this role, you will work closely with our engineering teams to optimize, implement, and maintain our Azure...