Cloud Data Engineer

2 weeks ago


Singapore UNISON Group Full time $13,200 - $144,000 per year
  • Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake. Integrate Informatica IDMC for metadata management and data cataloging.
  • Create, manage, and optimize data pipelines for ingesting, processing, and transforming data using AWS services like AWS Glue, AWS Data Pipeline, and AWS Lambda, Databricks for advanced data processing, and Informatica IDMC for data integration and quality.
  • Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.
  • Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
  • Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.

Requirements

  • Good experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC.
  • Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.
  • Evaluate potential technical solutions and make recommendations to resolve data issues especially on performance assessment for complex data transformations and long running data processes.
  • Strong knowledge of SQL and NoSQL databases.
  • Familiarity with data modeling and schema design.
  • AWS certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Data Analytics - Specialty), Databricks certifications, and Informatica certifications are a plus.

  • Cloud Engineer

    1 week ago


    Singapore Metaverse Cloud Solution Pte. Limited Full time

    Join hands to create a bright future for the informatization development in the field of engineering construction. Responsibilities: Responsible for Windows and Linux based IT infrastructure maintenance and implementation Provide server and network support and troubleshooting Provide technical support and system administration on cloud platform to meet...


  • Singapore NTT DATA Full time

    Requirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...

  • Data Engineer

    2 weeks ago


    Singapore CLOUD KINETICS CONSULTING PTE. LTD. Full time

    Overview We are seeking an experienced Data Engineer to join our Data team in Singapore. The ideal candidate will have a proven track record of hands-on data engineering experience, particularly within the AWS and Azure. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, ensuring the reliability, efficiency, and...

  • Cloud Engineer

    2 days ago


    Singapore NANO CLOUD PRIVATE LIMITED Full time

    Job Description & Requirements Mandatory skill : 1) Cloud Computing (Azure) Certifications. 2)Azure Solutions Architect Expert is advantageous. Job Responsibilities: To lead and manage, troubleshooting, support across various domain teams. Day1 implementation and existing Day2 operations of Cloud Operations. - At least ten (10) years’ experience in...


  • Singapore ST Engineering Cloud & Data Centre Solutions Pte Ltd Full time

    About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...


  • Singapore ST Engineering Cloud & Data Centre Solutions Pte Ltd Full time

    About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...

  • Aws Cloud Engineer

    4 days ago


    Singapore NTT Data Singapore Full time

    **Cloud Engineer (AWS)** **Responsibilities**: - Develop cloud infrastructure solutions which includes multi/hybrid cloud design and implementation. - Manage teams in implementing cloud-native frameworks for enterprise infrastructure. - Develop and implement best-in-class processes, metrics and practices. - Design, operations, and support of...

  • Azure Data engineer

    2 weeks ago


    Singapore NTT Data Singapore Full time

    Job Responsibilities: Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...


  • Singapore MAESTRO HUMAN RESOURCE PTE. LTD. Full time $120,000 - $200,000 per year

    We are seeking a highly skilled and experienced Cloud Data Engineering Lead to spearhead our cloud-based data initiatives. You will be responsible for architecting, building, and maintaining scalable data pipelines and platforms in the cloud, enabling advanced analytics and data-driven decision-making across the organization.Key Responsibilities:Leadership &...


  • Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    **Responsibilities: - Define, deploy and manage cloud-based workloads, security and compliance controls. - Implementing and maintaining cloud security measures, such as firewalls, encryption, and access controls - Managing cloud resources and provisioning capacity as needed - Troubleshooting issues and providing technical support to end-users - Regularly...