Cloud Data Engineer

1 day ago

Singapore UNISON Group Full time $13,200 - $144,000 per year
  • Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake. Integrate Informatica IDMC for metadata management and data cataloging.
  • Create, manage, and optimize data pipelines for ingesting, processing, and transforming data using AWS services like AWS Glue, AWS Data Pipeline, and AWS Lambda, Databricks for advanced data processing, and Informatica IDMC for data integration and quality.
  • Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.
  • Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
  • Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.

Requirements

  • Good experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC.
  • Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.
  • Evaluate potential technical solutions and make recommendations to resolve data issues especially on performance assessment for complex data transformations and long running data processes.
  • Strong knowledge of SQL and NoSQL databases.
  • Familiarity with data modeling and schema design.
  • AWS certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Data Analytics - Specialty), Databricks certifications, and Informatica certifications are a plus.

  • Technical Engineer

    7 days ago

    Singapore Alibaba Cloud Full time

    Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Alibaba Cloud Regional Talent Acquisition l Data Center I Software & Data Hiring Expert IAlibaba Cloud We are looking for an entry-level professional to join Alibaba Cloud's IDC team and explore the large-scale data centers. You will contribute to solution...

  • Technical Engineer

    7 days ago

    Singapore Alibaba Cloud Full time

    Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Alibaba Cloud Regional Talent Acquisition l Data Center I Software & Data Hiring Expert IAlibaba Cloud We are looking for an entry-level professional to join Alibaba Cloud's IDC team and explore the large-scale data centers. You will contribute to solution...

  • Data Center Technical Engineer

    7 days ago

    Singapore Alibaba Cloud Full time

    Overview Are you a highly motivated recent graduate with a passion for technology and a desire to build a career in cloud computing? Join Alibaba Cloud's Data Center Operations team as a Data Center Technical Engineer ! You'll play a critical role in maintaining the infrastructure that powers our global services. We are looking for enthusiastic,...

  • Data Center Technical Engineer

    12 hours ago

    Singapore Alibaba Cloud Full time

    Overview We are looking for an entry-level professional to join Alibaba Cloud's IDC team and explore the large-scale data centers. You will contribute to solution design, research and operational optimization for our Data Center. Responsibilities Responsible for exploring cutting-edge technologies (such as energy, power, HVAC, monitoring, etc.) in...

  • Cloud Data Engineer

    1 week ago

    Singapore TECH AALTO PTE. LTD. Full time

    **Job Role**:Cloud Data Engineer - GCP Migration & Transformation Specialist **Experience Level**:8+ years (with recent GCP project experience) **Job Summary**: **Key Responsibilities**: - Design and implement scalable data pipelines using **GCP BigQuery**and **Cloud Composer**, following **Medallion architecture**principles. - Lead **data model and data...

  • Data Center Technical Engineer

    7 days ago

    Singapore Alibaba Cloud Full time

    Overview Are you a highly motivated recent graduate with a passion for technology and a desire to build a career in cloud computing? Join Alibaba Cloud's Data Center Operations team as a Data Center Technical Engineer ! You'll play a critical role in maintaining the infrastructure that powers our global services. We are looking for enthusiastic,...

  • Cloud Data Engineer

    1 week ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Cloud Data Engineering ExpertWe are seeking a highly skilled Cloud Data Engineering professional to design, develop, and maintain large-scale data processing systems. This role requires a strong understanding of cloud-based data services, including AWS and Databricks.The ideal candidate will have experience with data pipelines, data warehousing, and ETL...

  • Cloud Engineer

    19 hours ago

    Singapore CLOUD KINETICS CONSULTING PTE. LTD. Full time

    Responsibilities & Duties - Responsible for day-to-day customer support and administration of cloud services. - Coordinate with vendors where cloud & virtualization specific issues need to be escalated. - Able to operate cloud security technologies / services provided natively in AWS such as Security Hub, Guarduty, Cloudwatch, AWS Config, Control Tower,...

  • Data Centre Engineer, Field Operations

    3 weeks ago

    Singapore SMC Cloud Full time

    Overview Data Centre Engineer, Field Operations role at SMC Cloud — SMC Cloud is seeking a skilled Data Centre Engineer to join the Operations team, supporting the daily operations and maintenance of AI-accelerated high-performance computing (HPC) infrastructure. This role will work closely with Field Service Engineers, HPC and Network Engineering teams,...

  • Cloud Data Engineer

    2 weeks ago

    Singapore beBeeDataEngineering Full time

    Job Title: Data Engineering Professional As a key member of our data engineering team, you will have the opportunity to work on a variety of projects that promote data culture and analytics competency. The ideal candidate will have hands-on experience with cloud-based big data platforms, including Azure Databricks and Azure Data Factory. You will be...