AWS Cloud Data Engineer

3 days ago

Singapore EPS Consultants Full time $120,000 - $180,000 per year

Job Title: AWS ETL Cloud Data Engineer

Job Overview:
The AWS Cloud Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data infrastructure in the AWS cloud environment. This role requires expertise in AWS services, data modeling, ETL processes, and a keen understanding of best practices for data management and governance.

Key Responsibilities:

  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Spark/Python on Glue, Redshift, S3, Athena, RDS-PostgreSQL, Airflow, Lambda, DMS, Code Commit, Code Pipeline, Code build, etc.
  • Design and build production ETL data pipelines from ingestion to consumption within a big data architecture, using DMS, DataSync & Glue.
  • Understand the existing applications(including on-premise Cloudera Datalake) and infrastructure architecture.
  • Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
  • Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
  • Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
  • Collaborate with development, infrastructure and data center teams to define Continuous Integration and Continuous Delivery processes in accordance with industry standards.
  • Work on hybrid Datalake.
  • Work closely with multiple stakeholders to ensure high standards are maintained.

Requirements

Mandatory Skill-set


• Bachelors Degree in Computer Science, Information Technology or other relevant fields

• 5+ years of work experience with ETL, Data Modelling, Data Architecture to build Datalake. Proficient in ETL optimization, designing, coding, and tuning big data processes using Pyspark.

• 3+ yrs of extensive experience in working on AWS platform using core services like AWS Athena, Glue Pyspark, Redshift, RDS-PostgreSQL, S3 & Airflow(for orchestration).

Good to have Skill-set :

Fundamental of Insurance domain

Functional knowledge on IFRS17

Benefits

14 days AL
Company Insurance Benefits

  • AWS Cloud Data Engineer

    2 weeks ago

    Singapore EPS Consultants Full time

    Job Title: AWS ETL Cloud Data Engineer Job Overview: The AWS Cloud Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data infrastructure in the AWS cloud environment. This role requires expertise in AWS services, data modeling, ETL processes, and a keen understanding of best practices for data management...

  • AWS Network Engineer

    2 weeks ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...

  • Aws Senior Engineer

    4 days ago

    Singapore NTT Data Singapore Full time

    Job Description: - Collaborating with engineering and development teams to evaluate and identify optimal cloud solutions. - Planning, implementation, monitoring and control of scalable and highly available cloud-based systems and solutions. - Developing and maintaining cloud-based solutions in accordance with best practices. - Educating teams on the...

  • Customs Brokerage Operations Manager, AWS Cloud Logistics

    1 week ago

    Singapore Amazon Web Services (AWS) Full time

    Customs Brokerage Operations Manager, AWS Cloud Logistics AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. We support data centers and the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to innovation. We work on challenging problems...

  • Cloud System Engineer

    2 weeks ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...

  • Data Engineer

    1 week ago

    Singapore CLOUD KINETICS CONSULTING PTE. LTD. Full time

    Job Title: Data EngineerJob Overview: We are seeking an experienced Data Engineer to join our Data team in Singapore. The ideal candidate will have a proven track record of hands-on data engineering experience, particularly within the AWS and Azure. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, ensuring the...

  • Data Engineer

    1 week ago

    Singapore CLOUD KINETICS CONSULTING PTE. LTD. Full time

    Overview We are seeking an experienced Data Engineer to join our Data team in Singapore. The ideal candidate will have a proven track record of hands-on data engineering experience, particularly within the AWS and Azure. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, ensuring the reliability, efficiency, and...

  • AWS & Azure Infrastructure Engineer (L2/L3)

    1 week ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the AWS & Azure Infrastructure Engineer (L2/L3)role at NTT DATA, Inc. Join to apply for the AWS & Azure Infrastructure Engineer (L2/L3)role at NTT DATA, Inc. Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a...

  • Senior Cloud Engineer

    1 week ago

    Singapore Bitdeer (NASDAQ: BTDR) Full time

    Join to apply for the Senior Cloud Engineer – AWS & Data Lake DBA role at Bitdeer (NASDAQ: BTDR)2 days ago Be among the first 25 applicants Join to apply for the Senior Cloud Engineer – AWS & Data Lake DBA role at Bitdeer (NASDAQ: BTDR)Get AI-powered advice on this job and more exclusive features. About Bitdeer Bitdeer Technologies Group (Nasdaq: BTDR)...

  • AWS-Cloud Engineer

    2 weeks ago

    Singapore AVENSYS CONSULTING PTE. LTD. Full time

    Overview Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service a client base...