AWS Cloud Data Engineer

7 days ago

Singapore EPS Consultants Full time $120,000 - $180,000 per year

Job Title: AWS ETL Cloud Data Engineer

Job Overview:
The AWS Cloud Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data infrastructure in the AWS cloud environment. This role requires expertise in AWS services, data modeling, ETL processes, and a keen understanding of best practices for data management and governance.

Key Responsibilities:

  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Spark/Python on Glue, Redshift, S3, Athena, RDS-PostgreSQL, Airflow, Lambda, DMS, Code Commit, Code Pipeline, Code build, etc.
  • Design and build production ETL data pipelines from ingestion to consumption within a big data architecture, using DMS, DataSync & Glue.
  • Understand the existing applications(including on-premise Cloudera Datalake) and infrastructure architecture.
  • Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
  • Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
  • Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
  • Collaborate with development, infrastructure and data center teams to define Continuous Integration and Continuous Delivery processes in accordance with industry standards.
  • Work on hybrid Datalake.
  • Work closely with multiple stakeholders to ensure high standards are maintained.

Requirements

Mandatory Skill-set


• Bachelors Degree in Computer Science, Information Technology or other relevant fields

• 5+ years of work experience with ETL, Data Modelling, Data Architecture to build Datalake. Proficient in ETL optimization, designing, coding, and tuning big data processes using Pyspark.

• 3+ yrs of extensive experience in working on AWS platform using core services like AWS Athena, Glue Pyspark, Redshift, RDS-PostgreSQL, S3 & Airflow(for orchestration).

Good to have Skill-set :

Fundamental of Insurance domain

Functional knowledge on IFRS17

Benefits

14 days AL
Company Insurance Benefits

  • ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD.

    4 days ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    Roles & Responsibilities About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses...

  • AWS Network Engineer

    2 weeks ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...

  • [GRIT] Cloud Engineer

    4 days ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    Roles & Responsibilities This position reports to the Project Management Office (PMO) and stakeholders. ST Engineering is committed to an employee-orientated, high performance culture that emphasises empowerment, quality, continuous improvement, and the recruitment and on-going development of a superior workplace. We are looking for a passionate and...

  • Cloud Engineer

    3 days ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time $60,000 - $120,000 per year

    This position reports to the Project Management Office (PMO) and stakeholders. ST Engineering is committed to an employee-orientated, high performance culture that emphasises empowerment, quality, continuous improvement, and the recruitment and on-going development of a superior workplace.We are looking for a passionate and motivated Cloud Engineer Intern to...

  • Customs Brokerage Operations Manager, AWS Cloud Logistics

    2 weeks ago

    Singapore Amazon Web Services (AWS) Full time

    Customs Brokerage Operations Manager, AWS Cloud Logistics AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. We support data centers and the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to innovation. We work on challenging problems...

  • Transportation Manager

    2 days ago

    Singapore Amazon Web Services (AWS) Full time

    Transportation Manager - APAC, AWS Cloud Logistics Join to apply for the Transportation Manager - APAC, AWS Cloud Logistics role at Amazon Web Services (AWS). AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. We keep the cloud running, supporting all AWS data centers and the servers, storage,...

  • Cloud Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$7,000 - S$9,500 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 7 years **Tech Stacks** AWS **Cloud Engineer (AWS)** **Responsibilities**: - Develop cloud infrastructure solutions which includes multi/hybrid cloud design and implementation. - Manage teams in implementing cloud-native...

  • Cloud System Engineer

    2 weeks ago

    Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    About ST Engineering ST Engineering is a global technology, defence, and engineering group with offices across Asia, Europe, the Middle East, and the U.S., serving customers in more than 100 countries. The Group uses technology and innovation to solve real-world problems and improve lives through its diverse portfolio of businesses across the aerospace,...

  • AWS Cloud Engineer

    1 week ago

    Singapore Rapsys Technologies Pte Ltd. Full time

    We're Hiring: AWS Cloud Engineer!We are looking for a skilled AWS Cloud Engineer to join our dynamic team in Singapore. The ideal candidate will have a strong background in cloud technologies, particularly AWS, and be adept at designing and implementing scalable cloud solutions. You will play a crucial role in managing our cloud infrastructure to ensure...

  • AWS Cloud Engineer

    1 week ago

    Singapore RAPSYS TECHNOLOGIES PTE LTD Full time

    AWS Cloud Engineer We are looking for a skilled AWS Cloud Engineer to join our dynamic team in Singapore. The ideal candidate will have a strong background in cloud technologies, particularly AWS, and be adept at designing and implementing scalable cloud solutions. You will play a crucial role in managing our cloud infrastructure to ensure optimal...