Aws Glue Developer
2 weeks ago
**Responsibilities**:
4+ years of work experience with ETL, Data Modelling, and Data Architecture Proficient in ETL optimization, designing, coding, and tuning big data processes using Pyspark Extensive experience in building data platforms on AWS using core AWS services Step function, EMR, Lambda, Glue and Athena, Redshift, Postgres, RDS etc and design/develop data engineering solutions. Orchestrate using Airflow.
**Technical Experience**:
Enhancements, new development, defect resolution, and production support of Big data ETL development using AWS native services.
Create data pipeline architecture by designing and implementing data ingestion solutions.
Integrate data sets using AWS services such as Glue, Lambda functions/ Airflow.
Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, RDS, S3, and Athena.
Author ETL processes using Python, and Pyspark.
Build Redshift Spectrum direct transformations and data modeling using data in S3.
ETL process monitoring using CloudWatch events.
You will be working in collaboration with other teams. Good communication must.
Must have experience in using AWS services API, AWS CLI, and SDK
**Professional Attributes**:
Experience operating very large data warehouses or data lakes Expert-level skills in writing and optimizing SQL Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technology.
Must have 4+ years of big data ETL experience using Python, S3, Lambda, Dynamo DB, Athena, and Glue in an AWS environment.
Expertise in S3, RDS, Redshift, Kinesis, EC2 clusters highly desired.
-
Singapore Intellect Minds Full timeKey Responsibilities: - Design, develop, and manage data solutions on AWS - Implement data warehousing, ETL, and data integration using AWS services (e.g., Redshift, Glue, Lake Formation) - Ensure data security, governance, and compliance - Optimize data pipeline performance and cost **Required Skills**: - AWS data services (Redshift, Glue, Lake...
-
AWS Cloud Data Engineer
6 days ago
Singapore EPS Consultants Full time $120,000 - $180,000 per yearJob Title: AWS ETL Cloud Data EngineerJob Overview:The AWS Cloud Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data infrastructure in the AWS cloud environment. This role requires expertise in AWS services, data modeling, ETL processes, and a keen understanding of best practices for data management and...
-
Technology Support Analyst
3 days ago
Singapore G2 COMTECH ASIA PTE. LTD. Full time**IT Infrastructure Operations.** Provide IT support for contact center project. - Handle Contact Center Agent Portal issues working with the vendor - Handle BMC related issues working with vendor - Support agents with issues related to system and access issues related to Agent Portal and BMC, connectivity issues - Monitoring AWS Connect Contact Center...
-
Support Partner Success Manager, AWS Support
2 weeks ago
Singapore Amazon Web Services (AWS) Full timeSupport Partner Success Manager, AWS Support Join to apply for the Support Partner Success Manager, AWS Support role at Amazon Web Services (AWS)AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training...
-
Research Engineer II
2 weeks ago
Singapore Nanyang Technological University Full timeResearch Engineer II (Adhesive and Glue) page is loaded## Research Engineer II (Adhesive and Glue)locations: NTU Main Campus, Singaporetime type: Full timeposted on: Posted Todayjob requisition id: R The AUMOVIO-NTU Corp Lab invites applications for the position of Research Engineer II. The research engineer will be part of a team of AUMOVIO-NTU corporate...
-
Full Stack Engineer
1 week ago
Singapore EXASOFT PTE. LTD. Full timeRoles & Responsibilities Responsibilities: Design and develop full stack applications with a focus on cloud-native architecture. Build and maintain RESTful APIs and microservices. Develop responsive front-end interfaces using modern frameworks (e.g., React, Angular). Design and implement ETL pipelines for data ingestion,transformation, and integration....
-
Senior Data Scientist
2 weeks ago
Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full timeOverview ASTEK is a technology and engineering consulting firm based in France. We have been around for over 30 years a community of more than 7200 passionate experts empowering clients in 22 countries throughout Europe, APAC, Middle East and the Americas Project phase: Maintenance phase. Data Pipeline Support Monitor and troubleshoot AWS Glue jobs and data...
-
Senior Data Scientist
5 days ago
Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full timeASTEK is a technology and engineering consulting firm based in France. We have been around for over 30 years a community of more than 7200 passionate experts empowering clients in 22 countries throughout Europe, APAC, Middle East and the Americas **_Project phase: Maintenance phase. - ** - Data Pipeline Support _ - Monitor and troubleshoot **AWS Glue**jobs...
-
Site Leader, AWS Reverse Logistics
1 week ago
Singapore Amazon Web Services (AWS) Full timeOverview AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they...
-
Aws with Etl Data Engineer
2 weeks ago
Singapore TechnoGains Solutions Pte. Ltd Full time**Roles and Responsibilities**: **- Understand key concepts in data modelling, data processing, data warehouse, data Mgmtt and data Security.** **- Hands-on experience in a data warehouse project.** **- Hands-on knowledge in Shell, Python, PowerShell.** **- Creating ingestion scripts using AWS Glue, any ETL tools like Informatica, Data Stage, Pentaho...