Data Engineer

2 weeks ago

Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time
Roles & Responsibilities

Responsibilities


•Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.


•Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.


•Implement data integration and transformation processes to ensure optimal performance and reliability of data pipelines.


•Optimize and fine-tune existing data pipelines / Airflow to improve efficiency, scalability, and maintainability.


•Troubleshoot and resolve issues related to data pipelines, ensuring smooth operation and minimal downtime.


•Work closely with AWS services like S3, Glue, EMR, Redshift, and other related technologies to design and optimize data infrastructure.


•Develop and maintain documentation for data pipelines, processes, and system architecture.


•Stay updated with the latest industry trends and best practices related to data engineering and AWS services.

Requirements


•Bachelor's degree in Computer Science, Engineering, or a related field.


•Proficiency in Python, PySpark and SQL for data processing and manipulation.


•Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies.

Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda.


•Understanding of Snowflake Data Lake is preferred.


•Experience with optimizing and scaling data pipelines for performance and efficiency.


•Good understanding of data modeling, ETL processes, and data warehousing concepts.


•Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.


•Effective communication skills and the ability to articulate technical concepts to non-technical stakeholders.

Preferred Qualifications:


•AWS certification(s) related to data engineering or big data.


•Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.


•Familiarity with other data orchestration tools in addition to Apache Airflow.


•Knowledge of version control systems like Bitbucket, Git.

Tell employers what skills you have

Git
Airflow
Apache Spark
Bitbucket
Glueing
AWS
Hadoop
Data Engineering
Apache Hadoop
SQL
Python
Snowflake Computing
AWS Lambda
Redshift

  • Data Engineer

    2 weeks ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...

  • Data Engineer

    7 days ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Azure Data engineer

    19 hours ago

    Singapore NTT Data Singapore Full time $120,000 - $180,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...

  • Data Engineer

    1 week ago

    Singapore NTT Data Singapore Full time

    **Competency Required**: - Possess a degree in Computer Science/Information Technology or related fields. - At least 3 years of experience in a role focusing on development and support of data ingestion pipelines. - **Experience with building on data platforms, e.g. Snowflake.**: - **Proficient in SQL and Python.**: - Experience in continuous integration...

  • Electrical Systems Technical Specialist

    2 weeks ago

    Singapore beBeeelectrical engineer Full time $80,000 - $120,000

    Job Title: Electrical Systems SpecialistAn Electrical Engineer plays a vital role in the conceptualization, design, and development of electrical engineering projects.This position involves performing prototype testing, troubleshooting, and compiling detailed analysis reports. The successful candidate will be responsible for generating electrical schematics...

  • Data Scientist

    2 weeks ago

    Singapore Data Analytics Full time $90,000 - $120,000 per year

    Get to Know the TeamGFin Analytics team supports the GFin product and business organisations, across Payments Core, Payments Experience, Lending, Insurance, and Kios. As a Data Scientist (Analytics), you'll be part of the Lending tech family where we strive to be the best FinTech company in the region. Our team is focused on understanding user experiences...

  • Systems Optimization Expert

    3 days ago

    Singapore beBee Engineer Full time $80,000 - $120,000

    Role Description:">">We are seeking an Engineer to join our team, responsible for monitoring and maintaining critical information-communication systems.">">About the Role:">As a key member of our team, you will work alongside fellow engineers to ensure the reliability and functionality of our communication systems. Your expertise in advanced technologies...

  • Senior Data Scientist

    4 days ago

    Singapore Data Analytics Full time $104,000 - $130,878 per year

    Get to Know the TeamOur Search and Personalisation Team focuses on advancing scalable machine learning and experimentation frameworks that power search relevance, ranking, and recommendations across Grab. By leveraging cutting-edge analytics and statistical methods, we continuously optimize how users connect with merchants, services, and content.Get to Know...

  • Senior Data Scientist

    4 hours ago

    Singapore Data Analytics Full time

    Get to Know the Team Our Search and Personalisation Team focuses on advancing scalable machine learning and experimentation frameworks that power search relevance, ranking, and recommendations across Grab. By leveraging cutting-edge analytics and statistical methods, we continuously optimize how users connect with merchants, services, and content. Get to...

  • Data Engineer

    2 weeks ago

    Singapore COMMUNITY DATA LABS PTE. LTD. Full time

    We are a San Francisco and Singapore based stealth startup developing a new framework for data on the internet powered by data interoperability and new economic systems. We are a stealth startup where everyone directly contributes to the core product. You’ll need to be comfortable wearing many hats and managing projects end-to-end independently. We are...