Data Engineer(Python + Airflow + Snowflake)

1 week ago


Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

Role
Data Engineer (Python + Airflow + Snowflake)
Responsibilities
Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.
Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.
Implement data integration and transformation processes to ensure optimal performance and reliability of data pipelines.
Optimize and fine-tune existing data pipelines / Airflow to improve efficiency, scalability, and maintainability.
Troubleshoot and resolve issues related to data pipelines, ensuring smooth operation and minimal downtime.
Work closely with AWS services like S3, Glue, EMR, Redshift, and other related technologies to design and optimize data infrastructure.
Develop and maintain documentation for data pipelines, processes, and system architecture.
Stay updated with the latest industry trends and best practices related to data engineering and AWS services.
Requirements
Bachelor’s degree in Computer Science, Engineering, or a related field.
Proficiency in Python, PySpark and SQL for data processing and manipulation.
Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies.
Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda.
Understanding of Snowflake Data Lake is preferred.
Experience with optimizing and scaling data pipelines for performance and efficiency.
Good understanding of data modeling, ETL processes, and data warehousing concepts.
Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
Effective communication skills and the ability to articulate technical concepts to non-technical stakeholders.
Preferred Qualifications
AWS certification(s) related to data engineering or big data.
Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.
Familiarity with other data orchestration tools in addition to Apache Airflow.
Knowledge of version control systems like Bitbucket, Git.
#J-18808-Ljbffr


  • Data Engineer

    10 hours ago


    Singapore Unison Consulting Pte Ltd Full time

    Overview Data Engineer with deep expertise in DBT (Data Build Tool), Snowflake, and PL/SQL to join our growing data team. Person will be responsible for designing, developing, and maintaining robust data transformation pipelines that support business intelligence, analytics, and data science initiatives. Key Responsibilities Design and implement scalable...

  • Data Engineer

    10 hours ago


    Singapore Unison Group Full time

    Overview Data Engineer with deep expertise in DBT (Data Build Tool), Snowflake, and PL/SQL to join our growing data team. Person will be responsible for designing, developing, and maintaining robust data transformation pipelines that support business intelligence, analytics, and data science initiatives. Key Responsibilities Design and implement scalable...

  • Sales Engineer

    2 weeks ago


    Singapore Snowflake Full time

    Build the future of the AI Data Cloud. Join the Snowflake team. We are looking for a Commercial Sales Engineer for the Singaporean market**_ _**who can solve our customer’s most complex problems. In this role you will work directly with the account sales team and channel partners to understand the needs of our customers, strategize on how to best support...

  • Data Engineer

    1 week ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Data Engineer

    2 days ago


    Singapore Epergne Solutions Full time

    Join to apply for the Data Engineer role at Epergne Solutions . Get AI-powered advice on this job and more exclusive features. Qualifications Python : Proven expertise in leveraging Python for data manipulation, scripting, and the development of robust data-driven applications. PySpark : In-depth experience in building and optimizing scalable data processing...


  • Singapore Snowflake Full time

    Build the future of the AI Data Cloud. Join the Snowflake team. The Solution Engineer will work hand-in-hand with Sales, Product, Engineering, and Marketing, and will be responsible for providing technical expertise to make Snowflake customers successful. The solution engineer will have a broad range of skills and experience ranging from data architecture...

  • Data Engineer

    2 weeks ago


    Singapore RIDIK PTE. LTD. Full time

    Must have 5+ years of relevant working experience in software or data engineering with proficiency in Python. - Strong experience in unit and integration testing. - Familiarity with DevOps practices and Agile methodologies. - Strong software engineering, analytical and problem-solving skills. - Good team player and communication skill. - Experience in AWS...

  • Data Engineer

    2 weeks ago


    Singapore NIBAARA TECHNOLOGIES PTE. LTD. Full time

    Bachelor's degree in Computer Science or related field plus 5+ years of relevant work experience in SNOWFLAKE and DBT. - Responsible for technical design, writing, support and operations of efficient, scalable, and extensible data integrations and ingestions & participate in architecture and design efforts. - Conduct PoCs for new technology exploration e.g.,...


  • Singapore Snowflake Full time

    Build the future of the AI Data Cloud. Join the Snowflake team. Snowflake is actively seeking a Solution Engineering Enablement Everboarding Partner to support our growing team. Reporting to the SE Enablement Manager, you will play a key role in creating and implementing our SE enablement strategy. IN THIS ROLE YOU WILL GET TO: Take a hands-on approach in...


  • Singapore OMRON ASIA PACIFIC PTE LTD Full time

    Overview Seeking a skilled Data Engineer to lead Snowflake-based solutions supporting AI and Data initiatives. This role drives scalable infrastructure, legacy data warehouse migration, and robust ETL/ELT pipelines. The ideal candidate will have hands-on experience implementing Snowflake Data Cloud, strong ETL/ELT capabilities, and a proven ability to...