Senior Data Engineer

1 day ago


Yishun, Singapore Rapsys Technologies Full time

**Summary**

Python + Airflow + Snowflake Data Engineer

**Responsibilities**
- Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.
- Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.
- Implement data integration and transformation processes to ensure optimal performance and reliability of data pipelines.
- Optimize and fine-tune existing data pipelines / Airflow to improve efficiency, scalability, and maintainability.
- Troubleshoot and resolve issues related to data pipelines, ensuring smooth operation and mínimal downtime.
- Work closely with AWS services like S3, Glue, EMR, Redshift, and other related technologies to design and optimize data infrastructure.
- Develop and maintain documentation for data pipelines, processes, and system architecture.
- Stay updated with the latest industry trends and best practices related to data engineering and AWS services.

**Requirements**:

- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Proficiency in **Python, PySpark**and **SQL**for data processing and manipulation.
- Min 5 years of experience in data engineering, specifically working with **Apache Airflow**and **AWS technologies**.
- Strong knowledge of AWS services, particularly **S3, Glue, EMR, Redshift, and AWS Lambda**.
- Understanding of **Snowflake Data Lake**is preferred.
- Experience with optimizing and scaling data pipelines for performance and efficiency.
- Good understanding of data modeling, ETL processes, and data warehousing concepts.
- Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
- Effective communication skills and the ability to articulate technical concepts to non-technical stakeholders.

**Preferred Qualifications**:

- AWS certification(s) related to data engineering or big data.
- Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.
- Familiarity with other data orchestration tools in addition to Apache Airflow.
- Knowledge of version control systems like Bitbucket, Git.

**Job Type**: Contract
Contract length: 12 months

**Experience**:

- Data engineer: 6 years (required)
- Airflow: 4 years (required)
- Python: 3 years (required)
- AWS services, S3, Glue, EMR, Redshift, and AWS Lambda: 3 years (required)

Work Location: In person


  • Senior Data Engineer

    23 hours ago


    Yishun New Town, Singapore Rapsys Technologies Pte. Ltd Full time $70,000 - $120,000 per year

    SummaryPython + Airflow + Snowflake Data EngineerWe are seeking a highly skilled Python / Airflow Data Engineer with 7 to 8 years of experience, specifically with a strong background in AWS technologies. The ideal candidate will have a deep understanding of Apache Airflow and its integration within AWS ecosystem, enabling efficient data pipeline...


  • Yishun, Singapore Blue Ocean Systems Infotech Pvt. Ltd. Full time

    Hi Immediate Hiring - Design and implement scalable and efficient data pipelines using **Snowflake**. - Develop and maintain **ETL/ELT workflows** to ingest, transform, and deliver clean data. - Optimize Snowflake performance (query tuning, resource management, clustering). - Collaborate with data analysts, data scientists, and business stakeholders to...


  • Yishun, Singapore Rapsys Technologies Full time

    **Responsibilities** - Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration. - Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment. - Implement data integration and transformation processes to ensure optimal performance...

  • Tech Lead

    1 week ago


    Yishun, Singapore POWER IT SERVICES Full time

    **Job Description - Tech Lead - Data Engineering & Analytics - Singapore** **Job Title: Tech Lead for Sales** - Snowflake - Advanced SQL - Data Engineering - GBI ETL Framework - Python **Roles and Responsibilities**: Pay: $8,000.00 - $10,000.00 per month Work Location: In person


  • Yishun, Singapore Mars Consulting Pte Ltd Full time

    We are seeking a highly experienced and strategic Senior Analytics Product Owner to lead the design, development, and delivery of enterprise-level analytics products. This role plays a pivotal part in bridging business objectives with data-driven solutions, enabling high-impact decision-making across multiple domains. As a key driver of analytics innovation,...


  • Yishun, Singapore Broadcom Full time

    Please Note: Job Description: Foundation IP Senior Memory Verification Engineer We are looking for energetic and passionate design engineers to join our Central Engineering Group and be part of an elite team responsible for the verification of foundation IP for AI products including memory compilers and custom macros of all types on the bleeding edge of...


  • Yishun, Singapore Broadcom Full time

    Please Note: **Job Description**: - Ability to work with common benchtop test equipment (oscilloscope, spectrum analyzer, logic analyzer, power supplies, etc) - Ability to communicate clearly, organize effectively, and document work thoroughly - Manage OSAT production-related issues (Low Yield, Engineering Change) - Support Piece part change and...


  • Yishun, Singapore INNOMFG PTE. LTD. Full time

    2 years exp **Roles & Responsibilities** Roles and responsibilities: - The Automation Project Engineer is in charge of developing Application Control Software for the automated machines developed by the company - Produce complete control solution and software design base on customer specification. - PLC based software control design & HMI software...


  • Yishun, Singapore Tech Domain Full time

    We are looking for an **ONSITE IT & Network Support Engineer/Technician**to support Casual Freelancing type tasks in your area. Would you be interested in contractual tasks? you will be paid either on an hourly or daily/half-day basis. Tickets will be dispatched with respect to your area & you may support them as per your availability (weekdays,...


  • Yishun, Singapore Broadcom Full time

    Please Note: **Job Description**: - Implement test program based on data sheet specification. - Debug and validate all software settings, wait time and IC response are within specification. - Support test platform migration and multi-site implementation. - Plan activities that optimize test program. - Drive test/probe hardware...