Senior Data Engineer

2 days ago

Yishun, Singapore Rapsys Technologies Full time

**Summary**

Python + Airflow + Snowflake Data Engineer

**Responsibilities**
- Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.
- Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.
- Implement data integration and transformation processes to ensure optimal performance and reliability of data pipelines.
- Optimize and fine-tune existing data pipelines / Airflow to improve efficiency, scalability, and maintainability.
- Troubleshoot and resolve issues related to data pipelines, ensuring smooth operation and mínimal downtime.
- Work closely with AWS services like S3, Glue, EMR, Redshift, and other related technologies to design and optimize data infrastructure.
- Develop and maintain documentation for data pipelines, processes, and system architecture.
- Stay updated with the latest industry trends and best practices related to data engineering and AWS services.

**Requirements**:

- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Proficiency in **Python, PySpark**and **SQL**for data processing and manipulation.
- Min 5 years of experience in data engineering, specifically working with **Apache Airflow**and **AWS technologies**.
- Strong knowledge of AWS services, particularly **S3, Glue, EMR, Redshift, and AWS Lambda**.
- Understanding of **Snowflake Data Lake**is preferred.
- Experience with optimizing and scaling data pipelines for performance and efficiency.
- Good understanding of data modeling, ETL processes, and data warehousing concepts.
- Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
- Effective communication skills and the ability to articulate technical concepts to non-technical stakeholders.

**Preferred Qualifications**:

- AWS certification(s) related to data engineering or big data.
- Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.
- Familiarity with other data orchestration tools in addition to Apache Airflow.
- Knowledge of version control systems like Bitbucket, Git.

**Job Type**: Contract
Contract length: 12 months

**Experience**:

- Data engineer: 6 years (required)
- Airflow: 4 years (required)
- Python: 3 years (required)
- AWS services, S3, Glue, EMR, Redshift, and AWS Lambda: 3 years (required)

Work Location: In person

  • Senior Data Engineer

    7 days ago

    Yishun New Town, Singapore Rapsys Technologies Pte. Ltd Full time $70,000 - $120,000 per year

    SummaryPython + Airflow + Snowflake Data EngineerWe are seeking a highly skilled Python / Airflow Data Engineer with 7 to 8 years of experience, specifically with a strong background in AWS technologies. The ideal candidate will have a deep understanding of Apache Airflow and its integration within AWS ecosystem, enabling efficient data pipeline...

  • Data Engineer/ Analyst

    12 hours ago

    Yishun, Singapore Abhidi Solution Full time

    **Must have skillset with Min 4 to 8 years' experience on** - Azure Synapse Analytics - Azure logic apps - ADLS Gen2 - PySpark - Azure Data Factory **Job Types**: Full-time, Contract Contract length: 12 months Pay: Up to $10,000.00 per month Work Location: In person

  • Senior / Sales Engineer (Aerospace), Singapore

    12 hours ago

    Yishun, Singapore PBA Group Full time

    **Job Summary**: The Senior / Sales Engineer is mainly responsible for executing sales & marketing initiatives, engaging new customers, and maintaining the relationship with existing accounts in order to bring in revenue for the Aerospace Business Group. **Responsibilities**: - Achieve or exceed sales target and profit margin in assigned growth...

  • Data Engineer

    2 weeks ago

    Yishun, Singapore Abhidi Solution Full time

    **Must have skillset with Min 4 to 8 years' experience on** - Working knowledge of Azure cloud. - Hands on experience on logic app - Synapse - Strong SQL and spark knowledge - Good Communication and should self-Motivator and decision maker **Good to have**: - Databricks knowledge or experience. **Job Types**: Full-time, Contract Contract length: 12...

  • Sales Engineer, Singapore

    12 hours ago

    Yishun, Singapore PBA Group Full time

    **Job Summary** The Senior / Sales Engineer is mainly responsible for executing sales & marketing initiatives, engaging new customers, and maintaining relationships with existing accounts in order to bring in revenue for the Precision Robotics Business Group. **Responsibilities**: To achieve and/or exceed sales and profit margin targets in assigned growth...

  • Senior Engineer

    2 weeks ago

    Yishun, North Region, Singapore ASMPT SEMI Solutions Full time $100,000 - $120,000 per year

    We are seeking a Senior Engineer to lead supplier quality management and ensure compliance with ASMPT's quality standards. The role involves working closely with cross-functional teams and suppliers to drive improvements, conduct audits, and support project transfers to contract manufacturers.Key Responsibilities:The role focuses on incoming material...

  • N - Singapore Manufacturing Quality Assurance Engineer (QA Engineer)

    2 weeks ago

    Yishun, Singapore AGENSI PEKERJAAN THE SUPREME HR ADVISORY SDN. BHD. Full time

    **Responsibilities**: **▪ Perform regular inspections and audit of manufacturing processes to ensure compliance with quality standards.** **▪ Establish and maintain quality standards and guidelines for manufacturing processes and output.** **▪ Collect and analyse quality-related data to identify issues and areas for improvement to enhance product...

  • Ic R&d Engineer

    2 weeks ago

    Yishun, Singapore Broadcom Full time

    Please Note: Job Description: An exciting position in the explosive growth area of Data Center Enterprise Storage doing low power, high performance analog and mixed signal design. In this role you will be responsible for developing the most advanced semiconductor devices to support high capacity storage needs across all the top tier service providers. You...

  • Process Technician/ Engineer #73464

    12 hours ago

    Yishun, Singapore Anradus Pte Ltd Full time

    Industry/ Organization Type: Manufacturing/ Production - Position Title**:Process Technician / Process Engineer**: - Working Location: Yishun - Working Hours: Mon - Fri, 8.30am - 5.30pm - Salary Package**:Up to $4,000 + Performance Bonus**: - Duration: Permanent **Key Responsibilities** - Troubleshoot process issues related to the product. - Analyze...

  • Service Engineer

    12 hours ago

    Yishun, Singapore Grace HR Solutions Full time

    Our client, one of the leading manufacturer company in Singapore for building automation products is expanding. Join them in this exciting journey as a: **Service Engineer** - Perform the maintenance service in a proper and correct manner as stated on the checklist - Attend emergency breakdown service as instructed by the team leader - Carry out testing &...