Senior Data Engineer

2 days ago

Yishun, Singapore Rapsys Technologies Full time

**Summary**

Python + Airflow + Snowflake Data Engineer

**Responsibilities**
- Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.
- Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.
- Implement data integration and transformation processes to ensure optimal performance and reliability of data pipelines.
- Optimize and fine-tune existing data pipelines / Airflow to improve efficiency, scalability, and maintainability.
- Troubleshoot and resolve issues related to data pipelines, ensuring smooth operation and mínimal downtime.
- Work closely with AWS services like S3, Glue, EMR, Redshift, and other related technologies to design and optimize data infrastructure.
- Develop and maintain documentation for data pipelines, processes, and system architecture.
- Stay updated with the latest industry trends and best practices related to data engineering and AWS services.

**Requirements**:

- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Proficiency in **Python, PySpark**and **SQL**for data processing and manipulation.
- Min 5 years of experience in data engineering, specifically working with **Apache Airflow**and **AWS technologies**.
- Strong knowledge of AWS services, particularly **S3, Glue, EMR, Redshift, and AWS Lambda**.
- Understanding of **Snowflake Data Lake**is preferred.
- Experience with optimizing and scaling data pipelines for performance and efficiency.
- Good understanding of data modeling, ETL processes, and data warehousing concepts.
- Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
- Effective communication skills and the ability to articulate technical concepts to non-technical stakeholders.

**Preferred Qualifications**:

- AWS certification(s) related to data engineering or big data.
- Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.
- Familiarity with other data orchestration tools in addition to Apache Airflow.
- Knowledge of version control systems like Bitbucket, Git.

**Job Type**: Contract
Contract length: 12 months

**Experience**:

- Data engineer: 6 years (required)
- Airflow: 4 years (required)
- Python: 3 years (required)
- AWS services, S3, Glue, EMR, Redshift, and AWS Lambda: 3 years (required)

Work Location: In person

  • Senior Data Engineer

    2 weeks ago

    Yishun New Town, Singapore Rapsys Technologies Pte. Ltd Full time $70,000 - $120,000 per year

    SummaryPython + Airflow + Snowflake Data EngineerWe are seeking a highly skilled Python / Airflow Data Engineer with 7 to 8 years of experience, specifically with a strong background in AWS technologies. The ideal candidate will have a deep understanding of Apache Airflow and its integration within AWS ecosystem, enabling efficient data pipeline...

  • Snowflake Data Engineer

    1 week ago

    Yishun, Singapore Blue Ocean Systems Infotech Pvt. Ltd. Full time

    Hi Immediate Hiring - Design and implement scalable and efficient data pipelines using **Snowflake**. - Develop and maintain **ETL/ELT workflows** to ingest, transform, and deliver clean data. - Optimize Snowflake performance (query tuning, resource management, clustering). - Collaborate with data analysts, data scientists, and business stakeholders to...

  • Data Engineer(Python + Airflow + Snowflake)

    2 weeks ago

    Yishun, Singapore Rapsys Technologies Full time

    **Responsibilities** - Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration. - Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment. - Implement data integration and transformation processes to ensure optimal performance...

  • Senior Analytics Product Owner

    2 weeks ago

    Yishun, Singapore Mars Consulting Pte Ltd Full time

    We are seeking a highly experienced and strategic Senior Analytics Product Owner to lead the design, development, and delivery of enterprise-level analytics products. This role plays a pivotal part in bridging business objectives with data-driven solutions, enabling high-impact decision-making across multiple domains. As a key driver of analytics innovation,...

  • Senior Product Engineer

    1 week ago

    Yishun, Singapore Broadcom Full time

    Please Note: **Job Description**: - Ability to work with common benchtop test equipment (oscilloscope, spectrum analyzer, logic analyzer, power supplies, etc) - Ability to communicate clearly, organize effectively, and document work thoroughly - Manage OSAT production-related issues (Low Yield, Engineering Change) - Support Piece part change and...

  • Senior Industrial Engineer

    3 days ago

    Yishun, Singapore Murata Electronics Singapore Pte Ltd Full time

    Description JOB DESCRIPTIONDepartment: Industrial Engineering Department Reports to: Industrial Engineering Functional relationships: MLCC factory performance monitoring in Japan factories Internal MES factory teams POSITION PROFILEThis position is designed for a trainee who will learn and be trained in cost accounting, profit and loss analysis, and related...

  • Senior Industrial Engineer

    2 weeks ago

    Yishun, Singapore Murata Electronics Singapore Pte Ltd Full time

    JOB DESCRIPTION Department: Industrial Engineering Department Reports to: Industrial Engineering Functional relationships: MLCC factory performance monitoring in Japan factories Internal MES factory teams POSITION PROFILE This position is designed for a trainee who will learn and be trained in cost accounting, profit and loss analysis, and related processes...

  • Senior Industrial Engineer

    1 day ago

    Yishun, Singapore Murata Electronics Singapore Pte Ltd Full time

    Description JOB DESCRIPTIONDepartment: Industrial Engineering Department Reports to: Industrial Engineering Functional relationships: MLCC factory performance monitoring in Japan factories Internal MES factory teams POSITION PROFILEThis position is designed for a trainee who will learn and be trained in cost accounting, profit and loss analysis, and related...

  • IT Support/data Center Engineer

    1 week ago

    Yishun, Singapore Tech Domain Full time

    We are looking for an **ONSITE IT & Network Support Engineer/Technician**to support Casual Freelancing type tasks in your area. Would you be interested in contractual tasks? you will be paid either on an hourly or daily/half-day basis. Tickets will be dispatched with respect to your area & you may support them as per your availability (weekdays,...

  • Senior Electrical Engineer

    2 days ago

    Yishun Central, Singapore MCI Career Services Pte Ltd Full time $60,000 - $100,000 per year

    Job Highlight:Located at SembawangBasic salary up to $5,000Performance BonusMonday to Friday: 9:00 AM to 6:00 PMSaturday: 9:00 AM to 1:00 PMResponsibilities:Lead and manage the electrical team, ensuring smooth operations and timely project completion.Take on engineering duties, including design, calculations, and planning of electrical systems for...