Data Engineer for WSG with 4 years experience

3 weeks ago


Singapore WEBSPARKS PTE. LTD. Full time
Roles & Responsibilities

Duration: 12months, renewable

We are looking for a experienced Data Engineer to support the development and maintenance of WSG data products within MOM's SeDAAP, we require a team of four developers.

The detailed key responsibilities include:

1) Data Ingestion and Processing:


• Ingest data from identified datasets (such as Career Coach 4.0 (CC 4.0) career coaching data, EDG (Enterprise Division Group) programme and grant data, Central Provident Fund (CPF) individual employment data) into MOM's SeDAAP.


• Perform data extraction, cleaning, transformation, and flow.


• Conduct web scraping when necessary for data extraction.


• Integrate and ingest both internal WSG and external datasets (e.g. from DataHive) into MOM's SeDAAP.

2) Stakeholder Collaboration:


• Work closely with various stakeholders on all data engineering related activities.


• Gather requirements, conduct clarifications, implement and deploy solutions, perform testing, and provide support maintenance across all project environments.


• Collaborate with Project Managers, Frontend Developers, UX Designers, and Data Analysts to build scalable, data-driven products that support lighthouse projects.

3) Data Architecture and Pipeline Development:


• Design data models and develop data pipelines for data warehouses, data lakes, and operational data stores.


• Create data marts and other data products to support secure analysis using various analytical tools.


• Design, build, launch, and maintain efficient and reliable large-scale batch and real-time data pipelines using appropriate data processing frameworks.

4) Documentation and Best Practices:


• Provide system documentation on design and development work.


• Ensure proper coding standards, version control, release management, and change management of programs.


• Work in an Agile environment practising Continuous Integration and Delivery.


• Engage in pair programming and code review processes with fellow developers.

5) Policy and Integration:


• Address evolving policy changes and reporting needs.


• Accommodate architecture adjustments resulting from technology upgrades.


• Ensure smooth integration with other relevant systems.


• Integrate and collate data silos in a scalable and compliant manner.

6) Backend Development:


• Develop backend APIs and work on databases to support applications.

7) SeDAAP Integration and Cloud Migration:


• Execute the migration of WSG's data into MOM's SeDAAP hosted in a cloud-based environment.


• Ensure data integrity during migration and position the data within the SeDAAP architecture.


• Collaborate with MOM's DevOps team and stakeholders to ensure seamless integration of applications and systems within SeDAAP.


• Coordinate development efforts to align with MOM's automation processes.


• Optimise platform use for specific needs and collaborate with MOM's DevOps for maintenance and support within SeDAAP.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field
  • 4 years of experience in data engineering, backend development, or cloud migration.
  • Prior experience with government-related data platforms like DataHive, CPF, or MOM's SeDAAP is a plus.
Tell employers what skills you have

Version Control
Web Scraping
Change Management
Pipelines
Release Management
Agile
Information Technology
Data Engineering
Data Architecture
Career Coaching
Continuous Integration
UX
Databases

  • Singapore WEBSPARKS PTE. LTD. Full time

    Roles & ResponsibilitiesAbout Design and Planning Lab (DPLab)Be part of URA's DPLab, which spearheads URBEX efforts in the experimentation and development of smart planning technologies through Policy-Ops-Tech collaborations. Our teams leverage on their capabilities in data policy, governance, strategy, and engineering, product strategy, business analysis,...


  • Singapore WSG Workforce Singapore Agency Full time

    [What the role is] You will play a supporting role in championing the manpower, skills and enterprises’ needs in the Food Services and Food Manufacturing sectors you may be assigned to handle. You will also be managing WSG manpower programmes and initiatives to ensure a sustainable pipeline of workers for your sector(s). [What you will be working...

  • Data Engineer

    2 weeks ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...

  • Data Engineer

    2 days ago


    Singapore User Experience Researchers Pte Ltd Full time

    **Position Summary / Project Description** Lead Data Engineer for cloud migration projects (Primarily utilizing AWS, IDMC, Databricks and Tableau) **Role and Responsibilities** **Cloud Data Engineer (AWS, Databricks, and Informatica IDMC)** A Cloud Data Engineer specializing in AWS, Databricks, and Informatica IDMC is responsible for building and...


  • Singapore WSG Workforce Singapore Agency Full time

    Strategic Manpower Planning - Identify and assess key industry, manpower challenges and skills needs - Engage strategic accounts and engage companies to diagnose gaps and identify opportunities - Recommend the design of appropriate strategic human capital solutions based on industry or enterprises’ business and manpower needs - Supporting the Industry...


  • Singapore WSG Workforce Singapore Agency Full time

    **Tasks and duties at this level includes: **Be an advocate for Jobseeker** - Identify jobseekers’ unique selling proposition and their suitability vis-à-vis targeted employers/jobs. - Collaborate within the SEU team to identify job opportunities and achieve synergy in serving the jobseekers and employers. **Employer Engagement and Relationship...

  • Leads Marketing

    5 days ago


    Singapore Workforce Singapore Full time

    **What the role is** - Background WSG is ramping up employment assistance in the form of Career Matching Services (CMS). CMS consists of career coaching, career events, Virtual Career Fairs, webinars to worker-centric programmes. Objective We are looking for Leads Marketing & CRM Executives to manage and support the outreach and sign-ups for WSG’s Career...


  • Singapore WEBSPARKS PTE. LTD. Full time

    Roles & ResponsibilitiesJoin the URA Design & Planning Lab (DPL) as a Data Manager, where you will be responsible for overseeing the entire dataset lifecycle. You will serve as the key point of contact for dataset-related inquiries and document the data management policy process from pre-acquisition to deconstruction. The Data Manager is to work with other...


  • Singapore NTT DATA Singapore PTE Ltd Full time

    Job Description - About Us - Roles and Responsibility **Job scopes**: - The Data Engineer will lead the enterprise-wide data transformations projects. The person will involve in developing and automating data processing pipelines for financial and Investment data modelling, analysis, and reporting from various data sources systems; The primary...

  • Data Engineer

    5 days ago


    Singapore TRIVI DATA CONSULTING PTE. LTD. Full time

    Key Responsibilities - Design, implement, and maintain ETL workflows for managing large-scale datasets. - Develop cloud-based data pipelines (AWS, Azure) for scalable and real-time analytics delivery. - Optimize data models to ensure high performance and reliable reporting. - Create advanced dashboards and visualizations using tools like Qlik Sense and...


  • Singapore GRAVITAS RECRUITMENT GROUP (SG) PTE. LTD. Full time

    **JUNIOR Data Engineer** Are you passionate about data engineering and eager to work in a dynamic, fast-paced environment? Join and be a key player in shaping the future of data-driven decision-making! **Role Overview**: As a Junior Data Engineer, you will be part of a team that will design, build, and optimize complex data pipelines, leveraging...

  • Data Engineer

    2 weeks ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities•Bachelor's Degree in Computer Science or equivalent;•Minimum 4+ years of experience in data engineering or software engineering.•Possess a solid foundation in Computer Science concepts such as Distributed Computing, High-Velocity Data Processing, and Lambda Architecture;•Proficient in Data modeling and...


  • Singapore WORKFORCE SINGAPORE AGENCY Full time

    Roles & ResponsibilitiesResponsibilities:Reporting to the Deputy Director, you will lead the Strategy or Planning team to drive high/wide impact processes to develop organisation-wide strategies and to drive corporate planning as well as ensure alignment and coordination within WSG and with MOM. This includes:Collaborate with WSG divisions in...

  • Data Engineer

    2 weeks ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesSummaryYou will be developing banking applications and supporting production environments.Responsibilities:Bachelor's Degree in Computer Science or equivalent; Minimum 4+ years of experience in data engineering or software engineering. Possess a solid foundation in Computer Science concepts such as Distributed Computing,...


  • Singapore WSG Workforce Singapore Agency Full time

    As the Senior Career Ambassador of Career Services Division (CSD) in Workforce Singapore Agency, you will report to the Assistant Centre Manager to engage and serve jobseekers at our WSG physical and digital touchpoints such as the Careers Connect, SGUnited Jobs & Skills Centres (SGUJSCs) across Singapore. You will work alongside our team of Career Coaches...

  • Data Engineer

    4 days ago


    Singapore IKIGAI ENABLERS Full time

    **Data Engineer Remote work from anywhere in India Experience level - 4 to 10 years Skills Required Darawarehousing Databricks AWS

  • Data Engineer

    2 days ago


    Singapore Rapsys Technologies Full time

    JD: - Good programming skills in Python - Must possess experience or interest in training and deploying machine learning models end to end. - Good understanding of basic statistics and deep learning techniques - Prior experience in data integration, profiling, validation and cleansing - Proficiency with SQL - Software delivery - Strong understanding of...

  • Career Consultant

    4 days ago


    Singapore ANGUSKNIGHT SINGAPORE PTE. LTD. Full time

    **1. JOB DESCRIPTION**: Job Title Career Consultant Job Description & Requirements **The Role** The CMP Programme is part of the ‘Adapt and Grow’ initiative by WSG which is targeted at Singaporeans (PMETs/ Non-PMETs) who are affected by redundancy and job loss. Unemployed jobseekers are referred to this programme where they are then qualified and...

  • Data Engineer

    3 days ago


    Singapore ANTAS PTE. LTD. Full time

    Role and Responsibilities - Architect and/or review technical solutions for the deployment of AI models, along with the data pipelines and visualization interfaces - Utilize DevOps tools and automate model deployment / tuning via orchestration - Provide guidance for maintenance, support and enhancements to model deployment platforms - Manage MLOps Engineer...

  • Data Engineer

    4 days ago


    Singapore Carecone Full time

    **Role - Data Engineer (Python)** **Location - Singapore** **Duration - Long term contract** **Job Scope** The Data Analyst/Engineer will define the enterprise metrics and deliver the capture of correct data in the automation and data analytics initiatives. The Data Analyst/Engineer is responsible to identify data sources, analyse existing data and...