Data Engineer for URA with 4 years experience

2 weeks ago


Singapore WEBSPARKS PTE. LTD. Full time
Roles & Responsibilities

About Design and Planning Lab (DPLab)

Be part of URA's DPLab, which spearheads URBEX efforts in the experimentation and development of smart planning technologies through Policy-Ops-Tech collaborations. Our teams leverage on their capabilities in data policy, governance, strategy, and engineering, product strategy, business analysis, software engineering, cloud engineering, urban design technologies, data science, AI/ML, and modelling and simulation to collaborate with planners, architects, and policymakers to create insights and digital solutions for Singapore's urban planning challenges.

Data Engineering Work:

  • Support data engineering tasks, including the implementation and enhancement of data pipelines, as well as the rectification of broken pipelines.
  • Manage the data platform and perform regular software version upgrades across all environments, ensuring thorough testing and detailed documentation.
  • Support daily operational needs by handling application configuration changes, managing user access request to application, addressing general function queries, and troubleshooting on issues.
  • Perform source code review and configuration review periodically to ensure code quality and verify that sensitive information, such as secrets, is not hardcoded or embedded in source codes or configuration files.
  • Periodic patching of Azure Cloud Servers
  • Develop business processes by engaging stakeholders to understand use cases for building data pipelines, performing data modeling, completing data collection forms, documenting use cases, defining data attributes within various data quality zones, and establishing naming conventions for datasets.

Requirements:

  • Degree in Computer Science, Engineering, or related disciplines
  • Experienced in data engineering, including the implementation of data pipelines, development of data models and schemas, and pipeline monitoring and management.
  • Experienced in architecting, designing, and developing data platform.
  • Experience with:

○ Python, PySpark, or similar programming languages

○ Python packages for data manipulation and analysis (e.g. Pandas, GeoPandas, Shapely)

○ Database design and management (e.g. PostgreSQL, MS SQL, Oracle, Geodatabase)

○ SQL programming (e.g. writing complex queries, optimizing performance, data manipulation)

○ Scripting and version control (e.g. Bash, PowerShell, Git)

○ ETL (Extract, Transform, Load) processes

○ Technologies such as JupyterHub, RStudio, PowerBI

○ CI/CD tools such as Jenkins, GitLab, YAML

○ GIS technology (e.g. ArcGIS Server, PostGIS)

○ API development and SFTP for secure data transfer

○ Cloud Platforms (e.g. Microsoft Azure, AWS)

○ Cloud Technologies (e.g. Azure Data Factory, Databricks, Azure Functions, Azure Key Vault, AWS Lambda)

○ Containerization technologies (e.g. Docker, Kubernetes)

  • Able to work well with a team and be willing to learn.
  • Effective presentation, communication and writing skills.

Added advantage with the following:

  • Infrastructure-as-code Tools – Terraform, CloudFormation
  • Log Management tools (e.g. Azure Monitor, AWS CloudWatch, Splunk)
  • Agile Management Tools – Confluence, Jira, Kanban board
Tell employers what skills you have

API Development
Microsoft Azure
PySpark
Pandas
ArcGIS Server
Kanban
Urban Design
Urban Planning
GIS
Data Engineering
PowerBI
YAML
Containerization
AWS Lambda
RStudio

  • Singapore WEBSPARKS PTE. LTD. Full time

    Roles & ResponsibilitiesJoin the URA Design & Planning Lab (DPL) as a Data Manager, where you will be responsible for overseeing the entire dataset lifecycle. You will serve as the key point of contact for dataset-related inquiries and document the data management policy process from pre-acquisition to deconstruction. The Data Manager is to work with other...


  • Singapore WEBSPARKS PTE. LTD. Full time

    Roles & ResponsibilitiesDuration: 12months, renewableWe are looking for a experienced Data Engineer to support the development and maintenance of WSG data products within MOM's SeDAAP, we require a team of four developers.The detailed key responsibilities include:1) Data Ingestion and Processing:• Ingest data from identified datasets (such as Career Coach...


  • Singapore WEBSPARKS PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Senior UX Designer in URA, you'll lead the design strategy and execution of complex user experiences while mentoring junior designers. Your comprehensive expertise will shape our design direction, influence product strategy, and establish best practices. Core responsibilities include:• Lead user research initiatives and...

  • Data Engineer

    6 days ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...


  • Singapore WEBSPARKS PTE. LTD. Full time

    Roles & Responsibilities[12 months contract, renewable]We are hiring a Frontend Software Engineer to join our team developing our internal 3D Geospatial web application. The primary function of this role would be to assist the team to develop new user-facing features to enhance the application, while architecting the features to maintain performance and...

  • Data Engineer

    5 days ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities•Bachelor's Degree in Computer Science or equivalent;•Minimum 4+ years of experience in data engineering or software engineering.•Possess a solid foundation in Computer Science concepts such as Distributed Computing, High-Velocity Data Processing, and Lambda Architecture;•Proficient in Data modeling and...

  • Data Engineer

    3 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Data Engineer

    1 week ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesSummaryYou will be developing banking applications and supporting production environments.Responsibilities:Bachelor's Degree in Computer Science or equivalent; Minimum 4+ years of experience in data engineering or software engineering. Possess a solid foundation in Computer Science concepts such as Distributed Computing,...


  • Singapore WEBSPARKS PTE. LTD. Full time

    Roles & Responsibilities[12 months contract, renewable] We are hiring a DevSecOps Software Engineer to join our team developing our internal 3D Geospatial web application. The primary function of this role will be to review and implement backend systems, involving CICD pipeline scripts, IaC scripts and application code in an AWS Environment.Objectives and...

  • Data Engineer

    2 weeks ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    Roles & ResponsibilitiesJob Title: Data Engineer - Mid-level/SeniorLocation: Singapore (CBD)Job Type: Full-Time PermanentKey Responsibilities:Design and maintain scalable ETL pipelines using Informatica. Optimize SQL queries and stored procedures for data manipulation. Lead data migration projects ensuring data integrity and quality. Collaborate with...

  • Data Engineer

    2 weeks ago


    Singapore AON SINGAPORE CENTER FOR INNOVATION, STRATEGY AND MANAGEMENT PTE. LTD. Full time

    Roles & ResponsibilitiesAon is in the business of better decisionsAt Aon, we shape decisions for the better to protect and enrich the lives of people around the world.As an organization, we are united through trust as one inclusive team and we are passionate about helping our colleagues and clients succeed.What the day will look likeWork closely with product...

  • Data Engineer

    3 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Data Engineer

    1 week ago


    Singapore DELTA SG CONSULTING Full time

    Roles & ResponsibilitiesLocation: SingaporeJob Type: Renewable Contract (Work onsite with a leading bank)Experience Level: Associate LevelWe are seeking a Data Engineer to design, develop, and implement data solutions leveraging Quantexa's cutting-edge technology. The ideal candidate will have strong expertise in data engineering, ETL pipelines, and big...

  • Cloud Engineer

    2 weeks ago


    Singapore USER EXPERIENCE RESEARCHERS PTE. LTD. Full time

    Roles & ResponsibilitiesWe are seeking a passionate and innovative AWS Cloud Engineer to join our team. In this role, you willbe responsible for migrating on-premises applications to AWS infrastructure using Infrastructure asCode (Terraform). You'll collaborate closely with application and data teams to ensure they have a solid,scalable platform for...

  • Data Engineer

    3 weeks ago


    Singapore PERCEPT SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesDuties:Data Domain business workflow interpretation, data requirement study, data exploration, creation of entity relationship diagram, data model creation, data extraction, transformation, and loading ("ETL"), pipeline creation and servicing data requests. Data Platform Operations, setup, installation, access controls and pipeline...

  • Data Engineer

    2 weeks ago


    Singapore IFIS ASIA HOLDINGS PTE. LTD. Full time

    Roles & ResponsibilitiesData Engineer (Contract)Are you passionate about harnessing the power of data to drive impactful decisions? Do you have a knack for building robust data platforms in Cloud? If so, we want you on our teamYour Role: As a Data Engineer, you will play a pivotal role in designing, developing, and maintaining our data infrastructure. You...


  • Singapore WEBSPARKS PTE. LTD. Full time

    Roles & Responsibilities[12 months contract, renewable]We are seeking a proactive and detail-oriented Business Analyst to join the VICA team. In this role, you will be responsible for gathering and analyzing business requirements, managing stakeholder relationships, and collaborating closely with product managers and engineering teams to ensure the...


  • Singapore BGC GROUP PTE. LTD. Full time

    Roles & ResponsibilitiesWhile prior experience in PETs is a significant plus, candidates with research or translational experience in adjacent areas are encouraged to apply.We are seeking a Privacy Research Engineer to conduct the following: Evaluate, Benchmark and Validate emerging technologies via literature reviews, studying international case studies,...

  • Data Engineer

    3 weeks ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    Roles & ResponsibilitiesSummary:We are looking for a skilled Data Engineers to support and enhance an AI-powered Search solution with Generative AI (GenAI) and Retrieval-Augmented Generation (RAG) capabilities. This solution will be implemented across Corporate Services and various departments, providing efficient and accurate responses by extracting...


  • Singapore WEBSPARKS PTE. LTD. Full time

    Roles & Responsibilities[Duration: 12+12 months, renewable]We are seeking an innovative Data Architect who has rich experience in visualizing and designing our organisation's enterprise data management framework, which describes the processes used to plan, specify, enable, create, acquire, maintain, use, archive, retrieve, control, and purge data. He or she...