Azure/ Databricks Data Engineer

5 days ago

Singapore PSA International Full time

**Azure/ Databricks Data Engineer**

You will be engaged as a Data Engineer in PSA Group Data For Excellence (DFE), supporting PSA’s Data Analytics initiatives and PSA Global Data Analytics Platform (GDAP). Besides creating and maintaining data pipelines, data models; enhancing GDAP features; you will work with other DFE members to promote data culture and data analytics competency within PSA.

**Job Description**:

- Work with PSA business units globally to set up their data analytics needs within GDAP.
- Enable the timely availability of good quality data to facilitate data-oriented management decisions.
- Work with new data sources from around the world to provide data to our Global Data Analytics Platform built on Azure Cloud and Databricks.
- Implement automated Data Quality measures to sieve out bad quality data for timely rectifications by data sources
- Design, construct and maintain Meta-data driven frameworks to automate & govern data engineering processes.
- Design, construct and maintain Datawarehouse models to support PSA global, regional and local business units data analytics needs.
- Create and maintain data pipelines to transform and load data from data lake into Datawarehouse models.
- Create and maintain data science sandbox, machine learning tools, generative ai, data marts, data catalogue, data lineage, etc.
- Continuous enhancement of GDAP to keep the platform relevant and ready.
- Work and collaborate with PSA data analytics team at all stages of CRISP-DM Methodology.
- Align to PSA data analytics policy, standards and best practices and document as required.
- Jointly organize data analytics workshops and data seminars to promote data culture and data analytics competency within PSA.

Technical Requirements
- Degree from a recognised university, preferably in Data Analytics or Computer Science domain;
- Must have at least two years hands-on experience as a Data Engineer including at least one year using Microsoft and \ or Databricks data tools;
- Must have knowledge of data warehouse concept (Star, snowflake or data vault) methodology and experience in designing data warehouse dimensional modelling;
- Must have hands-on experience in Azure Data Factory, Azure Synapse Analytics / Datawarehouse, Azure Analysis Services, Azure Databricks, Azure Fabric and Python;
- Preferably with relevant certifications from Microsoft including Azure Data Engineer Associate and / or Databricks including Databricks Certified Data Engineer Associate;
- Preferably with hands-on experience in using Azure OpenAI and \ or Azure AI Services;
- Knowledge of Microsoft Power Platform or.Net or C# or NoSQL or open-source data analytics software will be advantageous.

Soft Skills Requirements
- Strong project management skills;
- Analytical, meticulous, team player;
- Strong written and oral communication skills in English. Ability to communicate in additional languages is added advantage;
- Strong interpersonal skills to liaise effectively with users and stakeholders; overcoming challenges of language, cultural and time zones;
- Ability to work under pressure towards fixed deadlines without jeopardizing standard of work.

  • Data Engineer

    2 weeks ago

    Central Singapore Avanade Full time

    Data Engineer As a Data Engineer, you will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the data supply chain, by ensuring stakeholders can access and manipulate data for...

  • Data Engineer

    6 days ago

    Singapore REGTECH INSIGHT PTE. LTD. Full time

    We are seeking an experienced Project Manager with strong Databricks exposure to lead end-to-end data engineering, analytics, and cloud transformation initiatives. The ideal candidate will have demonstrated expertise in managing cross-functional teams, delivering data platform projects, and working closely with technical teams using Databricks, Azure/AWS,...

  • Databricks Admin

    5 days ago

    Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Preferable Azure Databricks certified professional with minimum 3 years of experience as Azure Databricks admin. **Requirements**: - Identity and Access Management - Data Security - Cost Management - Workspace Configuration - Monitoring and Logging - Automation - Networking and Security - Platform Governance 1 - Data Architecture Principles 2 - Data...

  • Databricks Admin

    5 days ago

    Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Preferable Azure Databricks certified professional with minimum 4 years of experience as Azure Databricks admin. **Requirements**: - Identity and Access Management - Data Security - Cost Management - Workspace Configuration - Monitoring and Logging - Automation - Networking and Security - Platform Governance 1 - Data Architecture Principles 2 - Data...

  • Azure Databricks Admin

    7 days ago

    Singapore Rapsys Technologies Full time

    Data Access - Preferable Azure Databricks certified professional with minimum 4 years of experience as Azure Databricks admin. Here is the minimum skillset required: - Identity and Access Management - Data Security - Cost Management - Workspace Configuration - Monitoring and Logging - Automation - Networking and Security - Platform Governance **Job...

  • Senior Azure Data Architect — Databricks

    2 days ago

    Singapore Charterhouse Partnership | Asia Full time

    A leading financial institution is seeking a Senior Azure Data Platform Solution Architect in Singapore. The role involves formulating Azure Data Architecture, devising data solutions using Databricks, and ensuring regulatory compliance. Applicants should have a relevant Bachelor's degree and extensive experience with Azure services and Databricks. Excellent...

  • Azure Data engineer

    1 week ago

    Singapore NTT Data Singapore Full time $80,000 - $120,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations...

  • Data Engineer

    1 week ago

    Singapore Unison Consulting Pte Ltd Full time

    As a Data Engineer specializing in Databricks, you will be instrumental in designing, building, and maintaining robust data processing pipelines leveraging the Databricks platform. You will work closely with data scientists and analysts to ensure the seamless integration and transformation of data to facilitate analytical needs and enhance decision-making...

  • Data Engineer

    1 week ago

    Central Singapore Avanade Full time

    As a Data Engineer, you will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the data supply chain, by ensuring stakeholders can access and manipulate data for routine and ad...

  • Data Engineer

    2 weeks ago

    Singapore TECHCOM SOLUTIONS (SINGAPORE) PTE. LTD. Full time

    Design and implement data storage solutions. Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Create data models for analytics purposes Utilizing Azure Data Factory or comparable...