Azure Data Engineer

4 weeks ago

Singapur, Singapore SMRT Corporation Ltd Full time

Job Purpose

We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you will create and maintain optimal data pipelines architecture in cloud. Overall, you will strive for efficiency by aligning data systems with business goals. 

To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.

If you are detail-oriented, with excellent organizational skills and experience in this field, we would like to hear from you.

Responsibilities

The duties and responsibilities are listed below. The list is not comprehensive and related duties and responsibilities may be assigned from time to time. 

• Understand the data landscape to formulate and complete end-to-end data strategy that includes data gathering, data processing, analysis, ongoing scaled deliverables, and presentations to facilitate decision-making and forward planning.
• Identify opportunities for data acquisition, work with system owners to automate data connection.
• Analyse and organize raw data, combine raw information from different sources, build data systems and data pipelines, perform extract transform and load (ETL) to prepare data for prescriptive and predictive modeling.
• Able to analyze, implement and integrate the right services in cloud based on different data formats (Structured, Semi-Structured and Unstructured)
• Evaluate business needs and objectives, interpret trends, patterns, and conduct complex data analysis and report on results 
• Build algorithms and prototypes, explore ways to enhance data quality and reliability; Develop analytical tools and programs
• Collaborate with data scientists and architects on several projects

Qualifications & Work Experience

• Degree in Computer Science, IT, or similar engineering field; a Master is a plus
• Previous experience as a data engineer or in a similar role
• Data engineering certification is a plus

Skills

Technical skills include:
• Strong analytical skills with the ability to collect, clean, organise, analyse, and disseminate significant amounts of information with attention to detail and accuracy.
• Strong technical knowledge of programming languages (Python, SQL & Spark)
• Experience in Azure Cloud technologies (i.e., Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Functions, Event Hub, Azure Logic Apps and ARM Templates)
• Experience with CI/CD tool: Azure DevOps.
• Experience in IaC (ARM Templates, Bicep).
• Strong knowledge about Git and branching.
• Technical expertise with data models, data mining, and segmentation techniques.
• Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.
• Hands-on experience with SQL database design.
• Nice to have Skills: Azure API Management, Azure API gateway, Scala, Snowflake, and Databricks.

Generic skills include:
• Critical thinker and problem-solving skills
• Team player
• Good time-management skill
• Great interpersonal and communication skills

  • Azure Data Engineer

    3 weeks ago

    Singapur, Singapore PSA International Full time

    As a member of #TeamPSA, you will be part of a diverse and global team at the forefront of creating cargo solutions to enable more agile, resilient and sustainable supply chains. Experience first-hand and drive supply chain transformation from Singapore and through PSA’s global network of ports, logistics and supply chain solutions. Alongside, we can...

  • Azure Data Platform Engineer

    4 days ago

    Singapur, Singapore Consultz Full time

    Azure Data Platform Design and Implementation:Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions. Implement and optimize data storage, processing, and analytics solutions on Azure, leveraging services such as Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics.Infrastructure...

  • Azure Data Platform Engineer

    3 days ago

    Singapur, Singapore Consultz Full time

    This role is for DataHonDo, based in Singapore.Consultz is supporting the hiring for DataHonDo.Azure Data Platform Design and Implementation: Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions. Implement and optimize data storage, processing, and analytics solutions on Azure, leveraging services...

  • Azure Data Platform Engineer

    5 days ago

    Singapur, Singapore Consultz Full time

    Job DescriptionAzure Data Platform Design and Implementation:Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions. Implement and optimize data storage, processing, and analytics solutions on Azure, leveraging services such as Azure Data Lake Storage, Azure SQL Database, and Azure Synapse...

  • Azure Data Platform Engineer

    2 days ago

    Singapur, Singapore Consultz Full time

    Job DescriptionThis role is for DataHonDo, based in Singapore.Consultz is supporting the hiring for DataHonDo.Azure Data Platform Design and Implementation: Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions. Implement and optimize data storage, processing, and analytics solutions on Azure,...

  • Business Analyst

    3 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Requirement Gathering and Analysis: Collaborate with business stakeholders to understand their data and analytics needs. Conduct thorough analysis of business requirements and translate them into technical specifications. Azure Data Factory Utilization: Demonstrate expertise in designing and implementing data pipelines using Azure Data Factory. Work closely...

  • Senior Data Engineer

    3 weeks ago

    Singapur, Singapore Helius Full time

    Responsibilities Design and develop data pipelines and data infrastructure to support efficient and scalable data processing and analytics. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions. Implement and maintain data integration and ETL (Extract, Transform,...

  • Azure Admin

    4 weeks ago

    Singapur, Singapore Flintex Consulting Pte Ltd Full time

    Job DescriptionJob requirements •           Technical know-how and experience in IT solutions such as (but not limited to) and at least operated in more than one of the following:• A must to have in-depth experience in architecture design, managing and support the following applications/systems – Cloud Computing Platforms (Office365, Azure,...

  • Data Engineer

    4 weeks ago

    Singapur, Singapore NodeFlair Full time

    1. Key Outputs:  Collaborate with both non-technical and technical team members from cross-functional business and IT teams to gather, elicit and document data requirements and translate them into: Data Models and Mapping Specifications Develop and govern data modeling standards, best practices, and guidelines to ensure consistency and maintainability...

  • Azure Admin

    4 weeks ago

    Singapur, Singapore Flintex Consulting Pte Ltd Full time

    Job requirements •           Technical know-how and experience in IT solutions such as (but not limited to) and at least operated in more than one of the following:• A must to have in-depth experience in architecture design, managing and support the following applications/systems – Cloud Computing Platforms (Office365, Azure, AWS,etc),...

  • Azure Cloud Infrastructure Specialist

    3 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Design, implement, and manage Azure AD solutions for user authentication and access management. Enforce security policies using Azure Identity Governance and maintain a robust access management framework. Implement Azure AD Security measures for threat prevention and mitigation. Utilize Azure Monitoring and Azure Log Analytics Workspace for continuous...

  • Data Acquisition and System Engineer

    3 weeks ago

    Singapur, Singapore Flintex Consulting Pte Ltd Full time

    Job DescriptionJob Description: • Must be a Diploma/Bachelor's Degree holder.• Hands-on implementation experience in building full-stack Restful web Applications.• Experience in the following domain area/Technology/Programming languages• Communication/Data Protocols: Modbus, OPC UA/AD, IEC 101/104, TCP/IP, SFTP, MQTT, AMQP• Programming languages:...

  • Data Engineer using DBT

    3 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Responsibilities: Engage in both exploratory data analysis to identify trends and data patterns Perform data preparation and data cleaning part of data migration project.  Understand Source data and support Source to Target mapping rules Design and implement the ETL framework for the data warehouse Build and maintain DBT pipelines to transform source data...

  • Senior Data Engineer

    2 weeks ago

    Singapur, Singapore JLL Full time

    JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and...

  • Data Engineer

    3 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Build and optimizing ‘big data’ data pipelines, architectures and data sets. Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. To support and develop Data modeling, Implementation activities. Strong analytic skills related to working with...

  • Senior Data Engineer

    3 weeks ago

    Singapur, Singapore BBGC Full time

    Job Description: Senior Data EngineerPosition Overview: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The Senior Data Engineer will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure to support our organization's data needs. The ideal candidate will have a...

  • Data Engineer

    3 weeks ago

    Singapur, Singapore PSA Singapore Full time

    Requirements Gathering (both functional and non-functional), Modular & Re- usable Design. • Proficient in ETL using programming language /tools such as Python and/or SSIS and/or Informatica Power Centre • Able to develop data applications including integration with ICT systems, build APIs and web applications via .Java and/or Python •...

  • Data Program Lead

    4 weeks ago

    Singapur, Singapore Infosys Singapore & Australia Full time

    We are looking for a highly experienced Subject Matter Expert (SME) in Data Management (FS) to join our team. The ideal candidate will have 12-15 years of experience in data governance, financial service data solutions, and data engineering. They will also have strong solution and delivery skills, as well as a view on business growth and managing...

  • Data Acquisition and System Engineer

    3 weeks ago

    Singapur, Singapore Flintex Consulting Pte Ltd Full time

    Job Description: • Must be a Diploma/Bachelor's Degree holder.• Hands-on implementation experience in building full-stack Restful web Applications.• Experience in the following domain area/Technology/Programming languages• Communication/Data Protocols: Modbus, OPC UA/AD, IEC 101/104, TCP/IP, SFTP, MQTT, AMQP• Programming languages: JavaScript,...

  • Engineer Data Management

    3 weeks ago

    Singapur, Singapore MISC Berhad Full time

    Description KEY ACCOUNTABILITIES Manage, plan and maintain the facilitation of support for data analysis across Eaglestar’s growing global fleet . Project-manage and deliver on data-related implementations ensuring that deliverables are met within agreed scope and timelines Manage, develop, and provide Eaglestar’s internal/external stakeholders...