Azure Data Engineer

4 days ago

Singapore Alphanet Pvt Ltd Full time

**Azure Data Engineer**
**Singapore**

**YOUR ROLE**:
The Senior Data Engineer will work on acquiring, storing, governing and processing huge sets of structured / unstructured data. You will bring a vision of the big data solutions landscape for choosing optimal architecture components to use for these purposes as well as a set of data engineering skills for implementing enterprise data foundations such as data lake. Finally, you will work closely with other PALO IT experts in Data Intelligence, Research, UX Design, Digital Technology and Agile teams to enable intelligence in the digital mesh of our clients and deliver big impact to them.

**YOUR RESPONSIBILITIES**:
Design, implement, and maintain robust and scalable data pipelines to ingest, transform, and process structured and unstructured data from various sources.
Build and manage data warehouses and data lakes, implementing efficient data storage and retrieval mechanisms. Design data models that support business requirements and analytics use cases.
Leverage cloud platforms (e.g., AWS, Azure, GCP) to design and deploy scalable data infrastructure, optimizing for performance, cost-effectiveness, and reliability.
Implement data quality checks, validation processes, and data governance frameworks to ensure data accuracy, integrity, and compliance with security standards.
Continuously monitor and optimize data pipelines and infrastructure to improve processing speed, reduce latency, and enhance overall system performance.
Work collaboratively with data scientists, analysts, and other stakeholders to understand their data needs, provide technical expertise, and deliver solutions that meet business objectives.
Support business users by implementing data presentation layer including data visualisation using tools like Tableau, PowerBI etc.
Stay up-to-date with emerging technologies and industry trends in the big data and data engineering space, evaluating and implementing innovative solutions to improve data processing capabilities.
Support the definition and optimization of underlying data infrastructure
**WHO YOU ARE**:
You hold a Bachelor's, Master's, or Ph.D. degree in IT, Information Management, and/or Computer Science with at least 6 years of experience.
Good knowledge of the big data technology landscape and concepts related to distributed storage/computing
Experience with big data frameworks (e.g. Hadoop, Spark) and distributions (Cloudera, Hortonworks, MapR)
Experience with batch & ETL jobs to ingest and process data from multiple data sources
Experience with NoSQL databases (e.g. Cassandra, MongoDB, Neo4J, ElasticSearch)
Experience with querying tools (e.g Hive, Spark SQL, Impala)
Experience with PowerBI
Experience or willingness to go in real-time stream processing, using solutions such as Kafka, AWS Kinesis, Flume, and/or Spark Streaming
Experience or willingness to learn about DevOps and DataOps principles (e.g Infrastructure as Code, automating different parts of the data pipeline)
High-level understanding of Data Science concepts and methodologies (how models are built, trained, and deployed)
You are passionate about technology and continuous learning comes naturally to you

Pay: $3,922.57 - $11,000.00 per month

Schedule:

- Day shift
- Monday to Friday

  • Azure Data engineer

    4 days ago

    Singapore NTT Data Singapore Full time $90,000 - $120,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...

  • Azure Data Engineer

    2 weeks ago

    Singapore NEARSOURCE PTE. LTD. Full time

    Business Understanding At least (3) years of relevant experience in: - Business Requirement Analysis - Business Process and System Understanding - Effective Communication with both business and technical users Azure Data Engineering At least (2) years of hands-on experience as Azure Data Engineer using: - Azure Data Factory - Azure Synapse Analytics /...

  • Azure Data Engineer

    7 days ago

    Singapore Intellect Minds Pte Ltd Full time

    _**Qualification**_ - Degree from a recognized university, preferably in Data Analytics or Computer Science domain; - Preferably with relevant certifications from Microsoft including Azure Data Engineer Associate - **Responsibilities**_ - Help ingest structured / unstructured can be batch or real time data in the Azure lake and perform cleaning and...

  • Data Engineer

    21 hours ago

    Central Singapore Avanade Full time

    As a Data Engineer, you will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the data supply chain, by ensuring stakeholders can access and manipulate data for routine and ad...

  • Data Engineer

    7 days ago

    Central Singapore Avanade Full time

    Data Engineer As a Data Engineer, you will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the data supply chain, by ensuring stakeholders can access and manipulate data for...

  • Azure Data Engineer

    5 days ago

    Singapore SMART INFORMATION MANAGEMENT SYSTEMS PRIVATE LIMITED Full time

    **Executive Summary** Smart IMS Inc provides Digital technology & Cloud transformation services, Application & Infrastructure Management Services, Unified Communications, and Insurance implementation services to customers across the Americas, Europe, Middle East, and Asia-Pacific regions. As the trusted technology and business partner of leading MNCs,...

  • AWS & Azure Infrastructure Engineer (L2/L3)

    2 weeks ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the AWS & Azure Infrastructure Engineer (L2/L3)role at NTT DATA, Inc. Join to apply for the AWS & Azure Infrastructure Engineer (L2/L3)role at NTT DATA, Inc. Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a...

  • Azure Data Engineer contract

    2 weeks ago

    Singapore NTT SINGAPORE PTE. LTD. Full time

    As an Azure Data Engineer must be familiar on **cloud-based data platforms (e.g., Azure Data Factory, Azure Purview, Databricks, Snowflake, Kafka, or equivalent) and data storage technologies (e.g., SQL databases, NoSQL databases).**: - Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends,...

  • Azure Synapse

    2 weeks ago

    Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    This is a 12 months contract assigned to our client Work Location: To be confirmed Salary Range : $4,500-$5,500 **Job Description**: 2. Core skills required Azure Synapse, Azure Data Factory (ADF). Skillsets 1. Microsoft Azure Data Factory 2. Microsoft Azure Synapse Analytics 3. Design & Build Enablement 4. Microsoft Power BI 5. Data Engineering

  • Azure Synapse

    4 days ago

    Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    1 - Microsoft Azure Data Factory 2 - Microsoft Azure Synapse Analytics 3 - Design & Build Enablement 4 - Microsoft Power BI 5 - Data Engineering