Sr. Data Engineer

2 days ago

Singapore Rapsys Technologies Full time

Client : Avanade

Sr. Data Engineer (Azure Data Factory, Talend, AWS Glue)

As a Data Engineer, you will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the data supply chain, by ensuring stakeholders can access and manipulate data for routine and ad hoc analysis. Additionally, you will support the full lifecycle of data from ingesting through analytics to action.

**Key Role Responsibilities**:

- Day-to-day you will:

- Translate business requirements to technical solutions leveraging strong business acumen
- Analyze current business practices, processes and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics PaaS Services
- Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.
- Deliver of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies.
- Design and Build Modern Data Pipelines and Data Streams.
- Design and Build Data Service APIs.
- Develop and maintain data warehouse schematics, layouts, architectures and relational/non-relational databases for data access and Advanced Analytics.
- Expose data to end users using PowerBI, Azure API Apps or any other modern visualization platform or experience
- Implement effective metrics and monitoring processes.

**Skill & Capability Requirements**:

- 6-9 years overall experience and at least 5 years working as Data Engineer
- Demonstrated experience of turning business use cases and requirements to technical solutions.
- Experience in business processing mapping of data and analytics solutions.
- Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
- Experienced in Data Transformation using ETL/ELT tools such as AWS Glue, Azure Data Factory, Talend, EAI
- Knowledge in business intelligence tools such as Power BI, Tableau, Qlik, Cognos TM1
- Knowledge of Azure Data Factory, Azure Data Lake, Azure SQL DW, and Azure SQL, Azure App Service is required. Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Databricks, Azure Stream Analytics is a plus.
- Experienced in Cloud Data-related tool such as Microsoft Azure, Amazon S3
- Ability to leverage on variety of programming languages & data crawling/processing tools to ensure data reliability, quality & efficiency
- Knowledge of Python is a plus.
- Experience preparing data for Data Science and Machine Learning.
- Experience preparing data for use in Azure Machine Learning and/or Azure Databricks is a plus.
- Demonstrated experience preparing data and building data pipelines for AI Use Cases (text, voice, image, etc. ).
- Designing and building Data Pipelines using streams of IOT data.
- Knowledge of Lambda and Kappa architecture patterns.
- Knowledge of Master Data Management (MDM) and Data Quality tools and processes
- Strong team collaboration and experience working with remote teams.
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals.
- Working experience with Visual Studio, PowerShell Scripting, and ARM templates.
- Azure certifications (AZ-900, AZ-200 and 201)

**Salary**: $7,000.00 - $8,500.00 per month

  • Sr. Solutions Engineer

    1 day ago

    Singapore Databricks Full time

    Overview Sr. Solutions Engineer (Greater China Region) – Databricks. Join to apply for the Sr. Solutions Engineer (Greater China Region) role at Databricks. Responsibilities Form successful relationships with clients in Mainland China to provide technical and business value in collaboration with an

  • Sr. Solutions Engineer

    6 days ago

    Singapore Databricks Full time

    Join to apply for the Sr. Solutions Engineer (Thai Speaking)role at Databricks 2 weeks ago Be among the first 25 applicants Join to apply for the Sr. Solutions Engineer (Thai Speaking)role at Databricks Get AI-powered advice on this job and more exclusive features. FEQ426R34At Databricks, our core principles are at the heart of everything we do; creating a...

  • Sr ENGINEER

    6 days ago

    Singapore Micron Technology Full time

    Join to apply for the Sr ENGINEER - CMP PROCESS DEV role at Micron Technology 3 days ago Be among the first 25 applicants Join to apply for the Sr ENGINEER - CMP PROCESS DEV role at Micron Technology Our vision is to transform how the world uses information to enrich life for all. Join an inclusive team passionate about one thing: using their expertise in...

  • Sr. Solutions Engineer

    1 day ago

    Singapore Databricks Full time

    Overview Join to apply for the Sr. Solutions Engineer (Taiwan)role at Databricks . At Databricks, our core principles guide us to create a culture of proactiveness and a customer-centric mindset that makes data science and analytics accessible to everyone. You will be an essential part of this mission, using your technical expertise to demonstrate how our...

  • Sr Database Engineer

    6 days ago

    Singapore PayPal Full time

    Join to apply for the Sr Database Engineer role at PayPal 11 hours ago Be among the first 25 applicants Join to apply for the Sr Database Engineer role at PayPal The Company PayPal has been revolutionizing commerce globally for more than 25 years. Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and...

  • SR. Engineer

    6 days ago

    Singapore Micron Technology Full time

    Join to apply for the SR. Engineer - NAND Generators role at Micron Technology 5 days ago Be among the first 25 applicants Join to apply for the SR. Engineer - NAND Generators role at Micron Technology Get AI-powered advice on this job and more exclusive features. Our vision is to transform how the world uses information to enrich life for all. Join an...

  • Sr Data Science Engineer

    1 week ago

    Singapore Qorvo Full time

    **Sr Data Science Engineer**: - Experience Level: Individual Contributor- Job Type: Full-Time- Location: Singapore - Singapore, SG- Requisition ID: 8439- Applied Data Science on Test Yield Analysis & Improvement Opportunity - Product Test Yield and Key Test Parameters Analysis in relationship & correlation to Fab WET data or Wafer Probe Die Sort Data -...

  • Sr. Solutions Engineer

    3 days ago

    Singapore Databricks Full time

    Join to apply for the Sr. Solutions Engineer role at Databricks . At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed...

  • Sr. Solutions Engineer

    22 hours ago

    Singapore Databricks Full time

    Join to apply for the Sr. Solutions Engineer role at Databricks . At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed...

  • sr. engineer

    1 day ago

    Singapore Micron Technology Full time

    Overview SR. ENGINEER - NAND CELL role at Micron Technology. Senior NAND Cell Device Engineer, in the Singapore Device Technology Development group of Micron Technology Inc., you will be responsible for electrical characterization of the NAND memory cell and develop novel device solutions for cutting-edge 3D-NAND flash technologies. You will have an...