Sr. Data Engineer
3 days ago
Client : Avanade
Sr. Data Engineer (Azure Data Factory, Talend, AWS Glue)
As a Data Engineer, you will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the data supply chain, by ensuring stakeholders can access and manipulate data for routine and ad hoc analysis. Additionally, you will support the full lifecycle of data from ingesting through analytics to action.
**Key Role Responsibilities**:
- Day-to-day you will:
- Translate business requirements to technical solutions leveraging strong business acumen
- Analyze current business practices, processes and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics PaaS Services
- Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.
- Deliver of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies.
- Design and Build Modern Data Pipelines and Data Streams.
- Design and Build Data Service APIs.
- Develop and maintain data warehouse schematics, layouts, architectures and relational/non-relational databases for data access and Advanced Analytics.
- Expose data to end users using PowerBI, Azure API Apps or any other modern visualization platform or experience
- Implement effective metrics and monitoring processes.
**Skill & Capability Requirements**:
- 6-9 years overall experience and at least 5 years working as Data Engineer
- Demonstrated experience of turning business use cases and requirements to technical solutions.
- Experience in business processing mapping of data and analytics solutions.
- Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
- Experienced in Data Transformation using ETL/ELT tools such as AWS Glue, Azure Data Factory, Talend, EAI
- Knowledge in business intelligence tools such as Power BI, Tableau, Qlik, Cognos TM1
- Knowledge of Azure Data Factory, Azure Data Lake, Azure SQL DW, and Azure SQL, Azure App Service is required. Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Databricks, Azure Stream Analytics is a plus.
- Experienced in Cloud Data-related tool such as Microsoft Azure, Amazon S3
- Ability to leverage on variety of programming languages & data crawling/processing tools to ensure data reliability, quality & efficiency
- Knowledge of Python is a plus.
- Experience preparing data for Data Science and Machine Learning.
- Experience preparing data for use in Azure Machine Learning and/or Azure Databricks is a plus.
- Demonstrated experience preparing data and building data pipelines for AI Use Cases (text, voice, image, etc. ).
- Designing and building Data Pipelines using streams of IOT data.
- Knowledge of Lambda and Kappa architecture patterns.
- Knowledge of Master Data Management (MDM) and Data Quality tools and processes
- Strong team collaboration and experience working with remote teams.
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals.
- Working experience with Visual Studio, PowerShell Scripting, and ARM templates.
- Azure certifications (AZ-900, AZ-200 and 201)
**Salary**: $7,000.00 - $8,500.00 per month
-
Sr. Sales Engineer
1 week ago
Singapore Pitchbook Data Full timeAt PitchBook, a Morningstar company, we are always looking forward. We continue to innovate, evolve, and invest in ourselves to bring out the best in everyone. We're deeply collaborative and thrive on the excitement, energy, and fun that reverberates throughout the company. Our extensive learning programs and mentorship opportunities help us create a culture...
-
Sr Data Engineer
1 week ago
Singapore PayPal Full timeOverview Sr Software Engineer role at PayPal. This job delivers complete solutions spanning all phases of the Software Development Lifecycle (SDLC). It involves advising management on project-level issues, guiding junior engineers, operating with little supervision, and applying knowledge of technical best practices. Essential Responsibilities Delivers...
-
Sr Data Science Engineer
1 week ago
Singapore Qorvo Full time**Sr Data Science Engineer**: - Experience Level: Individual Contributor- Job Type: Full-Time- Location: Singapore - Singapore, SG- Requisition ID: 8439- Applied Data Science on Test Yield Analysis & Improvement Opportunity - Product Test Yield and Key Test Parameters Analysis in relationship & correlation to Fab WET data or Wafer Probe Die Sort Data -...
-
Sr. IT Data Analyst
1 week ago
Singapore TD Full timeJoin to apply for the Sr. IT Data Analyst role at TD Pay Details We're committed to providing fair and equitable compensation to all our colleagues. As a candidate, we encourage you to have an open dialogue with a member of our HR Team and ask compensation related questions, including pay details for this role. Work Location : Singapore, Singapore Hours :...
-
Sr Quality Engineer
1 week ago
Singapore PayPal Full timeOverview Join to apply for the Sr Quality Engineer role at PayPal . The Company PayPal has been revolutionizing commerce globally for more than 25 years. PayPal enables consumers and businesses in approximately 200 markets to move money, sell, and shop securely with a global two-sided network. We provide proprietary
-
Sr Engineer Device Engineering
5 days ago
Singapore GlobalFoundries Full timeSr Engineer Device Engineering (FRCMOS) page is loaded## Sr Engineer Device Engineering (FRCMOS)locations: Singaporetime type: Full timeposted on: Posted Yesterdayjob requisition id: JR- **About** **GlobalFoundries**GlobalFoundriesis a leading full-service semiconductor foundry providing a unique combination of design, development, and fabrication services...
-
Sr Staff Engineer
1 week ago
Singapore Seagate Technology Full timeSr Staff Engineer (Test Process Development)Join to apply for the Sr Staff Engineer (Test Process Development)role at Seagate Technology About Our Group The team is responsible for developing cutting‐edge methodologies that support new product launches across Enterprise and Client HDD platforms, including technologies like Heat Assisted Magnetic Recording...
-
Sr. Resident Solutions Architect
4 hours ago
Singapore DATABRICKS ASIAPAC UNIFIED ANALYTICS PTE. LTD. Full timeAs a Sr. Resident Solutions Architect (Sr. RSA), you will be part of the Professional Services team and work with clients on short to medium term customer engagements solving their big data problems using Apache Spark™ and the Databricks Data Intelligence Platform. You will be in a customer-facing role that requires deep hands‑on expertise in Apache...
-
Sr. Network Engineer
3 days ago
Singapore Peoplebank Full time**Sr. Network Engineer** - 12 months contract - Hybrid work arrangement - Work location: Paya Lebar **Our Client** - Leading global digital payments tech company **The Opportunity** - Design and implement both the physical and wireless networks of an organization, including LANs, WANs, network segments, and internet and intranet systems. - Maintain network...
-
Sr Software Engineer
2 weeks ago
Singapore NE Digital Full timeCOMPANY DESCRIPTION NE Digital is the digital, data and technology organization that serve as a center of excellence to drive digital transformation for our group of NTUC Social Enterprises to meet the critical social needs of Singapore's community. Delivering innovative products and solutions, we empower our people to lead a better and meaningful life...