Data Engineer

**WHO YOU WILL WORK WITH**

We are a diverse international team of extremely talented and capable individuals who work together to exceed the clients' expectations, on every element of every contract. It is our #Changemakers that have made the Renoir Group the success that it is today. As a business with an instinct for delivery and improvement, Renoir is always aware that we must constantly look towards the future and develop the talent that will drive the business forward. It is vital to recruit, develop, reward and inspire the people whose ideas, ambitions and energy constantly refresh Renoir's competitive edge.

**WHAT YOU WILL DO**

As part of Renoir’s Data COE, the Data Engineer (DE) will serve to develop databases and data processing pipelines to enable predictive analytics, data science, and business intelligence for our clients.

The Data Engineer will also have strong analytical skills and the ability to combine data from different sources.

To succeed in this role, the Data Engineer should know how to work with key stakeholders, Business Analyst / Data Analyst, and development team to analyse and define technical solutions to meet business and non-functional requirements:
- Design, development, and testing of:
- ETL and data processing pipelines.
- Data Lakes, Data Warehouses, Delta Lakes.
- Analytical Data modelling.
- Aggregating data using SQL for BI tools.
- Database schemas, indexes, views etc.
- SQL queries and stored procedures.
- Cloud infrastructure and services (AWS, Azure)
- Data security (encryption, masking etc.)
- Assist in creation and support of analytic, BI, and reporting processes.

**YOU WILL BE**
- Responsible for analysing, building and optimizing the data infrastructure and data pipeline along with Renoir’s clients.
- Support the client to, potentially, migrate data from legacy systems to new solutions to align the system architecture with business requirements along with enabling the delivery of Renoir’s data solutions.
- Support the design of conceptual and logical data models and flowcharts.
- Identify ways to improve data reliability, efficiency and quality.
- Connect all client’s data sources into Renoir’s data solution (third-party vendor).
- **Building end-to-end data pipeline infrastructure** for optimal extraction, transformation and loading of data from various data sources using **AWS and SQL technologies - Glue, Lambda, Redshift, Athena, S3, Step Functions, PySpark, Data Lake.**:

- Analyse the client’s complete system landscape and specific system requirements and implement migration methods for existing data and/or consolidation of data into data warehouse cubes with the support of direct interfaces or API’s (where applicable).
- Support the client to improve system performance by conducting tests, troubleshooting and integrating new elements. Optimize new and current database systems. Define security and backup procedures.
- Develop database solutions to ensure client’s information is stored effectively and securely.
- Provide the foundations and support the client to set in place the tools for continuously monitoring and testing of the system interfaces to ensure optimized performance and security.
- Quantify benefit potential of Data Analytics solutions using ROI frameworks to aid in prioritization of development and definition with the client.

**YOU MUST HAVE**

**Qualification**:

- Bachelor’s degree in computer science, computer engineering or relevant field.
- At least 3-5 years of hands-on experience in a similar role.

**Technical Skills**:

- Experience **in writing complex SQL queries**.
- Experience in **AWS services such as Glue, Lambda, Redshift, Athena, S3, Step Functions, Event Bridge, Cloud Trail, Cloud Watch.**:

- Experience working in **ETL / ELT tools: Talend, SSIS, Glue, Data Factory.**:

- Experience with scripting languages**:Python, Spark, PySpark** etc.
- Experience with **Microsoft Azure, AWS, GCP** and other cloud tools and services.
- Familiar **with big data tools: Hadoop, Spark, Kafka**, etc.
- Familiar with data pipeline and workflow management tools.
- Familiar with NoSQL.
- Familiar with analytics software tools such as **Alteryx, Power BI, Tableau.**:

- Good working knowledge of productivity tools such as Git, Jira, Confluence.
- Familiar with DevOps and DataOps tools.

**Personal Attributes**:

- Leadership skills.
- Innovative yet grounded to operational reality.
- Excellent oral and written communication skills.
- Excellent organizational and analytical abilities.
- Critical Thinker; with good logical and creative problem-solving skills.
- Work collaboratively.
- Fast learner and self-starter.