Senior Data QA Engineer

**Join us on a mission to save the planet**

Reversing the impact of climate change is one of the world’s biggest challenges. And businesses have a responsibility to lead the way. While individual consumer choices are important, over 80% of all the emissions reductions necessary for the world to reach Net-Zero, require business-level action. But despite the growing momentum and ambition from companies around the world to set Net-Zero goals, there are significant challenges to delivering on these ambitions. Business leaders don’t really know how they will get there. And the very first step, of getting emissions measurement right, is hard.
Terrascope is a smart carbon management and accounting platform that empowers corporations to decarbonise their operations, portfolios and supply chains in a trusted, confident, and secure manner. We are on a journey to build digital tools and analytics, datasets and algorithms, and an ecosystem of technical expertise and partnerships needed for companies to optimise their climate strategy
Terrascope is backed by one of the world’s largest food and agri companies and global leader in climate action and sustainability. With their significant strategic advantage and secure funding, the venture is uniquely positioned to drive profit with purpose; driving decarbonization in supply chains while generating outsized financial returns.
We are looking for an innovative, quality-focussed and self-driven
**Senior Data QA Engineer** to join our data platform scrum team who is an expert in testing Big data based data pipelines and data platform products and building test automation framework for data products. This role will report into the ‘Head of Engineering - Data’ and will be crucial in shaping the future of climate-tech SaaS/PaaS products.

In this role you will:

- Work closely with an agile team of product manager and data platform scrum team to devise test strategies to test ETL pipelines.
- 100% hands-on to build a test automation framework to validate the quality of ETL data pipelines.
- 100% hands-on to build a test automation framework to validate the quality of data ingestion services, data workbench and quality mapping of source/destination data.
- The test strategy has to reduce manual efforts significantly.
- Create detailed, comprehensive and well-structured test plans and test cases.
- Prevent, report, analyze and track issues in an effective and efficient manner.
- Design, monitor and maintain QA reports, KPIs & quality trends for the internal data systems.
- Closely work with DevSecOps team to setup and create test automation environments.
- Closely collaborate with DevSecOps team to integrate test automation framework in Continuous Integration and Continuous Deployment pipelines.
- Validate the data security, compliance and data governance policies.
- Work closely with the data platform scrum team on defects reported by customer implementation in sandbox and production environments.
- Work closely with agile, multidisciplinary and international teams.

**You should have**:

- Minimum 3+ years of experience as a Senior Data QA Engineer testing data products.
- Industry experience in a technology environment with a record of successfully testing complex ETL pipelines, data-driven products and data platforms.
- Deep competence in data test automation tools such as Deequ, DataQ and RDt.
- Good understanding of the Big Data stack(Airflow, Spark, Hadoop, Flink) & Analytics stack.
- Experience working in a Big Data environment, dealing with large diverse data sets.
- Experience in automating API tests with RestAssured, Selenium and Java.
- Deep competence in Python, Java, Scala or related technologies.
- Deep competence in writing SQL queries and complex data tasks.
- Deep understanding of working with raw data in various file formats such as Excel, CSV, JSON, DAT, SQL, XML.
- Good knowledge of RDBMS and NOSQL technologies.
- Deep understanding of CI/CD pipelines and tools.
- Familiarity with triple stores and related technologies such as RDF, SPARQL, SHACL and Linked
- Strong decision-maker and ability to help teams achieve shared goals.
- Experience with agile software development methodology.

**Even better if you are**:

- Knowledgeable about industry data compliance, security (ISO 27001, SOC ⅔, GDPR, PII, HIPAA) and data governance strategies and testing practices such as Continuous testing and regression testing for data products.
- An entrepreneurial problem solver comfortable in managing risk and ambiguity
- A self-starter with a growth-mindset and proactiveness in working independently to drive toward results.
- We're committed to creating an inclusive environment for our strong and diverse team. We value diversity and foster a community where everyone can be his or her authentic self._