Data Engineer

**Organization**

At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

**Job Title**:Data Engineer

**Location**:Bangalore

**Business & Team**:
CommBank is recognised as leading the industry in IT and operations with its world-class platforms and processes, agile IT infrastructure, and innovation in everything from payments to internet banking and mobile apps.

The Group Security (GS) team protects the Bank and our customers from cyber compromise, through proactive management of cyber security, privacy, and operational risk. Our team includes:

- Cyber Strategy & Performance
- Cyber Security Centre
- Cyber Protection & Design
- Cyber Delivery
- Cyber Data Engineering
- Identity & Access Technology

The Group Security Data Engineering team provides specialised data services and platforms for the CommBank group & is accountable for developing Group’s data strategy, data policy & standards, governance and set requirements for data enablers/tools. The team is also accountable to facilitate a community of practitioners to share best practice and build data talent and capabilities.

**Impact & contribution**:
To ensure the Group achieves sustainable competitive advantage through data engineering, you will need to play a key role in supporting and executing the Groups data strategy.

We are looking for an experienced Data Engineer to join our Group Security Team, which is part of the wider Cyber Security Engineering practice. In your role as Data Engineer, you will be required to setup Group Security Data Platform to ingests data (structured and unstructured) from organisations security telemetry data with additional data assets to provide security controls and services that are leveraged across the Group.

**Roles & Responsibilities**:
You will be expected to perform the following tasks in a manner consistent with CBA’s Values and People Capabilities.

CORE RESPONSIBILITIES:

- As a Data Engineer,
- Contribute to thought leadership enabling business and technology teams to deliver world class data centric solutions and analytics by championing sustainable and re-useable data products.
- Participate in the full lifecycle of agile projects (ideation through implementation)
- Design and build group data products by integrating diverse data from hundreds of internal and external sources.
- Help to promote good coding standard and practices to ensure high quality and minimum risks.
- Utilizing Big Data technologies to solve our customers' data centric problems.
- Working closely with the Solution Designers and Business Stakeholders to perform Data Ingestion, Enrichment and Egression
- Designing and building group data products by integrating diverse data from hundreds of internal and external sources
- Adopting tools, programming languages and templates to improve our data quality and efficiency.
- Building and optimizing Big Data pipelines, architecture, and data sets
- Working with and extracting data from large disconnected / unstructured datasets
- Required to maintain and build excellent relationships with CDAO peers and stakeholders as well as actively contribute to business outcomes and team culture.

**Essential Skills**:

- Minimum 4-7 years of experience with expert level knowledge.
- SQL, python, Unix, cloud hands-on, ETL, Spark, data warehousing, agile, github, Big data ecosystem, Abinitio, Kafka
- Stakeholder Management - Contribute to meeting Team financial plan and simplifying how we work. Effective use of practice time (simplifying, optimising, automating, tools standardization, integration, decommissioning, innovation). Productive and effective participation of team members across Crews and Squads (contribution to achieving quarterly plans).
- Customers - Contribute to team being a trusted provider of data to the Group to achieve great outcomes for our customers and community.
- Risk Mindset -All CommBank employees are expected to proactively identify and understand, openly discuss, and act on current and future risks. Effectiveness with agreed risk reduction actions.
- Communication - expert oral and written communication skills with ability to lead discussions with a varied stakeholder across levels,Experience ITIL (Incident, Problem, Change management).
- Flexible to support on 24*7 model,Hands on experience on AWS (Amazon Web Services).
- Hands on experience on Teradata or Ab Initio is highly desirable,Good to have experience in Python.
- Exposure to JIRA/ Confluence would be beneficial.
- Hands-on experience in Software Engineering or development using Scala or Java to build solution in Hadoop, Hive an