Lead Data Engineer

COMPANY DESCRIPTION

**About the Company**

JERA Global Markets (JERAGM) is a leading utility-backed seaborne energy trader specialising in LNG, Coal and Freight with a platform to trade across all key markets worldwide. JERAGM is a joint venture between majority shareholder JERA Inc. (JERA) and EDF Trading.

JERAGM operates one of the largest seaborne energy portfolios in the world which gives us an in-depth understanding of the way local, regional and international energy markets behave. These insights enable the Company to help our customers increase security of supply, optimise their portfolios and improve the risk management of their assets.

The commercial hub of the company is in Singapore, with offices located in Japan (Tokyo), the UK (London) and the US (Baltimore).

DESIGNATION : Lead Data Engineer

RESPONSIBILITIES

The Lead Data Engineer is a software development and architecture role within the Data Team in the JERAGM IT Department. The role is focused on designing and implementing a data technology framework, and delivering specific projects within this framework based on the programme of work defined in the JERAGM Data Strategy. This is expected to include:

- Providing efficient access to authoritative transactional, reference, market and valuation/risk data (including real-time and historical data)
- Real-time processing and distribution of pricing and valuation data
- Rapid turn-around of new data feeds for data analytics e.g., from web scrapers or 3rd party web APIs
- Building visualisation and analysis tools for specific use-cases
- Data governance e.g., metadata, quality, lineage, security
- Security and access control

The role will cover the following:

- Supporting creation of a Data Strategy and associated aspects of the IT Strategy such as the Data Technology and Security Framework
- Taking ownership of the architecture for JERAGM production software, and defining and managing technical solution architecture(s) for new solutions
- Ensuring consistency with the broader IT roadmap and non-functional requirements (e.g., cloud-first, IT security, scalability) by collaborating closely across the IT team
- Building an understanding of how data is used within JERAGM’s commercial activity, and using this knowledge to support the definition of functional and non-functional business and system requirements
- Working directly with business stakeholders to help formulate, analyse and estimate IT work to deliver their data processing, analysis and reporting requirements, helping them understand the technology including opportunities, constraints and trade-offs (this may include non-technical users through to Analysts and Data Scientists)
- Creating documentation and presenting to technical and non-technical audiences
- Delivering software as a developer in the JERAGM Data Team using an agile and iterative delivery approach based on Scrum or Kanban
- Providing technical leadership in data architecture, solution design and software engineering processes/ standards/ practices e.g., championing and leading the team in their approach to source code managements, test-driven development, automated unit/ integration testing, CI/CD, DevOps, Collaboration tooling
- Working with the IT Operations and Infrastructure teams to deploy solutions into JERAGM's production IT landscape in an agile, controlled, secure and sustainable way
- Supporting effective handover to Operational Support teams and providing 3rd line support for short periods of hyper-care following releases
- Developing ongoing relationships with key vendors
- Mentoring and guiding less experienced members of the team
- Supporting the team in developing a culture of collective ownership and responsibility
- Assisting in recruitment into the team and developing relationships with consultants

The Lead Data Engineer must demonstrate a broad and deep set of technical experience, knowledge and skills as set out in the section below.

QUALIFICATIONS
- Extensive technical knowledge and experience (10+ years) of:
Technologies:

- SQL Server database design and development (excellent SQL, relational and dimensional modelling)
- Analytical querying using technologies such as SSAS cubes or columnar data stores
- ETL tools such as SSIS, Alteryx, Azure Data Factory
- Experience of modern cloud-based data architectures and technologies such as Data Lake, Delta Lake, Data Lakehouse e.g., Azure Data Lake Gen 2, Azure Delta Lake
- Streaming technologies e.g., Spark
- Data engineering and machine learning frameworks e.g., Snowflake, Azure Databricks
- Unstructured data stores and processing technologies such as MongoDB, Hadoop, Spark, etc.
- Reporting and visualisation tools such as SSRS, Tableau, Power BI or Excel
- Python - including data engineering and machine learning libraries e.g., Pandas, NumPy, Matplotlib

Software engineering and delivery
- Developing and documenting technical architectures and solution designs following a structured process e.g.,