Current jobs related to Lead Data Engineer - Singapore - JERA Global Markets Pte. Ltd.
-
Ms20220804 Data Engineer
16 hours ago
Singapore NTT DATA Singapore PTE Ltd Full timeJob Description - About Us - Roles and Responsibility **Job scopes**: - The Data Engineer will lead the enterprise-wide data transformations projects. The person will involve in developing and automating data processing pipelines for financial and Investment data modelling, analysis, and reporting from various data sources systems; The primary...
-
Data Engineer
3 days ago
Singapore TRIVI DATA CONSULTING PTE. LTD. Full timeKey Responsibilities - Design, implement, and maintain ETL workflows for managing large-scale datasets. - Develop cloud-based data pipelines (AWS, Azure) for scalable and real-time analytics delivery. - Optimize data models to ensure high performance and reliable reporting. - Create advanced dashboards and visualizations using tools like Qlik Sense and...
-
Azure Data engineer
3 days ago
Singapore NTT Data Singapore Full timeJob Responsibilities: Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...
-
Azure Data engineer
5 days ago
Singapore NTT Data Singapore Full time $80,000 - $120,000 per yearJob Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...
-
DevSecOps Lead
7 days ago
Singapore NTT DATA Full time $120,000 - $200,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe DevSecOps...
-
Lead Data Engineer
3 days ago
Singapore LINKS HR SINGAPORE PTE. LTD. Full timeTake end-to-end ownership of our cloud data architecture—designing, developing, and implementing a robust data warehouse using AWS services such as S3, Glue, Redshift, Lambda, Step Functions etc. Lead the evolution of our data infrastructure with a long-term vision, ensuring scalability, reliability, and performance. Define and enforce high standards...
-
Data Engineer
1 week ago
Singapore Ollion Full time1 day ago Be among the first 25 applicants This range is provided by Ollion. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range SGD120,000.00/yr - SGD160,000.00/yr Job Description We are seeking an experienced Data Engineer - Lead to join our team. This role will lead our data engineering...
-
Data Engineer Lead
2 days ago
Singapore UNISON Group Full time $13,200 - $180,000 per year5 years of experience in data management, data engineering, or data visualization.Experience with Python, AWS, Glue, spark, redshift, Lambda, S3 and strong Sql (DWH).Excellent with AWS side of data engineering.Amazon S3 for storage, AWS Glue for ETL, Amazon Redshift for data warehousing, Amazon Kinesis for real-time data processing, and AWS Lambda for...
-
Senior Data Scientist
21 hours ago
Singapore Data Science Full timeGet to know the team You'll be part of the SNP Data Science Personalization team, an established group dedicated to enhancing personalization experiences for Grab Food/Mart/Transport. We aim to develop cutting-edge Deep Learning models to deliver best user experiences. Our team comprises passionate Data Scientists with various expertise. If personalization...
-
Data Engineering Lead
3 days ago
Singapore Citi Full time $150,000 - $250,000 per yearThe Engineering Lead Analyst is a senior level position responsible for leading a variety of engineering activities including the design, acquisition and deployment of hardware, software and network infrastructure in coordination with the Technology team. The overall objective of this role is to lead efforts to ensure quality standards are being met within...
Lead Data Engineer
2 weeks ago
COMPANY DESCRIPTION
**About the Company**
JERA Global Markets (JERAGM) is a leading utility-backed seaborne energy trader specialising in LNG, Coal and Freight with a platform to trade across all key markets worldwide. JERAGM is a joint venture between majority shareholder JERA Inc. (JERA) and EDF Trading.
JERAGM operates one of the largest seaborne energy portfolios in the world which gives us an in-depth understanding of the way local, regional and international energy markets behave. These insights enable the Company to help our customers increase security of supply, optimise their portfolios and improve the risk management of their assets.
The commercial hub of the company is in Singapore, with offices located in Japan (Tokyo), the UK (London) and the US (Baltimore).
DESIGNATION : Lead Data Engineer
RESPONSIBILITIES
The Lead Data Engineer is a software development and architecture role within the Data Team in the JERAGM IT Department. The role is focused on designing and implementing a data technology framework, and delivering specific projects within this framework based on the programme of work defined in the JERAGM Data Strategy. This is expected to include:
- Providing efficient access to authoritative transactional, reference, market and valuation/risk data (including real-time and historical data)
- Real-time processing and distribution of pricing and valuation data
- Rapid turn-around of new data feeds for data analytics e.g., from web scrapers or 3rd party web APIs
- Building visualisation and analysis tools for specific use-cases
- Data governance e.g., metadata, quality, lineage, security
- Security and access control
The role will cover the following:
- Supporting creation of a Data Strategy and associated aspects of the IT Strategy such as the Data Technology and Security Framework
- Taking ownership of the architecture for JERAGM production software, and defining and managing technical solution architecture(s) for new solutions
- Ensuring consistency with the broader IT roadmap and non-functional requirements (e.g., cloud-first, IT security, scalability) by collaborating closely across the IT team
- Building an understanding of how data is used within JERAGM’s commercial activity, and using this knowledge to support the definition of functional and non-functional business and system requirements
- Working directly with business stakeholders to help formulate, analyse and estimate IT work to deliver their data processing, analysis and reporting requirements, helping them understand the technology including opportunities, constraints and trade-offs (this may include non-technical users through to Analysts and Data Scientists)
- Creating documentation and presenting to technical and non-technical audiences
- Delivering software as a developer in the JERAGM Data Team using an agile and iterative delivery approach based on Scrum or Kanban
- Providing technical leadership in data architecture, solution design and software engineering processes/ standards/ practices e.g., championing and leading the team in their approach to source code managements, test-driven development, automated unit/ integration testing, CI/CD, DevOps, Collaboration tooling
- Working with the IT Operations and Infrastructure teams to deploy solutions into JERAGM's production IT landscape in an agile, controlled, secure and sustainable way
- Supporting effective handover to Operational Support teams and providing 3rd line support for short periods of hyper-care following releases
- Developing ongoing relationships with key vendors
- Mentoring and guiding less experienced members of the team
- Supporting the team in developing a culture of collective ownership and responsibility
- Assisting in recruitment into the team and developing relationships with consultants
The Lead Data Engineer must demonstrate a broad and deep set of technical experience, knowledge and skills as set out in the section below.
QUALIFICATIONS
- Extensive technical knowledge and experience (10+ years) of:
Technologies:
- SQL Server database design and development (excellent SQL, relational and dimensional modelling)
- Analytical querying using technologies such as SSAS cubes or columnar data stores
- ETL tools such as SSIS, Alteryx, Azure Data Factory
- Experience of modern cloud-based data architectures and technologies such as Data Lake, Delta Lake, Data Lakehouse e.g., Azure Data Lake Gen 2, Azure Delta Lake
- Streaming technologies e.g., Spark
- Data engineering and machine learning frameworks e.g., Snowflake, Azure Databricks
- Unstructured data stores and processing technologies such as MongoDB, Hadoop, Spark, etc.
- Reporting and visualisation tools such as SSRS, Tableau, Power BI or Excel
- Python - including data engineering and machine learning libraries e.g., Pandas, NumPy, Matplotlib
Software engineering and delivery
- Developing and documenting technical architectures and solution designs following a structured process e.g.,
