Data Engineer/ Senior Engineer

2 weeks ago


Singapur, Singapore StarHub Full time

Job Description

Purpose:
⦁ The Data Platform Team is responsible for conceptualisation, implementation and management of organisation-wide data platform and solutions.
⦁ You will be part of the team responsible for data management to solve business problems, build and maintain data infrastructure to address business requirements and improve processes.
⦁ You will focus on defining optimal solutions in data collection, processing and warehousing for data scientists and business analysts to interpret and make data accessible to meet business requirements.
⦁ You are a subject matter expert in data engineering and data pipeline with adoption of best practices and innovations.
⦁ You will work closely with different stakeholders to support the project implementation and maintenance of existing or new data platforms on cloud

Responsibilities:
⦁ Design, implement and maintain data collection, data flow channels, data processing systems and warehousing that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable and secure manner in cloud environment
⦁ Identify, design, and implement internal process improvements including data collection for cross functional teams, automating manual processes, optimising data flow/delivery, re-designing infrastructure for greater scalability, etc. using SQL and 'big data' technologies
⦁ Collect, parse, manage, analyse and visualise large, complex sets of data to turn information into insights accessible through multiple platforms
⦁ Ensure data quality and efficiency, including the backup of data and its easy retrieval in case of system failure
⦁ Build analytic tools that utilise the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics for the use of analytics and data scientist team members
⦁ Operate, manage and maintain the data lakehouse infrastructure, including data model, data ingestion, ETL/ELT, data storage and visualisation
⦁ Work with stakeholders including Product, Data, Systems, Service Operations teams to resolve data-related technical issues and support their data infrastructure needs
⦁ Collaborate with Data Scientists and Architects on analytical projects in developing prescriptive and predictive models
⦁ Prepare and maintain proper documentations of data pipeline design and processes, operation procedures, etc
⦁ Be an advocate for best practices and continuous learning, keeping track of industry standards and technological advances that can improve the framework structure and design

Qualifications

⦁ An appropriate qualification in Computer Science, IT, or Applied Mathematics, including Data Engineering certifications such as IBM Certified Data Engineer, Google Certified Professional or equivalent
⦁ At least 2 years of experiences as data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up
⦁ Passionate about working with large data sets, data model and interpret data pattern
⦁ Ability to understand business processes and resolve challenges with data models, data mining, and segmentation techniques
⦁ Experiences in both batch processing and real-time data streaming.
⦁ Knowledge of data migration and integration techniques, along with the tools necessary to accomplish them
⦁ Hands-on experiences in transforming functional specifications into design specifications
⦁ Hands-on experiences in Linux system, Object Storage, Spark, Presto query engine
⦁ Hands-on experiences in building or maintaining ETL processes and SQL database design
⦁ Knowledge of programming languages (e.g. Java and Python)
⦁ Experiences to develop reports and visuals through any BI or visualisation tools such as Grafana/ Tableau
⦁ Familiar with AWS/GCP data pipeline and ecosystem, data warehouse and big data platforms such as Hadoop solutions
⦁ Good problem solving and communication skills, especially for explaining technical concepts to non-technical business leaders
⦁ Ability to work in a dynamic, research-oriented team that has concurrent projects
⦁ Certification in Cloud Technology platform (in Architecture or Networking), Container Architecture, Systems and/or Network Virtualization
⦁ Knowledge of telco network such as Mobile and Fixed will be advantageous
⦁ Passion for software development, automation and new technologies/innovations for business and in operational excellence



  • Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...


  • Singapur, Singapore NTT DATA Full time

    Job Description Want to be a part of our team?A Senior Associate Network Engineer is a developing technical professional responsible for leveraging their networking skills and experience to support, design, and optimise NTT's network infrastructure. This role works closely with network engineers, architects, and cross-functional teams to ensure the...


  • Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...


  • Singapur, Singapore NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Senior Data Engineer

    3 weeks ago


    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working arrangement (1-2 days in office). Role Overview We are passionate about harnessing the power of data to drive innovation and empower businesses. We are seeking a highly technical and experienced Senior Data Engineer to join our dynamic team. The successful candidate will be a key player in...

  • Senior Data Engineer

    2 months ago


    Singapur, Singapore Lynx Analytics Full time

    Apply Now Senior Data Engineer at Lynx Analytics (View all jobs) Singapore COMPANY OVERVIEW Founded in 2010, Lynx Analytics is a predictive analytics company run by world-class quantitative marketing scientists and industry-experienced data scientists. Our focus is to become a leading analytics solution provider in our chosen fields of expertise...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore Lynx Analytics Full time

    Apply Now Senior Data Engineer at Lynx Analytics (View all jobs) Singapore COMPANY OVERVIEW Founded in 2010, Lynx Analytics is a predictive analytics company run by world-class quantitative marketing scientists and industry-experienced data scientists. Our focus is to become a leading analytics solution provider in our chosen fields of expertise...

  • Senior Data Engineer

    4 weeks ago


    Singapur, Singapore Lynx Analytics Full time

    Apply Now Senior Data Engineer at Lynx Analytics (View all jobs) Singapore COMPANY OVERVIEW Founded in 2010, Lynx Analytics is a predictive analytics company run by world-class quantitative marketing scientists and industry-experienced data scientists. Our focus is to become a leading analytics solution provider in our chosen fields of expertise...


  • Singapur, Singapore NTT DATA Full time

    Job Description Want to be a part of our team?The Senior DevOps Engineer consults with internal clients about the software technology environment with high complexity. They translate business requirements into technology terms and develop more complex algorithms and programming code for software solutions. The primary objective of the Senior DevOps Engineer...

  • Senior Data Engineer

    4 weeks ago


    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...


  • Singapur, Singapore NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...


  • Singapur, Singapore NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...


  • Singapur, Singapore Singapore Airlines Limited Full time

    Job DescriptionThe senior data engineer is a senior software developer with strong software engineering skills who is responsible for building custom open-source-based data ingestion and MLOps platforms. He/she has deep appreciation of the complexity of the data engineering process, such as the challenges of data ingestion involving large or near-real-time...


  • Singapur, Singapore ST Engineering Full time

    Title: Senior Data Engineer, DA(MRO), GECJob ID: Location: ST Engineering Hub, SGDescription: Job DescriptionThe primary responsibilities involve designing, implementing, and maintaining essential data pipelines that support various data-driven scenarios. As a senior data engineer, you are expected to take charge of these pipelines, actively seek ways to...


  • Singapur, Singapore ST Engineering Full time

    Title: Senior Data Engineer, DA(MRO), GEC Job ID: Location: ST Engineering Hub, SG Description: Job Description The key responsibilities include the design, execution and maintenance of critical data pipelines supporting a myriad of data-related use cases. A senior data engineer is encouraged to take ownership of the pipelines, to...

  • Information Technology

    2 months ago


    Singapur, Singapore Singapore Airlines Full time

    Job DescriptionThe senior data engineer is a senior software developer with strong software engineering skills who is responsible for building custom open-source-based data ingestion and MLOps platforms. He/she has deep appreciation of the complexity of the data engineering process, such as the challenges of data ingestion involving large or near-real-time...


  • Singapur, Singapore Singapore Airlines Full time

    Job DescriptionThe senior data engineer is a senior software developer with strong software engineering skills who is responsible for building custom open-source-based data ingestion and MLOps platforms. He/she has deep appreciation of the complexity of the data engineering process, such as the challenges of data ingestion involving large or near-real-time...


  • Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...


  • Singapur, Singapore Garena Full time

    Job Description Collaborate with the business team for game data collection, extraction, modeling, mining and analysis Build systems to analyse business indicators based on different game types, build and improve on daily BI reports Analyze and research on business data, write analysis reports and provide data support for business decisions Apply machine...


  • Singapur, Singapore SAP Full time

    Bring out your best SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services...