Data Engineer/ Senior Engineer

2 weeks ago

Singapur, Singapore StarHub Full time

Job Description

Purpose:
⦁ The Data Platform Team is responsible for conceptualisation, implementation and management of organisation-wide data platform and solutions.
⦁ You will be part of the team responsible for data management to solve business problems, build and maintain data infrastructure to address business requirements and improve processes.
⦁ You will focus on defining optimal solutions in data collection, processing and warehousing for data scientists and business analysts to interpret and make data accessible to meet business requirements.
⦁ You are a subject matter expert in data engineering and data pipeline with adoption of best practices and innovations.
⦁ You will work closely with different stakeholders to support the project implementation and maintenance of existing or new data platforms on cloud


Responsibilities:
⦁ Design, implement and maintain data collection, data flow channels, data processing systems and warehousing that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable and secure manner in cloud environment
⦁ Identify, design, and implement internal process improvements including data collection for cross functional teams, automating manual processes, optimising data flow/delivery, re-designing infrastructure for greater scalability, etc. using SQL and ‘big data’ technologies
⦁ Collect, parse, manage, analyse and visualise large, complex sets of data to turn information into insights accessible through multiple platforms
⦁ Ensure data quality and efficiency, including the backup of data and its easy retrieval in case of system failure
⦁ Build analytic tools that utilise the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics for the use of analytics and data scientist team members
⦁ Operate, manage and maintain the data lakehouse infrastructure, including data model, data ingestion, ETL/ELT, data storage and visualisation
⦁ Work with stakeholders including Product, Data, Systems, Service Operations teams to resolve data-related technical issues and support their data infrastructure needs
⦁ Collaborate with Data Scientists and Architects on analytical projects in developing prescriptive and predictive models
⦁ Prepare and maintain proper documentations of data pipeline design and processes, operation procedures, etc
⦁ Be an advocate for best practices and continuous learning, keeping track of industry standards and technological advances that can improve the framework structure and design

Qualifications

⦁ An appropriate qualification in Computer Science, IT, or Applied Mathematics, including Data Engineering certifications such as IBM Certified Data Engineer, Google Certified Professional or equivalent
⦁ At least 2 years of experiences as data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up
⦁ Passionate about working with large data sets, data model and interpret data pattern
⦁ Ability to understand business processes and resolve challenges with data models, data mining, and segmentation techniques
⦁ Experiences in both batch processing and real-time data streaming.
⦁ Knowledge of data migration and integration techniques, along with the tools necessary to accomplish them
⦁ Hands-on experiences in transforming functional specifications into design specifications
⦁ Hands-on experiences in Linux system, Object Storage, Spark, Presto query engine
⦁ Hands-on experiences in building or maintaining ETL processes and SQL database design
⦁ Knowledge of programming languages (e.g. Java and Python)
⦁ Experiences to develop reports and visuals through any BI or visualisation tools such as Grafana/ Tableau
⦁ Familiar with AWS/GCP data pipeline and ecosystem, data warehouse and big data platforms such as Hadoop solutions
⦁ Good problem solving and communication skills, especially for explaining technical concepts to non-technical business leaders
⦁ Ability to work in a dynamic, research-oriented team that has concurrent projects
⦁ Certification in Cloud Technology platform (in Architecture or Networking), Container Architecture, Systems and/or Network Virtualization
⦁ Knowledge of telco network such as Mobile and Fixed will be advantageous
⦁ Passion for software development, automation and new technologies/innovations for business and in operational excellence

  • Senior Data Engineer

    4 weeks ago

    Singapur, Singapore BBGC Full time

    Job Description: Senior Data EngineerPosition Overview: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The Senior Data Engineer will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure to support our organization's data needs. The ideal candidate will have a...

  • Senior Data Engineer

    2 weeks ago

    Singapur, Singapore JLL Full time

    JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and...

  • Senior Data Engineer

    4 weeks ago

    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...

  • Senior Data Engineer

    3 weeks ago

    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...

  • Information Technology

    4 weeks ago

    Singapur, Singapore Singapore Airlines Full time

    Job DescriptionThe senior data engineer is a senior software developer with strong software engineering skills who is responsible for building custom open-source-based data ingestion and MLOps platforms. He/she has deep appreciation of the complexity of the data engineering process, such as the challenges of data ingestion involving large or near-real-time...

  • Senior Data Engineer

    4 weeks ago

    Singapur, Singapore Helius Full time

    Responsibilities Design and develop data pipelines and data infrastructure to support efficient and scalable data processing and analytics. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions. Implement and maintain data integration and ETL (Extract, Transform,...

  • Senior Data Engineer

    2 weeks ago

    Singapur, Singapore SAP Full time

    Bring out your bestSAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for...

  • Data Engineering Intern

    4 weeks ago

    Singapur, Singapore OnLoop Full time

    We are seeking a motivated and talented Data Engineering Intern with a special focus on prompt engineering to join our growing team. This internship offers an exciting opportunity to gain hands-on experience in the field of data engineering while contributing to the development of cutting-edge natural language processing (NLP) models. The ideal candidate is...

  • Senior Data Analytics Engineer

    3 days ago

    Singapur, Singapore Autodesk Full time

    Position Overview Autodesk is seeking an experienced data analyst reporting to the Senior Manager of Engineering to join the Licensing and Compliance team that administers Autodesk's business models and implements compliant access controls for all of Autodesk's products. You will be a valued contributor within the Identity & Licensing organization,...

  • Cloud Infrastructure Engineer

    4 weeks ago

    Singapur, Singapore NTT Data Singapore Full time

    Job briefRole: Cloud Infrastructure Engineer - Mid-level/SeniorLocation: Singapore (Onshore) - 1 resourceContract Duration - 12 Months renewable.  Support Cloud infrastructure operations.Responsibilities: Responsible in implementation, management and troubleshooting of AWS Technologies and Openshift Container Platform. Proficient in Operating System...

  • Data Engineer

    4 weeks ago

    Singapur, Singapore ST Engineering Full time

    Title: Data Engineer Job ID: Location: Aero - Airport Road, SG Description: Job Description Develop web applications using ASP.Net MVC and ASP.Net Web API, following the development standards and technical design provided Understanding of best practices in software development process (SDLC) including coding standards, code reviews,...

  • Senior Data Center Design Manager, Data Center Engineering

    4 weeks ago

    Singapur, Singapore Amazon Asia-Pacific Resources Private Limited (Singapore) - B12 Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...

  • Engineer/Senior Engineer, Backend

    4 weeks ago

    Singapur, Singapore Sea Full time

    Job Description Work with and materialize practical product ideas atop the latest technologies, bridging the gap between the forefront of technological advancement and people’s needs.Server-side design, development and deployment of the services/systems/platforms used by our products and our usersResearch the latest technologies and development trends in...

  • Senior Data Analyst, Data Analytics, GEC

    4 weeks ago

    Singapur, Singapore ST Engineering Full time

    Title: Senior Data Analyst, Data Analytics, GEC Job ID: Location: Aero - West Camp Road, SG Description: Job Description for Senior Data Analyst – Data & Business Intelligence Background: The Data Analytics Strategic Engineering Centre (DA SEC) is one of six SECs under the Group Engineering Centre (GEC) in ST Engineering. DA SEC...

  • Engineer/Senior Engineer, Backend

    1 day ago

    Singapur, Singapore Sea Full time

    Job Description Server-side design and development of the services/ systems/platforms used by our products and our users.Write high-quality, clean, simple, and maintainable code; build common libraries.Analyse requirements, design, and develop functionalities based on product requirements.Understand the product thoroughly, constantly optimize the product,...

  • Big Data Engineer

    4 weeks ago

    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 111170 Description Job Summary We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment , Cloudera Data Platform. Overall experience can be 5 to 10 years.. The successful candidate will...

  • Azure Data Engineer

    1 month ago

    Singapur, Singapore SMRT Corporation Ltd Full time

    Job Purpose We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you will create and maintain optimal data pipelines architecture in cloud. Overall, you will strive for efficiency by aligning data systems with business goals.  To succeed in this...

  • Senior Geotechnical Engineer

    4 weeks ago

    Singapur, Singapore Fugro Full time

    Job DescriptionWho we areDo you want to join our Geo-data revolution? Fugro’s global reach and unique know-how will put the world at your fingertips. Our love of exploration and technical expertise help us to provide our clients with invaluable insights. We source and make sense of the most relevant Geo-data for their needs, so they can design, build and...

  • Data Engineer Intern

    4 weeks ago

    Singapur, Singapore Razer Full time

    Job Responsibilities :Intern will be playing a key role in the revamp of existing data pipelines and building new pipelines that are essential for data analyst/data scientist to perform analytics.By studying and understanding the data and pipelines, the intern will perform data profiling, data processing, automation and deployment to ensure that data is...

  • Senior Data Engineer x Analyst

    4 weeks ago

    Singapur, Singapore QCP Capital Full time

    Established in 2017, QCP is one of the first digital asset trading firms in Singapore, with a vision to partner the next generation of investors to unlock institutional opportunities in digital assets. QCP brings to clients deep expertise gained from thriving through multiple market cycles. A global market maker in digital asset derivatives with a vast...