Data Engineer

4 weeks ago

Singapur, Singapore NodeFlair Full time

1. Key Outputs: 

  • Collaborate with both non-technical and technical team members from cross-functional business and IT teams to gather, elicit and document data requirements and translate them into:
    • Data Models and Mapping Specifications
      • Develop and govern data modeling standards, best practices, and guidelines to ensure consistency and maintainability across data models.
      • Review to ensure up-to-date documentation for data models, including entity-relationship diagrams, data flow diagrams, and data catalogues/data lineage.
      • Ensure regular data profiling and analysis to validate and optimize data models for performance and efficiency.
      • Analyze source system data structures, schemas, and formats to identify data relationships, dependencies, and mapping requirements and understand data semantics and business rules.
      • Create and maintain data mapping specifications that document how data from one source is transformed and loaded into the target data model.
        • Define transformation rules and logic to transform data as needed.
      • Communicate effectively with stakeholders to ensure a shared understanding of data modeling and mapping processes.
      • Ensure data quality and integrity throughout the mapping process. Implement data quality checks and validation mechanisms to identify and resolve data quality issues.
      • Document and maintain the data flow, data dependencies, data dictionary, and data lineage for the data assets using tools such as ERwin, or SqlDBM.
      • Perform data profiling, data validation, and data quality checks using tools such as SQL and Python to ensure that the data is accurate, complete, and consistent across the data sources and targets.
    • Data Pipeline Solutions
      • Drive automation using modern data and analytical tools to develop, test, automate and deploy repeatable data integration and data preparation flows from multiple source systems into our data lake and enterprise data warehouse systems.
      • Build quick prototype data management solutions required for proof of concept or proof of value.
  • Identify and propose opportunities for optimization of our data modeling, mapping, integration, and transformation processes and propose solutions.
  • Perform data analysis, visualization, and reporting using tools such as Excel, and Power BI to find patterns and insights from the data and communicate them to the business users.
  • Troubleshoot and resolve any data issues or anomalies that may arise in our data systems or processes.
  • Collaborate with business, D&A 3rd party service providers and broader IT colleagues to evangelize data management, act as a data guru and work across business silos to promote better understanding of data and analytics.
  • Any other assigned responsibilities

2. Selection Criteria (skills, experience, knowledge):

  • Bachelors degree in Computer Science, Engineering, Business or equivalent discipline
  • 3+ years of experience in a Data Management discipline including experience in data warehousing concepts and data modeling
    • Experience designing and implementing data warehouses using Data Vault 2.0 principles is a strong plus
  • Strong experience working with heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using modern Data Integration Tools (e.g. Talend, Azure Data Factory etc) and Data Storage Solutions (e.g. Azure Data Lake, Azure Synapse, Snowflake Data Warehouse etc.)
  • Proficient in SQL and PL/SQL
  • Experience of working with data warehousing solutions (e.g. Snowflake) to build data warehouses / data marts
  • Experience of working with data from SAP, manufacturing, or scientific research systems is strong plus but not required/compulsory.
  • Basic understanding of popular open-source and commercial data science tools and platforms such as Python and Azure ML is an advantage.
  • Experience working in a virtual team setting and self-driven with desire to take the lead and drive tasks to completion in a remote environment.
  • Detail-oriented and strict attention to details and the ability to quickly spot and fix problems.
  • Willingness and ability to stay abreast of Data Engineering industry trends.
  • Excellent communication, collaboration, and problem-solving skills.

  • Data Engineering Intern

    3 weeks ago

    Singapur, Singapore OnLoop Full time

    We are seeking a motivated and talented Data Engineering Intern with a special focus on prompt engineering to join our growing team. This internship offers an exciting opportunity to gain hands-on experience in the field of data engineering while contributing to the development of cutting-edge natural language processing (NLP) models. The ideal candidate is...

  • Data Engineer

    3 weeks ago

    Singapur, Singapore ST Engineering Full time

    Title: Data Engineer Job ID: Location: Aero - Airport Road, SG Description: Job Description Develop web applications using ASP.Net MVC and ASP.Net Web API, following the development standards and technical design provided Understanding of best practices in software development process (SDLC) including coding standards, code reviews,...

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 111170 Description Job Summary We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment , Cloudera Data Platform. Overall experience can be 5 to 10 years.. The successful candidate will...

  • Data Engineer

    3 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Build and optimizing ‘big data’ data pipelines, architectures and data sets. Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. To support and develop Data modeling, Implementation activities. Strong analytic skills related to working with...

  • Azure Data Engineer

    4 weeks ago

    Singapur, Singapore SMRT Corporation Ltd Full time

    Job Purpose We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you will create and maintain optimal data pipelines architecture in cloud. Overall, you will strive for efficiency by aligning data systems with business goals.  To succeed in this...

  • Data Engineer Intern

    4 weeks ago

    Singapur, Singapore Razer Full time

    Job Responsibilities :Intern will be playing a key role in the revamp of existing data pipelines and building new pipelines that are essential for data analyst/data scientist to perform analytics.By studying and understanding the data and pipelines, the intern will perform data profiling, data processing, automation and deployment to ensure that data is...

  • Senior Software Engineer, Frontend

    3 weeks ago

    Singapur, Singapore Twelve Data Full time

    What we need An experienced front-end developer is required in the core development team. The team develops products that automate processes within the company, develops pages and components of the twelvedata.com site, improves site performance and customer experience. We make a high-quality intranet, meeting the high requirements of our users - Twelve Data...

  • Senior Data Engineer

    3 weeks ago

    Singapur, Singapore Helius Full time

    Responsibilities Design and develop data pipelines and data infrastructure to support efficient and scalable data processing and analytics. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions. Implement and maintain data integration and ETL (Extract, Transform,...

  • Senior Data Engineer

    2 weeks ago

    Singapur, Singapore JLL Full time

    JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and...

  • Data Engineer/ Senior Engineer

    1 week ago

    Singapur, Singapore StarHub Full time

    Job Description Purpose: ⦁ The Data Platform Team is responsible for conceptualisation, implementation and management of organisation-wide data platform and solutions. ⦁ You will be part of the team responsible for data management to solve business problems, build and maintain data infrastructure to address business requirements and improve...

  • Senior Data Engineer

    3 weeks ago

    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...

  • Data Quality Assurance Engineer

    3 days ago

    Singapur, Singapore TikTok Full time

    About the team The mission of the Data Business Partner (BP) Quality Assurance Team is to build a highly robust(standardized/professional/efficient) data quality system, ensuring the better delivery of data. Our goal is to safeguard the quality of data throughout the entire lifecycle in terms of timeliness, accuracy, and stability, empowering the...

  • Senior Data Engineer

    3 weeks ago

    Singapur, Singapore BBGC Full time

    Job Description: Senior Data EngineerPosition Overview: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The Senior Data Engineer will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure to support our organization's data needs. The ideal candidate will have a...

  • Senior Data Engineer

    2 weeks ago

    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...

  • Senior Software Engineer

    2 weeks ago

    Singapur, Singapore Twelve Data Full time

    Summary Twelve Data’s Backend team is looking for a high-energy Golang backend developer with a passion for creating impactful FinTech products. This team is responsible for developing stable systems that process terabytes of financial quotes daily. The tools we develop will be used by thousands of users creating their own financial worlds that altogether...

  • Data Quality Assurance Engineer, Data Platform

    4 weeks ago

    Singapur, Singapore TikTok Full time

    About the team The mission of the Data Business Partner (BP) Quality Assurance Team is to build a highly mature (standardized/professional/efficient) data quality system, ensuring the better delivery of data. Our goal is to safeguard the quality of data throughout the entire lifecycle in terms of timeliness, accuracy, and stability, empowering the...

  • Network SDWAN Implementation Engineer

    3 weeks ago

    Singapur, Singapore NTT Data Singapore Full time

    Job Responsibilities ・ Leads as the subject matter expert, to design, plan and deploy the right functional technical solution accordance with the specification and service levels of business and/or system requirements include multi-region routing across regional DCs Cisco SDWAN controller and Internet Gateway disaster recovery. ・ ...

  • Engineer Data Management

    3 weeks ago

    Singapur, Singapore MISC Berhad Full time

    Description KEY ACCOUNTABILITIES Manage, plan and maintain the facilitation of support for data analysis across Eaglestar’s growing global fleet . Project-manage and deliver on data-related implementations ensuring that deliverables are met within agreed scope and timelines Manage, develop, and provide Eaglestar’s internal/external stakeholders...

  • Lead Data Engineer

    3 weeks ago

    Singapur, Singapore Helius Full time

    Our goal is to transform the entire hiring process by making it simple, efficient, and enjoyable for recruiters, hiring managers, and candidates alike Our mission is to offer the best-in-class AI-powered technologies to empower small, medium, and large businesses in their staffing & recruitment transformation. Responsibilities Set, define, and own...

  • Associate Data Engineer

    1 week ago

    Singapur, Singapore Aon Full time

    Associate Data Engineer Aon is in the business of better decisions At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive, diverse team, and we are passionate about helping our colleagues and clients succeed. About ACIA Aon’s Centers...