Data Engineer

3 weeks ago


Singapur, Singapore Unison Consulting Pte Ltd Full time

Design, implement, and maintain scalable and efficient data pipelines using Spark, Python, and PySpark.

Ensure the smooth flow of data from various sources to destination systems.

Utilize SAS, Spark, Python, and PySpark for efficient data processing.

Design and implement data models to support business requirements.

Work closely with data architects to ensure data models align with organizational needs.

Implement data quality checks to ensure accuracy and consistency.

Adhere to data governance policies and maintain data integrity.

Optimize data processing and query performance using Spark, Python, and PySpark.

Identify and resolve bottlenecks in the data pipeline.

Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.

Requirements

Bachelor's degree in Computer Science, Information Technology, or a related field.

Proven experience as a Data Engineer with expertise in Hadoop Implementation, Scala, Spark, Python, and PySpark.

Experience with big data technologies and distributed computing.

Proficient in, Spark, Python, and PySpark.

Strong problem-solving and analytical skills.

Excellent collaboration and communication skills.

Familiarity with data security and privacy best practices.

Experience with big data technologies such as Hadoop is a plus.
Good to have Connexa



  • Singapur, Singapore OnLoop Full time

    We are seeking a motivated and talented Data Engineering Intern with a special focus on prompt engineering to join our growing team. This internship offers an exciting opportunity to gain hands-on experience in the field of data engineering while contributing to the development of cutting-edge natural language processing (NLP) models. The ideal candidate is...

  • Data Engineer

    3 weeks ago


    Singapur, Singapore ST Engineering Full time

    Title: Data Engineer Job ID: Location: Aero - Airport Road, SG Description: Job Description Develop web applications using ASP.Net MVC and ASP.Net Web API, following the development standards and technical design provided Understanding of best practices in software development process (SDLC) including coding standards, code reviews,...

  • Big Data Engineer

    3 weeks ago


    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 111170 Description Job Summary We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment , Cloudera Data Platform. Overall experience can be 5 to 10 years.. The successful candidate will...

  • Data Engineer

    3 weeks ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Build and optimizing ‘big data’ data pipelines, architectures and data sets. Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. To support and develop Data modeling, Implementation activities. Strong analytic skills related to working with...

  • Azure Data Engineer

    4 weeks ago


    Singapur, Singapore SMRT Corporation Ltd Full time

    Job Purpose We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you will create and maintain optimal data pipelines architecture in cloud. Overall, you will strive for efficiency by aligning data systems with business goals.  To succeed in this...

  • Data Engineer

    4 weeks ago


    Singapur, Singapore NodeFlair Full time

    1. Key Outputs:  Collaborate with both non-technical and technical team members from cross-functional business and IT teams to gather, elicit and document data requirements and translate them into: Data Models and Mapping Specifications Develop and govern data modeling standards, best practices, and guidelines to ensure consistency and maintainability...

  • Data Engineer Intern

    4 weeks ago


    Singapur, Singapore Razer Full time

    Job Responsibilities :Intern will be playing a key role in the revamp of existing data pipelines and building new pipelines that are essential for data analyst/data scientist to perform analytics.By studying and understanding the data and pipelines, the intern will perform data profiling, data processing, automation and deployment to ensure that data is...


  • Singapur, Singapore Twelve Data Full time

    What we need An experienced front-end developer is required in the core development team. The team develops products that automate processes within the company, develops pages and components of the twelvedata.com site, improves site performance and customer experience. We make a high-quality intranet, meeting the high requirements of our users - Twelve Data...

  • Senior Data Engineer

    3 weeks ago


    Singapur, Singapore Helius Full time

    Responsibilities Design and develop data pipelines and data infrastructure to support efficient and scalable data processing and analytics. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions. Implement and maintain data integration and ETL (Extract, Transform,...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore JLL Full time

    JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and...


  • Singapur, Singapore StarHub Full time

    Job Description Purpose: ⦁ The Data Platform Team is responsible for conceptualisation, implementation and management of organisation-wide data platform and solutions. ⦁ You will be part of the team responsible for data management to solve business problems, build and maintain data infrastructure to address business requirements and improve...

  • Senior Data Engineer

    3 weeks ago


    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...


  • Singapur, Singapore TikTok Full time

    About the team The mission of the Data Business Partner (BP) Quality Assurance Team is to build a highly robust(standardized/professional/efficient) data quality system, ensuring the better delivery of data. Our goal is to safeguard the quality of data throughout the entire lifecycle in terms of timeliness, accuracy, and stability, empowering the...

  • Senior Data Engineer

    3 weeks ago


    Singapur, Singapore BBGC Full time

    Job Description: Senior Data EngineerPosition Overview: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The Senior Data Engineer will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure to support our organization's data needs. The ideal candidate will have a...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...


  • Singapur, Singapore Twelve Data Full time

    Summary Twelve Data’s Backend team is looking for a high-energy Golang backend developer with a passion for creating impactful FinTech products. This team is responsible for developing stable systems that process terabytes of financial quotes daily. The tools we develop will be used by thousands of users creating their own financial worlds that altogether...


  • Singapur, Singapore TikTok Full time

    About the team The mission of the Data Business Partner (BP) Quality Assurance Team is to build a highly mature (standardized/professional/efficient) data quality system, ensuring the better delivery of data. Our goal is to safeguard the quality of data throughout the entire lifecycle in terms of timeliness, accuracy, and stability, empowering the...


  • Singapur, Singapore NTT Data Singapore Full time

    Job Responsibilities ・ Leads as the subject matter expert, to design, plan and deploy the right functional technical solution accordance with the specification and service levels of business and/or system requirements include multi-region routing across regional DCs Cisco SDWAN controller and Internet Gateway disaster recovery. ・ ...


  • Singapur, Singapore MISC Berhad Full time

    Description KEY ACCOUNTABILITIES Manage, plan and maintain the facilitation of support for data analysis across Eaglestar’s growing global fleet . Project-manage and deliver on data-related implementations ensuring that deliverables are met within agreed scope and timelines Manage, develop, and provide Eaglestar’s internal/external stakeholders...

  • Lead Data Engineer

    3 weeks ago


    Singapur, Singapore Helius Full time

    Our goal is to transform the entire hiring process by making it simple, efficient, and enjoyable for recruiters, hiring managers, and candidates alike Our mission is to offer the best-in-class AI-powered technologies to empower small, medium, and large businesses in their staffing & recruitment transformation. Responsibilities Set, define, and own...