Data Engineer

1 month ago


Singapore timesjobs Full time
## Data Engineer - CREQ194439

### Description
:

We are seeking a highly motivated Junior Consultant Data Engineer to join our dynamic data engineering team.

The ideal candidate will have experience in data engineering technologies and be eager to learn and grow within the role.

This position will involve working with .NET, ETL processes, Python, PySpark, Hive, and will also include opportunities to work with ChatGPT and machine learning models.

Responsibilities:

  • Develop and maintain ETL processes to extract, transform, and load data from various sources.
  • Use .NET to develop data integration and processing solutions.
  • Work with Python and PySpark for data processing and analysis.
  • Utilize Hive for data warehousing solutions.
  • Assist in the implementation and integration of ChatGPT and machine learning models into data pipelines.
  • Collaborate with data scientists and other stakeholders to understand data requirements and deliver solutions.
  • Optimize and troubleshoot data processes for performance and reliability.
  • Maintain documentation of data engineering processes and workflows.
  • Stay updated with the latest industry trends and technologies in data engineering and machine learning.
Requirements:

  • Bachelors degree in Computer Science, Information Technology, Data Science, or a related field.
  • Proven experience in data engineering or software development.
  • Proficiency in .NET for data processing and integration.
  • Experience with ETL processes and tools.
  • Strong programming skills in Python.
  • Familiarity with PySpark and Hive for big data processing.
  • Basic understanding of ChatGPT and machine learning models.
  • Strong analytical and problemsolving skills.
  • Excellent communication and teamwork skills.
  • Willingness to learn and adapt to new technologies and methodologies.
### Preferred Qualifications

  • Experience with cloud platforms (e.g., AWS, Azure, Google Cloud).
  • Knowledge of data modeling and database design.
  • Familiarity with other big data technologies and frameworks.
  • Understanding of DevOps practices and CI/CD pipelines.
  • Exposure to machine learning frameworks and libraries (e.g., TensorFlow, PyTorch).
### Primary Location
Tanjong Pagar, Central Singapore, Singapore

### Job Type
Experienced

### Primary Skills
PySpark

### Years of Experience
5

### Travel
No
  • Data Engineer

    4 days ago


    Singapore NTT Data Singapore Full time

    Job Summary:We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. As a Data Engineer, you will play a key role in designing and building robust and scalable data ingestion and management solutions for batch loading and streaming from data sources using Python.Key Responsibilities:Collaborate with data stewards, data analysts,...

  • Data Architect

    5 days ago


    Singapore NTT Data Singapore Full time

    Job RequirementsWe are seeking a highly skilled professional to join our team at NTT Data Singapore as a Data Engineer. The ideal candidate will have a strong background in computer science and a minimum of 7 years of experience in IT, with at least 5 years in a similar role.Key ResponsibilitiesDesign and develop large-scale data processing systems using...


  • Singapore NTT Data Singapore Full time

    Job Summary:We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. As a Data Engineer, you will play a critical role in designing and building robust and scalable data ingestion and management solutions for batch loading and streaming from data sources using Python.Key Responsibilities:Collaborate with data stewards, data...


  • Singapore NTT Data Singapore Full time

    Job DescriptionWe are seeking a highly skilled and experienced IT Operations Manager to lead our Data Centre operations team at NTT Data Singapore. The successful candidate will be responsible for ensuring the smooth and efficient operation of our data centre facilities, including daily IT infrastructure and data centre operations.Key...


  • Singapore NTT Data Singapore Full time

    Job DescriptionWe are seeking a highly skilled and experienced IT Operations Manager to lead our Data Centre operations team at NTT Data Singapore. The successful candidate will be responsible for ensuring the smooth and efficient operation of our data centre facilities, including the management of daily IT infrastructure and data centre operations.Key...


  • Singapore DATA DISTINCTION Full time

    b'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...

  • Data Engineer

    17 hours ago


    Singapore MyCareersFuture Full time

    **Job Summary**We are seeking a highly motivated and detail-oriented Junior Data Engineer to join our Data Engineering Practice team at MyCareersFuture. The ideal candidate will assist in the following key areas:Develop and maintain data pipelines to support business decisionsPlan and coordinate events and workshops to enhance data engineering skillsEvaluate...

  • Data Engineer

    17 hours ago


    Singapore MyCareersFuture Full time

    About MyCareersFutureMyCareersFuture is a leading platform for career development and job search. Our mission is to empower individuals to take control of their careers and achieve their goals.Job SummaryWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining...

  • Data Engineer

    1 month ago


    Singapore TEKsystems (Allegis Group Singapore Pte Ltd) Full time

    We are looking for a highly skilled Data Engineer specializing in Data Quality to join our Data Platform Engineering team. In this role, you will be responsible for managing data quality (DQ) and data catalog platforms within the organisation. Your primary focus will be on building and maintaining DQ pipelines and ensuring data integrity and reliability. ...

  • Data Engineer

    1 month ago


    Singapore Crypto.com Full time

    As a Data Engineer at Crypto.com , you will be a valued member of our talented data engineering team. You will play a critical role in designing, building, and maintaining our robust data infrastructure. You will collaborate with data analysts, scientists, and business stakeholders to develop and implement data solutions that drive informed decision-making....

  • Data Engineer

    2 months ago


    Singapore Luxoft Full time

    Project descriptionWe are seeking a highly skilled and experienced Data Engineer to join our Data & Analytics team. The ideal candidate will have a strong background in Snowflake SQL, investment reporting data, and financial knowledge related to investment management. As a Data Engineer, you will play a critical role in designing, implementing, and...

  • Data Engineer

    17 hours ago


    Singapore MyCareersFuture Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at MyCareersFuture. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure.Key ResponsibilitiesDesign and implement complex ETL pipelines to extract, transform, and load data from various sources.Develop and maintain data...

  • Data Engineer

    17 hours ago


    Singapore MyCareersFuture Full time

    About MyCareersFutureMyCareersFuture is a leading technology company that empowers creators to express themselves and transform videos into creative masterpieces. Our mission is to inspire creativity and enrich life by providing innovative solutions for content creation.Job SummaryWe are seeking a highly skilled Data Engineer - Big Data to join our team. As...

  • Data Engineer

    1 day ago


    Singapore MyCareersFuture Full time

    Roles & Responsibilities About the job Reporting and Analytics Developer/Data Engineer We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. Overall experience can be 4 to...

  • Data Engineer

    3 months ago


    Singapore Cognizant Full time

    Do you have software developer experience, and are you seeking a new job in Singapore? Cognizant is looking for a Data Engineer, and the full-time role comes with an attractive salary and benefits package.As a Data Engineer, you will design, develop and implement data-processing pipelines to process large volumes of structured and unstructured data....

  • Data Engineer

    4 weeks ago


    Singapore TEKsystems (Allegis Group Singapore Pte Ltd) Full time

    Job Description & Requirements The Data Informatics Developer will collaborate closely with internal business stakeholders, as well as product and engineering teams, to support and deliver data engineering and integration solutions, along with operational data support. In addition, the role involves leading small to medium complexity projects from inception...

  • Data Engineer

    3 months ago


    Singapore Cognizant Full time

    Do you have software developer experience, and are you seeking a new job in Singapore? Cognizant is looking for a Data Engineer, and the full-time role comes with an attractive salary and benefits package.As a Data Engineer, you will design, develop and implement data-processing pipelines to process large volumes of structured and unstructured data. You...

  • Data Engineer

    1 day ago


    Singapore MyCareersFuture Full time

    Roles & Responsibilities The Data Engineer supports and improves the data capabilities in terms of collecting, managing, and converting raw data into information that can be interpreted by data analysts and data scientists. The goals will be to define, build and improve the tools and procedures for data pipelining, functional and unit testing to enhancing...

  • Data Engineer

    3 months ago


    Singapore Fpt Asia Pacific Pte. Ltd. Full time

    Develop and support enterprise data services, and ensure operational stability and performance through continuous optimization. * Work hand-in-glove the product owners and various stakeholders Develop and support enterprise data services, and ensure operational stability and performance through continuous optimization. Work hand-in-glove the product owners...


  • Singapore MyCareersFuture Full time

    Job SummaryMyCareersFuture is seeking a highly skilled Data Engineer/Senior Data Engineer to join our team. As a key member of our big data infrastructure team, you will be responsible for designing, implementing, and maintaining large-scale distributed systems.Key ResponsibilitiesDesign and implement scalable and efficient big data clusters, ensuring high...