Data Engineer
1 month ago
### Description
:
We are seeking a highly motivated Junior Consultant Data Engineer to join our dynamic data engineering team.
The ideal candidate will have experience in data engineering technologies and be eager to learn and grow within the role.
This position will involve working with .NET, ETL processes, Python, PySpark, Hive, and will also include opportunities to work with ChatGPT and machine learning models.
Responsibilities:- Develop and maintain ETL processes to extract, transform, and load data from various sources.
- Use .NET to develop data integration and processing solutions.
- Work with Python and PySpark for data processing and analysis.
- Utilize Hive for data warehousing solutions.
- Assist in the implementation and integration of ChatGPT and machine learning models into data pipelines.
- Collaborate with data scientists and other stakeholders to understand data requirements and deliver solutions.
- Optimize and troubleshoot data processes for performance and reliability.
- Maintain documentation of data engineering processes and workflows.
- Stay updated with the latest industry trends and technologies in data engineering and machine learning.
- Bachelors degree in Computer Science, Information Technology, Data Science, or a related field.
- Proven experience in data engineering or software development.
- Proficiency in .NET for data processing and integration.
- Experience with ETL processes and tools.
- Strong programming skills in Python.
- Familiarity with PySpark and Hive for big data processing.
- Basic understanding of ChatGPT and machine learning models.
- Strong analytical and problemsolving skills.
- Excellent communication and teamwork skills.
- Willingness to learn and adapt to new technologies and methodologies.
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud).
- Knowledge of data modeling and database design.
- Familiarity with other big data technologies and frameworks.
- Understanding of DevOps practices and CI/CD pipelines.
- Exposure to machine learning frameworks and libraries (e.g., TensorFlow, PyTorch).
Tanjong Pagar, Central Singapore, Singapore
### Job Type
Experienced
### Primary Skills
PySpark
### Years of Experience
5
### Travel
No
-
Data Engineer
4 days ago
Singapore NTT Data Singapore Full timeJob Summary:We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. As a Data Engineer, you will play a key role in designing and building robust and scalable data ingestion and management solutions for batch loading and streaming from data sources using Python.Key Responsibilities:Collaborate with data stewards, data analysts,...
-
Data Architect
5 days ago
Singapore NTT Data Singapore Full timeJob RequirementsWe are seeking a highly skilled professional to join our team at NTT Data Singapore as a Data Engineer. The ideal candidate will have a strong background in computer science and a minimum of 7 years of experience in IT, with at least 5 years in a similar role.Key ResponsibilitiesDesign and develop large-scale data processing systems using...
-
Senior Data Ingestion Specialist
5 days ago
Singapore NTT Data Singapore Full timeJob Summary:We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. As a Data Engineer, you will play a critical role in designing and building robust and scalable data ingestion and management solutions for batch loading and streaming from data sources using Python.Key Responsibilities:Collaborate with data stewards, data...
-
Data Centre Operations Lead
4 days ago
Singapore NTT Data Singapore Full timeJob DescriptionWe are seeking a highly skilled and experienced IT Operations Manager to lead our Data Centre operations team at NTT Data Singapore. The successful candidate will be responsible for ensuring the smooth and efficient operation of our data centre facilities, including daily IT infrastructure and data centre operations.Key...
-
IT Operations Manager
4 days ago
Singapore NTT Data Singapore Full timeJob DescriptionWe are seeking a highly skilled and experienced IT Operations Manager to lead our Data Centre operations team at NTT Data Singapore. The successful candidate will be responsible for ensuring the smooth and efficient operation of our data centre facilities, including the management of daily IT infrastructure and data centre operations.Key...
-
Nlp And Text Classfication Ml Engineering
3 months ago
Singapore DATA DISTINCTION Full timeb'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...
-
Data Engineer
17 hours ago
Singapore MyCareersFuture Full time**Job Summary**We are seeking a highly motivated and detail-oriented Junior Data Engineer to join our Data Engineering Practice team at MyCareersFuture. The ideal candidate will assist in the following key areas:Develop and maintain data pipelines to support business decisionsPlan and coordinate events and workshops to enhance data engineering skillsEvaluate...
-
Data Engineer
17 hours ago
Singapore MyCareersFuture Full timeAbout MyCareersFutureMyCareersFuture is a leading platform for career development and job search. Our mission is to empower individuals to take control of their careers and achieve their goals.Job SummaryWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining...
-
Data Engineer
1 month ago
Singapore TEKsystems (Allegis Group Singapore Pte Ltd) Full timeWe are looking for a highly skilled Data Engineer specializing in Data Quality to join our Data Platform Engineering team. In this role, you will be responsible for managing data quality (DQ) and data catalog platforms within the organisation. Your primary focus will be on building and maintaining DQ pipelines and ensuring data integrity and reliability. ...
-
Data Engineer
1 month ago
Singapore Crypto.com Full timeAs a Data Engineer at Crypto.com , you will be a valued member of our talented data engineering team. You will play a critical role in designing, building, and maintaining our robust data infrastructure. You will collaborate with data analysts, scientists, and business stakeholders to develop and implement data solutions that drive informed decision-making....
-
Data Engineer
2 months ago
Singapore Luxoft Full timeProject descriptionWe are seeking a highly skilled and experienced Data Engineer to join our Data & Analytics team. The ideal candidate will have a strong background in Snowflake SQL, investment reporting data, and financial knowledge related to investment management. As a Data Engineer, you will play a critical role in designing, implementing, and...
-
Data Engineer
17 hours ago
Singapore MyCareersFuture Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at MyCareersFuture. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure.Key ResponsibilitiesDesign and implement complex ETL pipelines to extract, transform, and load data from various sources.Develop and maintain data...
-
Data Engineer
17 hours ago
Singapore MyCareersFuture Full timeAbout MyCareersFutureMyCareersFuture is a leading technology company that empowers creators to express themselves and transform videos into creative masterpieces. Our mission is to inspire creativity and enrich life by providing innovative solutions for content creation.Job SummaryWe are seeking a highly skilled Data Engineer - Big Data to join our team. As...
-
Data Engineer
1 day ago
Singapore MyCareersFuture Full timeRoles & Responsibilities About the job Reporting and Analytics Developer/Data Engineer We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. Overall experience can be 4 to...
-
Data Engineer
3 months ago
Singapore Cognizant Full timeDo you have software developer experience, and are you seeking a new job in Singapore? Cognizant is looking for a Data Engineer, and the full-time role comes with an attractive salary and benefits package.As a Data Engineer, you will design, develop and implement data-processing pipelines to process large volumes of structured and unstructured data....
-
Data Engineer
4 weeks ago
Singapore TEKsystems (Allegis Group Singapore Pte Ltd) Full timeJob Description & Requirements The Data Informatics Developer will collaborate closely with internal business stakeholders, as well as product and engineering teams, to support and deliver data engineering and integration solutions, along with operational data support. In addition, the role involves leading small to medium complexity projects from inception...
-
Data Engineer
3 months ago
Singapore Cognizant Full timeDo you have software developer experience, and are you seeking a new job in Singapore? Cognizant is looking for a Data Engineer, and the full-time role comes with an attractive salary and benefits package.As a Data Engineer, you will design, develop and implement data-processing pipelines to process large volumes of structured and unstructured data. You...
-
Data Engineer
1 day ago
Singapore MyCareersFuture Full timeRoles & Responsibilities The Data Engineer supports and improves the data capabilities in terms of collecting, managing, and converting raw data into information that can be interpreted by data analysts and data scientists. The goals will be to define, build and improve the tools and procedures for data pipelining, functional and unit testing to enhancing...
-
Data Engineer
3 months ago
Singapore Fpt Asia Pacific Pte. Ltd. Full timeDevelop and support enterprise data services, and ensure operational stability and performance through continuous optimization. * Work hand-in-glove the product owners and various stakeholders Develop and support enterprise data services, and ensure operational stability and performance through continuous optimization. Work hand-in-glove the product owners...
-
Data Engineer/Senior Data Engineer
17 hours ago
Singapore MyCareersFuture Full timeJob SummaryMyCareersFuture is seeking a highly skilled Data Engineer/Senior Data Engineer to join our team. As a key member of our big data infrastructure team, you will be responsible for designing, implementing, and maintaining large-scale distributed systems.Key ResponsibilitiesDesign and implement scalable and efficient big data clusters, ensuring high...