Big Data Integration Specialist
1 week ago
We are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. This is a challenging role that requires expertise in designing, developing, and implementing scalable data processing pipelines using Spark Scala.
Key Responsibilities:- Data Processing: Design and develop efficient Spark Scala applications to process large volumes of structured and unstructured data.
- Elasticsearch Integration: Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data.
- Performance Optimization: Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch.
- Collaboration: Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions.
- Scalable Applications: Develop and maintain scalable and fault-tolerant Spark applications, adhering to industry best practices and coding standards.
- Troubleshooting: Troubleshoot and resolve issues related to data processing, performance, and data quality in the Spark-Elasticsearch integration.
- At least 5 years of experience as a Data Engineer.
- Strong experience in Spark, Scala, and Elasticsearch.
- Able to develop and maintain scalable and fault-tolerant Spark applications.
- Excellent problem-solving skills and attention to detail.
- Stay updated with emerging trends and advancements in big data technologies.
- Mandatory Skills: Spark, Scala, and Elasticsearch.
The ideal candidate should have a strong background in software development and data engineering, with excellent problem-solving skills and attention to detail. If you're passionate about working with big data and want to be part of a dynamic team, we encourage you to apply for this exciting opportunity.
Salary$120,000 - $180,000 per annum, depending on experience.
-
Big Data Integration Specialist
1 week ago
Singapore Helius Full timeJob DescriptionAbout the RoleWe are seeking a highly skilled Big Data Integration Specialist to join our team at Helius. As a key member of our data integration team, you will be responsible for designing and implementing production-grade Talend Big Data jobs that meet our IT organization's architecture standards.Key ResponsibilitiesDevelop and maintain...
-
Big Data Support Specialist
2 days ago
Singapore NTT DATA Services Full timeAbout NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...
-
Senior Big Data Engineer
4 weeks ago
Singapore NTT Data Singapore Full timeJob Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Key Responsibilities • Proficient understanding of distributed computing...
-
Big Data Engineering Specialist
7 days ago
Singapore Unison Consulting Pte Ltd Full timeAbout UsUnison Consulting Pte Ltd is a leading consulting firm that specializes in data engineering solutions.We are seeking a highly skilled Big Data Engineering Specialist to join our team.Job DescriptionJob Title: Big Data Engineering SpecialistEstimated Salary: $120,000 - $180,000 per annumAs a Big Data Engineering Specialist at Unison Consulting Pte...
-
Data Integration Specialist
3 weeks ago
Singapore ITCAN Full timeJob DescriptionAt ITCAN, we are seeking a highly skilled Data Integration Specialist to join our team.The ideal candidate will have 5+ years of experience as a ETL Developer and minimum 3 years of experience with Big Data technologies such as Hadoop Spark, Hive, Sqoop, and YARN.The successful candidate will have a strong background in programming languages...
-
Systems Integrator
2 months ago
Singapore D L RESOURCES PTE LTD Full timeRoles & ResponsibilitiesMandatory Key Skills:1. Role is focused on Middleware Configuration & App Infrastructure Integration2. (Secondary Requirement): Application Software Aspect (Trouble Shoot Error Logs only, no programming needed)4. Data Processing5. 3-tier environment installation6. Configuration and troubleshooting, Shell Script, SQL, NOSQL, System...
-
Big Data Architect Specialist
2 weeks ago
Singapore USER EXPERIENCE RESEARCHERS PTE. LTD. Full timeAbout the JobWe are seeking a highly skilled and experienced Big Data Engineer to join our team at USER EXPERIENCE RESEARCHERS PTE. LTD.With a minimum of 4 years of experience managing data engineering jobs in big data environments such as Cloudera Data Platform, the ideal candidate will be responsible for designing, developing, and maintaining the data...
-
Senior Data Integration Specialist
1 week ago
Singapore ITCAN Full timeJob DescriptionAs a highly skilled ETL developer at ITCAN, you will be responsible for designing and implementing medium to large scale data integration projects using Big Data technologies such as Hadoop Spark, Hive, Sqoop, and YARN. Your extensive experience with SQL in relational databases like Oracle, DB2, and MySQL will be essential in developing...
-
Data Integration Specialist
1 week ago
Singapore ITCAN Full timeJob Requirements:ITCAN seeks a highly skilled Data Integration Specialist to join our team.Key Responsibilities:Develop and implement data integration solutions using ETL tools and technologies.Design and architect scalable data pipelines to handle large data volumes.Collaborate with cross-functional teams to ensure data quality and integrity.Stay up-to-date...
-
Big Data Developer
4 weeks ago
Singapore PRIMESTAFF MANAGEMENT SERVICES PTE LTD Full timeRoles & ResponsibilitiesOur client is looking for an experienced and highly skilled Senior Big Data Developer to join the dynamic team. The ideal candidate will have over 10 years of extensive working knowledge and hands-on expertise in big data technologies, especially in Spark on Scala or PySpark, and Hive. This role will involve the design, development,...
-
Big Data Engineering Expert
1 week ago
Singapore Unison Consulting Pte Ltd Full timeUnison Consulting Pte Ltd is seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have 5+ years of experience in designing, developing, and implementing Spark Scala applications and data processing pipelines.About the RoleThis is a key role that requires expertise in integrating Elasticsearch with Spark to enable efficient...
-
Big Data Solutions Developer
1 week ago
Singapore Nityo Infotech Full timeAs a key member of our data engineering team at Nityo Infotech, you will play a crucial role in designing, building, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.The ideal candidate will have a solid understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL, as well as experience integrating and working...
-
Big Data Framework Engineer
4 weeks ago
Singapore TANGSPAC CONSULTING PTE LTD Full timeRoles & ResponsibilitiesAs a Data Framework Engineer at TANGSPAC CONSULTING PTE LTD, you will be responsible for creating frameworks and technical features that enable faster operationalisation of data models, analytical models, and user-generated contents. This includes partnering with data scientists to enable faster adoption of AL/ML model-based systems,...
-
Data Integration Specialist
3 weeks ago
Singapore Unison Consulting Pte Ltd Full timeJob SummaryWe are seeking a talented Data Integration Specialist to join our team at Unison Consulting Pte Ltd.Main ResponsibilitiesDevelop and deploy ETL processes to integrate data from various sources.Collaborate with cross-functional teams to understand business requirements and design data solutions.Ensure data quality and integrity by implementing data...
-
Data Architecture Specialist
5 days ago
Singapore TikTok Full timeAbout the TeamTikTok's Tea platform is a leading analytics solution used by over 10,000 employees worldwide. As a data middle platform product, it supports massive data volumes and provides high-performance data analysis services.Job SummaryWe are seeking an experienced Data Architecture Specialist to join our global engineering team for Tea. This role will...
-
IT Infrastructure Integration Specialist
3 days ago
Singapore NTT DATA Services Full timeWe are seeking a highly skilled IT Infrastructure Integration Specialist to join our team in Singapore. This role involves designing and deploying network infrastructure solutions that meet client needs.Key responsibilities include handling multiple projects, providing network design and deployment support, and preparing Network Design Documents (NDD) for...
-
Data Scientist
4 weeks ago
Singapore NTT Data Singapore Full timeRequirementsFor this role at NTT Data Singapore, we are looking for a highly skilled professional with a Bachelor's degree in Computer Science or a related field. The ideal candidate will have at least 7 years of IT experience, with a minimum of 5 years in a similar role, preferably in Big Data tools.Key ResponsibilitiesOur ideal candidate will have a strong...
-
Big Data Support Specialist
1 week ago
Singapore U3 Full timeJob DescriptionThis role is an exciting opportunity to work with a dynamic team at U3 as a Big Data Support Specialist.Key Responsibilities:Pursue and resolve IT-related issues efficiently, ensuring minimal downtime for our users.Develop and maintain strong relationships with the helpdesk team to ensure seamless collaboration and knowledge sharing.Stay...
-
Big Data Engineer
2 weeks ago
Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full timeRoles & ResponsibilitiesRole: Contract (1 year, Renewable)Position: Big Data Support EngineerMandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 6 - 8 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data...
-
Data Integrity Specialist
1 week ago
Singapore Connect Energy Full timeThe Data Integrity Specialist position at Connect Energy is part of the site Instrument, control and electrical (ICE) team that provides maintenance and technical support to the Operations and Project teams in the LNG Terminal.Job SummaryWe are seeking a highly skilled Data Integrity Specialist with 5-8 years of experience in maintenance of various process...