Big Data Integration Specialist

1 week ago


Singapore Unison Consulting Pte Ltd Full time
Job Description

We are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. This is a challenging role that requires expertise in designing, developing, and implementing scalable data processing pipelines using Spark Scala.

Key Responsibilities:
  • Data Processing: Design and develop efficient Spark Scala applications to process large volumes of structured and unstructured data.
  • Elasticsearch Integration: Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data.
  • Performance Optimization: Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch.
  • Collaboration: Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions.
  • Scalable Applications: Develop and maintain scalable and fault-tolerant Spark applications, adhering to industry best practices and coding standards.
  • Troubleshooting: Troubleshoot and resolve issues related to data processing, performance, and data quality in the Spark-Elasticsearch integration.
Requirements:
  1. At least 5 years of experience as a Data Engineer.
  2. Strong experience in Spark, Scala, and Elasticsearch.
  3. Able to develop and maintain scalable and fault-tolerant Spark applications.
  4. Excellent problem-solving skills and attention to detail.
  5. Stay updated with emerging trends and advancements in big data technologies.
  6. Mandatory Skills: Spark, Scala, and Elasticsearch.

The ideal candidate should have a strong background in software development and data engineering, with excellent problem-solving skills and attention to detail. If you're passionate about working with big data and want to be part of a dynamic team, we encourage you to apply for this exciting opportunity.

Salary

$120,000 - $180,000 per annum, depending on experience.



  • Singapore Helius Full time

    Job DescriptionAbout the RoleWe are seeking a highly skilled Big Data Integration Specialist to join our team at Helius. As a key member of our data integration team, you will be responsible for designing and implementing production-grade Talend Big Data jobs that meet our IT organization's architecture standards.Key ResponsibilitiesDevelop and maintain...


  • Singapore NTT DATA Services Full time

    About NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...


  • Singapore NTT Data Singapore Full time

    Job Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Key Responsibilities • Proficient understanding of distributed computing...


  • Singapore Unison Consulting Pte Ltd Full time

    About UsUnison Consulting Pte Ltd is a leading consulting firm that specializes in data engineering solutions.We are seeking a highly skilled Big Data Engineering Specialist to join our team.Job DescriptionJob Title: Big Data Engineering SpecialistEstimated Salary: $120,000 - $180,000 per annumAs a Big Data Engineering Specialist at Unison Consulting Pte...


  • Singapore ITCAN Full time

    Job DescriptionAt ITCAN, we are seeking a highly skilled Data Integration Specialist to join our team.The ideal candidate will have 5+ years of experience as a ETL Developer and minimum 3 years of experience with Big Data technologies such as Hadoop Spark, Hive, Sqoop, and YARN.The successful candidate will have a strong background in programming languages...

  • Systems Integrator

    2 months ago


    Singapore D L RESOURCES PTE LTD Full time

    Roles & ResponsibilitiesMandatory Key Skills:1. Role is focused on Middleware Configuration & App Infrastructure Integration2. (Secondary Requirement): Application Software Aspect (Trouble Shoot Error Logs only, no programming needed)4. Data Processing5. 3-tier environment installation6. Configuration and troubleshooting, Shell Script, SQL, NOSQL, System...


  • Singapore USER EXPERIENCE RESEARCHERS PTE. LTD. Full time

    About the JobWe are seeking a highly skilled and experienced Big Data Engineer to join our team at USER EXPERIENCE RESEARCHERS PTE. LTD.With a minimum of 4 years of experience managing data engineering jobs in big data environments such as Cloudera Data Platform, the ideal candidate will be responsible for designing, developing, and maintaining the data...


  • Singapore ITCAN Full time

    Job DescriptionAs a highly skilled ETL developer at ITCAN, you will be responsible for designing and implementing medium to large scale data integration projects using Big Data technologies such as Hadoop Spark, Hive, Sqoop, and YARN. Your extensive experience with SQL in relational databases like Oracle, DB2, and MySQL will be essential in developing...


  • Singapore ITCAN Full time

    Job Requirements:ITCAN seeks a highly skilled Data Integration Specialist to join our team.Key Responsibilities:Develop and implement data integration solutions using ETL tools and technologies.Design and architect scalable data pipelines to handle large data volumes.Collaborate with cross-functional teams to ensure data quality and integrity.Stay up-to-date...

  • Big Data Developer

    4 weeks ago


    Singapore PRIMESTAFF MANAGEMENT SERVICES PTE LTD Full time

    Roles & ResponsibilitiesOur client is looking for an experienced and highly skilled Senior Big Data Developer to join the dynamic team. The ideal candidate will have over 10 years of extensive working knowledge and hands-on expertise in big data technologies, especially in Spark on Scala or PySpark, and Hive. This role will involve the design, development,...


  • Singapore Unison Consulting Pte Ltd Full time

    Unison Consulting Pte Ltd is seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have 5+ years of experience in designing, developing, and implementing Spark Scala applications and data processing pipelines.About the RoleThis is a key role that requires expertise in integrating Elasticsearch with Spark to enable efficient...


  • Singapore Nityo Infotech Full time

    As a key member of our data engineering team at Nityo Infotech, you will play a crucial role in designing, building, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.The ideal candidate will have a solid understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL, as well as experience integrating and working...


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesAs a Data Framework Engineer at TANGSPAC CONSULTING PTE LTD, you will be responsible for creating frameworks and technical features that enable faster operationalisation of data models, analytical models, and user-generated contents. This includes partnering with data scientists to enable faster adoption of AL/ML model-based systems,...


  • Singapore Unison Consulting Pte Ltd Full time

    Job SummaryWe are seeking a talented Data Integration Specialist to join our team at Unison Consulting Pte Ltd.Main ResponsibilitiesDevelop and deploy ETL processes to integrate data from various sources.Collaborate with cross-functional teams to understand business requirements and design data solutions.Ensure data quality and integrity by implementing data...


  • Singapore TikTok Full time

    About the TeamTikTok's Tea platform is a leading analytics solution used by over 10,000 employees worldwide. As a data middle platform product, it supports massive data volumes and provides high-performance data analysis services.Job SummaryWe are seeking an experienced Data Architecture Specialist to join our global engineering team for Tea. This role will...


  • Singapore NTT DATA Services Full time

    We are seeking a highly skilled IT Infrastructure Integration Specialist to join our team in Singapore. This role involves designing and deploying network infrastructure solutions that meet client needs.Key responsibilities include handling multiple projects, providing network design and deployment support, and preparing Network Design Documents (NDD) for...

  • Data Scientist

    4 weeks ago


    Singapore NTT Data Singapore Full time

    RequirementsFor this role at NTT Data Singapore, we are looking for a highly skilled professional with a Bachelor's degree in Computer Science or a related field. The ideal candidate will have at least 7 years of IT experience, with a minimum of 5 years in a similar role, preferably in Big Data tools.Key ResponsibilitiesOur ideal candidate will have a strong...


  • Singapore U3 Full time

    Job DescriptionThis role is an exciting opportunity to work with a dynamic team at U3 as a Big Data Support Specialist.Key Responsibilities:Pursue and resolve IT-related issues efficiently, ensuring minimal downtime for our users.Develop and maintain strong relationships with the helpdesk team to ensure seamless collaboration and knowledge sharing.Stay...

  • Big Data Engineer

    2 weeks ago


    Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole: Contract (1 year, Renewable)Position: Big Data Support EngineerMandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 6 - 8 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data...


  • Singapore Connect Energy Full time

    The Data Integrity Specialist position at Connect Energy is part of the site Instrument, control and electrical (ICE) team that provides maintenance and technical support to the Operations and Project teams in the LNG Terminal.Job SummaryWe are seeking a highly skilled Data Integrity Specialist with 5-8 years of experience in maintenance of various process...