Senior Big Data Engineer

4 weeks ago


Singapore NTT Data Singapore Full time

Requirements
We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Proficiency in distributed computing principles and strong experience with Hadoop, Spark, Iceberg, and Spring Boot are essential. Additionally, the candidate should have experience with building stream-processing systems using solutions such as Spark-Streaming, good knowledge of Big Data querying tools like Pig, Hive, and Impala, and experience with integration of data from multiple data sources. Familiarity with NoSQL databases such as HBase, Cassandra, and MongoDB is also required. The successful candidate will have a good understanding of various ETL techniques and frameworks, experience with messaging systems like Kafka or RabbitMQ, and knowledge of Big Data ML toolkits such as Mahout, SparkML, or H2O. Finally, a good understanding of Lambda Architecture, including its advantages and drawbacks, is necessary.

Key Responsibilities
Design and develop scalable data processing systems using Hadoop, Spark, and other Big Data tools
Collaborate with cross-functional teams to integrate data from multiple sources
Develop and maintain data pipelines using ETL techniques and frameworks
Ensure data quality and integrity through data validation and testing
Stay up-to-date with industry trends and emerging technologies in Big Data



  • Singapore NTT Data Singapore Full time

    Job Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Key Responsibilities • Proficient understanding of distributed computing...


  • Singapore ITCAN Full time

    About ITCANWe are a leading technology company that delivers innovative solutions to our clients.Job Title: Senior Big Data EngineerSalary Range:$170,000 - $220,000 per yearAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have extensive experience in designing and implementing large-scale big...

  • Big Data Engineer

    1 week ago


    Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesRole: Contract (1 year, Renewable)Position: Big Data Support EngineerMandatory Skills: Big Data, Data pipeline, Apache and HadoopExperience: 6 - 8 yrsPOSITION GENERAL DUTIES AND TASKS:- Strong in data engineering concepts and programming- Experience in building and optimizing ‘big data’ data pipelines, architectures and data...


  • Singapore Unison Consulting Pte Ltd Full time

    About UsAt Unison Consulting Pte Ltd, we are a forward-thinking consulting firm that provides expert solutions to businesses in the digital age.Job Title: Senior Big Data ArchitectJob DescriptionWe are seeking an experienced Senior Big Data Architect to join our team. The ideal candidate will have a strong background in big data engineering and architecture,...


  • Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Job DescriptionWe are seeking an experienced Senior Big Data Engineer to join our team at RAPSYS TECHNOLOGIES PTE. LTD.Responsibilities:Design and develop data applications using Python and other programming languages, ensuring efficient data processing on big data systems.Create APIs using Python to handle structured and unstructured data, with a strong...

  • Big Data Developer

    3 weeks ago


    Singapore PRIMESTAFF MANAGEMENT SERVICES PTE LTD Full time

    Roles & ResponsibilitiesOur client is looking for an experienced and highly skilled Senior Big Data Developer to join the dynamic team. The ideal candidate will have over 10 years of extensive working knowledge and hands-on expertise in big data technologies, especially in Spark on Scala or PySpark, and Hive. This role will involve the design, development,...


  • Singapore Virtusa Full time

    We are seeking an experienced Big Data Engineer to join our team at Virtusa in Moulmein-Kallang, Central Singapore. The successful candidate will have a strong background in big data engineering and experience working with Python, PySpark, Linux, and ETL tools like Informatica.ResponsibilitiesDesign and implement scalable big data solutions using Hive,...


  • Singapore Unison Consulting Pte Ltd Full time

    About UsUnison Consulting Pte Ltd is a leading consulting firm that specializes in data engineering solutions.We are seeking a highly skilled Big Data Engineering Specialist to join our team.Job DescriptionJob Title: Big Data Engineering SpecialistEstimated Salary: $120,000 - $180,000 per annumAs a Big Data Engineering Specialist at Unison Consulting Pte...


  • Singapore TikTok Full time

    About the teamByteDance/TikTok's Tea analytics platform is a leading in-house data platform used by over 10,000 employees globally. As a key member of our global engineering team, you will be responsible for building and maintaining the platform that supports exabyte-level data, trillion-level events, and millisecond-level response...


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesAs a Data Framework Engineer at TANGSPAC CONSULTING PTE LTD, you will be responsible for creating frameworks and technical features that enable faster operationalisation of data models, analytical models, and user-generated contents. This includes partnering with data scientists to enable faster adoption of AL/ML model-based systems,...


  • Singapore U3 Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team at U3 Infotech. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines and data services modules with robustness in mind to support the growing demands from business users.Key ResponsibilitiesDesign and implement...


  • Singapore Careers@Gov Full time

    Careers@Gov: Lecturer - Data Engineering ITE College WestEstimated Salary: SGD $80,000 - $120,000 per annumAbout the RoleWe are seeking an experienced Lecturer in Data Engineering to join our team at ITE College West. As a key member of our faculty, you will play a critical role in shaping the next generation of data professionals.About YouTo be successful...


  • Singapore Unison Consulting Pte Ltd Full time

    Unison Consulting Pte Ltd is seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have 5+ years of experience in designing, developing, and implementing Spark Scala applications and data processing pipelines.About the RoleThis is a key role that requires expertise in integrating Elasticsearch with Spark to enable efficient...


  • Singapore Tencent Singapore Full time

    Job Responsibilities:As a Senior Big Data Solution Architect at Tencent Singapore, you will be responsible for designing and implementing Big Data solutions tailored to customer business scenarios and technical requirements. You will need to deeply understand customers' needs and pain points regarding Big Data products and solutions.Recommend the core...


  • Singapore CORPORATE IT SOLUTIONS PTE. LTD. Full time

    Unlock the Power of Big Data with Corporate IT Solutions PTE. LTD.We are seeking a highly skilled Senior Cloud Software Developer in Analytics and AI to join our dynamic and focused team. As an AI/ML Engineer, you will implement core software components and contribute to the scalable design of our cloud software architecture. This is an excellent opportunity...

  • Big Data Engineer

    4 days ago


    Singapore Unison Consulting Pte Ltd Full time

    Job Title: Big Data Engineer - Scala ExpertWe are seeking a highly skilled Scala Developer with expertise in Apache Spark to join our dynamic team at Unison Consulting Pte Ltd. The ideal candidate will have a deep understanding of big data technologies and experience in designing, developing, and optimizing high-performance data processing pipelines using...

  • Data Engineer

    4 days ago


    Singapore Crédit Agricole CIB Full time

    About the JobCrédit Agricole CIB is seeking a highly skilled Data Engineer to join its team. As a key member of our Big Data department, you will be responsible for designing and implementing data solutions using cutting-edge technologies.Key Responsibilities:Develop and maintain large-scale data processing systems using Storm, Hadoop, and Elastic Search...


  • Singapore Helius Full time

    Talend Big Data Developer RoleAt Helius, we are seeking a skilled Big Data Developer to join our team. The ideal candidate will have experience with Talend Big Data version 7+ and Hadoop, with a strong understanding of data models and data flows.Key Responsibilities:Design and develop production-grade Talend Big Data jobs with consideration for IT...


  • Singapore OPENSOURCE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Title: Senior Data Engineer (5-10 Years of Experience)Position Summary:A company is seeking an experienced and skilled Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will possess a strong technical background in data...


  • Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Roles & Responsibilities2. Position Title: Senior Data EngineerExperience Required: 5-10 YearsPosition Summary:We are seeking an experienced Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools,...