Big Data Expert

2 days ago


Singapore CAPGEMINI SINGAPORE PTE. LTD. Full time
Job Summary
A Big Data Expert with expertise in designing scalable solutions is sought after to join Capgemini Singapore Pte. Ltd. As a key member of our team, you will be responsible for developing and implementing robust application solutions using the Hadoop ecosystem.

About the Role
We are looking for an experienced Big Data Expert who can leverage their skills in Hive, HDFS, YARN, Spark (Spark SQL, PySpark), Scala, and Python to design and implement efficient data processing pipelines. Your strong understanding of concurrent software systems, ensuring scalability, maintainability, and robustness, will be valuable assets to our team.

Responsibilities
• Design and implement robust application solutions using the Hadoop ecosystem
• Develop efficient data processing pipelines leveraging HDFS file formats such as Parquet, ORC, Sequence
• Create automation scripts using Jenkins, Shell, or Python for builds, testing frameworks, and app configurations
• Monitor system resource utilization using tools like Grafana to ensure optimal performance
• Contribute to the development and maintenance of data warehousing systems, including data modeling and optimization
• Implement CI/CD processes using tools such as Bitbucket, Jenkins, and Azure DevOps (ADO) for automated deployment and version control
• Work with integration tools such as FileIT, MQ, or similar systems to enable seamless data flows
• Develop and manage scheduling workflows using Control-M and ensure efficient resource allocation

Qualifications
• 3–10 years of experience in Big Data Ecosystem: Hive, HDFS, YARN, Spark (Spark SQL, PySpark), Scala, and Python
• Scripting: Proficiency in Shell scripting and Python
• CI/CD Tools: Jenkins, Azure DevOps (ADO), Bitbucket
• Monitoring Tools: Grafana or equivalent
• File Formats: In-depth knowledge of HDFS formats (e.g., Parquet, ORC, Sequence)
• Solid understanding of concurrent software systems, ensuring scalability, maintainability, and robustness

Salary Estimate
The estimated salary for this role ranges from SGD $120,000 to SGD $180,000 per annum, depending on experience and qualifications.

About Capgemini
CAPGEMINI SINGAPORE PTE. LTD. is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world. We are committed to providing our employees with opportunities for growth and development, and we offer a comprehensive benefits package, including medical insurance, retirement plans, and paid time off.

  • Big Data Expert

    2 days ago


    Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    KERRY CONSULTING GROUP PTE. LTD. is seeking a highly skilled Big Data Expert to join our team in Singapore.We offer an attractive annual salary of SGD 120,000.Job Description:The ideal candidate will have strong experience in implementing big data solutions using Cloudera Distributed Hadoop (CDH), Hive, Pig, Sqoop, Flume, Oozie, MapReduce, YARN, Spark,...


  • Singapore SOURCEO PTE. LTD. Full time

    Job Title: Data Engineering Lead - Big Data ExpertAbout the Role:We are seeking an experienced Data Engineering Lead to join our team at SOURCEO PTE. LTD. as a Big Data Expert.Responsibilities:The successful candidate will be responsible for guiding and de-risking the delivery of data projects, promoting iterative and incremental value addition. They will...

  • Big Data Engineer

    3 weeks ago


    Singapore Unison Consulting Pte Ltd Full time

    Job Title: Big Data Engineer - Scala ExpertWe are seeking a highly skilled Scala Developer with expertise in Apache Spark to join our dynamic team at Unison Consulting Pte Ltd. The ideal candidate will have a deep understanding of big data technologies and experience in designing, developing, and optimizing high-performance data processing pipelines using...


  • Singapore WECHAT INTERNATIONAL PTE. LTD. Full time

    WeChat International PTE. LTD. is seeking a highly skilled and experienced expert to join our team as a Tencent Big Data Cluster Operations Expert.The ideal candidate will have a strong background in big data cluster operation and maintenance, with experience in managing large-scale Hadoop clusters, Kubernetes, and other related...

  • Big Data Architect

    2 days ago


    Singapore SAKSOFT PTE LIMITED Full time

    Company OverviewSaksoft PTE LIMITED is a leading technology company that specializes in big data solutions. Our team of experts is dedicated to delivering innovative and scalable data engineering solutions to our clients.SalaryThe estimated salary for this role is $120,000 - $180,000 per annum, depending on experience and location.Job DescriptionWe are...


  • Singapore NTT DATA Services Full time

    About NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...


  • Singapore Careers@Gov Full time

    About the RoleWe are seeking an experienced Big Data Analytics Expert to join our team at Careers@Gov. This is a unique opportunity to make a real impact in shaping the future of data analytics and contribute to the growth and development of our organization.Job DescriptionDesign, develop, and maintain course materials/curriculum as well as assessments for...


  • Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    We are seeking a highly skilled Senior Big Data Architect to join our team at SOFTENGER (SINGAPORE) PTE. LTD.The ideal candidate will have 6-8 years of experience in designing and implementing large-scale big data architectures, with expertise in Apache Hadoop, data pipelines, and data engineering concepts.As a Senior Big Data Architect, you will be...


  • Singapore Unison Consulting Pte Ltd Full time

    Unison Consulting Pte Ltd is seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have 5+ years of experience in designing, developing, and implementing Spark Scala applications and data processing pipelines.About the RoleThis is a key role that requires expertise in integrating Elasticsearch with Spark to enable efficient...


  • Singapore CLOUDERA SINGAPORE PTE. LTD. Full time

    CLOUDERA SINGAPORE PTE. LTD. is seeking an experienced Solutions Architect to join its APAC Professional Services team in Singapore.About the RoleThis exciting opportunity presents a client-facing chance to combine consulting skills with deep technical design and development expertise in Big Data solutions using Hadoop, NiFi, Spark, and related...


  • Singapore TRINITY CONSULTING SERVICES PTE. LTD. Full time

    Job Description:At TRINITY CONSULTING SERVICES PTE. LTD., we seek a highly skilled Expert Java Developer to join our team and contribute to the development of innovative Big Data solutions.About UsWe are a leading consulting services provider, dedicated to delivering cutting-edge solutions that drive business growth and success. Our mission is to empower...


  • Singapore Unison Consulting Pte Ltd Full time

    About UsAt Unison Consulting Pte Ltd, we are a forward-thinking consulting firm that provides expert solutions to businesses in the digital age.Job Title: Senior Big Data ArchitectJob DescriptionWe are seeking an experienced Senior Big Data Architect to join our team. The ideal candidate will have a strong background in big data engineering and architecture,...


  • Singapore PALO IT SINGAPORE PTE. LTD. Full time

    Job Summary PALO IT SINGAPORE PTE. LTD. is a global technology consultancy that crafts tech as a force for good, designing, developing and scaling digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We are seeking an experienced Data Architect for Big Data Solutions to work on acquiring,...


  • Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    Job OpportunityKERRY CONSULTING GROUP PTE. LTD. is seeking a highly skilled Business Development Expert to lead the implementation of strategic initiatives and process improvements in big data and financial services.About the RoleThe ideal candidate will have solid experience in the IT industry and as a Business Analyst with exposure to handling...

  • Big Data Developer

    1 week ago


    Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    Roles & ResponsibilitiesKerry is currently hiring a Big Data Developer / Data Modeller that is proficient with Cloudera Distributed Hadoop (CDH), Big Data, Spark, and Informatica. This role will involve strong experience in testing life cycles as well as excellent verbal and written communications skills to add value to the client-facing experiences.If you...


  • Singapore THEE BIRAPANJAA SYSTEMS (PTE. LTD.) Full time

    Thee Birapannjaa Systems Pte. Ltd. - Senior Data Engineer RoleWe are seeking a highly skilled Senior Data Engineer with 10+ years of experience in software development and expertise in Big Data technologies to join our team at Thee Birapannjaa Systems Pte. Ltd.About the Role:We are looking for a seasoned data engineer who can design, develop, and maintain...


  • Singapore NTT DATA Services Full time

    Job Title: Software Development ExpertWe are seeking a highly skilled Software Development Expert to join our team in Singapore. The ideal candidate will have a strong background in system development and implementation of EAI applications.Key Responsibilities:Design, develop, and implement EAI applications, including gathering and analyzing requirements,...


  • Singapore MC CONSULTING PTE. LTD. Full time

    Estimated Salary: $120,000 - $180,000 per yearAbout MC CONSULTING PTE. LTD.MC Consulting Pte. Ltd. is a leading consulting firm that specializes in providing expert solutions to clients across various industries. Our team of experienced professionals has a proven track record of delivering high-quality results and exceeding client expectations.Job...

  • Big data engineer

    1 week ago


    Singapore SAKSOFT PTE LIMITED Full time

    Roles & ResponsibilitiesExperience: 9+ YearsRole: Big Data EngineerSkills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is MustDatabase knowledge and should be able to write the queries is Must.Handson on Unix Shell scripting is Must.Knowledge in Spark SQL (Good to have).Understand on Regulatory reporting(Good to...


  • Singapore NTT SINGAPORE PTE. LTD. Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at NTT Singapore PTE. LTD. as a contract position. The ideal candidate will have strong proficiency in Scala programming and functional programming principles, with excellent SQL skills, including query optimization and database design.The successful candidate will have hands-on...