Big Data Expert
2 days ago
A Big Data Expert with expertise in designing scalable solutions is sought after to join Capgemini Singapore Pte. Ltd. As a key member of our team, you will be responsible for developing and implementing robust application solutions using the Hadoop ecosystem.
About the Role
We are looking for an experienced Big Data Expert who can leverage their skills in Hive, HDFS, YARN, Spark (Spark SQL, PySpark), Scala, and Python to design and implement efficient data processing pipelines. Your strong understanding of concurrent software systems, ensuring scalability, maintainability, and robustness, will be valuable assets to our team.
Responsibilities
• Design and implement robust application solutions using the Hadoop ecosystem
• Develop efficient data processing pipelines leveraging HDFS file formats such as Parquet, ORC, Sequence
• Create automation scripts using Jenkins, Shell, or Python for builds, testing frameworks, and app configurations
• Monitor system resource utilization using tools like Grafana to ensure optimal performance
• Contribute to the development and maintenance of data warehousing systems, including data modeling and optimization
• Implement CI/CD processes using tools such as Bitbucket, Jenkins, and Azure DevOps (ADO) for automated deployment and version control
• Work with integration tools such as FileIT, MQ, or similar systems to enable seamless data flows
• Develop and manage scheduling workflows using Control-M and ensure efficient resource allocation
Qualifications
• 3–10 years of experience in Big Data Ecosystem: Hive, HDFS, YARN, Spark (Spark SQL, PySpark), Scala, and Python
• Scripting: Proficiency in Shell scripting and Python
• CI/CD Tools: Jenkins, Azure DevOps (ADO), Bitbucket
• Monitoring Tools: Grafana or equivalent
• File Formats: In-depth knowledge of HDFS formats (e.g., Parquet, ORC, Sequence)
• Solid understanding of concurrent software systems, ensuring scalability, maintainability, and robustness
Salary Estimate
The estimated salary for this role ranges from SGD $120,000 to SGD $180,000 per annum, depending on experience and qualifications.
About Capgemini
CAPGEMINI SINGAPORE PTE. LTD. is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world. We are committed to providing our employees with opportunities for growth and development, and we offer a comprehensive benefits package, including medical insurance, retirement plans, and paid time off.
-
Big Data Expert
2 days ago
Singapore KERRY CONSULTING GROUP PTE. LTD. Full timeKERRY CONSULTING GROUP PTE. LTD. is seeking a highly skilled Big Data Expert to join our team in Singapore.We offer an attractive annual salary of SGD 120,000.Job Description:The ideal candidate will have strong experience in implementing big data solutions using Cloudera Distributed Hadoop (CDH), Hive, Pig, Sqoop, Flume, Oozie, MapReduce, YARN, Spark,...
-
Data Engineering Lead
2 days ago
Singapore SOURCEO PTE. LTD. Full timeJob Title: Data Engineering Lead - Big Data ExpertAbout the Role:We are seeking an experienced Data Engineering Lead to join our team at SOURCEO PTE. LTD. as a Big Data Expert.Responsibilities:The successful candidate will be responsible for guiding and de-risking the delivery of data projects, promoting iterative and incremental value addition. They will...
-
Big Data Engineer
3 weeks ago
Singapore Unison Consulting Pte Ltd Full timeJob Title: Big Data Engineer - Scala ExpertWe are seeking a highly skilled Scala Developer with expertise in Apache Spark to join our dynamic team at Unison Consulting Pte Ltd. The ideal candidate will have a deep understanding of big data technologies and experience in designing, developing, and optimizing high-performance data processing pipelines using...
-
Tencent Big Data Cluster Operations Expert
2 days ago
Singapore WECHAT INTERNATIONAL PTE. LTD. Full timeWeChat International PTE. LTD. is seeking a highly skilled and experienced expert to join our team as a Tencent Big Data Cluster Operations Expert.The ideal candidate will have a strong background in big data cluster operation and maintenance, with experience in managing large-scale Hadoop clusters, Kubernetes, and other related...
-
Big Data Architect
2 days ago
Singapore SAKSOFT PTE LIMITED Full timeCompany OverviewSaksoft PTE LIMITED is a leading technology company that specializes in big data solutions. Our team of experts is dedicated to delivering innovative and scalable data engineering solutions to our clients.SalaryThe estimated salary for this role is $120,000 - $180,000 per annum, depending on experience and location.Job DescriptionWe are...
-
Big Data Support Specialist
3 weeks ago
Singapore NTT DATA Services Full timeAbout NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...
-
Big Data Analytics Expert
3 weeks ago
Singapore Careers@Gov Full timeAbout the RoleWe are seeking an experienced Big Data Analytics Expert to join our team at Careers@Gov. This is a unique opportunity to make a real impact in shaping the future of data analytics and contribute to the growth and development of our organization.Job DescriptionDesign, develop, and maintain course materials/curriculum as well as assessments for...
-
Senior Big Data Architect
2 days ago
Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full timeWe are seeking a highly skilled Senior Big Data Architect to join our team at SOFTENGER (SINGAPORE) PTE. LTD.The ideal candidate will have 6-8 years of experience in designing and implementing large-scale big data architectures, with expertise in Apache Hadoop, data pipelines, and data engineering concepts.As a Senior Big Data Architect, you will be...
-
Big Data Engineering Expert
3 weeks ago
Singapore Unison Consulting Pte Ltd Full timeUnison Consulting Pte Ltd is seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have 5+ years of experience in designing, developing, and implementing Spark Scala applications and data processing pipelines.About the RoleThis is a key role that requires expertise in integrating Elasticsearch with Spark to enable efficient...
-
Big Data Architectural Expert
2 days ago
Singapore CLOUDERA SINGAPORE PTE. LTD. Full timeCLOUDERA SINGAPORE PTE. LTD. is seeking an experienced Solutions Architect to join its APAC Professional Services team in Singapore.About the RoleThis exciting opportunity presents a client-facing chance to combine consulting skills with deep technical design and development expertise in Big Data solutions using Hadoop, NiFi, Spark, and related...
-
Expert Java Developer for Big Data Solutions
2 days ago
Singapore TRINITY CONSULTING SERVICES PTE. LTD. Full timeJob Description:At TRINITY CONSULTING SERVICES PTE. LTD., we seek a highly skilled Expert Java Developer to join our team and contribute to the development of innovative Big Data solutions.About UsWe are a leading consulting services provider, dedicated to delivering cutting-edge solutions that drive business growth and success. Our mission is to empower...
-
Senior Big Data Architect
3 weeks ago
Singapore Unison Consulting Pte Ltd Full timeAbout UsAt Unison Consulting Pte Ltd, we are a forward-thinking consulting firm that provides expert solutions to businesses in the digital age.Job Title: Senior Big Data ArchitectJob DescriptionWe are seeking an experienced Senior Big Data Architect to join our team. The ideal candidate will have a strong background in big data engineering and architecture,...
-
Data Architect for Big Data Solutions
2 days ago
Singapore PALO IT SINGAPORE PTE. LTD. Full timeJob Summary PALO IT SINGAPORE PTE. LTD. is a global technology consultancy that crafts tech as a force for good, designing, developing and scaling digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We are seeking an experienced Data Architect for Big Data Solutions to work on acquiring,...
-
Singapore KERRY CONSULTING GROUP PTE. LTD. Full timeJob OpportunityKERRY CONSULTING GROUP PTE. LTD. is seeking a highly skilled Business Development Expert to lead the implementation of strategic initiatives and process improvements in big data and financial services.About the RoleThe ideal candidate will have solid experience in the IT industry and as a Business Analyst with exposure to handling...
-
Big Data Developer
1 week ago
Singapore KERRY CONSULTING GROUP PTE. LTD. Full timeRoles & ResponsibilitiesKerry is currently hiring a Big Data Developer / Data Modeller that is proficient with Cloudera Distributed Hadoop (CDH), Big Data, Spark, and Informatica. This role will involve strong experience in testing life cycles as well as excellent verbal and written communications skills to add value to the client-facing experiences.If you...
-
Big Data Engineering Leader
2 days ago
Singapore THEE BIRAPANJAA SYSTEMS (PTE. LTD.) Full timeThee Birapannjaa Systems Pte. Ltd. - Senior Data Engineer RoleWe are seeking a highly skilled Senior Data Engineer with 10+ years of experience in software development and expertise in Big Data technologies to join our team at Thee Birapannjaa Systems Pte. Ltd.About the Role:We are looking for a seasoned data engineer who can design, develop, and maintain...
-
Software Development Expert
1 month ago
Singapore NTT DATA Services Full timeJob Title: Software Development ExpertWe are seeking a highly skilled Software Development Expert to join our team in Singapore. The ideal candidate will have a strong background in system development and implementation of EAI applications.Key Responsibilities:Design, develop, and implement EAI applications, including gathering and analyzing requirements,...
-
Singapore MC CONSULTING PTE. LTD. Full timeEstimated Salary: $120,000 - $180,000 per yearAbout MC CONSULTING PTE. LTD.MC Consulting Pte. Ltd. is a leading consulting firm that specializes in providing expert solutions to clients across various industries. Our team of experienced professionals has a proven track record of delivering high-quality results and exceeding client expectations.Job...
-
Big data engineer
1 week ago
Singapore SAKSOFT PTE LIMITED Full timeRoles & ResponsibilitiesExperience: 9+ YearsRole: Big Data EngineerSkills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is MustDatabase knowledge and should be able to write the queries is Must.Handson on Unix Shell scripting is Must.Knowledge in Spark SQL (Good to have).Understand on Regulatory reporting(Good to...
-
Big Data Technology Expert
24 hours ago
Singapore NTT SINGAPORE PTE. LTD. Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at NTT Singapore PTE. LTD. as a contract position. The ideal candidate will have strong proficiency in Scala programming and functional programming principles, with excellent SQL skills, including query optimization and database design.The successful candidate will have hands-on...