Big Data Developer
2 weeks ago
§ Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust
§ Experience in designing application solutions in hadoop ecosystem
§ Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark
§ HDFS file formats and their use cases (eg Parquet, ORC, Sequence etc)
§ Good knowledge in data warehousing system
§ Experienced in any scripting language (SHELL, PYTHON)
§ HortonWorks distribution and understanding on SQL engines (Tez, MR)
§ Java/RestServices/Maven experience is a value addition
§ Control-M development. Monitoring Resource utilization using Grafana Tool
§ Good skillset to create automation scripts in Jenkins & knowledge in working on automating builds, test frameworks, app configuration etc
§ Experience in implementing scalable applications with fully automated deployment and control using Bitbucket, Jenkins, ADO etc
§ Skillset:
o Mandatory: Big Data – Hive, HDFS, Spark, Scala, Pyspark.
o Good to have : Schedulers (Control-M), ETL Tool – Dataiku , Unix/Shell scripting , Knowledge of Integration services of FileIT/MQ and others , CI/CD tools – Jenkins, Jira, ADO Devops – tools suite , Oracle .
Tell employers what skills you have
PySpark
Apache Spark
Scala
Oracle
Big Data
Hadoop
Software Engineering
Scripting
ETL
SQL
JIRA
Python
Java
Apache
Data Warehousing
-
Singapore NTT Data Singapore Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore.This is an excellent opportunity for someone with experience in big data technologies to take their career to the next level and work on challenging projects.ResponsibilitiesDesign, develop, and deploy large-scale data processing systems using Hadoop ecosystem...
-
Big Data Developer
1 month ago
Singapore KERRY CONSULTING GROUP PTE. LTD. Full timeRoles & ResponsibilitiesKerry is currently hiring a Big Data Developer / Data Modeller that is proficient with Cloudera Distributed Hadoop (CDH), Big Data, Spark, and Informatica. This role will involve strong experience in testing life cycles as well as excellent verbal and written communications skills to add value to the client-facing experiences.If you...
-
Big Data Architect
4 weeks ago
Singapore SAKSOFT PTE LIMITED Full timeCompany OverviewSaksoft PTE LIMITED is a leading technology company that specializes in big data solutions. Our team of experts is dedicated to delivering innovative and scalable data engineering solutions to our clients.SalaryThe estimated salary for this role is $120,000 - $180,000 per annum, depending on experience and location.Job DescriptionWe are...
-
Big Data Expert
4 weeks ago
Singapore KERRY CONSULTING GROUP PTE. LTD. Full timeKERRY CONSULTING GROUP PTE. LTD. is seeking a highly skilled Big Data Expert to join our team in Singapore.We offer an attractive annual salary of SGD 120,000.Job Description:The ideal candidate will have strong experience in implementing big data solutions using Cloudera Distributed Hadoop (CDH), Hive, Pig, Sqoop, Flume, Oozie, MapReduce, YARN, Spark,...
-
Big Data Engineer
3 weeks ago
Singapore DATADYNAMO LABS PTE. LTD. Full timeRoles & ResponsibilitiesJob Description: Participate in the development and construction of the data platform. Implement and maintain data collection, processing, and analysis processes to ensure data accuracy and completeness. Collaborate with other departments and teams to ensure integration and coordination with other key systems. Conduct technical...
-
Big Data Engineer
3 weeks ago
Singapore DATADYNAMO LABS PTE. LTD. Full timeRoles & ResponsibilitiesJob Description: Participate in the development and construction of the data platform. Implement and maintain data collection, processing, and analysis processes to ensure data accuracy and completeness. Collaborate with other departments and teams to ensure integration and coordination with other key systems. Conduct technical...
-
Big data engineer
3 weeks ago
Singapore SAKSOFT PTE LIMITED Full timeRoles & ResponsibilitiesExperience: 9+ YearsRole: Big Data EngineerSkills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is MustDatabase knowledge and should be able to write the queries is Must.Handson on Unix Shell scripting is Must.Knowledge in Spark SQL (Good to have).Understand on Regulatory reporting(Good to...
-
Big data engineer
1 month ago
Singapore SAKSOFT PTE LIMITED Full timeRoles & ResponsibilitiesExperience: 9+ YearsRole: Big Data EngineerSkills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is MustDatabase knowledge and should be able to write the queries is Must.Handson on Unix Shell scripting is Must.Knowledge in Spark SQL (Good to have).Understand on Regulatory reporting(Good to...
-
Senior Big Data Architect
4 weeks ago
Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full timeWe are seeking a highly skilled Senior Big Data Architect to join our team at SOFTENGER (SINGAPORE) PTE. LTD.The ideal candidate will have 6-8 years of experience in designing and implementing large-scale big data architectures, with expertise in Apache Hadoop, data pipelines, and data engineering concepts.As a Senior Big Data Architect, you will be...
-
Big Data Analytics Specialist
4 weeks ago
Singapore KERRY CONSULTING GROUP PTE. LTD. Full timeAbout Kerry Consulting Group PTE. LTD.We are Kerry Consulting Group PTE. LTD., a leading consulting firm in the field of data analytics and cloud computing.Job OverviewWe are seeking an experienced Big Data Analytics Specialist to join our team. This role will involve designing, developing, and implementing big data solutions using Cloudera Distributed...
-
Big Data Solutions Engineer
4 weeks ago
Singapore ONE NORTH CONSULTING PTE. LTD. Full timeAt One North Consulting PTE. LTD., we are seeking an experienced Senior Data Engineering Specialist to lead our big data solutions team. With a strong background in data engineering and modelling, you will design and implement scalable data pipelines, ensuring seamless data integration across multiple platforms.The ideal candidate will have at least 8+ years...
-
Big Data Architect Lead
4 weeks ago
Singapore COMBUILDER PTE LTD Full timeOverviewCombBuilder PTE LTD is seeking a highly skilled Big Data Architect Lead to design, develop, and deploy big data solutions. The ideal candidate will have strong expertise in designing and architecting large-scale data platforms using advanced technologies.
-
Big Data Solutions Engineer
4 weeks ago
Singapore SAKSOFT PTE LIMITED Full timeSAKSOFT PTE LIMITED seeks a highly skilled Big Data Solutions Engineer to join our team.We are looking for a talented professional with 9+ years of experience in big data engineering to design and implement scalable, fault-tolerant ETL pipelines on our big data platform. The ideal candidate will have hands-on experience with Java, Unix Shell scripting, and...
-
Senior Big Data Solutions Architect
3 weeks ago
Singapore TENCENT CLOUD INTERNATIONAL PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities The candidate needs to deeply understand customers' needs and pain points regarding Big Data products and solutions and design overall Big Data product solutions tailored to customer business scenarios and technical requirements. Capable of recommending the core advantages and capabilities of Tencent Cloud's Big...
-
Senior Big Data Solutions Architect
3 weeks ago
Singapore TENCENT CLOUD INTERNATIONAL PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities The candidate needs to deeply understand customers' needs and pain points regarding Big Data products and solutions and design overall Big Data product solutions tailored to customer business scenarios and technical requirements. Capable of recommending the core advantages and capabilities of Tencent Cloud's Big...
-
Big Data Systems Architect
4 weeks ago
Singapore PAGE PERSONNEL RECRUITMENT PTE. LTD. Full timeAbout the RoleWe are seeking a highly skilled Senior Big Data Developer to join our dynamic team at Page Personnel Recruitment Pte. Ltd.This is an exciting opportunity to work on industry-leading big data solutions and large-scale recommendation systems.
-
Big Data Architectural Engineer
4 weeks ago
Singapore D L RESOURCES PTE LTD Full timeJob OverviewWe are seeking a skilled Big Data Architectural Engineer to join our team at D L RESOURCES PTE LTD. The ideal candidate will have experience in designing and implementing large-scale big data architectures, as well as developing applications using Java, Scala, Python, Shell scripting.
-
Data Architect for Big Data Solutions
4 weeks ago
Singapore PALO IT SINGAPORE PTE. LTD. Full timeJob Summary PALO IT SINGAPORE PTE. LTD. is a global technology consultancy that crafts tech as a force for good, designing, developing and scaling digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We are seeking an experienced Data Architect for Big Data Solutions to work on acquiring,...
-
Big Data Architect
4 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeAbout ByteDance PTE. LTD.We are committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace.To us, every challenge is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.At...
-
Senior Big Data Solution Architect
2 months ago
Singapore Tencent Singapore Full timeResponsibilities: Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between users and industries to create innovative solutions for smart industries via technological advancements such as cloud, AI, and network security. While driving the digitalization of...