Big Data Developer

2 weeks ago


Singapore TECHNOPALS CONSULTANTS PTE. LTD. Full time
Roles & Responsibilities

§ Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust
§ Experience in designing application solutions in hadoop ecosystem
§ Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark
§ HDFS file formats and their use cases (eg Parquet, ORC, Sequence etc)
§ Good knowledge in data warehousing system
§ Experienced in any scripting language (SHELL, PYTHON)
§ HortonWorks distribution and understanding on SQL engines (Tez, MR)
§ Java/RestServices/Maven experience is a value addition
§ Control-M development. Monitoring Resource utilization using Grafana Tool
§ Good skillset to create automation scripts in Jenkins & knowledge in working on automating builds, test frameworks, app configuration etc
§ Experience in implementing scalable applications with fully automated deployment and control using Bitbucket, Jenkins, ADO etc
§ Skillset:
o Mandatory: Big Data – Hive, HDFS, Spark, Scala, Pyspark.
o Good to have : Schedulers (Control-M), ETL Tool – Dataiku , Unix/Shell scripting , Knowledge of Integration services of FileIT/MQ and others , CI/CD tools – Jenkins, Jira, ADO Devops – tools suite , Oracle .


Tell employers what skills you have

PySpark
Apache Spark
Scala
Oracle
Big Data
Hadoop
Software Engineering
Scripting
ETL
SQL
JIRA
Python
Java
Apache
Data Warehousing

  • Singapore NTT Data Singapore Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore.This is an excellent opportunity for someone with experience in big data technologies to take their career to the next level and work on challenging projects.ResponsibilitiesDesign, develop, and deploy large-scale data processing systems using Hadoop ecosystem...

  • Big Data Developer

    1 month ago


    Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    Roles & ResponsibilitiesKerry is currently hiring a Big Data Developer / Data Modeller that is proficient with Cloudera Distributed Hadoop (CDH), Big Data, Spark, and Informatica. This role will involve strong experience in testing life cycles as well as excellent verbal and written communications skills to add value to the client-facing experiences.If you...

  • Big Data Architect

    4 weeks ago


    Singapore SAKSOFT PTE LIMITED Full time

    Company OverviewSaksoft PTE LIMITED is a leading technology company that specializes in big data solutions. Our team of experts is dedicated to delivering innovative and scalable data engineering solutions to our clients.SalaryThe estimated salary for this role is $120,000 - $180,000 per annum, depending on experience and location.Job DescriptionWe are...

  • Big Data Expert

    4 weeks ago


    Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    KERRY CONSULTING GROUP PTE. LTD. is seeking a highly skilled Big Data Expert to join our team in Singapore.We offer an attractive annual salary of SGD 120,000.Job Description:The ideal candidate will have strong experience in implementing big data solutions using Cloudera Distributed Hadoop (CDH), Hive, Pig, Sqoop, Flume, Oozie, MapReduce, YARN, Spark,...

  • Big Data Engineer

    3 weeks ago


    Singapore DATADYNAMO LABS PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description: Participate in the development and construction of the data platform. Implement and maintain data collection, processing, and analysis processes to ensure data accuracy and completeness. Collaborate with other departments and teams to ensure integration and coordination with other key systems. Conduct technical...

  • Big Data Engineer

    3 weeks ago


    Singapore DATADYNAMO LABS PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description: Participate in the development and construction of the data platform. Implement and maintain data collection, processing, and analysis processes to ensure data accuracy and completeness. Collaborate with other departments and teams to ensure integration and coordination with other key systems. Conduct technical...

  • Big data engineer

    3 weeks ago


    Singapore SAKSOFT PTE LIMITED Full time

    Roles & ResponsibilitiesExperience: 9+ YearsRole: Big Data EngineerSkills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is MustDatabase knowledge and should be able to write the queries is Must.Handson on Unix Shell scripting is Must.Knowledge in Spark SQL (Good to have).Understand on Regulatory reporting(Good to...

  • Big data engineer

    1 month ago


    Singapore SAKSOFT PTE LIMITED Full time

    Roles & ResponsibilitiesExperience: 9+ YearsRole: Big Data EngineerSkills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is MustDatabase knowledge and should be able to write the queries is Must.Handson on Unix Shell scripting is Must.Knowledge in Spark SQL (Good to have).Understand on Regulatory reporting(Good to...


  • Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    We are seeking a highly skilled Senior Big Data Architect to join our team at SOFTENGER (SINGAPORE) PTE. LTD.The ideal candidate will have 6-8 years of experience in designing and implementing large-scale big data architectures, with expertise in Apache Hadoop, data pipelines, and data engineering concepts.As a Senior Big Data Architect, you will be...


  • Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    About Kerry Consulting Group PTE. LTD.We are Kerry Consulting Group PTE. LTD., a leading consulting firm in the field of data analytics and cloud computing.Job OverviewWe are seeking an experienced Big Data Analytics Specialist to join our team. This role will involve designing, developing, and implementing big data solutions using Cloudera Distributed...


  • Singapore ONE NORTH CONSULTING PTE. LTD. Full time

    At One North Consulting PTE. LTD., we are seeking an experienced Senior Data Engineering Specialist to lead our big data solutions team. With a strong background in data engineering and modelling, you will design and implement scalable data pipelines, ensuring seamless data integration across multiple platforms.The ideal candidate will have at least 8+ years...


  • Singapore COMBUILDER PTE LTD Full time

    OverviewCombBuilder PTE LTD is seeking a highly skilled Big Data Architect Lead to design, develop, and deploy big data solutions. The ideal candidate will have strong expertise in designing and architecting large-scale data platforms using advanced technologies.


  • Singapore SAKSOFT PTE LIMITED Full time

    SAKSOFT PTE LIMITED seeks a highly skilled Big Data Solutions Engineer to join our team.We are looking for a talented professional with 9+ years of experience in big data engineering to design and implement scalable, fault-tolerant ETL pipelines on our big data platform. The ideal candidate will have hands-on experience with Java, Unix Shell scripting, and...


  • Singapore TENCENT CLOUD INTERNATIONAL PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities The candidate needs to deeply understand customers' needs and pain points regarding Big Data products and solutions and design overall Big Data product solutions tailored to customer business scenarios and technical requirements. Capable of recommending the core advantages and capabilities of Tencent Cloud's Big...


  • Singapore TENCENT CLOUD INTERNATIONAL PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities The candidate needs to deeply understand customers' needs and pain points regarding Big Data products and solutions and design overall Big Data product solutions tailored to customer business scenarios and technical requirements. Capable of recommending the core advantages and capabilities of Tencent Cloud's Big...


  • Singapore PAGE PERSONNEL RECRUITMENT PTE. LTD. Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Developer to join our dynamic team at Page Personnel Recruitment Pte. Ltd.This is an exciting opportunity to work on industry-leading big data solutions and large-scale recommendation systems.


  • Singapore D L RESOURCES PTE LTD Full time

    Job OverviewWe are seeking a skilled Big Data Architectural Engineer to join our team at D L RESOURCES PTE LTD. The ideal candidate will have experience in designing and implementing large-scale big data architectures, as well as developing applications using Java, Scala, Python, Shell scripting.


  • Singapore PALO IT SINGAPORE PTE. LTD. Full time

    Job Summary PALO IT SINGAPORE PTE. LTD. is a global technology consultancy that crafts tech as a force for good, designing, developing and scaling digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We are seeking an experienced Data Architect for Big Data Solutions to work on acquiring,...

  • Big Data Architect

    4 weeks ago


    Singapore BYTEDANCE PTE. LTD. Full time

    About ByteDance PTE. LTD.We are committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace.To us, every challenge is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.At...


  • Singapore Tencent Singapore Full time

    Responsibilities: Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between users and industries to create innovative solutions for smart industries via technological advancements such as cloud, AI, and network security. While driving the digitalization of...