Big Data Developer

2 weeks ago


Singapore TECH AALTO PTE. LTD. Full time
Roles & Responsibilities

Big Data Developer

Experience: (3 – 10 Years)

Job Requirements:

· Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust

· Experience in designing application solutions in hadoop ecosystem

· Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark

· HDFS file formats and their use cases (eg Parquet, ORC, Sequence etc)

· Good knowledge in data warehousing system

· Experienced in any scripting language (SHELL, PYTHON)

· HortonWorks distribution and understanding on SQL engines (Tez, MR)

· Java/RestServices/Maven experience is a value addition

· Control-M development. Monitoring Resource utilization using Grafana Tool

· Good skillset to create automation scripts in Jenkins & knowledge in working on automating builds, test frameworks, app configuration etc

· Experience in implementing scalable applications with fully automated deployment and control using Bitbucket, Jenkins, ADO etc
Skillset:
o Mandatory: Big Data – Hive, HDFS, Spark, Scala, Pyspark.
o Good to have : Schedulers (Control-M), ETL Tool – Dataiku , Unix/Shell scripting , Knowledge of Integration services of FileIT/MQ and others , CI/CD tools – Jenkins, Jira, ADO Devops – tools suite , Oracle .

When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the Tech Aalto Privacy Policy, a copy of which is published at Tech Aalto's website (https://www.techaalto.com/privacy/)

Confidentiality is assured, and only shortlisted candidates will be notified for interviews.

Tell employers what skills you have

PySpark
Apache Spark
Scala
Big Data
Hadoop
Software Engineering
Scripting
ETL
SQL
JIRA
Python
Hive
archive systems
Java
Apache
Data Warehousing
  • Big Data Developer

    3 weeks ago


    Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesWorking on a large project for financial institution, you will be responsible for carrying out analysis and design of Big data applicationRoles :- carrying out development of data platform (kubernetes, kafka) and using applications such as Apache stack, collibra- develop solutions to build data pipelines and to monitor application...

  • Big Data Developer

    2 weeks ago


    Singapore RESOURCE HUNT PTE. LTD. Full time

    Roles & ResponsibilitiesBig Data Developer  Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS file formats and...

  • Big Data

    2 weeks ago


    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities:Collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient big data platform solutions. Design and architect robust big data platforms, ensuring high performance, reliability, and scalability. Implement end-to-end data processing workflows, from data...

  • Big Data Developer

    3 weeks ago


    Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJD:Big Data Developer (3 – 10 Years) Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS...

  • Big Data Developer

    3 weeks ago


    Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJD:Big Data Developer (3 – 10 Years) Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS...

  • Big Data Developer

    3 weeks ago


    Singapore KRIS INFOTECH PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS file formats and their use cases...

  • Big Data Developer

    3 weeks ago


    Singapore KRIS INFOTECH PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description: Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS file formats and their use cases...

  • Big Data Developer

    3 weeks ago


    Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesWorking on a large project for financial institution, you will be responsible for carrying out analysis and design of Big data applicationRoles :- carrying out development of data platform (kubernetes, kafka) and using applications such as Apache stack, collibra- develop solutions to build data pipelines and to monitor application...

  • Big Data Engineer

    3 weeks ago


    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesAre you passionate about big data and love working with cutting-edge technologies? Join our team as a Big Data Engineer and help us build scalable data solutions What You'll Do: Design, develop, and optimize big data pipelines Work with Apache Spark, Scala, Hadoop, Hive, Kafka, and more Manage and process large datasets efficiently...

  • Big Data Engineer

    3 weeks ago


    Singapore DADACONSULTANTS PTE. LTD. Full time

    Roles & ResponsibilitiesMy ClientIt is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the...

  • Big Data Engineer

    3 weeks ago


    Singapore DADACONSULTANTS PTE. LTD. Full time

    Roles & ResponsibilitiesMy ClientIt is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the...

  • Big Data Engineer

    2 weeks ago


    Singapore DADACONSULTANTS PTE. LTD. Full time

    Roles & ResponsibilitiesKey Responsibilities: Ensure seamless deployment, configuration, and operation of applications on cloud servers and container platforms. Collaborate with development teams to design scalable and highly available system architectures. Contribute to the development and maintenance of internal platforms and tools. Perform daily...

  • Big Data Engineer

    3 weeks ago


    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesAre you passionate about big data and love working with cutting-edge technologies? Join our team as a Big Data Engineer and help us build scalable data solutions! What You’ll Do:✔ Design, develop, and optimize big data pipelines✔ Work with Apache Spark, Scala, Hadoop, Hive, Kafka, and more✔ Manage and process large datasets...

  • Big Data Engineer

    3 weeks ago


    Singapore INFINITE COMPUTER SOLUTIONS PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big...

  • Big Data Engineer

    3 weeks ago


    Singapore INFINITE COMPUTER SOLUTIONS PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big...

  • Big Data Engineer

    3 weeks ago


    Singapore MICHAEL PAGE INTERNATIONAL PTE LTD Full time

    Roles & ResponsibilitiesOrganisation is a global leader in the technology and telecoms industry. Fast-paced environment, rapidly growing organisation.About Our ClientThe organisation is a global leader in the technology and telecoms industry. They are well-known for their innovative approach to tackling complex technical challenges and their commitment to...


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesJob Description & RequirementsWorking in a large Big data and datawarehouse team of a bank, you will be responsible for carrying out the followingUnderstand functional requirements Carrying out data analysis, data mapping development of data pipeline, back end services performing data management and data transformation Ensuring...


  • Singapore TENCENT CLOUD INTERNATIONAL PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilitiesThe candidate needs to deeply understand customers' needs and pain points regarding Big Data products and solutions and design overall Big Data product solutions tailored to customer business scenarios and technical requirements. Capable of recommending the core advantages and capabilities of Tencent Cloud's Big Data...

  • Big Data Engineer

    4 weeks ago


    Singapore ITCAN PTE. LIMITED Full time

    Roles & Responsibilities· Bachelor's or master's degree in computer science, Engineering, or a related field.· Proven experience as a Big Data Engineer or similar role.· Strong proficiency in Apache Spark and Scala programming.· Experience with big data technologies such as Hadoop, Hive, Kafka, etc.· Familiarity with data warehousing concepts and...

  • Big Data Engineer

    2 weeks ago


    Singapore ITCAN PTE. LIMITED Full time

    Roles & Responsibilities· Bachelor's or master's degree in computer science, Engineering, or a related field.· Proven experience as a Big Data Engineer or similar role.· Strong proficiency in Apache Spark and Scala programming.· Experience with big data technologies such as Hadoop, Hive, Kafka, etc.· Familiarity with data warehousing concepts and...