See more Collapse

Senior Spark Developer

2 months ago


Singapore ARISTON SERVICES PTE. LTD. Full time
Roles & Responsibilities

This role will be responsible for Leading a team for development, and maintenance of Spark, Hadoop and Hive applications.

The ideal candidate should have:

strong technology delivery experience with Spark, Java, Hive, Hadoop, ecosystem. They will also be familiar with data modeling, data wrangling, and data analysis.

experience with both SAS / ETL Platforms and be able to lead a team.

Responsibilities:

•Team Lead, develop, and maintain Spark and Java applications.

•Work with data scientists and analysts to build data pipelines and data models.

•Optimize Spark and Hive queries for performance.

•Troubleshoot and debug Spark and Hive applications.

•Migrate SAS code to Java , deliver new Java applications.

•Document the migrated code.

•Work with other engineers to ensure the smooth transition to Java.

Qualifications:

•Bachelor's degree in computer science, data science, or a related field

•Experience with Spark, Java, SAS, Hive, Hadoop, and the Hadoop ecosystem

•Experience with data modeling, data wrangling, and data analysis

•Experience with cloud computing platforms (e.g., AWS, Azure, GCP)

•Strong problem-solving and analytical skills

•Excellent communication and teamwork skills

•Strong delivery skills, experience with data migration


Interested qualified candidates may revert with their updated resume.


Thank you

Ariston Team



Tell employers what skills you have

Data Wrangling
Data Analysis
Analytical Skills
Azure
Data Modeling
Cloud Computing
Pipelines
Hadoop
ETL
Spark
Data Migration
Team Lead
Hive
Data Science
Java
Teamwork Skills

We have other current jobs related to this field that you can find below


  • Singapore SPARK EDTECH PTE. LIMITED Full time

    **About Spark EducationSpark Education is a fast-growing global online education platform offering small-group classes for kids in Math, Chinese, and Logic. Our mission is to "spark passion for learning, ignite lifelong growth".We offer a portfolio of products and classes including Vispark Spark Math (Math curriculum based in Singapore Math), Spark Chinese,...


  • Singapore search index Full time

    We are seeking a talented and experienced Spark Scala Developer with expertise in Elasticsearch to join our team. As a Spark Scala Developer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch. You will collaborate with cross-functional teams to build scalable and efficient...


  • Singapore DBS Bank Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we managethe majority ofthe Bank\'s operational processes and inspire to delight our business...


  • Singapore Unison Consulting Pte Ltd Full time

    Key Responsibilities: Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate data solutions. Develop and optimize ETL (Extract, Transform, Load) processes to ensure data quality and...


  • Singapore JJ Consulting Services Full time

    Our Client is an established company in Singapore, who is seeking to recruit a Senior/ Java Developer. Senior/ Java Developer Responsibility . Be a lead developer and guide the team of developers Our Client is an established company in Singapore, who is seeking to recruit a Senior/ Java Developer. Senior/ Java Developer Responsibility . Be a lead developer...


  • Singapore JJ Consulting Services Full time

    Our Client is an established company in Singapore, who is seeking to recruit a Senior/ Java Developer. Senior/ Java Developer Responsibility . Be a lead developer and guide the team of developers Our Client is an established company in Singapore, who is seeking to recruit a Senior/ Java Developer. Senior/ Java Developer Responsibility . Be a lead developer...

  • Mathematics Teacher

    3 weeks ago


    Singapore SPARK EDTECH PTE. LIMITED Full time

    About Spark Education GroupSpark Education Group is a rapidly growing global online education company focused on interactive live instruction with small-group classes for kids. Our mission is to ignite a love for learning and foster continuous growth. Since 2018, we have amassed over half a million users globally and have the support of prominent investors...

  • Course Consultant

    3 weeks ago


    Singapore SPARK LEARNING CENTRE PTE. LTD. Full time

    Spark Education Group is a fast-growing global online education company specializing in interactive live-instruction with small-group classes for kids. Our mission is to "spark passion for learning, ignite lifelong growth". Since 2018, the company has attracted over half a million users worldwide and is backed by top global investors including KKR, IDG...


  • Singapore SAKSOFT PTE LIMITED Full time

    Roles & ResponsibilitiesExperience: 10+ YearsRole: Software Developer or Senior Software DeveloperKey Skills:o Hadoop Ecosystem: Hadoop 2.x, HBase, Apache Spark 1.x/ 2.x, Apache Phoenix, Apache Zookeeper, Apache Hive, Apache Storm.o Cloud: AWS [AWS EMR, Kinesis, EC2, Redshift, Cloud watch, I AM], GCPo Programming Languages: Python, Scala, Java.o Databases:...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$10,000 - S$20,000 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 5 yearsTech StacksTensorFlow C++ Hive Spark PythonJob Description: Participate in full development cycle of machine learning model, including design, data processing, develop, deploy, experiment and analyse. Explore, improve and validate suitable cuttingedge...

  • Senior Data Engineer

    3 weeks ago


    Singapore NodeFlair Full time

    Job Summary:SalaryS$9,000 - S$10,000 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 10 yearsTech StacksAWK ETL Informatica Shell Script HDFS Shell Control-M UNIX Git Hive Impala Spark SQL Hadoop ElasticsearchRole:Senior Data EngineerJob level:More than 10 years of relevant experience (L4)Key skills:AS400, Hadoop, Data Lake, SQL, InformaticaKey...

  • Senior Developer

    1 month ago


    Singapore Luxoft Full time

    Our Client a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe and North America are looking for Consultants to be part of the project The Technology and Operations function is comprised of five teams of specialists with distinct capabilities: business partnership,...

  • Senior Developer

    3 weeks ago


    Singapore Luxoft Full time

    Project Description**:Our Client a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe and North America are looking for Consultants to be part of the projectThe Technology and Operations function is comprised of five teams of specialists with distinct capabilities: business...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$8,000 - S$13,000 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 5 yearsTech StacksHBase Spark Linux kafka Flink HadoopJob Description: Design and develop software solutions to automate the technical operations of largescale systems Work closely with crossfunctional teams to improve the big data system, and develop...


  • Singapore VISEO Full time

    The Senior Database Developer - Postgres SQL is expected to provide guidance to other developers that would be assigned to him/her in the course of the project. He/She must ensure the activities/processes performed follows strictly the development standards and processes as prescribed by in the IT governance.Your Responsibilities :Design, Develop, Test,...

  • Senior Developer

    3 weeks ago


    Singapore Adecco Full time

    Qualifications and Profile An ideal Candidate should have * At least 6 years of software development experience with at least 4 years' experience working with Java * A strong understanding of Qualifications and Profile An ideal Candidate should have At least 6 years of software development experience with at least 4 years' experience working with Java A...

  • Senior Developer

    1 month ago


    Singapore Adecco Full time

    Qualifications and Profile An ideal Candidate should have * At least 6 years of software development experience with at least 4 years' experience working with Java * A strong understanding of Qualifications and Profile An ideal Candidate should have At least 6 years of software development experience with at least 4 years' experience working with Java A...

  • Senior Developer

    1 month ago


    Singapore Adecco Full time

    Qualifications and Profile An ideal Candidate should have * At least 6 years of software development experience with at least 4 years' experience working with Java * A strong understanding of Qualifications and Profile An ideal Candidate should have At least 6 years of software development experience with at least 4 years' experience working with Java A...

  • Senior Data Engineer

    3 weeks ago


    Singapore Claremont Consulting Full time

    Work type: Location:Singapore Discipline: Contact name: Posted date:25-Jul-2023Senior Data Engineer-Essential Skills:Strong experience in Data Engineering building strong, robust pipelines to ingest data from a variety of sources with a focus on real-time streaming Strong Spark / Spark Streaming experience Experience in Java, Kafka and Streaming...

  • Data Engineer Spark

    3 weeks ago


    Singapore NodeFlair Full time

    Job Summary:SalaryS$7,500 - S$9,500 / MonthlyJob TypeSeniorityMidYears of ExperienceAt least 5 yearsTech StacksETL Informatica Analytics SAP pySpark Cloudera Hive Impala Linux SQL PythonJob Summary:- a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. Overall experience can be 5 to 10 years....