Spark Scala Engineer
1 month ago
We are seeking a highly skilled Spark Scala Developer to collaborate with our dynamic team. The ideal candidate will possess a deep understanding of big data technologies, particularly Apache Spark, and experience in Scala programming.
Key Responsibilities- Design and Development: Implement high-performance data processing pipelines using Apache Spark and Scala.
- Optimization: Enhance the performance of existing data processing jobs by tuning Spark jobs, improving data storage, and optimizing the overall data flow.
- Data Integration: Work with various data sources, including structured, semi-structured, and unstructured data, to integrate them into the data processing framework.
- Collaboration: Collaborate with data engineers, data scientists, and other stakeholders to define requirements, refine processes, and ensure successful project delivery.
- Testing: Develop unit tests and integration tests to ensure the reliability and accuracy of the data processing pipelines.
- 5+ Years of experience as a Spark Scala Developer.
- Minimum 5 Years of experience in Scala programming.
- Proficient in Scala, with experience in functional programming paradigms.
- Strong experience in Apache Spark and Scala programming.
- Familiarity with Hadoop, HDFS, Hive, or similar big data technologies.
- Experience with ETL processes, data integration, and handling large-scale datasets.
- Understanding of data warehousing concepts and principles.
- Proficiency in SQL and data query optimization.
- Experience with real-time data processing using Kafka or similar technologies is a plus.
- Experience with version control systems like Git.
- Familiarity with CI/CD pipelines and tools like Jenkins or similar.
- Mandatory Skills: Minimum 5+ Years in Scala.
Unison Consulting Pte Ltd is a dynamic company that values innovation and collaboration. We are committed to delivering high-quality solutions that meet the needs of our clients.
-
Spark Scala Engineer
3 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeSpark Scala Developer Job DescriptionWe are seeking a highly skilled Spark Scala Developer to contribute to our team's success. The ideal candidate will possess a deep understanding of big data technologies, particularly Apache Spark, and experience in Scala programming.Key Responsibilities:Design and Development: Implement high-performance data processing...
-
Spark Scala Engineer
3 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeSpark Scala DeveloperWe are seeking a highly skilled Spark Scala Developer to collaborate with our dynamic team. The ideal candidate will possess a deep understanding of big data technologies, particularly Apache Spark, and experience in Scala programming.Key ResponsibilitiesDesign and Development: Implement high-performance data processing pipelines using...
-
Senior Spark Scala Engineer
2 months ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeJoin Our Team as a Spark Scala EngineerUnison Consulting Pte Ltd is seeking a talented Spark Scala Engineer to enhance our innovative team. The successful candidate will possess extensive knowledge of big data frameworks, particularly Apache Spark, along with proficiency in Scala programming. Your primary role will involve crafting, refining, and sustaining...
-
Spark Scala Developer
3 months ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeWe are looking for a skilled Spark Scala Developer to join our dynamic team. The ideal candidate will have a deep understanding of big data technologies, particularly Apache Spark, and experience in Scala programming. You will be responsible for developing, optimizing, and maintaining our data processing pipelines, ensuring data integrity, performance, and...
-
Scala, Spark
4 weeks ago
Singapur, Singapore TapTalent.ai Full time10+ yrs Extensive working knowledge and expertise in Spark on Scala or PySpark and Hive.Experience in Design, development and performance tuning in Spark.Strong programming skills in Java or Scala or PythonFamiliarity with big data processing tools and techniques.Experience with the Hadoop ecosystemGood understanding of distributed systemsShould have working...
-
Data Engineer
3 months ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeDesign, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...
-
Data Engineer
5 months ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeDesign, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...
-
Data Engineer(Hadoop, Spark, Scala)
2 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeDesign, develop, and maintain scalable data pipelines and ETL processes using Hadoop and Spark. Write efficient and optimized data processing jobs in Scala to transform and load data. Utilize SQL for querying and manipulating data across various databases. Collaborate with data scientists and analysts to gather requirements and deliver data solutions that...
-
Data Engineer
2 months ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeWe are seeking a talented and experienced Data Engineer (Quantexa)with expertise in Hadoop, Scala, Spark, Elastic, Open Shift Container Platform (OCP) and DevOps practices. Elasticsearch to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch....
-
Data Engineer
2 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeJob DescriptionUnison Consulting Pte Ltd is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes using Hadoop and Spark. You will also write efficient and optimized data processing jobs in Scala to transform and load data.Key...
-
Apache Spark Specialist
2 months ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeJoin Our Team as a Spark Scala EngineerUnison Consulting Pte Ltd is seeking a talented Spark Scala Engineer to enhance our innovative team. The successful candidate will possess extensive knowledge of big data frameworks, especially Apache Spark, along with a solid background in Scala programming. Your primary role will involve the creation, enhancement, and...
-
Data Engineer
4 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Implement data transformation, aggregation, and enrichment processes...
-
Java Spark Developer
1 month ago
Singapur, Singapore Virtusa Full timeJob Title: Java Spark DeveloperJob Summary:We are seeking a highly skilled Java Spark Developer to join our team at Virtusa. The ideal candidate will have hands-on expertise in Java and Scala/Spark development, with a strong background in the Financial sector.Key Responsibilities:Develop and maintain Java and Scala/Spark applications with a focus on...
-
Java Spark Developer
3 weeks ago
Singapur, Singapore Virtusa Full timeJob DescriptionJob Title: Java Spark DeveloperJob Summary: We are seeking a highly skilled Java Spark Developer to join our team at Virtusa. The ideal candidate will have hands-on expertise in Java and Scala/Spark development, with a strong understanding of the application data model and functional requirements.Key Responsibilities:Design and develop...
-
Java Spark Developer
3 months ago
Singapur, Singapore Virtusa Full timeJava Spark Developer - CREQ195116 Description Detailed JD (Min 5 lines) 5+ years of IT experience with hands-on expertise in Java and Scala/Spark development. Experience in Financial sector is an advantage Resource should be able to work with multiple stakeholders/teams Should be able to understand the application data model and able to explain the...
-
Data Engineer
2 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeData EngineerUnison Consulting Pte Ltd is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.Key Responsibilities:Design and develop efficient data...
-
Data Engineer
2 months ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will be responsible for designing, developing, and implementing Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.Key Responsibilities:Design and develop...
-
Senior Data Engineer
2 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeData Engineer RoleWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will be responsible for designing, developing, and implementing Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.Key ResponsibilitiesDesign and develop Spark...
-
Senior Big Data Engineer
2 weeks ago
Singapur, Singapore Unison Consulting Pte Ltd Full timeSenior Spark Scala DeveloperWe are seeking a highly skilled Spark Scala Developer to collaborate with our dynamic team in delivering cutting-edge data processing solutions. The ideal candidate will possess a deep understanding of big data technologies, particularly Apache Spark, and expertise in Scala programming.Key ResponsibilitiesDesign and Development:...
-
Data Engineer
3 months ago
Singapur, Singapore Nityo Infotech Full timeSpark Scala Elastic,Network Link Analysis,Spark Scala applications,Spark Experience Required 2 - 7 Years Industry Type IT Employment Type Contract Location Singapore Roles & Responsibilities you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and...