Hadoop scala

Degree in Information Technology or equivalent field. - Must have minimum of 3-5 years of experience in Hadoop Ecosystem (Spark, Scala, Hive, PIG ) - Must have exposure on Hadoop distribution and worked on one or more computation frameworks, such as Spark. - Must have knowledge in Java. - Good to have performance tuning in hadoop eco-system, Unix Shell...

**Responsibilities**: - Responsible for Hadoop development and implementation for data ingestion on Hadoop technologies - Required to have sound knowledge and implementation experience to build Data warehouse / Data Mart using structured / unstructured data for both near real-time & batch processing - Hands on experience in complex code development and...

**Responsibilities**: - 6-8 years’ experience in agile way of working in DevOps mode - Writing scalable robust testable efficient and easily maintainable code - Translating software requirements into stable working high performance software Ensure that software packages and programs are well documented and has reasonable test coverage - Collaborate...

Proficiency in Scala programming and functional programming principles. - Strong SQL skills, including query optimization and database design. - Hands-on experience with Hadoop ecosystem tools (HDFS, Hive, YARN, MapReduce). - Familiarity with other big data tools like Spark, Kafka, or Flink is a plus. - **Problem-Solving**: - Strong analytical skills with...

**Job responsibilities**: - Work with Consumer Banking Business Analysts team to understand existing SAS code logic written by techno-functional users - Develop the SAS logic in Big Data environment, using Spark, Scala and Pyspark utilizing Hadoop ecosystem of the inhouse Data Lake - Perform unit testing and system integration testing - Work closely with...

**Responsibilities**: - Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data - Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch - Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and...

**Responsibilities**: - Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives - Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions - Integrate Elasticsearch with Spark to enable efficient...

**Job Summary**: **Salary** S$5,000 - S$7,100 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Shell Script HDFS Shell UNIX Java Hive Spark SQL Scala Hadoop Python **The Opportunity** Key Responsibilities - Working with the latest tools and techniques - Hands-on coding, usually in a pair programming...

Are you excited about transforming the way we bank by using the latest technology? We are too! **About the job**: - Work with clients to solve business problems in fraud, compliance and financial crime and present project results - Manage, transform, and cleanse high volume data - Automate data processing to enable on-going alerts on high-risk activity -...

Are you excited about transforming the way we bank by using the latest technology? We are too! **About the job**: - Work with clients to solve business problems in fraud, compliance and financial crime and present project results - Manage, transform, and cleanse high volume data - Automate data processing to enable on-going alerts on high-risk activity -...

Roles & Responsibilities· Bachelor's or master's degree in computer science, Engineering, or a related field.· Proven experience as a Big Data Engineer or similar role.· Strong proficiency in Apache Spark and Scala programming.· Experience with big data technologies such as Hadoop, Hive, Kafka, etc.· Familiarity with data warehousing concepts and...

Roles & ResponsibilitiesBig Data Developer  Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS file formats and...

We are looking for an experienced Data engineer. **Responsibilities**: - Develop new and improve existing data pipeline on Big Data platform (Hadoop or equivalent). - Work on Apache Airflow data pipeline, Python, Spark, Scala, Java, etc open sources technologies. - Develop and maintain Data REST API (Spring Boot or equivalent) and Streaming API (Kafka or...

**Job Summary**: **Salary** S$5,000 - S$6,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 2 years **Tech Stacks** Analytics Qlik R Hive Spark SQL Scala Hadoop Python We are hiring aspiring / proven data scientist to join us in our cause of helping customer Stay Modern, ahead of the technology curve! **Roles and...

**Job Summary**: **Salary** S$8,333 - S$16,666 / Monthly EST **Job Type** Permanent **Seniority** Senior **Years of Experience** At least 5 years **Tech Stacks** Snowflake Spring BigQuery Java Spark kafka Flink Springboot Kotlin SQL Scala Hadoop Python - In this data engineering role, we are seeking engineers with a background in data engineering to...

Requirements: - Proven experience as a Big Data Engineer or similar role. - Strong proficiency in Apache Spark and Scala programming. - Experience with big data technologies such as Hadoop, Hive, Kafka, etc. - Familiarity with data warehousing concepts and tools. - Knowledge of SQL and NoSQL databases. - Excellent problem-solving skills and attention to...

Roles & ResponsibilitiesResponsibilities• Working with business users to define and understand business requirements to develop and implement solutions• Support development and deployment of applications utilising the data pipelines to provide actionable insights• Involve in UAT execution with a focus on strategic testing processes and procedures to...

Roles & ResponsibilitiesWe are looking for a skilled Data Engineer with a focus on Big Data to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. The role will be a direct permanent position with the clients.Key...

**Job Summary**: **Job Type** Permanent **Seniority** **Years of Experience** Information not provided **Tech Stacks** Container MapReduce Docker C++ CI Java Hive Spark Kubernetes Flink Scala Hadoop Python - Work with the Product and Security teams in delivering robust infrastructure services according to the business requirements and demands - Design,...

**Job Summary**: **Job Type** **Seniority** Senior **Years of Experience** Information not provided **Tech Stacks** ETL Snowflake AWS play Analytics Databricks Azure Spark kafka SQL Scala Hadoop Python Our client is a financial analytics platform backed by some of Indonesia and Singapore's most prominent early-stage VCs. We are seeking a Senior Data...