Data Engineer Spark

Roles & ResponsibilitiesAvensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success we have evolved to become one of the top trusted providers in Singapore and service...

Roles & ResponsibilitiesAvensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success we have evolved to become one of the top trusted providers in Singapore and service...

We are seeking a talented and experienced Spark Scala Developer with expertise in Elasticsearch to join our team. As a Spark Scala Developer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch. You will collaborate with cross-functional teams to build scalable and efficient...

We are seeking a talented and experienced Spark Scala Developer with expertise in Elasticsearch to join our team. As a Spark Scala Developer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch. You will collaborate with cross-functional teams to build scalable and efficient...

Key Responsibilities: Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate data solutions. Develop and optimize ETL (Extract, Transform, Load) processes to ensure data quality and...

About the job:This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data.This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers.Responsibilities:In this role,...

Roles & ResponsibilitiesThis role will be responsible for Leading a team for development, and maintenance of Spark, Hadoop and Hive applications. The ideal candidate should have:strong technology delivery experience with Spark, Java, Hive, Hadoop, ecosystem. They will also be familiar with data modeling, data wrangling, and data analysis.experience...

Client Description:Job Description:Position: Data Engineer (Spark Scala Elastic)Employment Type: 1-year Agency Contract (Highly Renewable)Location: AlexandraJob ObjectivesWe are seeking a talented and experienced Spark Scala Developer with expertise in Elasticsearch to join our team. As a Spark Scala Developer, you will play a crucial role in designing,...

Key Responsibilities:Create Spark Scala/PySpark jobs for data transformation and aggregation.Produce unit tests for Spark transformations and helper methods.Use Spark and Spark-SQL to read parquet data and create tables in Hive using the Scala API.Work closely with Business Analysts to review test results and obtain sign-off.Prepare necessary design and...

Roles & Responsibilities Create Spark Scala/Pyspark jobs for data transformation and aggregation. Produce unit tests for Spark transformations and helper methods. Use Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API. Work closely with Business Analysts team to review the test results and obtain sign off Prepare...

Data EngineerThis is a 12 months contract assinged to our clientWork Location: To be confirmedSalary Range : $6,000-$9,500Job Description:Data Engineer with hands on programming skills using Python, Spark, ETL pipeline related such asKafka, airflow.Experience on Data Warehouse ToolsSkillsets RequirementData EngineeringData Warehouse ToolsPython (Programming...

Do you have software developer experience, and are you seeking a new job in Singapore? Cognizant is looking for a Data Engineer, and the full-time role comes with an attractive salary and benefits package.As a Data Engineer, you will design, develop and implement data-processing pipelines to process large volumes of structured and unstructured data....

Job Title: Data Engineer (Python, Java or Scala)Welcome to our company! We are currently looking for a skilled Data Engineer to join our team. In this role, you will play a key part in designing, constructing, and managing data pipelines to support our data analytics and business intelligence projects. Collaboration with various teams is essential to create...

Do you have software developer experience, and are you seeking a new job in Singapore? Cognizant is looking for a Data Engineer, and the full-time role comes with an attractive salary and benefits package.As a Data Engineer, you will design, develop and implement data-processing pipelines to process large volumes of structured and unstructured data. You...

Do you have software developer experience, and are you seeking a new job in Singapore? Cognizant is looking for a Data Engineer, and the full-time role comes with an attractive salary and benefits package.As a Data Engineer, you will design, develop and implement data-processing pipelines to process large volumes of structured and unstructured data. You...

This is a 12 months contract assigned to our clientWork Location: To be confirmedSalary Range : $6,000-$8,000Job Description:Primary Skill: Data AnalyticsData EngineeringHands on programming skills using Python, Spark, ETL pipeline related such as Kafka, airflow.Skills Requirement (Intermidiate Level)Apache KafkaApache SparkData Warehouse ToolsPython...

Data EngineerAre you excited about transforming the way we bank by using the latest technology? We are tooAbout the job: Work with clients to solve business problems in fraud, compliance and financial crime and present project results Manage, transform, and cleanse high volume data Automate data processing to enable ongoing alerts on highrisk activity Work...

Roles & ResponsibilitiesJob Description:We are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data...

Roles & Responsibilities Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles Code in Python with tools like Apache Spark to build a multi-cluster data warehouse Codify best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases to facilitate data capturing and...

Roles & ResponsibilitiesJob Description: Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Solve complex data problems to deliver insights that help the organization achieve its goals. Code in Python with tools like Apache Spark to build a multi-cluster data warehouse. Interact with...