Data Engineer(Spark Developer)

**The Opportunity** Key Responsibilities - Working with the latest tools and techniques - Hands-on coding, usually in a pair programming environment - Working in highly collaborative teams and building quality code **Essential Skills & Prerequisites**: - Hand-on Development experience with Spark, ScalaSpark and Distributed computing. - 4 to 6...

**Responsibilities**: - Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data - Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch - Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and...

About the RoleWe are looking for a talented Data Engineer to join our team at TRINITY CONSULTING SERVICES PTE. LTD. As a Senior Java/Spark Developer, you will be responsible for building, deploying, and maintaining large-scale data processing systems.Key ResponsibilitiesBuild and deploy data pipelines using Java and Spark.Work closely with cross-functional...

**Responsibilities**: - Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives - Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions - Integrate Elasticsearch with Spark to enable efficient...

**Job Summary**: **Job Type** **Seniority** Mid **Years of Experience** Information not provided **Tech Stacks** ETL AWS Google Cloud pySpark BigQuery RedShift Apache Azure Spark SQL Python **Key Responsibilities**: - Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL - Collaborate with...

**About the job**: This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data. This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers. **Responsibilities**: In...

**Key Responsibilities**: - Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL. - Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate data solutions. - Develop and optimize ETL (Extract, Transform, Load) processes to ensure data...

Roles & ResponsibilitiesDeliver fully tested source code. Address technical aspects with architect and functional aspects with business analyst. Liaise with business analysts for clarification and understanding of requirements. Analyze technical constraints considering functional impacts with technical lead's help. Deliver software products for...

Data Engineer This is a 12 months contract assinged to our client Work Location: To be confirmed Salary Range : $6,000-$9,500 **Job Description**: 1. Data Engineer with hands on programming skills using Python, Spark, ETL pipeline related such as Kafka, airflow. 2. Experience on Data Warehouse Tools Skillsets Requirement 1. Data Engineering 2. Data...

This is a 12 months contract assigned to our client Work Location: To be confirmed Salary Range : $6,000-$8,000 **Job Description**: 1. Primary Skill: Data Analytics 2. Data Engineering 3. Hands on programming skills using Python, Spark, ETL pipeline related such as Kafka, airflow. Skills Requirement (Intermidiate Level) 1. Apache Kafka 2. Apache...

Roles & ResponsibilitiesJob Description & RequirementsThis role will be responsible for designing, developing, and maintaining Applications using Apache Spark open-source framework. They work with different aspects of the Spark ecosystem, including Spark SQL, Data Frames, Datasets, and streaming.Role:Help write analytics code, services and components in...

Roles & ResponsibilitiesJob Description & RequirementsThis role will be responsible for designing, developing, and maintaining Applications using Apache Spark open-source framework. They work with different aspects of the Spark ecosystem, including Spark SQL, Data Frames, Datasets, and streaming.Role:Help write analytics code, services and components in...

Roles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...

**Role Overview**: **Key Responsibilities**: - **Design, build, and maintain scalable data pipelines and architectures**: - **Work with both relational and NoSQL databases to handle structured and unstructured data sources**: - **Utilize Hadoop and Spark for distributed data processing**: - **Implement efficient batch and streaming data engineering...

Job Description - About Us - Roles and Responsibility **Job scopes**: - The Data Engineer will lead the enterprise-wide data transformations projects. The person will involve in developing and automating data processing pipelines for financial and Investment data modelling, analysis, and reporting from various data sources systems; The primary...

As a Lead Data Engineer, you will play a leading role in designing, building, and optimizing the client's data infrastructure, ensuring that it supports the bank's advanced analytics needs. Your main responsibilities will include: - Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data. - Optimize and tune Spark...

Experience: 1 to 9 Years Role: Data Engineer Key Responsibilities: - Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data - Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch - Collaborate with data engineers, data scientists, and other...

Job OverviewWe are seeking an experienced Java Developer with expertise in Spark to join our team at TRINITY CONSULTING SERVICES PTE. LTD. As a Senior Java/Spark Developer, you will be responsible for designing, developing, and deploying scalable data processing systems.Key ResponsibilitiesDesign and implement data pipelines using Java and Spark.Collaborate...

Job DescriptionAt TRINITY CONSULTING SERVICES PTE. LTD., we are seeking a skilled Data Engineer to join our team. As a Senior Java/Spark Developer, you will play a key role in designing, developing, and maintaining large-scale data processing systems.ResponsibilitiesDesign and develop high-performance data pipelines using Java and Spark...

**Singapore | Fulltime** Seeing the challenges of FX today with high latency and rejection rates, fragmented marketplace and outdated technology, Spark Systems sets out to build a robust trading platform designed for low-latency access to worldwide FX liquidity with smart algorithmic execution, reducing trading costs for our clients. We are also delivering...