Data Engineer(Python, PySpark, Spark

We are looking for a skilled Data Engineer with a strong background in Python, PySpark, Spark, and SQL. The ideal candidate will have experience in building and optimizing data pipelines and architectures. This role requires a collaborative professional who can work across teams to design and implement robust data solutions.Key Responsibilities: Design,...

We are looking for a skilled Data Engineer with a strong background in Python, PySpark, Spark, and SQL. The ideal candidate will have experience in building and optimizing data pipelines and architectures. This role requires a collaborative professional who can work across teams to design and implement robust data solutions.Key Responsibilities: Design,...

Design, implement, and maintain scalable and efficient data pipelines using SAS, Spark, Python, and PySpark. Ensure the smooth flow of data from various sources to destination systems. Utilize SAS, Spark, Python, and PySpark for efficient data processing. Design and implement data models to support business requirements. Work closely with data architects to...

Key Responsibilities: Create Spark Scala/PySpark jobs for data transformation and aggregation.Produce unit tests for Spark transformations and helper methods.Use Spark and Spark-SQL to read parquet data and create tables in Hive using the Scala API.Work closely with Business Analysts to review test results and obtain sign-off.Prepare necessary design and...

Design, implement, and maintain scalable and efficient data pipelines using Spark, Python, and PySpark.Ensure the smooth flow of data from various sources to destination systems.Utilize SAS, Spark, Python, and PySpark for efficient data processing.Design and implement data models to support business requirements.Work closely with data architects to ensure...

Roles and Responsibilities: Develop Spark Scala and PySpark jobs for data transformation and aggregation.  Create unit tests for Spark transformations and helper methods.  Utilize Spark and Spark SQL to read parquet data and create tables in Hive using the Scala API.  Collaborate closely with the Business Analysts team to review...

Roles and Responsibilities: Develop Spark Scala and PySpark jobs for data transformation and aggregation.  Create unit tests for Spark transformations and helper methods.  Utilize Spark and Spark SQL to read parquet data and create tables in Hive using the Scala API.  Collaborate closely with the Business Analysts team to review...

Data Architecture and Design: Collaborate with cross-functional teams to understand data requirements and design efficient and scalable data architectures. Develop and maintain data models, schema designs, and data flow diagrams. ETL Development: Design, develop, and optimize Extract, Transform, Load (ETL) processes using Python and PySpark. Implement robust...

Data Architecture and Design: Collaborate with cross-functional teams to understand data requirements and design efficient and scalable data architectures. Develop and maintain data models, schema designs, and data flow diagrams. ETL Development: Design, develop, and optimize Extract, Transform, Load (ETL) processes using Python and PySpark. Implement robust...

Roles & Responsibilities· Creating complex, enterprise-transforming applications on diverse, high energy teams· Working with the latest tools and techniques· Hands-on coding, usually in a pair programming environment· Working in highly collaborative teams and building quality code· The candidate must exhibit a good understanding of model ...

Roles & Responsibilities· Creating complex, enterprise-transforming applications on diverse, high energy teams· Working with the latest tools and techniques· Hands-on coding, usually in a pair programming environment· Working in highly collaborative teams and building quality code· The candidate must exhibit a good understanding of model ...

We are seeking a talented and experienced Data Engineer cum SAS Consultant to join our team. The ideal candidate will possess a strong background in data engineering, SAS programming, and proficiency in Python and Spark or PySpark. The role involves designing, developing, and implementing data solutions while leveraging SAS tools to provide insightful...

Responsibilities:•Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives•Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions•Ensure data quality and integrity throughout the data processing...

Responsibilities:•Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives•Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions•Ensure data quality and integrity throughout the data processing...

Description KEY ACCOUNTABILITIES Manage, plan and maintain the facilitation of support for data analysis across Eaglestar’s growing global fleet . Project-manage and deliver on data-related implementations ensuring that deliverables are met within agreed scope and timelines Manage, develop, and provide Eaglestar’s internal/external stakeholders...

Description KEY ACCOUNTABILITIES Manage, plan and maintain the facilitation of support for data analysis across Eaglestar’s growing global fleet . Project-manage and deliver on data-related implementations ensuring that deliverables are met within agreed scope and timelines Manage, develop, and provide Eaglestar’s internal/external stakeholders...

Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...

Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...

Responsibilities:•Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data•Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data•Optimize and tune Spark jobs for performance and scalability, ensuring efficient data...

Responsibilities:•Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data•Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data•Optimize and tune Spark jobs for performance and scalability, ensuring efficient data...