Data Engineer(Python, PySpark, Spark

We are in search of a proficient Data Engineer with expertise in Python, PySpark, Spark, and SQL. The perfect candidate will excel in constructing and enhancing data pipelines and structures. We need a team player who can collaborate effectively to design and deploy robust data solutions.Key Responsibilities:Design, construct, and manage efficient, scalable,...

Design, implement, and maintain scalable and efficient data pipelines using SAS, Spark, Python, and PySpark. Ensure the smooth flow of data from various sources to destination systems. Utilize SAS, Spark, Python, and PySpark for efficient data processing. Design and implement data models to support business requirements. Work closely with data architects to...

Key Responsibilities: Create Spark Scala/PySpark jobs for data transformation and aggregation.Produce unit tests for Spark transformations and helper methods.Use Spark and Spark-SQL to read parquet data and create tables in Hive using the Scala API.Work closely with Business Analysts to review test results and obtain sign-off.Prepare necessary design and...

Design, implement, and maintain scalable and efficient data pipelines using Spark, Python, and PySpark.Ensure the smooth flow of data from various sources to destination systems.Utilize SAS, Spark, Python, and PySpark for efficient data processing.Design and implement data models to support business requirements.Work closely with data architects to ensure...

Data Architecture and Design: Collaborate with cross-functional teams to understand data requirements and design efficient and scalable data architectures. Develop and maintain data models, schema designs, and data flow diagrams. ETL Development: Design, develop, and optimize Extract, Transform, Load (ETL) processes using Python and PySpark. Implement robust...

Roles and Responsibilities: Develop Spark Scala and PySpark jobs for data transformation and aggregation.  Create unit tests for Spark transformations and helper methods.  Utilize Spark and Spark SQL to read parquet data and create tables in Hive using the Scala API.  Collaborate closely with the Business Analysts team to review...

Roles & Responsibilities· Creating complex, enterprise-transforming applications on diverse, high energy teams· Working with the latest tools and techniques· Hands-on coding, usually in a pair programming environment· Working in highly collaborative teams and building quality code· The candidate must exhibit a good understanding of model ...

We are seeking a talented and experienced Data Engineer cum SAS Consultant to join our team. The ideal candidate will possess a strong background in data engineering, SAS programming, and proficiency in Python and Spark or PySpark. The role involves designing, developing, and implementing data solutions while leveraging SAS tools to provide insightful...

Responsibilities:•Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives•Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions•Ensure data quality and integrity throughout the data processing...

Description KEY ACCOUNTABILITIES Manage, plan and maintain the facilitation of support for data analysis across Eaglestar’s growing global fleet . Project-manage and deliver on data-related implementations ensuring that deliverables are met within agreed scope and timelines Manage, develop, and provide Eaglestar’s internal/external stakeholders...

Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...

Responsibilities:•Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data•Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data•Optimize and tune Spark jobs for performance and scalability, ensuring efficient data...

We are looking for a highly experienced and skilled Data Architect to join our team. The ideal candidate will have 12-15 years of experience in architecting solutions of data engineering, focusing on ELT and PySpark/Hadoop workloads. In addition to strong solution and delivery skills, the ideal candidate will also have a view on business growth and managing...

Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our...

Big Data Engineer - 123101 Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. • Good understanding of analytics and data warehouse implementations. • Ability to troubleshoot complex issues ranging from system resource to application stack traces. • Strong SQL, data modelling and data...

Big Data Engineer Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. Good understanding of analytics and data warehouse implementations. Ability to troubleshoot complex issues ranging from system resource to application stack traces. Strong SQL, data modelling and data analysis skills are a must....

Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions Ensure data quality and integrity throughout the data processing lifecycle Design and...

In our 'always on' world, we believe it's essential to have a genuine connection with the work you do. RUCKUS Networks is hiring a Data Engineer who will work closely with our team in Singapore How You'll Help Us Connect the World You will join a dynamic and focused team to develop innovative big data applications in Analytics and Artificial...

Responsibilities:•Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives•Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions•Ensure data quality and integrity throughout the data processing...

In our 'always on' world, we believe it's essential to have a genuine connection with the work you do. RUCKUS Networks is hiring a Data Engineer who will work closely with our team in Singapore! How You'll Help Us Connect the World You will join a dynamic and focused team to develop innovative big data applications in Analytics and Artificial...