Pyspark Developer

Key Responsibilities: Analyze and understand existing SAS programs and datasets Design and develop PySpark code that replicates the functionality of existing SAS programs Optimize PySpark code for performance and scalability Test and validate PySpark code to ensure it produces the same results as the original SAS programs Identify and resolve issues and...

Key Responsibilities: Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate data solutions. Develop and optimize ETL (Extract, Transform, Load) processes to ensure data quality and...

JD: Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python; Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc. Experience with Banking domain is preferable. Strong understanding of SDLC processes including all the project documentations. Ability to work under...

Roles & ResponsibilitiesStrong Python development skillsExpertise in Pyspark developmentProficiency in Java Spring BootExperience in L2/L3 supportData analysis proficiencyWork ScheduleMorning shift from 6am to 3pmGeneral shift from 9am to 6pmAfternoon shift from 2pm to 11pmNight shift from 10pm to 7amAvailability required for night shifts, weekends, and...

Responsibility: Develop and maintain data pipelines implementing ETL processes in Bigdata environment Take responsibility for Hadoop development and implementation Experience in Python, Spark, PySpark, and Hive Understanding of data warehousing and data modeling techniques Knowledge on Data lake architectureRequirements: Bachelor's degree in Computer Science...

Key Responsibilities:Create Spark Scala/PySpark jobs for data transformation and aggregation.Produce unit tests for Spark transformations and helper methods.Use Spark and Spark-SQL to read parquet data and create tables in Hive using the Scala API.Work closely with Business Analysts to review test results and obtain sign-off.Prepare necessary design and...

Data Architecture and Design: Collaborate with crossfunctional teams to understand data requirements and design efficient and scalable data architectures. Develop and maintain data models, schema designs, and data flow diagrams.ETL Development: Design, develop, and optimize Extract, Transform, Load (ETL) processes using Python and PySpark. Implement robust...

Job responsibilities: Work with Consumer Banking Business Analysts team to understand existing SAS code logic written by technofunctional users Develop the SAS logic in Big Data environment, using Spark, Scala and Pyspark utilizing Hadoop ecosystem of the inhouse Data Lake Perform unit testing and system integration testing Work closely with Business...

We are a well-capitalised startup company HQ in Singapore developing cutting-edge Quantamental & Decision Models and Algorithms for our exclusive platform.We are in search of an individual who can work remotely, preferably situated in Singapore or New York.Join Our TeamYou will play a vital role in the Quantamental engineering and product decision scientists...

Roles & ResponsibilitiesOur company, a mobile gaming market leader, seeks a talented individual for regional expansion.TasksParticipate in the design of DWH, DataLake & DeltaLake Build a culture of data governance Participate in business analysis and design data based on that analysis Develop and maintain a continuous data delivery pipeline Develop a data...

Job RoleReporting and Analytics Developer/Data EngineerJob SummaryWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/ Senior...

About the PositionAs a member of the MASAI project's development team, you will develop robust processes to ingest huge amounts of data from disparate systems, and build processes that transform and use that data. The core technology used is Apache Spark on top of HDFS, and development is primarily in Java. The position is ideal for someone with a strong...

About the PositionAs a member of the MASAI project's development team, you will develop robust processes to ingest huge amounts of data from disparate systems, and build processes that transform and use that data. The core technology used is Apache Spark on top of HDFS, and development is primarily in Java. The position is ideal for someone with a strong...

Job Role Reporting and Analytics Developer/Data Engineer Job Summary We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/...

Roles & ResponsibilitiesDescription:Responsibilities: 1. Partner with business stakeholders across various departments to define and translate business needs into actionable data-driven strategies. 2. Source data from SAP and convert it to SQL or pyspark messages; build the logic for the data extraction, analysing the SAP transaction data related to required...

Our Client a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe and North America are looking for Consultants to be part of the project The Technology and Operations function is comprised of five teams of specialists with distinct capabilities: business partnership,...

Project Description**:Our Client a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe and North America are looking for Consultants to be part of the projectThe Technology and Operations function is comprised of five teams of specialists with distinct capabilities: business...

I am working with a client in the financial industry, with a well-recognised name brand and a stable work environment. Looking to hire a data scientist for their growing analytics team.Job responsibilities: Develop and evaluate machine learning models and advanced analytics to address business problems at a enterprise level Implement and deploy models into...

Job Summary:SalaryS$7,500 - S$9,500 / MonthlyJob TypeSeniorityMidYears of ExperienceAt least 5 yearsTech StacksETL Informatica Analytics SAP pySpark Cloudera Hive Impala Linux SQL PythonJob Summary:- a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. Overall experience can be 5 to 10 years....

Roles & Responsibilities EMAIL ID : Interested candidates, please email your resume to Only shortlisted candidates would be contacted for interview.Role: BAU Support - 12 months Renewable contractExperience: Minimum of 8 yearsLocation : East CoastBenefits:Renewable contract (Performance-based, with possibility of conversion to perm) Medical Insurance...