PySpark Developer

• Minimum 4 years experienced & motivated ETL Developer skilled in the design, development & deployment of Python & PySpark based XML Frameworks for ingestion of data from various source systems to Snowflake in AWS & Google Cloud Platform (GCP) environments. • Hands-on coding using Python, PySpark in cloud-based environment involving big-data frameworks...

**Job Summary**: **Job Type** Permanent **Seniority** Senior Mid **Years of Experience** 4-6 years **Tech Stacks** Shell Script pySpark HDFS Shell UNIX Java Hive Spark SQL Scala Hadoop Python **Key Responsibilities**: - Working with the latest tools and techniques - Hands-on coding, usually in a pair programming environment - Working in highly...

**Job Summary**: **Salary** S$7,500 - S$11,500 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 6 years **Tech Stacks** ETL AWS Analytics pySpark Apache Azure Spark NoSQL SQL Python **Position Overview**: As a PySpark Data Engineer, you will be responsible for designing, implementing, and maintaining data processing...

**Data Architecture and Design**: - Collaborate with cross-functional teams to understand data requirements and design efficient and scalable data architectures. - Develop and maintain data models, schema designs, and data flow diagrams. **ETL Development**: - Design, develop, and optimize Extract, Transform, Load (ETL) processes using Python and...

Key Responsibilities - Design, develop, and optimize data workflows and pipelines using Apache Hadoop, Cloudera, and Spark. - Develop microservice APIs using Python Django framework and utilized Redis as a data store - Manage and optimize data storage in data warehouse solutions, including Cloudera and Hive. - Implement and manage data processing workflows...

**Key Responsibilities**: - Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL. - Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate data solutions. - Develop and optimize ETL (Extract, Transform, Load) processes to ensure data...

Excellent Python - Technical aptitude, including understanding of data science concepts and tools (e.g. Hadoop, Spark, Python) - Knowledge on Spark, Python modelling packages, JIRA, Bitbucket - Experience of User Acceptance Testing and requirements gathering - Experience working with large and complex datasets - Effective communicator - Strong team player

**About Us**: Alephys Pte Ltd is dedicated to leveraging data to drive innovation and business solutions. We are looking for a skilled Python Developer with expertise in PySpark to join our dynamic team. **As a Python Developer with PySpark, you will be responsible for designing, developing, and maintaining data processing solutions. You will work closely...

Big Data Expertise SoughtWe are looking for a skilled PySpark developer to spearhead the design, development, and deployment of high-performance Python and PySpark-based frameworks for data ingestion from various sources into Snowflake in cloud environments.The ideal candidate will possess hands-on experience with coding using Python and PySpark in big-data...

Big Data Expertise Sought We are looking for a skilled PySpark developer to spearhead the design, development, and deployment of high-performance Python and PySpark-based frameworks for data ingestion from various sources into Snowflake in cloud environments. The ideal candidate will possess hands-on experience with coding using Python and PySpark in...