Pyspark Developer

**Job Summary**: **Salary** S$7,500 - S$11,500 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 6 years **Tech Stacks** ETL AWS Analytics pySpark Apache Azure Spark NoSQL SQL Python **Position Overview**: As a PySpark Data Engineer, you will be responsible for designing, implementing, and maintaining data processing...

About Sembcorp Sembcorp is a leading energy and urban solutions provider headquartered in Singapore. Led by its purpose to drive energy transition, Sembcorp delivers sustainable energy solutions and urban developments by leveraging its sector expertise and global track record. Purpose & Scope We are seeking a highly skilled and self-driven Azure Data...

Key Responsibilities - Design, develop, and optimize data workflows and pipelines using Apache Hadoop, Cloudera, and Spark. - Develop microservice APIs using Python Django framework and utilized Redis as a data store - Manage and optimize data storage in data warehouse solutions, including Cloudera and Hive. - Implement and manage data processing workflows...

**Key Responsibilities**: - Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL. - Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate data solutions. - Develop and optimize ETL (Extract, Transform, Load) processes to ensure data...

Excellent Python - Technical aptitude, including understanding of data science concepts and tools (e.g. Hadoop, Spark, Python) - Knowledge on Spark, Python modelling packages, JIRA, Bitbucket - Experience of User Acceptance Testing and requirements gathering - Experience working with large and complex datasets - Effective communicator - Strong team player

**About Us**: Alephys Pte Ltd is dedicated to leveraging data to drive innovation and business solutions. We are looking for a skilled Python Developer with expertise in PySpark to join our dynamic team. **As a Python Developer with PySpark, you will be responsible for designing, developing, and maintaining data processing solutions. You will work closely...

Roles & Responsibilities About Sembcorp Sembcorp is a leading energy and urban solutions provider headquartered in Singapore. Led by its purpose to drive energy transition, Sembcorp delivers sustainable energy solutions and urban developments by leveraging its sector expertise and global track record. Play a role in Powering Asia’s Energy Transition Drive...

Roles & Responsibilities * 5 days work week * Location: Central * Strong in Python coding like Panda, PyArrow, PySpark * 5 months renewable contract Our client is a global leader IT consulting for 500 fortune company Responsibilities: Database Migration – Proven experience migrating relational databases to cloud-native data lake solutions Programming &...

* 5 days work week * Location: Central * Strong in Python coding like Panda, PyArrow, PySpark * 5 months renewable contract Our client is a global leader IT consulting for 500 fortune company Responsibilities: Database Migration - Proven experience migrating relational databases to cloud-native data lake solutions Programming & Processing - Python (Pandas,...

* 5 days work week * Location: Central * Strong in Python coding like Panda, PyArrow, PySpark * 5 months renewable contract Our client is a global leader IT consulting for 500 fortune company Responsibilities: Database Migration - Proven experience migrating relational databases to cloud-native data lake solutions Programming & Processing - Python (Pandas,...