Pyspark Developer

1 week ago

Singapore NodeFlair Full time

**Job Summary**:
**Job Type**
Permanent

**Seniority**

Senior Mid

**Years of Experience**
4-6 years

**Tech Stacks**
Shell Script pySpark HDFS Shell UNIX Java Hive Spark SQL Scala Hadoop Python

**Key Responsibilities**:

- Working with the latest tools and techniques
- Hands-on coding, usually in a pair programming environment
- Working in highly collaborative teams and building quality code
- The resource will be working with consumer financial products, data systems and data environments, and processes that are necessary for the implementation of Risk and Finance models

**Essential Skills & Prerequisites**:

- Hand-on Development experience with PySpark, ScalaSpark and Distributed computing.
- 4 to 6 years' experience designing and developing in Python.
- 4 to 6 years' experience in Hadoop Platform (Hive, HDFS and Spark)
- 3 to 5 years' experience with Unix shell scripting
- 3 to 5 years' experience with SQL
- 2 to 3 years' experience with Spark programming.
- Knowledge of micro-services architecture and cloud will be added advantage.
- Knowledge of Java and Scala will be added advantage

**Desired**:

- Excellent analytical skills: Proficient in MS Office and able to produce board-level documentation
- Fluency in written and spoken English; Good communication and interpersonal skills
- Self-starter who sets and meets challenging personal targets, Detailed person, with a big picture outlook
- Understanding of current technologies employed by Tier 1 Investment Banking Institutions
- Must be a team player

  • PySpark Developer

    6 days ago

    Singapore OPUS IT SERVICES PTE LTD Full time

    Roles & Responsibilities· Minimum 4 years experienced & motivated ETL Developer skilled in the design, development & deployment of Python & PySpark based XML Frameworks for ingestion of data from various source systems to Snowflake in AWS & Google Cloud Platform (GCP) environments.· Hands-on coding using Python, PySpark in cloud-based environment involving...

  • PySpark Developer

    14 hours ago

    Singapore OPUS IT SERVICES PTE LTD Full time

    • Minimum 4 years experienced & motivated ETL Developer skilled in the design, development & deployment of Python & PySpark based XML Frameworks for ingestion of data from various source systems to Snowflake in AWS & Google Cloud Platform (GCP) environments. • Hands-on coding using Python, PySpark in cloud-based environment involving big-data frameworks...

  • Data Engineer

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$7,500 - S$11,500 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 6 years **Tech Stacks** ETL AWS Analytics pySpark Apache Azure Spark NoSQL SQL Python **Position Overview**: As a PySpark Data Engineer, you will be responsible for designing, implementing, and maintaining data processing...

  • Data Engineer(Python

    2 weeks ago

    Singapore Unison Consulting Pte Ltd Full time

    **Data Architecture and Design**: - Collaborate with cross-functional teams to understand data requirements and design efficient and scalable data architectures. - Develop and maintain data models, schema designs, and data flow diagrams. **ETL Development**: - Design, develop, and optimize Extract, Transform, Load (ETL) processes using Python and...

  • Software Engineer

    1 week ago

    Singapore QUESSCORP HOLDINGS PTE. LTD. Full time

    Key Responsibilities - Design, develop, and optimize data workflows and pipelines using Apache Hadoop, Cloudera, and Spark. - Develop microservice APIs using Python Django framework and utilized Redis as a data store - Manage and optimize data storage in data warehouse solutions, including Cloudera and Hive. - Implement and manage data processing workflows...

  • Data Engineer(Python, Pyspark, Spark

    22 hours ago

    Singapore Unison Consulting Pte Ltd Full time

    **Key Responsibilities**: - Design, build, and maintain efficient, scalable, and reliable data pipelines using Python, PySpark, Spark, and SQL. - Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate data solutions. - Develop and optimize ETL (Extract, Transform, Load) processes to ensure data...

  • Pyspark Developer

    2 days ago

    Singapore RIDIK PTE. LTD. Full time

    Excellent Python - Technical aptitude, including understanding of data science concepts and tools (e.g. Hadoop, Spark, Python) - Knowledge on Spark, Python modelling packages, JIRA, Bitbucket - Experience of User Acceptance Testing and requirements gathering - Experience working with large and complex datasets - Effective communicator - Strong team player

  • Python Developer

    1 week ago

    Singapore ALEPHYS PTE. LTD. Full time

    **About Us**: Alephys Pte Ltd is dedicated to leveraging data to drive innovation and business solutions. We are looking for a skilled Python Developer with expertise in PySpark to join our dynamic team. **As a Python Developer with PySpark, you will be responsible for designing, developing, and maintaining data processing solutions. You will work closely...

  • Principal Big Data Developer

    6 days ago

    Singapore beBeeExpert Full time $150,000 - $200,000

    Big Data Expertise SoughtWe are looking for a skilled PySpark developer to spearhead the design, development, and deployment of high-performance Python and PySpark-based frameworks for data ingestion from various sources into Snowflake in cloud environments.The ideal candidate will possess hands-on experience with coding using Python and PySpark in big-data...

  • Principal Big Data Developer

    5 days ago

    Singapore beBeeExpert Full time

    Big Data Expertise Sought We are looking for a skilled PySpark developer to spearhead the design, development, and deployment of high-performance Python and PySpark-based frameworks for data ingestion from various sources into Snowflake in cloud environments. The ideal candidate will possess hands-on experience with coding using Python and PySpark in...