Principal Big Data Developer

Big Data Expertise SoughtWe are looking for a skilled PySpark developer to spearhead the design, development, and deployment of high-performance Python and PySpark-based frameworks for data ingestion from various sources into Snowflake in cloud environments.The ideal candidate will possess hands-on experience with coding using Python and PySpark in big-data...

**Responsibilities** **1、**Design and develop scalable, high-performance data processing systems using Hadoop, Flink, and other Big Data technologies. 2、Develop and maintain data pipelines for data ingestion, processing, and analysis. 3、Design and implement data models to optimize data storage and retrieval efficiency. 4、Collaborate with...

**Overview**: **Key Responsibilities**: - Design, develop, and optimize scalable data processing systems leveraging Hadoop, Flink, and other Big Data technologies. - Build and manage robust data pipelines for data ingestion, transformation, and analysis. - Create and implement efficient data models to support effective data storage and retrieval. -...

Responsibilities Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. Developing and deploying data processing applications using Big Data...

We are looking for Big Data Developers in the vibrant city of Singapore. This is a fantastic opportunity for someone who is passionate about big data and wants to take their career to new heights. **Requirements**: - Minimum of 5 years of experience as a Big Data Developer - Strong knowledge and experience with Big Data technologies such as Hadoop, Spark,...

**Responsibilities**: - Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions - Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. - Write efficient and optimised code in programming languages...

Job Overview:We are seeking a highly skilled professional to fill the role of Assistant Big Data Development Engineer. As a key contributor to our big data development team, you will be responsible for designing and building robust data warehouses and performing data analysis based on business requirements.Key Responsibilities:Develop and implement big data...

Big Data Engineer OpportunityAs a key member of our data-driven team, we are seeking an experienced Big Data Engineer to join us in developing and maintaining ETL processes for finance regulatory reporting projects and applications.This role involves designing and implementing scalable data warehouse solutions to support business intelligence and analytics....

**Job Summary**: **Job Type** Permanent **Seniority** Mid **Years of Experience** At least 3 years **Tech Stacks** ETL AWS Analytics R EMR pySpark Glue Athena RedShift Flume Presto Java Hive Spark kafka Flink SQL Scala Python **Responsibility**: - Designing and build scalable data pipelines to extract, transform, and load data from a variety of sources...

**Must Have**: - Strong foundational knowledge of data structures and algorithms - Experience in Java programming, Relational/NoSQL database, and SQL - Exposure to one or more Big Data technologies like Hadoop, Spark, Hive, Kafka **Good To Have**: - Experience in development in a CI/CD environment and familiarity with CI/CD tools is required **Job...