Big Data Developer

1 week ago

Singapore NodeFlair Full time

**Job Summary**:
**Job Type**
Permanent

**Seniority**

Mid

**Years of Experience**
At least 3 years

**Tech Stacks**
ETL AWS Analytics R EMR pySpark Glue Athena RedShift Flume Presto Java Hive Spark kafka Flink SQL Scala Python

**Responsibility**:

- Designing and build scalable data pipelines to extract, transform, and load data from a variety of sources with specific time latency.
- Maintaining and optimizing existing data pipelines and automate data workflows such as data ingestion, aggregation, and ETL processing.
- Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
- Design and implement reliable, scalable, robust and extensible big data systems that support core products and business (e.g. growth analysis, money-laundering analysis and multi-dimensional analysis)
- Research and evaluate latest data related technologies and tools to keep our data platform updated and competitive

**Requirements**:

- Proficiency in developing robust data pipelines, including data collection and ETL(Extract, Transform, Load) processes and architecting data systems
- Proficiency in at least one programming languages such as Python, Java, or Scala.
- At least 3 year of experience in the Big Data technologies(Hadoop, M/R, Hive, Spark/PySpark, Presto, Flume, Kafka, Flink etc.)
- At least 1 year of experience in the AWS platform services (Glue, Athena, EMR, Redshift etc.)
- Experience designing and implementing various components of a data platform, including data ingestion, storage, data warehousing, data orchestration
- Experience in writing, analyzing and debugging SQL queries
- Passionate and deep understanding about technologies in the Data area
- Solid communication and collaboration skills

  • Big Data Developer

    2 days ago

    Singapore SURPASS STAFFING PTE. LTD. Full time

    **Overview**: **Key Responsibilities**: - Design, develop, and optimize scalable data processing systems leveraging Hadoop, Flink, and other Big Data technologies. - Build and manage robust data pipelines for data ingestion, transformation, and analysis. - Create and implement efficient data models to support effective data storage and retrieval. -...

  • Big Data Developer

    2 weeks ago

    Singapore Zone IT Solutions Full time

    We are looking for Big Data Developers in the vibrant city of Singapore. This is a fantastic opportunity for someone who is passionate about big data and wants to take their career to new heights. **Requirements**: - Minimum of 5 years of experience as a Big Data Developer - Strong knowledge and experience with Big Data technologies such as Hadoop, Spark,...

  • Big Data Developer

    15 hours ago

    Singapore ALMR CONSULTING PTE. LTD. Full time

    **Responsibilities**: - Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions - Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. - Write efficient and optimised code in programming languages...

  • Big Data Developer

    2 weeks ago

    Singapore DADACONSULTANTS PTE. LTD. Full time $80,000 - $120,000 per year

    My ClientIt is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the dynamic team. The role...

  • Big Data Developer

    14 hours ago

    Singapore ITCAN Pte. Ltd. Full time

    **Must Have**: - Strong foundational knowledge of data structures and algorithms - Experience in Java programming, Relational/NoSQL database, and SQL - Exposure to one or more Big Data technologies like Hadoop, Spark, Hive, Kafka **Good To Have**: - Experience in development in a CI/CD environment and familiarity with CI/CD tools is required **Job...

  • Senior Big Data Developer

    7 days ago

    Singapore Peoplebank Singapore Pte Ltd Full time

    Overview We are seeking a skilled and experienced Senior Big Data Developer to join our technology team. The ideal candidate will be responsible for designing, developing, and maintaining high-performance big data solutions, while working collaboratively within a structured Agile development environment. Responsibilities Analyze functional specifications and...

  • Senior Big Data Developer

    3 days ago

    Singapore Information Tech Consultants Full time

    Description Location: Onsite (Relocation to UK) Experience: 14-18 years Education: Bachelors in Science (IT/Computer Science/Engineer) Employment Type: Full-Time About Us We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part of an exciting growth phase, we are looking for a...

  • Senior Big Data Developer

    1 day ago

    Singapore Information Tech Consultants Full time

    Description Location: Onsite (Relocation to UK)Experience: 14-18 years Education: Bachelors in Science (IT/Computer Science/Engineer)Employment Type: Full-Time About Us We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part of an exciting growth phase, we are looking for a...

  • Senior Big Data Developer

    1 day ago

    Singapore Information Tech Consultants Full time

    Location: Onsite (Relocation to UK)Experience: 14-18 years Education: Bachelors in Science (IT/Computer Science/Engineer)Employment Type: Full-Time About Us We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part of an exciting growth phase, we are looking for a Senior Big Data...

  • Big Data Architect

    2 weeks ago

    Singapore Unison Consulting Pte Ltd Full time

    Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. - Optimize data...