Big Data Developer

2 days ago


Singapore NodeFlair Full time

**Job Summary**:
**Job Type**
Permanent

**Seniority**

Mid

**Years of Experience**
At least 3 years

**Tech Stacks**
ETL AWS Analytics R EMR pySpark Glue Athena RedShift Flume Presto Java Hive Spark kafka Flink SQL Scala Python

**Responsibility**:

- Designing and build scalable data pipelines to extract, transform, and load data from a variety of sources with specific time latency.
- Maintaining and optimizing existing data pipelines and automate data workflows such as data ingestion, aggregation, and ETL processing.
- Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
- Design and implement reliable, scalable, robust and extensible big data systems that support core products and business (e.g. growth analysis, money-laundering analysis and multi-dimensional analysis)
- Research and evaluate latest data related technologies and tools to keep our data platform updated and competitive

**Requirements**:

- Proficiency in developing robust data pipelines, including data collection and ETL(Extract, Transform, Load) processes and architecting data systems
- Proficiency in at least one programming languages such as Python, Java, or Scala.
- At least 3 year of experience in the Big Data technologies(Hadoop, M/R, Hive, Spark/PySpark, Presto, Flume, Kafka, Flink etc.)
- At least 1 year of experience in the AWS platform services (Glue, Athena, EMR, Redshift etc.)
- Experience designing and implementing various components of a data platform, including data ingestion, storage, data warehousing, data orchestration
- Experience in writing, analyzing and debugging SQL queries
- Passionate and deep understanding about technologies in the Data area
- Solid communication and collaboration skills


  • Big Data Developer

    2 days ago


    Singapore Zone IT Solutions Full time

    We are looking for Big Data Developers in the vibrant city of Singapore. This is a fantastic opportunity for someone who is passionate about big data and wants to take their career to new heights. **Requirements**: - Minimum of 5 years of experience as a Big Data Developer - Strong knowledge and experience with Big Data technologies such as Hadoop, Spark,...

  • Big Data Developer

    1 week ago


    Singapore Pan Asia Group Resources Full time

    JD: - Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python; - Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc. - Experience with Banking domain is preferable. - Strong understanding of SDLC processes including all the project documentations. - Ability to...

  • Big Data Developer

    2 weeks ago


    Singapore TECHNOALLY PTE. LTD. Full time

    Requirement - 6+ years of experience in the field of Software Engineering with good communication skills. - Atleast 4 years of hands on experience in Hadoop, Hive and Oozie. - Atleast 2 years of hands on experience in Apache spark programming. - Atleast 2 years of experience working with AWS technologies. - Good knowledge and understanding on current big...

  • Big Data Developer

    2 weeks ago


    Singapore ROADGET BUSINESS PTE. LTD. Full time

    **Responsibilities**: - Responsible for analyzing data requirements and provide data technology solution for business departments - Responsible for data integration between the business system and big data platform, build a data warehouse - Responsible for business data ETL development, offline and real-time data development on the current big data...

  • Big Data Developer

    6 days ago


    Singapore Zenith Infotech Pte Ltd. Full time

    Join to apply for the Big Data Developer role at Zenith Infotech . Get AI-powered advice on this job and more exclusive features. This range is provided by Zenith Infotech. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Job Scope: Using the Talend ETL toolset, to create new and maintain...


  • Singapore beBeeData Full time $60,000 - $80,000

    Job Overview:We are seeking a highly skilled professional to fill the role of Assistant Big Data Development Engineer. As a key contributor to our big data development team, you will be responsible for designing and building robust data warehouses and performing data analysis based on business requirements.Key Responsibilities:Develop and implement big data...

  • Big Data Developer

    7 days ago


    Singapore ROADGET BUSINESS PTE. LTD. Full time

    **Responsibilities**: - Responsible for analyzing data requirements and provide data technology solution for business departments. - Responsible for data integration between the business system and big data platform, build data warehouse. - Responsible for business data ETL development, offline and real-time data development on the current big data...


  • Singapore beBeeBigDataDeveloper Full time $90,000 - $120,000

    As a Senior Big Data Developer, you will be working on designing and developing scalable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses and data lakes.Your key responsibilities will include collaborating with cross-functional teams to understand data requirements and deliver high-quality data solutions....

  • Big Data Architect

    5 days ago


    Singapore People Profilers Full time

    Job Description: - Provide leadership and drive architecture and the design of Big Data solutions - Design and implement high performance systems supporting large volume real time and batched data processes - Ensure implementation Data Governance and security best practices for Big Data environments - Provide technical guidance and mentorship to the team to...

  • BIg Data Developer

    1 day ago


    Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    Roles & ResponsibilitiesABOUT THE COMPANYZenith Infotech (S) Pte Ltd. was started in 1997, primarily with the vision of offering state-of-the-art IT Professionals and solutions to various organizations and thereby helping them increase their productivity and competitiveness. From deployment of one person to formation of whole IT teams, Zenith Infotech has...