Big Data Engineer

1 week ago


Singapore Capgemini Full time

Capgemini SingaporePosted 3 hours ago Hybrid Permanent S$70k - S$90k
- Posted by
- Nirzham Shah- Talent Acquisition ManagerFollow
- A Big Data Engineer is an information technology (IT) professional who is responsible for designing, building, testing and maintaining complex data processing systems that work with large data sets.

**Job responsibilities**:

- Work with Consumer Banking Business Analysts team to understand existing SAS code logic written by techno-functional users.
- Develop the SAS logic in Big Data environment, using Spark, Scala and Pyspark utilizing Hadoop ecosystem of the inhouse Data Lake
- Perform unit testing and system integration testing.
- Work closely with Business Analysts team to review the test results and obtain sign-off.
- Deploy the new code in the Production environment.
- Prepare necessary design/operations documentation for future usage.
- Perform peers Code quality review and be gatekeeper for quality checks.

**Requirements**:

- Strong understanding and hands on experience of Big Data technologies like CDH, Hadoop/HDFS, S3, Colibra, Claudera Workbench, etc.
- Technical proficiency on data mining techniques and performance optimization
- Adequate knowledge of database systems (RDBMS, MariaDB, SQL, NOSQL)
- Experience on SAS will be beneficial but not mandatory.
- Handling of reporting packages (Tableau, QlikView) is nice to have.
- AWS experience is nice to have.
- Degree in Computer Science or Engineering is a must.
- Good problem diagnosis and creative problem-solving skills
- Passion to learn and master diverse new technologies in the open source community
- Accuracy and attention to detail
- Team-working, Verbal, and Written communication skills


  • Data Engineer

    1 day ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Data Engineer

    1 day ago


    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Engineer

    3 days ago


    Singapore SAKSOFT PTE LIMITED Full time

    Experience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...

  • Big Data Engineer

    2 weeks ago


    Singapore UNISON Group Full time

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    1 week ago


    Singapore Unison Group Full time $104,000 - $130,878 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    4 weeks ago


    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...

  • Big Data Engineer

    3 weeks ago


    Singapore Unison Consulting Full time

    Get AI-powered advice on this job and more exclusive features. We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing,...

  • Big Data Engineer

    3 weeks ago


    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...


  • Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation.Key Responsibilities: Design and develop...