Big Data Engineer
1 day ago
Capgemini SingaporePosted 3 hours ago Hybrid Permanent S$70k - S$90k
- Posted by
- Nirzham Shah- Talent Acquisition ManagerFollow
- A Big Data Engineer is an information technology (IT) professional who is responsible for designing, building, testing and maintaining complex data processing systems that work with large data sets.
**Job responsibilities**:
- Work with Consumer Banking Business Analysts team to understand existing SAS code logic written by techno-functional users.
- Develop the SAS logic in Big Data environment, using Spark, Scala and Pyspark utilizing Hadoop ecosystem of the inhouse Data Lake
- Perform unit testing and system integration testing.
- Work closely with Business Analysts team to review the test results and obtain sign-off.
- Deploy the new code in the Production environment.
- Prepare necessary design/operations documentation for future usage.
- Perform peers Code quality review and be gatekeeper for quality checks.
**Requirements**:
- Strong understanding and hands on experience of Big Data technologies like CDH, Hadoop/HDFS, S3, Colibra, Claudera Workbench, etc.
- Technical proficiency on data mining techniques and performance optimization
- Adequate knowledge of database systems (RDBMS, MariaDB, SQL, NOSQL)
- Experience on SAS will be beneficial but not mandatory.
- Handling of reporting packages (Tableau, QlikView) is nice to have.
- AWS experience is nice to have.
- Degree in Computer Science or Engineering is a must.
- Good problem diagnosis and creative problem-solving skills
- Passion to learn and master diverse new technologies in the open source community
- Accuracy and attention to detail
- Team-working, Verbal, and Written communication skills
-
Big Data Engineer
2 weeks ago
Singapore ALMR CONSULTING PTE. LTD. Full timeJob Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...
-
Big Data Engineer
1 week ago
Singapore Unison Group Full time $120,000 - $180,000 per yearWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...
-
Big Data Test Engineer
2 weeks ago
Singapore Patsnap Full timeAbout PatSnap PatSnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...
-
Senior Engineer
2 weeks ago
Singapore Reeracoen Singapore Pte Ltd Full timeOur client is a dynamic technology consulting company specializing in digital transformation and innovative solutions. They are currently looking for a Senior Engineer (Big Data) to join their tech engineering team. - 【 What you will be doing 】- Responsible for designing, creating, and managing large-scale data processing systems. - Ensure that systems...
-
Big Data Test Engineer
2 weeks ago
Singapore Patsnap Full time $80,000 - $120,000 per yearAbout PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...
-
Big Data Architect
1 day ago
Singapore Direct Search Global Full time**Job Detail**: - Job Reference - P5549 **Role**: Installing and maintaining operating environments Support in the Big Data stack area of responsibility Align the work of ongoing projects with the organization’s big data solution. Educating and supporting additional O&M team members and partners Accountable for the production environment’s Big Data...
-
Big Data Engineer
2 weeks ago
Singapore DADACONSULTANTS PTE. LTD. Full timeBuilt end-to-end data pipelines and automation of data quality reporting process to ensure data integrity; - Participate in the construction of a unified data warehouse in hierarchical architecture and support ETL requirements of various features; - Participate in building metrics and provide data solutions based on the business; **Job Requirement**: -...
-
Big Data Engineer, Data Platform
3 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...
-
Senior Site Reliability Engineer
1 week ago
Singapore Shopee Full timeDepartmentEngineering and Technology- LevelExperienced (Individual Contributor)- LocationSingaporeThe Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not...
-
Big Data Engineer
3 days ago
Singapore BASIL TECHNOLOGIES PTE. LTD. Full timeDevelop data processing pipelines for ingestion, modelling, analysis, mining and reporting with Enterprise Big Data Lake - Responsible for the code writing of the core module of the system - Develop POC and build data pipeline architecture using of the overall technical framework of the software - Work closely with teams ensure timely delivery of...