
Bigdata Engineer(Scala,hadoop,pyspark)
2 weeks ago
**Requirements**:
- University Graduate in Computer Science or Related discipline
- 8 years of experience in developing, maintaining and supporting Enterprise Class Big Data Applications, preferably in banking environment
- Expertise in **Big Data technologies/tools/platforms such as Hadoop, HDFS, Hive, Impala, HDFS, Presto, Spark, Hive, Impala,Zeppelin, Yarn, Cloudera, Hortonworks**:
- Experience in Relational Databases.
- Knowledge and experience in coding and performance tuning of Spark jobs. Java Spark preferred but not compulsory
- Establish and adhere to best practices relating to Apache Spark programming
- Responsible for understanding functional/non-functional requirements and implement them in Apache Spark.
- Experience in usage of CI/CD tools - Jenkins, Git, Bitbucket.
- Experience in writing Linux basic Shell Scripts
- Knowledge and experience in Apache Spark batch and streaming framework
- Knowledge of working with different file formats like Parquet, ORC, AVRO and JSON
- Knowledge of Micro Services architecture
- Knowledge of S3 is added advantage
- Ability to work proactively, independently and with cross-functional and cross-regional teams
- Strong communication and analytical skills and experience in Agile projects
-
Big Data Engineer
22 hours ago
Singapore RIDIK SOFTWARE SOLUTIONS PTE. LTD. Full timeShould have strong knowledge in Bigdata environment: Hadoop, PySpark, Spark. - Knowledge or experience in Python is added advantage. - Should be a quick learner and must be willing to learn new technologies - Should have knowledge PLSQL with Oracle, PLSQL with Bigdata knowledge
-
Senior Software Development Engineer
1 week ago
Singapore QUESSCORP SOLUTIONS PTE. LTD. Full time**Job Description**: - Software design, Bigdata,Scala & Spark development, automated testing of new and existing components in an Agile, DevOps and dynamic environment - Promoting development standards, code reviews, mentoring, and knowledge sharing - Production support & troubleshooting. - Implement the tools and processes, handling performance, scale,...
-
Bigdata Solution Architect
1 week ago
Singapore SINGDATA CLOUD PTE. LTD. Full time1. Provide consulting service to the key customers of Singdata Lakehouse, 2. Work with local sales team to ensure that our products can meet the customer’s business needs. 3. Solution and reference build-up and reproduce, develop technical expertise and deliver cloud based Bigdata solutions. 4. Knowledge sharing with customers and partners, for example,...
-
Test Engineer
1 week ago
Singapore TECHCOM SOLUTIONS (SINGAPORE) PTE. LTD. Full time5+ years of Java with QA Automation testing experience - Excellent coding skills in Java - Bigdata Automation - Knowledge on API automation using Rest assured or similar technology for REST API's - Experience with software builds, testing and continuous integration tools preferably Jenkins - Knowledge of object-oriented programming, distributed systems,...
-
Data Engineer
2 weeks ago
Singapore OX CONSULTANCY PTE. LTD. Full time**Requirements**: - Sr Bigdata Engineer with atleast 4+ years of experience in **big data platform **. - Must have hands-on experience with cloudera Hadoop and its tools like - **Hive, Impala and Spark **(all three tools must). **HDFS, YARN.**: - Expert in writing Complex **SQL Queries.**: - Able to write **Linux Shell Scripts **. - Experience building or...
-
Big Data Engineer
2 weeks ago
Singapore ALTROCKS TECH PTE. LTD. Full timeBachelor's or Master's degree in Computer Science, Data Science, or a related field. - At least 3 years of experience managing and maintaining Hadoop or Cloudera Data Platform. - Strong knowledge of BigData platform migration and upgrade activities. - Experience with MSSQL, MySQL, Oracle, PostgreSQL and other database technologies. - Proficiency in...
-
Senior Data Scientist
3 days ago
Singapore EXL Corp Full time**Role : Senior Data Scientist** **Job Type : Full time permanent** **Location : Singapore** **The broad area of the role covers**: - Translate customer pain-points into problem statements, architect analytics solution, and engagingly present results and learnings to both technical and non-technical audiences. - Develop and manage entire end-to-end...
-
Bigdata Developer
2 weeks ago
Singapore SAKSOFT PTE LIMITED Full timeRole: Developer Expereince: 6+ yrs. **Job Description**: - More than 4 years IT experience in development which includes ETL and data processing (E.g. Data warehouse, Data mart, Data pipelines, Data lake development) - Minimum 2 years’ hands-on experience in Hadoop/Big Data development - Hands on with Cloudera Hadoop technology stack, including platform...
-
Singapore Shopee Full timeSite Reliability Engineer, Data Infrastructure (Campus Recruitment 2026)Join to apply for the Site Reliability Engineer, Data Infrastructure (Campus Recruitment 2026) role at Shopee. About The Team Shopee will be prioritizing applicants who have a current right to work in Singapore, and do not require Shopee sponsorship of a visa. Kindly note that you can...
-
Singapore Shopee Full timeSite Reliability Engineer, Data Infrastructure (Campus Recruitment 2026)Join to apply for the Site Reliability Engineer, Data Infrastructure (Campus Recruitment 2026) role at Shopee. About The Team Shopee will be prioritizing applicants who have a current right to work in Singapore, and do not require Shopee sponsorship of a visa. Kindly note that you can...