
Big Data Developer
12 hours ago
Requirement - 6+ years of experience in the field of Software Engineering with good communication skills. - Atleast 4 years of hands on experience in Hadoop, Hive and Oozie. - Atleast 2 years of hands on experience in Apache spark programming. - Atleast 2 years of experience working with AWS technologies. - Good knowledge and understanding on current big data technolgies. - Atleast 5 years of experience working on RDBMS systems such as Oracle, SQL Server and expert level SQL/PL-SQL programming skills. - 3 years of experience working on Java/Python and experience in writing shell scrpits. Good knowledge and **hands-on experience **with Big Data platforms covering - Hadoop data platform/tools experience on anyone of these distribution - **Cloudera **/ Hortonworks - **Must Have Hands on Developing experience in Apache Spark Framework/API's (1.6 / 2.x) - Streaming, Core, SQL**: - **Must have Strong programming language background preferably on Scala or python along with SQL on Big Data context**: - **Must have hands on experience in Big data Ingestion tools like Kafka, Sqoop, Flume with integration on DB, Message Queue, Flat files.**: - Basic Knowledge of NoSQL storage (Hive / HBase / Impala / Kudu) & Hadoop File Format (Avro / Parquet) - Basic Working knowledge Hadoop connectors across components like Kafka>Spark, Sqoop>HDFS, Flume>Kafka, Spark>HBase, Spark>Impala - Good analytical and problem-solving skills with proven communication and experience in working Customer facing roles. - Cloudera Certified developer certification, will be preferred
-
Big Data Developer
1 week ago
Singapore SURPASS STAFFING PTE. LTD. Full time**Overview**: **Key Responsibilities**: - Design, develop, and optimize scalable data processing systems leveraging Hadoop, Flink, and other Big Data technologies. - Build and manage robust data pipelines for data ingestion, transformation, and analysis. - Create and implement efficient data models to support effective data storage and retrieval. -...
-
Big Data Developer
2 weeks ago
Singapore DADACONSULTANTS PTE. LTD. Full time $80,000 - $120,000 per yearMy ClientIt is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the dynamic team. The role...
-
Big Data Engineer
1 week ago
Singapore ALMR CONSULTING PTE. LTD. Full timeJob Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...
-
Big Data Architect
6 days ago
Singapore IKIGAI ENABLERS PTE. LTD. Full timePlan, design, implement, deliver, and maintain big data platforms to support the organization's data infrastructure needs. - Develop real-time and offline data collection, calculation, storage, and processing solutions using advanced data technologies while ensuring adherence to standards and metrics. - Establish standardized data services within the data...
-
Big Data Engineer
2 weeks ago
Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per yearRoles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...
-
Big Data Engineer
2 weeks ago
Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per yearJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...
-
Big Data Engineer
1 week ago
Singapore DADACONSULTANTS PTE. LTD. Full timeBuilt end-to-end data pipelines and automation of data quality reporting process to ensure data integrity; - Participate in the construction of a unified data warehouse in hierarchical architecture and support ETL requirements of various features; - Participate in building metrics and provide data solutions based on the business; **Job Requirement**: -...
-
Senior Java Developer
2 weeks ago
Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full timeSenior Java Developer - Big Data ASTEK is a technology and engineering consulting firm based in France. We have been around for over 30 years a community of more than 7200 passionate experts empowering clients in 22 countries throughout Europe, APAC, Middle East and the Americas. The department develops and maintains global Risk and Finance applications...
-
Big Data Engineer
5 days ago
Singapore Unison Group Full time $120,000 - $180,000 per yearWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...
-
Big Data Engineer
13 hours ago
Singapore BASIL TECHNOLOGIES PTE. LTD. Full timeDevelop data processing pipelines for ingestion, modelling, analysis, mining and reporting with Enterprise Big Data Lake - Responsible for the code writing of the core module of the system - Develop POC and build data pipeline architecture using of the overall technical framework of the software - Work closely with teams ensure timely delivery of...