Hadoop Specialist

2 weeks ago

Singapore CONSULGURU PTE. LTD. Full time

**Job Requirements**:

- 10+ consecutive years in the software engineering profession, in which 3+ years of hands-on experience in Hadoop eco system.
- Must have 2+ years experience as a Hadoop Technical Lead / Architect.
- Must have strong experience with design, development, and analytical skills in handling both structured and unstructured data.
- Should have led the design and implementation of an E2E Big Data-warehousing platform including source system integration and data lake implementation Must be willing to work in a fast-paced environment with an onshore and offshore distributed Agile teams.
- Must have the ability to develop and maintain strong collaborative relationships at all levels across IT and Business Stakeholders.
- Must have the ability to prioritize multiple tasks and deal with urgent requests in a demanding environment.
- Excellent written and oral communication skills. Adept and presenting complex topics, influencing and executing with timely / actionable follow-through

**Job responsibilities**:

- Handling Hadoop Log Files.
- Supervising Hadoop jobs using scheduler & optimizing it.
- Assist Map Reduce programs running on the Hadoop cluster
- Responsible for Hadoop development and implementation.
- Pre-processing using Hive, spark, python.
- Analyze vast amount of data and gain insights from it.
- Preserve security and data privacy.
- Develop highly scalable and services with exceptional performance, for data tracking.
- High-speed querying.
- Conduct POC independently and responsible to build, test & performance tuning in Hadoop ecosystem.
- Come up with best practices.
- Responsible for troubleshooting and development on Hadoop technologies like HDFS, Hive, Sqoop, Zookeeper, Spark, MapReduce2, YARN, HBase, Tez, Kafka, kibana, solr, elastic search.
- Translate, load and exhibit unrelated data sets in various formats and sources like JSON, text files, Kafka queues, and log data.
- Responsible to build Data warehouse Data Mart using structured / unstructured data for both near real-time & batch processing.

  • Data Transformation Specialist

    2 hours ago

    Singapore beBeeTransformation Full time

    Data Transformation Specialist Transforming data is a critical function in today's digital landscape. As a Data Transformation Specialist, you will be responsible for using various tools and techniques to extract, transform, and load data from multiple sources. Design and implement ETL (Extract, Transform, Load) processes to migrate data between systems....

  • System Support Specialist

    2 days ago

    Singapore beBeeDataPlatformSupportEngineer Full time $80,000 - $120,000

    System Support SpecialistWe are seeking a highly skilled System Support Specialist to join our team. The ideal candidate will have a strong background in IT, with experience in supporting complex systems and troubleshooting technical issues.This is a fantastic opportunity for someone who is passionate about technology and wants to work in a fast-paced...

  • Data Transformation Specialist

    2 days ago

    Singapore beBeeTransformation Full time $80,000 - $150,000

    Data Transformation SpecialistTransforming data is a critical function in today's digital landscape. As a Data Transformation Specialist, you will be responsible for using various tools and techniques to extract, transform, and load data from multiple sources.Design and implement ETL (Extract, Transform, Load) processes to migrate data between...

  • Cloud Infrastructure Specialist

    6 days ago

    Singapore beBeeCloud Full time $80,000 - $120,000

    Job Title: Cloud Infrastructure SpecialistAs a Cloud Infrastructure Specialist, you will be responsible for designing and implementing scalable cloud-based infrastructure solutions.Experience in Docker, Ansible, Puppet, Mesos, and Kubernetes is required.Strong knowledge of Distributed Systems, including Hadoop and containers is essential.Proficiency in Perl...

  • Data Analytics Specialist

    2 days ago

    Singapore beBeeDataAnalysis Full time $100,000 - $120,000

    Job Title: Data Analytics SpecialistWe are seeking a highly skilled Data Analytics Specialist to join our team. In this role, you will be responsible for developing and optimizing SAS programs for data analysis, reporting, and visualization.Key Responsibilities:Develop, modify, and optimize SAS programs for data analysis, reporting, and...

  • Cloud Infrastructure Specialist

    24 hours ago

    Singapore beBeeEngineering Full time $90,000 - $120,000

    Job DescriptionWe are seeking a professional to join our team as a Staff Systems Engineer. This role involves designing, building and managing Hadoop and Kafka clusters on Cloud - AWS, GCP and Azure platforms.Develop and maintain high-performance, reliable and scalable Open Source Apache Hadoop and Big Data clusters.Design and implement tools and processes...

  • Data Insights Specialist

    2 weeks ago

    Singapore beBeeDataInsights Full time

    AI-Powered Data Insights SpecialistWe are seeking a highly skilled Data Scientist to join our team. As an AI-powered Data Insights Specialist, you will be responsible for developing and implementing data-driven solutions that drive business growth.Key Responsibilities:Design and develop complex data models and algorithms to solve real-world problems.Analyze...

  • Senior Data Specialist

    2 days ago

    Singapore beBeeData Full time $4,000 - $5,500

    Job DescriptionWe are seeking an experienced professional to fill the role of Data Engineer within our project team. The successful candidate will be responsible for building and optimizing Spark-based applications within a Hadoop ecosystem.The ideal candidate will have hands-on experience in developing and maintaining Spark applications in PySpark/Scala for...

  • Data Specialist

    22 hours ago

    Singapore AURELIUS SOFTWARE PTE. LTD. Full time

    Roles & Responsibilities Mandatory Skills : (Azure OR AWS) AND ("Apache Spark" OR Hive OR Hadoop) AND ("Spark Streaming" OR "Apache Flink" OR Kafka) AND NoSQL AND Datamodeling AND Shell OR Python Job Description: Mandatory Skills :(SQL Server / Oracle / DB2 / Netezza) – at-least good working knowledge in 2 of these DB Apache Spark Streaming or...

  • Senior Systems Implementation Specialist

    6 days ago

    Singapore beBeeSystemImplementation Full time $90,000 - $120,000

    Job Title:Senior Systems Implementation Specialist Job Description:As a Senior Systems Implementation Specialist, you will lead end-to-end system implementation projects for the MLS system. This involves collaborating with cross-functional teams and external vendors to drive solution design, technical documentation, testing, and deployment while ensuring...