Hadoop Specialist
5 days ago
**Job Requirements**:
- 10+ consecutive years in the software engineering profession, in which 3+ years of hands-on experience in Hadoop eco system.
- Must have 2+ years experience as a Hadoop Technical Lead / Architect.
- Must have strong experience with design, development, and analytical skills in handling both structured and unstructured data.
- Should have led the design and implementation of an E2E Big Data-warehousing platform including source system integration and data lake implementation Must be willing to work in a fast-paced environment with an onshore and offshore distributed Agile teams.
- Must have the ability to develop and maintain strong collaborative relationships at all levels across IT and Business Stakeholders.
- Must have the ability to prioritize multiple tasks and deal with urgent requests in a demanding environment.
- Excellent written and oral communication skills. Adept and presenting complex topics, influencing and executing with timely / actionable follow-through
**Job responsibilities**:
- Handling Hadoop Log Files.
- Supervising Hadoop jobs using scheduler & optimizing it.
- Assist Map Reduce programs running on the Hadoop cluster
- Responsible for Hadoop development and implementation.
- Pre-processing using Hive, spark, python.
- Analyze vast amount of data and gain insights from it.
- Preserve security and data privacy.
- Develop highly scalable and services with exceptional performance, for data tracking.
- High-speed querying.
- Conduct POC independently and responsible to build, test & performance tuning in Hadoop ecosystem.
- Come up with best practices.
- Responsible for troubleshooting and development on Hadoop technologies like HDFS, Hive, Sqoop, Zookeeper, Spark, MapReduce2, YARN, HBase, Tez, Kafka, kibana, solr, elastic search.
- Translate, load and exhibit unrelated data sets in various formats and sources like JSON, text files, Kafka queues, and log data.
- Responsible to build Data warehouse Data Mart using structured / unstructured data for both near real-time & batch processing.
-
Hadoop Cloud Integration Specialist
3 days ago
Singapore ANTAS PTE. LTD. Full time $120,000 - $180,000 per yearWe are seeking a Hadoop Cloud Integration Specialist to design, implement, and manage hybrid data platforms integrating on-premise Hadoop clusters with cloud environments (AWS, Azure, or GCP). The role focuses on data migration, automation, and performance optimization across distributed systems.Key Responsibilities:Integrate and migrate Hadoop/Cloudera...
-
Software Development Senior Specialist
1 week ago
Singapore NTT DATA Full timeThe support specialist will be a techno-functional support team member for the Enterprise Datawarehouse (EDW) under IT BAU team. He/she is responsible for ensuring system availability and timely deliverables for datamarts for various business unit like Finance, regulatory, Campaign. **Roles/Responsibilities** - Responsible to provide BAU support for...
-
Software Development Senior Specialist
1 week ago
Central Singapore Hashmap Full timeThe support specialist will be a techno-functional support team member for the Enterprise Datawarehouse (EDW) under IT BAU team. He/she is responsible for ensuring system availability and timely deliverables for datamarts for various business unit like Finance, regulatory, Campaign. **Roles/Responsibilities** - Responsible to provide BAU support for...
-
Senior Compliance Data Engineer
7 days ago
Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full timeA leading consultancy firm based in Singapore is seeking a Compliance Technology / Data Engineering Specialist to lead design and development of data solutions and analytics platforms. The ideal candidate has over 10 years of experience in data engineering, particularly in financial compliance sectors. Responsibilities include overseeing data quality and...
-
Cloudera CDP Migration Specialist
3 days ago
Singapore ANTAS PTE. LTD. Full time $100,000 - $150,000 per yearWe are seeking an experienced Cloudera CDP Migration Specialist to lead the end-to-end migration of enterprise data platforms from Cloudera CDH/HDP to Cloudera Data Platform (CDP). The role requires deep technical expertise in cluster upgrades, data migration, security configuration, and performance optimization within hybrid or cloud environments.Key...
-
Senior Manager, Data Engineering Specialist
3 days ago
Singapore Visa Full time**Company Description** Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and...
-
SAP Hana Specialist
3 days ago
Singapore Unison Consulting Pte Ltd Full timeWe are seeking a skilled professional with strong expertise in SAP HANA Cloud and HANA DB, proficient in modeling and optimizing data workflows. Hands-on experience with SAP BTP integrating HANA DB and Datasphere is essential. Must have deep knowledge in using BTP services to connect and ingest data from non-SAP sources like Oracle and Hadoop into HANA...
-
Specialist Solutions Architect
2 weeks ago
Singapore Databricks Full timeAs a Specialist Solutions Architect (SSA), you will guide customers in building big data solutions on Databricks that span a large variety of use cases. These are customer-facing roles, working with and supporting the Solution Architects, requiring hands-on production experience with Apache Spark and expertise in other data technologies. SSAs help customers...
-
Sr. Specialist Solutions Engineer
2 days ago
Singapore Databricks Full timeBeing part of the Specialist Solutions Architect (SSA) organisation, you will guide customers in building big data solutions on Databricks that span a large variety of use cases. You will be in a leading customer-facing role, working alongside and in support of the Solution Architects, which requires hands-on production experience with Apache Spark and...
-
Data Analyst, Regional Business Intelligence
5 days ago
Singapore Shopee Full timeDepartment Business Intelligence and Data Analytics - LevelEntry Level - LocationSingapore The Business Intelligence and Data Analytics team plays a critical role in conducting close-loop data-driven business iterations. As business intelligence specialists and data analysts, our scope of work is not limited to just performance monitoring and reporting, but...