Spark/hadoop Engineer

**Key Responsibilities** - As part of the security operation teams, operate, support and maintain a Hadoop Date Lake environment in a dedicated customer environment - Perform data engineering to extract, transform, load for data science analysis - Work with customer’s and internal data science team to design effective data models for optimal storage and...

**Responsibilities**: - Design, implement, and maintain data pipelines for the migration of data from on-premises systems to Hadoop-based platforms. - Develop and optimize data processing jobs using Spark, Hive, and Python. - Manage job orchestration and scheduling using Control-M, ensuring timely and accurate data delivery. - Collaborate with...

We are seeking a skilled Hadoop Security & Compliance Engineer to design and maintain secure, compliant, and high-performing enterprise data platforms. The role involves implementing and managing Hadoop ecosystem security , ensuring data governance , and supporting regulatory compliance across Cloudera CDP/CDH environments.Key Responsibilities:Configure and...

Key Responsibilities: - Install, configure, and maintain Hadoop clusters (HDFS, YARN, Hive, Spark, Kafka, Zookeeper). - Perform capacity planning, performance tuning, upgrades, and patch management. - Manage user access, Kerberos authentication, Ranger/Sentry policies, and data security controls. - Monitor system health and troubleshoot performance or...

**Responsibilities**: - Responsible for Hadoop development and implementation for data ingestion on Hadoop technologies - Required to have sound knowledge and implementation experience to build Data warehouse / Data Mart using structured / unstructured data for both near real-time & batch processing - Hands on experience in complex code development and...

**Responsibilities**: - Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data - Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch - Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and...

We are looking for an experienced Hadoop Administrator to manage, optimize, and support enterprise-level Big Data platforms running on Cloudera or Hortonworks distributions. The ideal candidate will ensure platform stability, performance, and security across complex data ecosystems.Key Responsibilities:Install, configure, and maintain Hadoop clusters (HDFS,...

We are seeking a Hadoop Cloud Integration Specialist to design, implement, and manage hybrid data platforms integrating on-premise Hadoop clusters with cloud environments (AWS, Azure, or GCP). The role focuses on data migration, automation, and performance optimization across distributed systems. **Key Responsibilities**: - Integrate and migrate...

Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Trinity Consulting Services (\"TRINITY\")Professional Consulting | Empowering PEOPLE & BUSINESS | Servant Leader | Diversity & Inclusion Leader | Character before Credentials | We Are Hiring... · Must have minimum 3 - 5 years of software development experience....

We are seeking a Hadoop Cloud Integration Specialist to design, implement, and manage hybrid data platforms integrating on-premise Hadoop clusters with cloud environments (AWS, Azure, or GCP). The role focuses on data migration, automation, and performance optimization across distributed systems.Key Responsibilities:Integrate and migrate Hadoop/Cloudera...