Senior Data Engineer( Hive SQL, Hadoop, Cloudera)
2 days ago
Roles & Responsibilities Responsibilities • Migrate existing data warehouse and data model from MariaDB to Hadoop Big Data Cloudera on-premises platform. •Develop and optimize SQL, Hive SQL, and Spark scripts to ensure efficient data processing. •Design and implement data models to support business requirements and optimize performance. •Collaborate with cross-functional teams to understand data requirements and ensure data integrity throughout the migration process.•Develop and execute test plans to validate data accuracy and system performance.•Coordinate with stakeholders (internal) to plan and execute production deployments.•Schedule and monitor jobs using Autosys to ensure timely execution and minimize downtime.•Provide technical expertise and guidance to team members throughout the migration project.•Document processes, procedures, technical specifications, and best practices to facilitate knowledge sharing and ensure scalability.•Create and maintain unit test case documents to ensure code quality and reliability. Requirements: • Bachelor’s (or Higher) degree in computer science, Engineering, or a related field. •Proven experience of 5+ years in data engineering and migration projects for big data (Hortonworks / Cloudera) •Strong hands-on experience on Cloudera and related ecosystem components. •Strong experience in implementing ETL (Extract, Transform, Load) processes.•Highly proficient in SQL, Hive SQL, Spark, and data modeling.•Strong understanding of the production deployment process.•Experience with scheduling jobs using Autosys or similar.•Experience with version control systems such as Bitbucket, GIT etc.•Ability to troubleshoot and resolve data related issues efficiently.•Good communication and interpersonal skills•Experience with Dataiku is a plus, but not mandatory. Tell employers what skills you have Version ControlScalabilityBig DataData ModelingInterpersonal SkillsHadoopETLMariaDBReliabilityData EngineeringSQLAutosysSchedulingBusiness Requirements
-
Senior Data Engineer
2 days ago
Singapore NEPTUNEZ SINGAPORE PTE. LTD. Full timeResponsibilities Migrate existing data warehouse and data model from MariaDB to Hadoop Big Data Cloudera on-premises platform. Develop and optimize SQL, Hive SQL, and Spark scripts to ensure efficient data processing. Design and implement data models to support business requirements and optimize performance. Collaborate with cross-functional teams to...
-
Data Engineer
2 weeks ago
Singapore Unison Group Full timeOverview We are looking for a skilled Data Engineer with 5 years of hands-on experience in designing, developing, and optimizing big data pipelines and solutions. The ideal candidate will have strong expertise in SQL, Python, Apache Spark, Hive, and Hadoop ecosystems and will be responsible for building scalable data platforms to support business...
-
Resident Engineer
1 week ago
Singapore Peoplebank Full time**Resident Engineer (Cloudera)** - 12 months contract role, with potential extension **Our Client** - Multinational tech company **The Opportunity** We are looking for a Resident Engineer with Hadoop skillset as well as infrastructure support skills. Job Responsibilities: - Cluster configuration and deployment details to integrate with the data center -...
-
Senior Data Engineer
2 days ago
Singapore EXASOFT PTE. LTD. Full time $120,000 - $180,000 per yearJob Description: We are seeking a skilled Data Engineer to do the migration of our existing data warehouse and data model from MariaDB to the Hadoop Big Data Cloudera on-premise platform. The ideal candidate must be proficient in SQL, Hive SQL, Spark, and data modeling. Additionally, they should possess a strong understanding of the production deployment...
-
BI Consultant-hadoop
7 days ago
Singapore IntersoftKK Full timeSingapore **Experience**: **Skills**: Mandatory Skills Hadoop Preferred Skills Brief Job Description - Hadoop planning, deployment and administration experience - Strong Linux skills - Experience in using Hive, Impala, Spark, HBase, SOLR, Zookeeper, Pig, Storm, Oozie - Familiar with HDFS, getting data into HDFS (Flume, Sqoop, REST interfaces, etc) -...
-
Data Engineer
2 weeks ago
Singapore ANTAS PTE. LTD. Full time $104,000 - $130,878 per yearPOSITION OVERVIEW : Software Development Analyst POSITION GENERAL DUTIES AND TASKS :Job Description: We are seeking a skilled Data Engineer to do the migration of our existing data warehouse and data model from MariaDB to the Hadoop Big Data Cloudera on-premise platform. The ideal candidate must be proficient in SQL, Hive SQL, Spark, and data modeling....
-
Hadoop Security
2 days ago
Singapore ANTAS PTE. LTD. Full time $80,000 - $120,000 per yearWe are seeking a skilled Hadoop Security & Compliance Engineer to design and maintain secure, compliant, and high-performing enterprise data platforms. The role involves implementing and managing Hadoop ecosystem security , ensuring data governance , and supporting regulatory compliance across Cloudera CDP/CDH environments.Key Responsibilities:Configure and...
-
Hadoop Administrator
2 days ago
Singapore ANTAS PTE. LTD. Full time $80,000 - $120,000 per yearWe are looking for an experienced Hadoop Administrator to manage, optimize, and support enterprise-level Big Data platforms running on Cloudera or Hortonworks distributions. The ideal candidate will ensure platform stability, performance, and security across complex data ecosystems.Key Responsibilities:Install, configure, and maintain Hadoop clusters (HDFS,...
-
Solutions Architect, Singapore
1 week ago
Singapore Cloudera Full timeSolutions Architect, Singapore page is loaded Solutions Architect, Singapore Apply remote type Remote locations Singapore-Remote time type Full time posted on Posted 30+ Days Ago job requisition id Business Area: Professional Services Seniority Level: Mid-Senior level Job Description: At Cloudera, we empower people to transform complex data into clear and...
-
Cloudera Platform Engineer
2 days ago
Singapore ANTAS PTE. LTD. Full time $120,000 - $180,000 per yearWe are seeking a Cloudera Platform Engineer to design, implement, and maintain enterprise-scale Cloudera Data Platform (CDP/CDH) environments supporting critical data workloads. The role involves cluster management, automation, performance tuning, and integration with cloud and DevOps ecosystems.Key Responsibilities:Install, configure, and manage Cloudera...