Architect (Unity Catalog & Hive Metastore)
1 week ago
Architect (Unity Catalog & Hive Metastore)
You have a job opportunity as an Architect-1/ Data Engineer/ Migration Specialist for a contract duration of 6-7 months (ext), working remotely in UK Shift. Let's dive into the qualifications, skills, responsibilities, and role and responsibilities for this position:Qualifications & Skills:- You should possess 9-10 years of hands-on experience in data platform engineering or migration projects.- Proficiency in tools such as Databricks, Unity Catalog, Hive Metastore, and UCX assessment tools is essential.- Cloud platform expertise, specifically in Azure, including IAM and networking setup, is required.- Familiarity with BI/reporting tools integration and security policy governance is a plus.- Strong documentation and cross-functional collaboration skills are necessary.Good to have:- Experience with cluster policy design and UC-enabled environments.- Knowledge of ACL mapping strategies and data governance best practices.- Ability to create migration dashboards or reports for leadership visibility.Role & Responsibilities:HMS Assessment & Migration Planning:- Evaluate Hive Metastore (HMS) state, migration complexity, and readiness using UCX Assessment Tool.- Identify external and managed tables, BI dependencies, and environmental separation needs.- Prepare a detailed migration plan and finalize a migration runbook.Platform Setup:- Configure cloud resources like storage accounts, IAM roles, and networking.- Set up Unity Catalog Metastore(s) and assign workspace mappings.- Establish and validate admin roles including
-
Cloud Data Architect
2 weeks ago
Singapore beBeeCloudDataArchitect Full time $90,000 - $120,000Job Title: Cloud Data ArchitectAbout the Job:We are seeking an experienced Cloud Data Architect to lead our data platform engineering and migration projects. As a key member of our team, you will be responsible for designing and implementing scalable and secure cloud-based data architectures.Key Responsibilities:Evaluate Hive Metastore state, migration...
-
Data Engineering Expert
1 week ago
Singapore 3 CUBED BUSINESS CONSULTING PTE. LTD. Full time1. Data Engineering & Platform Knowledge (Must)• Strong understanding of Hadoop ecosystem: HDFS, Hive, Impala, Oozie, Sqoop, Spark (on YARN). • Experience in data migration strategies (lift & shift, incremental, re-engineering pipelines). • Knowledge of Databricks architecture (Workspaces, Unity Catalog, Clusters, Delta Lake, Workflows). 2. Testing &...
-
Senior Data Platform Engineer
2 weeks ago
Singapore beBeeDataEngineer Full time $90,000 - $120,000Job Opportunity for Data Platform EngineerYou have a chance to work as a senior data platform engineer on a contract basis for 6-7 months, working remotely in the UK. This is an excellent opportunity to showcase your skills and experience in designing and implementing large-scale data platforms.The ideal candidate will have at least 9 years of hands-on...
-
Data Engineering Expert
2 weeks ago
Singapore 3 CUBED BUSINESS CONSULTING PTE. LTD. Full timeRoles & Responsibilities 1. Data Engineering & Platform Knowledge (Must) • Strong understanding of Hadoop ecosystem: HDFS, Hive, Impala, Oozie, Sqoop, Spark (on YARN). • Experience in data migration strategies (lift & shift, incremental, re-engineering pipelines). • Knowledge of Databricks architecture (Workspaces, Unity Catalog, Clusters, Delta...
-
Data Engineering Expert
2 weeks ago
Singapore 3 CUBED BUSINESS CONSULTING PTE. LTD. Full timeRoles & Responsibilities1. Data Engineering & Platform Knowledge (Must)• Strong understanding of Hadoop ecosystem: HDFS, Hive, Impala, Oozie, Sqoop, Spark (on YARN).• Experience in data migration strategies (lift & shift, incremental, re-engineering pipelines).• Knowledge of Databricks architecture (Workspaces, Unity Catalog, Clusters, Delta Lake,...
-
Data Platform Engineer
1 week ago
Singapore beBeeDataMigration Full time $120,000 - $180,000Job Title: Data Migration SpecialistWe are seeking an experienced Data Migration Specialist to join our team. As a key member of our data platform engineering team, you will be responsible for evaluating Hive Metastore (HMS) state, migration complexity, and readiness using UCX Assessment Tool.This is a contract position lasting 6-7 months with the...
-
Data Solutions Architect
1 week ago
Singapore beBeeData Full time $100,000 - $150,000We are seeking a skilled professional to fill the role of Data Solutions Architect. As a key member of our team, you will be responsible for designing and implementing secure data environments, configuring and managing Unity Catalog, and automating cloud deployments and governance.Main Responsibilities:Design and implement secure data environmentsConfigure...
-
Manager, Partner Relations, APAC
7 days ago
Singapore Unity Full timeThe opportunity Unity's Partner Relations team is looking for a proactive, people-centric manager to be responsible for the success of our most valued partners while equipping the Partner Relations team with the knowledge they need to guide the success of Unity's largest customers. In this role, you will manage a team of Partner Relations Managers...
-
Solution Architect
3 days ago
Singapore TG SERVICES PTE. LTD. Full timeKey Responsibilities: - Lead end-to-end solution architecture across data engineering, AI/ML workflows, and governance frameworks - Define and implement reference architectures for large-scale distributed data platforms on AWS or Azure - Design secure, scalable solutions using Databricks Lakehouse, Unity Catalog, and Delta Live Tables - Integrate data...
-
Senior Cloud Data Architect
2 weeks ago
Singapore beBeeData Full time $90,000 - $120,000Job Title:Solution ArchitectAbout the Role:We are seeking a seasoned Data Engineer to lead the setup and integration of Databricks platform for a Global In-house Center on AWS.Key Responsibilities:Lead Databricks platform setup and integration for a Global In-house Center on AWS.Design and implement Databricks workspaces leveraging Terraform IaC best...
