Data Architecture Specialist

1 week ago

Singapore beBeeData Full time

Expert Data Engineer

Key Position Summary:

We are seeking a highly skilled expert data engineer to lead the development and maintenance of large-scale data processing systems. As a critical team member, you will be responsible for designing and building scalable architectures using industry-leading tools.

Key Responsibilities:

  • Design and develop cutting-edge data processing architectures leveraging Hadoop ecosystem tools such as HDFS, Hive, Impala, Oozie, Sqoop, and Spark on YARN.
  • Develop migration strategies to move data from existing storage systems to cloud-based solutions like ADLS, S3, or GCS.
  • Implement robust data reconciliation methods to ensure accuracy and consistency across source and target systems.
  • Design and implement automated test frameworks for ETL pipelines to guarantee data quality and integrity.

Required Skills and Qualifications:

  • Strong understanding of Hadoop ecosystem tools and technologies.
  • Experience in designing and implementing data migration strategies.
  • Knowledge of Databricks architecture and its components such as Workspaces, Unity Catalog, Clusters, Delta Lake, and Workflows.
  • Ability to work closely with business stakeholders to understand data requirements and design effective data solutions.
  • Strong documentation and governance mindset.

Preferred Skills:

  • Delta Lake: ACID transactions, time travel, schema evolution, and Z-ordering.
  • Unity Catalog: Catalog/schema/table design, access control, lineage, and tags.
  • Workflows/Jobs: Orchestration, job clusters vs. all-purpose clusters.
  • SQL Endpoints / Databricks SQL: Designing downstream consumption models.
  • Performance Tuning: Partitioning, caching, adaptive query execution (AQE), and photon runtime.

Soft Skills:

  • Excellent communication and problem-solving skills.
  • Flexibility and adaptability in a fast-paced environment.

  • Data Architecture Specialist

    7 days ago

    Singapore beBeeDataEngineering Full time $90,000 - $120,000

    Job Title: Data Architecture SpecialistJob Summary:We are seeking a highly skilled Data Architecture Specialist to join our team. The ideal candidate will have a strong background in data engineering, data modeling, and big data technologies.About the Role:This is an exciting opportunity to work with a dynamic team of professionals who are passionate about...

  • Data Architecture Specialist

    3 days ago

    Singapore beBeeDataArchitecture Full time

    Job Title: Data Architecture Specialist "> I am seeking a talented Data Architecture Specialist to join our team. As a key member of the data team, you will be responsible for designing and developing data architectures that meet the company's business needs. "> Key Responsibilities: "> Design and develop data pipelines and systems for data modeling,...

  • Data Architecture Specialist

    5 days ago

    Singapore beBeeDataArchitecture Full time $100,000 - $150,000

    Job Title: Data Architecture Specialist">I am seeking a talented Data Architecture Specialist to join our team. As a key member of the data team, you will be responsible for designing and developing data architectures that meet the company's business needs.">Key Responsibilities:">Design and develop data pipelines and systems for data modeling, mining, and...

  • Data Architectural Specialist

    1 week ago

    Singapore beBeeDataSpecialist Full time $80,000 - $120,000

    Job TitleOur organization is seeking a highly skilled Data Architectural Specialist to join our team.">As a key member of our data engineering team, you will design and build robust data systems, including data warehouses, data lakes, and data pipelines, using appropriate technologies and architectures.Key Responsibilities:Design and implement data...

  • Chief Data Architecture Specialist

    2 weeks ago

    Singapore beBeeData Full time $125,000 - $175,000

    Job Title: Chief Data Architecture SpecialistWRS Health is seeking a skilled and strategic Chief Data Architecture Specialist to lead our data platform initiatives on Amazon Web Services (AWS) with a strong emphasis on healthcare data, data lake strategy, and AI enablement.As a key member of the team, you will architect and manage scalable, secure, and...

  • Data Architecture Lead

    4 days ago

    Singapore beBeeSpecialist Full time $80,000 - $120,000

    Job DescriptionThe primary role of the Senior Data Management Specialist is to develop and implement data architectures that support business objectives.

  • Intermediate Architect

    2 weeks ago

    Singapore JGP ARCHITECTURE (S) PTE LTD Full time

    The Intermediate Architect / Architectural Designer to work with design principal and project manager, provide technical guidance to the design team members for various building projects. - The Intermediate Architect / Architectural Designer's scope to interpret, organize, execute and coordinate assignments, monitor the delivery of the project with the PM...

  • Data Architecture Specialist

    1 week ago

    Singapore beBeeData Full time $90,000 - $120,000

    Job OpportunityThe role involves designing, implementing and maintaining an Azure data architecture in a banking environment.Key Responsibilities:Develop and maintain data solutions using Databricks.Design and implement data architectures that meet business needs.Monitor and optimize data solutions for improved performance.Requirements:Senior Data Architect...

  • Data Architecture Specialist

    1 week ago

    Singapore beBeeData Remote Work Freelance Full time $150,000 - $200,000

    Expert Data EngineerKey Position Summary:We are seeking a highly skilled expert data engineer to lead the development and maintenance of large-scale data processing systems. As a critical team member, you will be responsible for designing and building scalable architectures using industry-leading tools.Key Responsibilities:Design and develop cutting-edge...

  • Data Architecture Leader

    2 weeks ago

    Singapore beBeeData Full time $90,000 - $120,000

    Job Description:">">Salesforce professionals are in high demand, and we're looking for an expert to lead our team in data architecture.">The ideal candidate will have 5-7 years of experience in a consulting role as a technical specialist, architect, or developer.">">Required Skills and Qualifications:">">End-to-end project implementation experience in one or...