Data Architect with Databricks Expertise

3 weeks ago


Singapore ZENITH INFOTECH (S) PTE LTD. Full time

Zenith Infotech is seeking a highly skilled Data Architect with expertise in Databricks to join our team. The ideal candidate will have at least 5 years of experience in data engineering, with a strong background in Python and AWS or Azure services.

Job Description

We are looking for a talented individual who can lead end-to-end data migration projects from on-premises environments to Databricks with minimal downtime. The successful candidate will work closely with architects to design solutions that meet functional and non-functional requirements.

  • Design and implement data pipelines using Databricks and AWS services.
  • Configure Databricks clusters, write PySpark code, and build CI/CD pipelines for deployments.
  • Ongoing optimization techniques such as Zordering, Auto Compaction, and vacuuming.
  • Process near real-time data through Auto Loader and DLT pipelines.
Requirements

To be successful in this role, you will need:

  • A Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • Minimum 5 years of experience in data engineering, with expertise in AWS or Azure services, Databricks, and/or Informatica IDMC.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Evaluate potential technical solutions and make recommendations to resolve data issues.
  • Strong knowledge of SQL and NoSQL databases.
Preferred Skills

The following skills are highly desirable:

  • Experience with big data technologies like Apache Spark and Hadoop on Databricks.
  • Knowledge of containerization and orchestration tools like Docker and Kubernetes.
  • Familiarity with data visualization tools like Tableau or Power BI.
  • Understanding of DevOps principles for managing and deploying data pipelines.

We estimate the salary for this position to be around $120,000 per annum, based on industry standards and the location of Zenith Infotech in Singapore.



  • Singapore AVENSYS CONSULTING PTE. LTD. Full time

    We are seeking a highly skilled Data Architect to join our team at AVENSYS CONSULTING PTE. LTD. This is an exciting opportunity to work on challenging projects and expand your skill set as a Databricks Engineer.The ideal candidate will have a strong background in data architecture, cloud solutions, and data governance. They will be responsible for designing...


  • Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    We are seeking an experienced Databricks Data Architect to join our team at ZENITH INFOTECH (S) PTE LTD.Job Description:A Databricks Data Architect is responsible for designing and implementing data architecture on Databricks, ensuring high-quality data management, security, and compliance. The role involves migrating from as-is on-prem data warehouse to...


  • Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    Unlock Your Potential as a Databricks EngineerAbout the Role:We are seeking an experienced Databricks Engineer to lead end-to-end data migration projects from on-premises environments to Databricks with minimal downtime. This is a fantastic opportunity for someone who is passionate about working with big data technologies and has expertise in AWS or Azure...


  • Singapore Databricks Inc. Full time

    The Databricks Customer Enablement team is on a mission to upskill Data and AI professionals in our customer organizations to use Databricks and accelerate customer success and outcomes. We are looking for a Customer Enablement Architect, reporting to our APJ Regional Enablement Lead, to be based in Singapore to support some of our regional customers. You...


  • Singapore AVN DIGITAL PTE. LTD. Full time

    Unlock Your Data PotentialAVN Digital Pte. Ltd., a technology-enabled business solutions and services expert, seeks a highly skilled Databricks Solutions Architect to design and implement data storage solutions using AWS services and Databricks' Delta Lake.This is an exciting opportunity for a seasoned professional to expand their skill set, achieve job...

  • Chief Data Architect

    4 weeks ago


    Singapore AVENSYS CONSULTING PTE. LTD. Full time

    Job SummaryWe are seeking a highly skilled Chief Data Architect to lead our data engineering team. The ideal candidate will have extensive experience in designing and implementing data storage solutions using AWS services, Databricks, and Informatica IDMC.About Avensys Consulting Pte LtdAvensys Consulting Pte Ltd is a global IT professional services company...


  • Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    About Helius TechnologiesHelius Technologies PTE. LTD. is a leading technology company providing innovative solutions to businesses worldwide.Job Title: Data Architect with Expertise in Cloud MigrationEstimated Salary: SGD 12,000 - 18,000 per monthAbout the RoleWe are seeking an experienced Data Architect to join our team. As a key member of our data...


  • Singapore Databricks Inc. Full time

    Databricks is looking for an experienced Senior Digital Marketing Manager who will focus on scaling our APJ region across all paid media channels. You will partner with key stakeholders to guide overall channel plans that map to regional goals, provide strategic scale and optimization opportunities, apply best practices and regional expertise to improve the...


  • Singapore Databricks Inc. Full time

    As the Product Specialist for Generative AI, you will lead the enablement, expertise, and backline support for our customer-facing field team with Generative AI, including supporting RAG (retrieval augmented generation), open source models like Llama2, MPT, Mistral, 3rd party models including OpenAI, Vector Indexing, and foundational model pre-training...


  • Singapore AVN DIGITAL PTE. LTD. Full time

    Roles & ResponsibilitiesAVN-Digital is an expert in providing technology-enabled business solutions and services. Since inception, AVN-Digital has helped clients Cyber-security, Data Analytics and Robotic Process Automation to improve their operations and profitability, focus on core competencies and achieve business results such as increased agility,...

  • Solutions architect

    1 month ago


    Singapore Databricks Inc. Full time

    At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. You will be an essential...


  • Singapore AVENSYS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesAvensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success we have evolved to become one of the top trusted providers in Singapore and service...

  • Databricks Engineer

    2 weeks ago


    Singapore KRIS INFOTECH PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description: Responsible for migrating from as-is on-perm data warehouse to Databricks and sound knowledge of Databricks. Requires good understanding of data architecture, cloud solutions, building and maintaining a robust, integrated, and governed data infrastructure. The role involves extracting valuable insights from data...

  • Databricks Engineer

    4 weeks ago


    Singapore KRIS INFOTECH PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description: Responsible for migrating from as-is on-perm data warehouse to Databricks and sound knowledge of Databricks. Requires good understanding of data architecture, cloud solutions, building and maintaining a robust, integrated, and governed data infrastructure. The role involves extracting valuable insights from data...


  • Singapore Databricks Inc. Full time

    As part of our accelerating APJ growth, Databricks is looking for a dynamic Enterprise Account Executive to join the founding team. This is an exciting new logo Sales role that will make an important impact on the revenue and expansion of our business for the GCR region. As an Enterprise Account Executive your mission will be to acquire and grow some of our...

  • Chief Data Architect

    4 weeks ago


    Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Helius Technologies Pte. Ltd.About the RoleThis is a senior-level position that requires extensive experience in designing and implementing data storage solutions, data pipelines, and data governance frameworks using cloud-based technologies such as AWS and Databricks.The ideal...


  • Singapore EVOLUTION RECRUITMENT SOLUTIONS PTE. LTD. Full time

    We are seeking a highly skilled Data Architect to lead our cloud data migration project.The successful candidate will be responsible for migrating our on-premises data warehouse to Databricks, ensuring minimal downtime and maximum efficiency.About the Role:Design and implement a robust and integrated data infrastructure on AWS using Databricks.Work closely...


  • Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    About the RoleWe are seeking an experienced Data Infrastructure Architect to join our team at ZENITH INFOTECH (S) PTE LTD. The successful candidate will be responsible for designing and implementing robust, integrated, and governed data infrastructure on Databricks.Key ResponsibilitiesLead end-to-end data migration projects from on-premises environments to...

  • Cloud Data Architect

    3 weeks ago


    Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    Job OverviewAs a Senior Data Engineer at Helius Technologies Pte. Ltd., you will play a key role in designing and architecting data storage solutions using AWS services, Databricks, and Informatica IDMC.Key ResponsibilitiesDesign and architect scalable data storage solutions for our cloud-based infrastructureIntegrate data from various sources into AWS and...


  • Singapore ADECCO PERSONNEL PTE LTD Full time

    We are seeking an experienced Data Engineering Architect to join our team at ADECCO PERSONNEL PTE LTD. As a key member of our data engineering team, you will be responsible for designing and architecting scalable and secure data infrastructure solutions using AWS services, Databricks, and Informatica IDMC.Key ResponsibilitiesData Storage Solutions: Design...