Databricks Data Engineer

2 weeks ago

Singapore Unison Consulting Pte Ltd Full time

**Job Summary**:
We are seeking a skilled and motivated **Databricks Data Engineer** to design, build, and maintain scalable data pipelines and data platforms using **Databricks** on **Azure/AWS**. You will work closely with data scientists, analysts, and business stakeholders to enable data-driven decision-making across the organization.

**Key Responsibilities**:

- Design and implement robust, scalable, and high-performance data pipelines using **Apache Spark** on **Databricks**.
- Develop and maintain **ETL/ELT processes** using **Databricks Notebooks**, **Delta Lake**, and **Spark SQL**.
- Optimize and troubleshoot large-scale distributed data processing jobs.
- Collaborate with data scientists and analysts to deliver data products that support analytics, reporting, and machine learning use cases.
- Develop and enforce best practices in data engineering and DevOps processes.
- Implement **CI/CD pipelines** for Databricks workflows using tools such as **Azure DevOps**, **GitHub Actions**, or **Terraform**.
- Ensure data quality, integrity, security, and compliance across platforms.
- Support migration of data systems to the cloud or from legacy environments to Databricks.

**Requirements**:
**Required Qualifications**:

- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering or related roles.
- Proficiency with **Apache Spark** and the **Databricks platform**.
- Strong experience with **Python**, **SQL**, and **PySpark**.
- Experience with **Delta Lake**, **Lakehouse Architecture**, and **data partitioning** strategies.
- Hands-on experience with cloud platforms (**Azure**, **AWS**, or **GCP**).
- Familiarity with **Databricks Workflows**, **Unity Catalog**, and **DBFS**.
- Experience working with structured and unstructured data at scale.
- Good understanding of **data warehousing**, **data modeling**, and **data governance** concepts.

**Preferred Qualifications**:

- Databricks certification (e.g., **Databricks Certified Data Engineer Associate or Professional**).
- Experience integrating Databricks with **Power BI**, **Tableau**, or **other BI tools**.
- Experience with **Terraform**, **Databricks REST APIs**, and infrastructure-as-code (IaC).
- Knowledge of **MLflow**, **Feature Store**, and MLOps best practices is a plus.
- Experience with **streaming technologies** like **Structured Streaming** or **Kafka**.

  • Business Development Representative

    4 days ago

    Singapore Databricks Full time

    SAP Databricks - Partner Development Representative Join to apply for the SAP Databricks - Partner Development Representative role at Databricks SAP Databricks - Partner Development Representative Join to apply for the SAP Databricks - Partner Development Representative role at Databricks SLSQ226R112Databricks is at the leading edge of the Unified Data...

  • Business Development Representative

    4 days ago

    Singapore Databricks Full time

    SAP Databricks - Partner Development Representative Join to apply for the SAP Databricks - Partner Development Representative role at Databricks SAP Databricks - Partner Development Representative Join to apply for the SAP Databricks - Partner Development Representative role at Databricks SLSQ226R112Databricks is at the leading edge of the Unified...

  • Data Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Job Type** Contract **Seniority** Senior Mid **Years of Experience** Information not provided **Tech Stacks** Delta Lake ETL AWS Google Cloud Apache Databricks Azure Spark SQL **Role**: - As an integral part of the data engineering team, your responsibilities will include designing, developing, and maintaining data pipelines and...

  • Data Engineer(IDMC, Databricks)

    4 weeks ago

    Singapore ANTAS PTE. LTD. Full time

    Roles & Responsibilities* Position: Data Engineer(IDMC, Databricks) Experience: +6 YearsSkills: AWS, IDMC, Databricks and TableauRoles And Responsibilities:* Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with...

  • Big Data Solutions Architect

    2 weeks ago

    Singapore Databricks Full time

    As a Resident Solutions Architect (RSA) in our Professional Services team ,you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Data Engineer

    1 week ago

    Singapore EXASOFT PTE. LTD. Full time

    **Responsibilities**: - Create, manage, and optimize data pipelines for ingesting, processing, and transforming data using AWS services like AWS Glue, AWS Data Pipeline, and AWS Lambda, Databricks for advanced data processing, and Informatica IDMC for data integration and quality. - Integrate data from various sources, both internal and external, into AWS...

  • Solutions Engineer

    6 days ago

    Singapore Databricks Full time

    At Databricks, our customers challenge us with solving some of the world's toughest data problems. Our customers rely on our pre-sales team to fully understand the technologies that power our platform, the broader cloud and technology ecosystems, and how they can all be brought together to solve these problems. As a Solutions Engineer at Databricks, you...

  • Sr. Solutions Engineer

    1 week ago

    Singapore Databricks Full time

    At Databricks, our customers challenge us with solving some of the world's toughest data problems. Our customers rely on our pre-sales team to fully understand the technologies that power our platform, the broader cloud and technology ecosystems, and how they can all be brought together to solve these problems. As a Sr. Solutions Engineer at Databricks, you...

  • Sr. Solutions Engineer

    5 days ago

    Singapore Databricks Full time

    FEQ425R54 As a Pre-sales Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers...

  • Sr. Solutions Engineer

    2 weeks ago

    Singapore Databricks Full time

    Overview Sr. Solutions Engineer (Vietnamese Speaking) at Databricks. Databricks is the data and AI company helping organizations unify and democratize data, analytics and AI. At Databricks, our core principles guide us to create a proactive, customer-centric culture and a unified platform that makes data science and analytics accessible to everyone. You...