Databricks Data Engineer

2 weeks ago

Singapore Unison Consulting Pte Ltd Full time

**Job Summary**:
We are seeking a skilled and motivated **Databricks Data Engineer** to design, build, and maintain scalable data pipelines and data platforms using **Databricks** on **Azure/AWS**. You will work closely with data scientists, analysts, and business stakeholders to enable data-driven decision-making across the organization.

**Key Responsibilities**:

- Design and implement robust, scalable, and high-performance data pipelines using **Apache Spark** on **Databricks**.
- Develop and maintain **ETL/ELT processes** using **Databricks Notebooks**, **Delta Lake**, and **Spark SQL**.
- Optimize and troubleshoot large-scale distributed data processing jobs.
- Collaborate with data scientists and analysts to deliver data products that support analytics, reporting, and machine learning use cases.
- Develop and enforce best practices in data engineering and DevOps processes.
- Implement **CI/CD pipelines** for Databricks workflows using tools such as **Azure DevOps**, **GitHub Actions**, or **Terraform**.
- Ensure data quality, integrity, security, and compliance across platforms.
- Support migration of data systems to the cloud or from legacy environments to Databricks.

**Requirements**:
**Required Qualifications**:

- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering or related roles.
- Proficiency with **Apache Spark** and the **Databricks platform**.
- Strong experience with **Python**, **SQL**, and **PySpark**.
- Experience with **Delta Lake**, **Lakehouse Architecture**, and **data partitioning** strategies.
- Hands-on experience with cloud platforms (**Azure**, **AWS**, or **GCP**).
- Familiarity with **Databricks Workflows**, **Unity Catalog**, and **DBFS**.
- Experience working with structured and unstructured data at scale.
- Good understanding of **data warehousing**, **data modeling**, and **data governance** concepts.

**Preferred Qualifications**:

- Databricks certification (e.g., **Databricks Certified Data Engineer Associate or Professional**).
- Experience integrating Databricks with **Power BI**, **Tableau**, or **other BI tools**.
- Experience with **Terraform**, **Databricks REST APIs**, and infrastructure-as-code (IaC).
- Knowledge of **MLflow**, **Feature Store**, and MLOps best practices is a plus.
- Experience with **streaming technologies** like **Structured Streaming** or **Kafka**.

  • Data Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Job Type** Contract **Seniority** Senior Mid **Years of Experience** Information not provided **Tech Stacks** Delta Lake ETL AWS Google Cloud Apache Databricks Azure Spark SQL **Role**: - As an integral part of the data engineering team, your responsibilities will include designing, developing, and maintaining data pipelines and...

  • Field Engineering, Data Engineering Product Specialist

    10 hours ago

    Singapore Databricks Full time

    Join to apply for the Field Engineering, Data Engineering Product Specialist role at Databricks . As the Data Engineering Product Specialist, you will be defining our technical go‐to‐market strategy and driving Data Engineering Product Adoption in the Asia Pacific and Japan region. The Impact You Will Have Lead the vision and strategy for data engineer...

  • Data Engineer

    1 week ago

    Singapore Helius Technologies Full time

    Vice President Talent Acquisition at Helius Technologies Build, manage, and optimize robust ETL/ELT data pipelines using Databricks and Azure Data Factory, ensuring high performance and scalability for batch and streaming workloads. Develop advanced data transformation workflows leveraging Spark (PySpark/Scala), SQL, and Delta Lake architectures. Integrate...

  • Big Data Solutions Architect

    2 weeks ago

    Singapore Databricks Full time

    As a Resident Solutions Architect (RSA) in our Professional Services team ,you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Field Engineering, Data Engineering Product Specialist

    1 day ago

    Singapore Databricks Full time $120,000 - $200,000 per year

    FEQ426R570As the Data Engineering Product Specialist, you will be defining our technical go to market strategy and driving Data Engineering Product Adoption in the Asia Pacific and Japan region. You will be directly working with customers to guide and influence their data engineering architecture and decisions. You will be expected to present, demo and...

  • Associate Data Engineer

    2 days ago

    Singapore JOBLINE RESOURCES PTE. LTD. Full time

    Roles & Responsibilities Responsibilities • Build and optimize ETL/ELT processes leveraging Databricks' native capabilities to handle large volumes of structured and unstructured data from various sources • Implement data quality frameworks and monitoring solutions using Databricks data quality features to ensure data accuracy and reliability across all...

  • Field Engineering, Data Engineering Product Specialist

    10 hours ago

    Singapore Databricks Inc. Full time

    Overview As the Data Engineering Product Specialist, you will be defining our technical go to market strategy and driving Data Engineering Product Adoption in the Asia Pacific and Japan region. You will be directly working with customers to guide and influence their data engineering architecture and decisions. You will be expected to present, demo and pitch...

  • Data Engineer

    1 week ago

    Singapore Helius Technologies Full time

    Direct message the job poster from Helius Technologies Vice President of IT Recruitment at Helius Technologies Interested candidate please share your updated copy of resume at (To receive a quick response, kindly leave a message on the WhatsApp number )While sharing resume please share with following details. Preference will be given to candidates with...

  • Data Engineer

    4 days ago

    Singapore EXASOFT PTE. LTD. Full time

    Roles & Responsibilities Role and Responsibilities: Define, develop, and maintain blueprints, roadmaps, and reference architectures for data analytics infrastructure and services. Analyze new requirements, develop solutions, and manage solution delivery through acquisition or change control. Enhance cloud capability by designing and implementing cloud-based...

  • Sr. Solutions Engineer

    3 days ago

    Singapore Databricks Full time

    FEQ425R54 As a Pre-sales Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers...