Data Engineer

6 days ago

Central Singapore JEET ANALYTICS PTE. LTD. Full time $90,000 - $120,000 per year

The Databricks Engineer is responsible for designing, implementing, and optimizing big data solutions using Databricks and Apache Spark. This role involves developing scalable ETL pipelines, data lakes, and analytics solutions on cloud platforms such as AWS, Azure, or GCP. The engineer works closely with data scientists, analysts, and software engineers to enable high-performance data processing and machine learning workflows.

Key Responsibilities:

1. Databricks Development & Implementation:

Design and develop scalable data processing pipelines using Databricks, Apache Spark, and Delta Lake.

Optimize ETL jobs, batch processing, and real-time streaming workloads.

Implement data ingestion strategies using Kafka, IDMC etc.

Develop SQL-based transformations and data models in Databricks.

2. Cloud Data Architecture & Integration:

Design and implement data lakehouse architectures on AWS.

Integrate Databricks with cloud storage (S3) and databases (Databricks, Redshift, BigQuery).

Work with Terraform, CloudFormation, to automate Databricks deployments.

Implement CI/CD pipelines for Databricks notebooks using GitHub Actions.

3. Performance Optimization & Troubleshooting:

Optimize Spark jobs, cluster configurations, and query performance.

Monitor and debug Databricks jobs, workflows, and runtime errors.

Tune Delta Lake tables for efficient data processing and storage.

4. Security & Data Governance:

Implement RBAC (Role-Based Access Control), Unity Catalog, and data masking.

Ensure compliance with GDPR, HIPAA, and SOC2 regulations.

Manage IAM roles, permissions, and encryption settings for Databricks environments.

5. Collaboration & Support:

Work closely with data scientists, analysts, and DevOps teams to enable advanced analytics and machine learning workloads.

Provide technical guidance and best practices on Databricks development.

Document technical designs, processes, and troubleshooting guides.

Required Skills & Qualifications:

Technical Skills:

Strong experience with Databricks, Apache Spark (PySpark, Scala), and Delta Lake.

Proficiency in Python, SQL, and Scala for data processing.

Experience with cloud platforms (AWS, Azure, or GCP) and data services.

Hands-on knowledge of ETL, data warehousing, and lakehouse architectures.

Familiarity with Airflow, dbt, or similar workflow orchestration tools.

Knowledge of machine learning frameworks (MLflow, TensorFlow, PyTorch) is a plus.

Soft Skills:

Strong problem-solving and analytical skills.

Ability to work independently and within cross-functional teams.

Excellent communication and documentation skills.

Ability to manage multiple projects and prioritize tasks effectively.

  • Data Engineer

    1 week ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...

  • Data Engineer

    2 days ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Azure Data engineer

    2 weeks ago

    Singapore NTT Data Singapore Full time

    Job Responsibilities: Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...

  • Data Engineer

    4 days ago

    Singapore NTT Data Singapore Full time

    **Competency Required**: - Possess a degree in Computer Science/Information Technology or related fields. - At least 3 years of experience in a role focusing on development and support of data ingestion pipelines. - **Experience with building on data platforms, e.g. Snowflake.**: - **Proficient in SQL and Python.**: - Experience in continuous integration...

  • Electrical Systems Technical Specialist

    5 days ago

    Singapore beBeeelectrical engineer Full time $80,000 - $120,000

    Job Title: Electrical Systems SpecialistAn Electrical Engineer plays a vital role in the conceptualization, design, and development of electrical engineering projects.This position involves performing prototype testing, troubleshooting, and compiling detailed analysis reports. The successful candidate will be responsible for generating electrical schematics...

  • Data Scientist

    5 days ago

    Singapore Data Analytics Full time $90,000 - $120,000 per year

    Get to Know the TeamGFin Analytics team supports the GFin product and business organisations, across Payments Core, Payments Experience, Lending, Insurance, and Kios. As a Data Scientist (Analytics), you'll be part of the Lending tech family where we strive to be the best FinTech company in the region. Our team is focused on understanding user experiences...

  • Senior Process Systems Specialist

    2 weeks ago

    Singapore beBeeProcess Engineer Full time $120,000 - $180,000

    Job Description">Hanwha Ocean Offshore Business is transitioning from a traditional shipbuilder to an Engineering, Procurement, Construction, Installation, and Operation (EPCI(O)) solution provider. We offer products such as FPSO, FLNG, Offshore Renewables, and other Floating Production Units.We are expanding our global footprint by establishing new Global...

  • Data Engineer

    1 week ago

    Central Singapore Intellect Minds Pte Ltd Full time

    Degree in Computer Science, Data Science, or a related field - Proficient in languages such as Python, JAVA, SQL, and experience with data science and engineering frameworks such as Scikit-learn, Pandas, Tensorflow, Spark, Hadoop, etc. - Basic understanding of data warehousing and data management concepts. - Basic knowledge in building and deploying scalable...

  • Data Engineer

    5 days ago

    Central Region, Singapore Dynamic Human Capital Pte Ltd Full time $80,000 - $120,000 per year

    Data Engineer (Junior & Senior)Contract Duration: 2025 – 2027 Location: Pasir PanjangRole OverviewWe are seeking Junior and Senior Data Engineers to design, build, and maintain data infrastructure that supports the detection of unauthorised privileged access. You will implement robust ETL/ELT processes, deploy machine learning models into production, and...

  • Data Engineer

    5 days ago

    Central Region, Singapore Ambition Group Singapore Pte. Ltd. (SG) Full time $90,000 - $120,000 per year

    Data EngineerA leading organization is seeking a Data Engineer to join its Singapore office. This role involves designing scalable data platforms, managing database performance, and ensuring data governance and compliance across the enterprise.ResponsibilitiesYou will design scalable data platforms and build robust ETL pipelines to support business...