Data Engineer

4 weeks ago


Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time
Roles & Responsibilities

Job Summary:


We are seeking a skilled Data Engineer with 3 to 5+ years of experience in Databricks and Python to join our dynamic team. The ideal candidate will play a key role in designing, developing, and optimizing data pipelines and analytics solutions on Databricks. Experience with AWS Cloud is highly preferred.


Key Responsibilities:


  • Develop and maintain scalable data pipelines and ETL processes using Databricks and Python.
  • Optimize and troubleshoot existing Databricks workflows for performance and reliability.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Implement data processing solutions using Spark in Databricks.
  • Integrate and manage data from multiple sources, ensuring accuracy, quality, and consistency.
  • Leverage AWS cloud services (e.g., S3, Lambda, Redshift, Glue) for data storage, transformation, and analytics.
  • Perform data profiling and validation to ensure the reliability of processed data.
  • Monitor and maintain data pipelines for continuous performance improvements and error handling.

Required Skills:


  • 3-5+ years of hands-on experience with Databricks and Python development.
  • Strong expertise in PySpark and data transformation techniques.
  • Proficiency in writing optimized, efficient, and scalable Python code.
  • Experience with SQL and relational databases for data querying and manipulation.
  • Familiarity with AWS services (e.g., S3, EC2, RDS) and cloud-based data engineering concepts.
  • Knowledge of version control systems such as Git.
  • Strong problem-solving and analytical skills with a focus on data processing and integration.

Preferred Skills:


  • Working experience with AWS Redshift, Glue, or Athena.
  • Familiarity with CI/CD pipelines for data engineering projects.
  • Exposure to data visualization tools or frameworks.
  • Knowledge of data security best practices and governance principles.

Qualifications:


  • Bachelor's degree in Computer Science, Data Engineering, or a related field.
  • Relevant certifications in Databricks, AWS, or Python development are a plus.

Tell employers what skills you have

Version Control
PySpark
Pipelines
Hadoop
Data Transformation
ETL
EC2
Reliability
Data Engineering
SQL
Python
Cloud Services
S3
Databases
Data Visualization
Business Requirements

  • Singapore NTT Data Singapore Full time

    NTT Data Singapore is seeking a highly skilled Data Engineer to join our team. This role will be responsible for designing, developing, and maintaining large-scale data systems.Job Description:Key Responsibilities: Design, develop, and maintain large-scale data systems using Scala programming and functional programming principles. Collaborate with...


  • Singapore NTT Data Singapore Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore.This is an excellent opportunity for someone with experience in big data technologies to take their career to the next level and work on challenging projects.ResponsibilitiesDesign, develop, and deploy large-scale data processing systems using Hadoop ecosystem...


  • Singapore ECF Data, LLC Full time

    Description: Location: Singapore Budget : 8000 -10000Responsibilities: 1. Drive analytic projects for all pillars of the bank’s treasury and markets department, such as bond analytics, news generation FX trading signals, product recommendation and customer hyper-personalization. 2. Conduct literature review and evaluate trade-offs between different...


  • Singapore Aboitiz Data Innovation Full time

    Aboitiz Data Innovation (ADI)is one of the leading up and coming start-ups in the field of Data Science and Artificial Intelligence. We believe data can drive change for a better world by advancing businesses across industries and communities. We are looking for 2 x Mid-Senior Data Scientists to develop and deploy multiple machine learning models leveraging...


  • Singapore Tech Data Full time

    Job Purpose: The Services Engagement Manager is responsible for achieving sales and profit targets for Professional Services offerings related to the products TechData distributes while ensuring exceptional service delivery. This role balances Professional Services sales with Service Delivery, focusing on relationships with TechData's extended sales...


  • Singapore TRIVI DATA CONSULTING PTE. LTD. Full time

    Unlock Business Potential with Data Engineering ExpertiseWe are seeking a seasoned Data Engineer to join our team at NITYO PROGRESSION CONSULTANCY PTE. LTD. The ideal candidate will have a proven ability to design scalable data pipelines, implement machine learning models, and deliver data-driven solutions that optimize decision-making processes.About the...

  • Data Scientist

    2 weeks ago


    Singapore Aboitiz Data Innovation (ADI) Remote Work Freelance Full time

    Aboitiz Data Innovation (ADI) is one of the leading up and coming start-ups in the field of Data Science and Artificial Intelligence. We believe data can drive change for a better world by advancing businesses across industries and communities.We are looking for 2 x Mid-Senior Data Scientists to develop and deploy multiple machine learning models leveraging...


  • Singapore NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Application Management...

  • Cloud Data Architect

    3 weeks ago


    Singapore NTT Data Business Solutions Singapore Pte Ltd Full time

    Your career at NTT DATA Business Solutions Empowering You – to feel our passion for SAP / Analytic Solutions As NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to becoming intelligent...


  • Singapore BRIDGE DATA CENTRES (INTERNATIONAL) PTE. LTD. Full time

    OverviewBridge Data Centres (International) Pte. Ltd. is a leading provider of hyperscale and wholesale data centre solutions in the Asia-Pacific region.Job DescriptionWe are seeking an experienced Business Development Director to drive our expansion in Asia, focusing on new business development, strategic partnerships, and exceptional service delivery.The...

  • Data Engineer

    2 weeks ago


    Singapore SMRT Corporation Ltd Full time

    Job PurposeAs a Data Engineer, you will be a key player in building and maintaining the robust data infrastructure that underpins our railway operations. You will design, develop, and optimize data pipelines to ingest, process, and transform data from diverse sources, including laser measurement systems, photo imaging, and maintenance records. Your expertise...

  • Cloud Data Architect

    3 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic SolutionsAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to...

  • Cloud Data Architect

    3 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic SolutionsAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to...


  • Singapore NTT Data Full time

    Qualifications and Responsibilities Duties include providing support to client perimeter security infrastructure, which includes firewall , proxy , and remote access systems . Investigation, documentation, and resolution of outages to critical business systems that may be caused by firewall, proxy, or remote access systems. Escalation of issues and tracking...


  • Singapore NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Network-Routing System Integration Specialist Company: NTT DATA Services NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Data Engineer

    4 weeks ago


    Singapore TOTAL EBIZ SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Engineer, you will be required to:•Perform data extraction, cleaning, transformation, and flow.•Design, build, launch and maintain efficient and reliable large-scale batch and realtime data pipelines with data processing frameworks.•Integrate and collate data silos in a manner which is both scalable and compliant. ...

  • Data Engineer

    4 months ago


    Singapore ADOMITA TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJD:"Proficiency with SQLBuilding data pipelines and architectureShould have extensive experience with relational and NO-SQL databasesShould have proficiency in handling both structured and unstructured data sourcesStrong experience deploying applications to cloud platforms like Azure, AWSInterest in building efficient batch and...

  • Data Engineer

    3 weeks ago


    Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJD:o Good programming skills in Pythono Must possess experience or interest in training and deploying machine learning models end to end.o Good understanding of basic statistics and deep learning techniqueso Prior experience in data integration, profiling, validation and cleansingo Proficiency with SQL· Software deliveryo Strong...

  • Data Engineer

    3 weeks ago


    Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJD:o Good programming skills in Pythono Must possess experience or interest in training and deploying machine learning models end to end.o Good understanding of basic statistics and deep learning techniqueso Prior experience in data integration, profiling, validation and cleansingo Proficiency with SQL· Software deliveryo Strong...


  • Singapore KEPPEL DATA CENTRES HOLDING PTE. LTD. Full time

    Keppel Data Centres Holding Pte. Ltd.Salary:$120,000 - $180,000 per annumAbout the Role:We are seeking an experienced Data Centre Development Manager to join our team in Singapore.Job Description:Drive data centre development projects from inception to execution, working closely with cross-functional teams.Develop and implement sustainable solutions in the...