Data Engineer for Cloud and Big Data Solutions

5 days ago


Singapore JOBLINE RESOURCES PTE. LTD. Full time
Job Title: Data Engineer for Cloud and Big Data Solutions

About Jobline Resources PTE LTD

We are seeking an experienced Data Engineer to join our team at Jobline Resources PTE LTD. As a leading provider of innovative solutions, we value expertise in cloud and big data technologies. The successful candidate will play a vital role in designing, implementing, and optimizing complex data systems.

Job Description:

In this challenging role, you will be responsible for leading end-to-end data migration projects from on-premises environments to Databricks with minimal downtime. You will work closely with architects to develop solution designs that meet functional and non-functional requirements. Your hands-on experience with Databricks on AWS is essential for designing and implementing solutions that drive business outcomes.

You will also have the opportunity to configure Databricks clusters, write PySpark codes, and build CI/CD pipelines for deployments. Additionally, you will leverage your expertise in optimization techniques, such as Zordering, Auto Compaction, and vacuuming, to ensure high-performing data systems. Your strong background in Python and ability to identify, communicate, and mitigate risks and issues will be valuable assets in this role.

The ideal candidate will have a bachelor's or master's degree in computer science, data engineering, or a related field, along with a minimum of 5 years of experience in data engineering. Proficiency in programming languages such as Python, Java, or Scala for building data pipelines is necessary. Familiarity with SQL and NoSQL databases, data modelling, and schema design is also required. Strong problem-solving and analytical skills, excellent communication and collaboration skills, and a strong understanding of DevOps principles are also essential.

Responsibilities:
  • Lead end-to-end data migration projects from on-premises environments to Databricks with minimal downtime.
  • Work with architects to develop solution designs that meet functional and non-functional requirements.
  • Configure Databricks clusters, write PySpark codes, and build CI/CD pipelines for deployments.
  • Apply expertise in optimization techniques, such as Zordering, Auto Compaction, and vacuuming.
  • Develop solutions that leverage knowledge of SQL and NoSQL databases, data modelling, and schema design.

Requirements:
  • Bachelor's or master's degree in computer science, data engineering, or a related field.
  • Minimum 5 years of experience in data engineering.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Familiarity with SQL and NoSQL databases.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration skills.

Payout Details:
$180,000 per annum based on performance over 3 years.

  • Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    Job Title: Cloud and Data Centre Solutions EngineerWe are seeking an experienced Cloud and Data Centre Solutions Engineer to join our team at ST Engineering Cloud and Data Centre Solutions Pte. Ltd.Estimated Salary: SGD 120,000 - 180,000 per annumAs a Cloud and Data Centre Solutions Engineer, you will play a key role in designing, implementing, and managing...


  • Singapore SINGAPORE TELECOMMUNICATIONS LIMITED Full time

    Job SummaryWe are seeking an experienced Data Engineer to join our team at SINGAPORE TELECOMMUNICATIONS LIMITED. The successful candidate will be responsible for designing, implementing, and managing cloud data processing pipelines (e.g., AWS) and developing big data solutions for real-time and batch processing of large telco datasets.Main Responsibilities:


  • Singapore NTT DATA Services Full time

    About NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...


  • Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    About the RoleAs a Cloud DevOps Engineer with ST Engineering Cloud and Data Centre Solutions PTE. LTD., you will be responsible for designing, building, and maintaining AWS infrastructure using infrastructure as code tools like GitLab, Terraform, Sentinel, and Ansible.This is an excellent opportunity to work on cutting-edge technologies and architectures,...


  • Singapore PALO IT SINGAPORE PTE. LTD. Full time

    Job Summary PALO IT SINGAPORE PTE. LTD. is a global technology consultancy that crafts tech as a force for good, designing, developing and scaling digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We are seeking an experienced Data Architect for Big Data Solutions to work on acquiring,...


  • Singapore SINGDATA CLOUD PTE. LTD. Full time

    About SINGDATA CLOUD PTE. LTD.SINGDATA CLOUD PTE. LTD. is a Singapore-based company that specializes in providing innovative cloud-native and AI-native data infrastructure solutions to modern enterprises. Our "Single-Engine" approach simplifies data platform architecture, delivering superior performance and return on investment (ROI) to our clients.Job...


  • Singapore Tencent Singapore Full time

    Responsibilities: Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between users and industries to create innovative solutions for smart industries via technological advancements such as cloud, AI, and network security. While driving the digitalization of...


  • Singapore EVOLUTION RECRUITMENT SOLUTIONS PTE. LTD. Full time

    Job Title: Data Architect for Cloud SolutionsSalary: SGD $120,000 - SGD $180,000 per annumAbout the Role:Evolving as a Databricks Engineer, you will lead the migration of on-premises data warehouses to Databricks and design robust integrated governed data infrastructure. You should have a sound knowledge of Databricks and good understanding of cloud...

  • Cloud Data Engineer

    4 weeks ago


    Singapore ITSOFT SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Expert you are the bridge between business problems and innovative solutions, using a powerful blend of well-defined methodologies, statistics, mathematics, domain expertise, consulting, and software engineering. You'll wear many hats, and each day you will dive deep into the heart of our business, understanding its...


  • Singapore AVENSYS CONSULTING PTE. LTD. Full time

    Job OverviewAvensys Consulting Pte Ltd, a global IT professional services company headquartered in Singapore, seeks a seasoned Data Engineering Leader to spearhead cloud and big data solutions. With a strong background in AWS services, Databricks, and Informatica IDMC, this individual will design and implement cutting-edge data storage, processing, and...


  • Singapore Tencent Singapore Full time

    Job OverviewTencent Singapore is seeking a skilled Big Data Solution Architect to join our Cloud & Smart Industries Group (CSIG). This role involves promoting the company's cloud and industry Internet strategy, driving digitalization of various industries, and creating innovative solutions for smart industries.


  • Singapore NTT Data Singapore Full time

    Company Overview">NTT Data Singapore is a leading IT services company that offers end-to-end solutions to clients across various industries.We are currently seeking an experienced Azure Cloud Solutions Engineer to join our team in Singapore.">Job Summary">The successful candidate will be responsible for designing and implementing scalable and resilient cloud...

  • Data Engineer

    3 weeks ago


    Singapore Singtel Full time

    Company OverviewSingtel, a leading telecommunications company in Singapore, has partnered with the Singapore Institute of Technology to launch The Catalyst Programme. This innovative Work-Study Programme (WSP) aims to develop and groom talent in the ICT sector over a 3-year period.About The RoleWe are seeking an experienced Data Engineer to join our team and...


  • Singapore SAKSOFT PTE LIMITED Full time

    SAKSOFT PTE LIMITED seeks a highly skilled Big Data Solutions Engineer to join our team.We are looking for a talented professional with 9+ years of experience in big data engineering to design and implement scalable, fault-tolerant ETL pipelines on our big data platform. The ideal candidate will have hands-on experience with Java, Unix Shell scripting, and...


  • Singapore NTT DATA Full time

    About the RoleWe are seeking an experienced Cloud Solutions Expert to join our team at NTT DATA. As a seasoned professional, you will be responsible for driving sales growth and delivering innovative cloud solutions to our clients.Salary Estimate: $120,000 - $180,000 per year, based on location and experience.Job DescriptionIn this role, you will work...


  • Singapore Unison Consulting Pte Ltd Full time

    About UsUnison Consulting Pte Ltd is a leading consulting firm that specializes in data engineering solutions.We are seeking a highly skilled Big Data Engineering Specialist to join our team.Job DescriptionJob Title: Big Data Engineering SpecialistEstimated Salary: $120,000 - $180,000 per annumAs a Big Data Engineering Specialist at Unison Consulting Pte...


  • Singapore COMBUILDER PTE LTD Full time

    We are seeking a highly skilled and experienced Big Data Architect to design, develop, and deploy big data solutions at CombBuilder PTE LTD.The ideal candidate will have strong expertise in designing and architecting large-scale data platforms using advanced technologies such as Cloudera, Azure Cloud, and Kubernetes, among others.Key Responsibilities:Design...


  • Singapore Databricks Full time

    At Databricks, we are on a mission to accelerate innovation in big data, cloud, and AI. As an Enterprise Account Executive, you will play a critical role in driving revenue growth and expanding our business in the ASEAN region.The key responsibilities of this position include:Elevating Databricks' Unified Analytics Platform powered by Spark and launching the...


  • Singapore U3 INFOTECH PTE. LTD. Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at U3 INFOTECH PTE. LTD. The ideal candidate will have a strong background in designing and delivering intelligent data solutions, with expertise in big data technologies and cloud platforms.About the RoleThis is a permanent position, based in Beach Road. As a Senior Data...

  • Data Architect

    2 days ago


    Singapore CAPGEMINI SINGAPORE PTE. LTD. Full time

    Are you passionate about crafting innovative data solutions that drive impactful business decisions? We are seeking a highly skilled Data Architect to join our team in Singapore. In this role, you will play a key part in building cutting-edge platforms that process and analyze vast datasets with efficiency and scalability.This is an exciting opportunity to...