Data Engineer for Cloud and Big Data Solutions
5 days ago
About Jobline Resources PTE LTD
We are seeking an experienced Data Engineer to join our team at Jobline Resources PTE LTD. As a leading provider of innovative solutions, we value expertise in cloud and big data technologies. The successful candidate will play a vital role in designing, implementing, and optimizing complex data systems.
Job Description:
In this challenging role, you will be responsible for leading end-to-end data migration projects from on-premises environments to Databricks with minimal downtime. You will work closely with architects to develop solution designs that meet functional and non-functional requirements. Your hands-on experience with Databricks on AWS is essential for designing and implementing solutions that drive business outcomes.
You will also have the opportunity to configure Databricks clusters, write PySpark codes, and build CI/CD pipelines for deployments. Additionally, you will leverage your expertise in optimization techniques, such as Zordering, Auto Compaction, and vacuuming, to ensure high-performing data systems. Your strong background in Python and ability to identify, communicate, and mitigate risks and issues will be valuable assets in this role.
The ideal candidate will have a bachelor's or master's degree in computer science, data engineering, or a related field, along with a minimum of 5 years of experience in data engineering. Proficiency in programming languages such as Python, Java, or Scala for building data pipelines is necessary. Familiarity with SQL and NoSQL databases, data modelling, and schema design is also required. Strong problem-solving and analytical skills, excellent communication and collaboration skills, and a strong understanding of DevOps principles are also essential.
Responsibilities:
- Lead end-to-end data migration projects from on-premises environments to Databricks with minimal downtime.
- Work with architects to develop solution designs that meet functional and non-functional requirements.
- Configure Databricks clusters, write PySpark codes, and build CI/CD pipelines for deployments.
- Apply expertise in optimization techniques, such as Zordering, Auto Compaction, and vacuuming.
- Develop solutions that leverage knowledge of SQL and NoSQL databases, data modelling, and schema design.
Requirements:
- Bachelor's or master's degree in computer science, data engineering, or a related field.
- Minimum 5 years of experience in data engineering.
- Proficiency in programming languages such as Python, Java, or Scala.
- Familiarity with SQL and NoSQL databases.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.
Payout Details:
$180,000 per annum based on performance over 3 years.
-
Cloud and Data Centre Solutions Engineer
4 weeks ago
Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full timeJob Title: Cloud and Data Centre Solutions EngineerWe are seeking an experienced Cloud and Data Centre Solutions Engineer to join our team at ST Engineering Cloud and Data Centre Solutions Pte. Ltd.Estimated Salary: SGD 120,000 - 180,000 per annumAs a Cloud and Data Centre Solutions Engineer, you will play a key role in designing, implementing, and managing...
-
Singapore SINGAPORE TELECOMMUNICATIONS LIMITED Full timeJob SummaryWe are seeking an experienced Data Engineer to join our team at SINGAPORE TELECOMMUNICATIONS LIMITED. The successful candidate will be responsible for designing, implementing, and managing cloud data processing pipelines (e.g., AWS) and developing big data solutions for real-time and batch processing of large telco datasets.Main Responsibilities:
-
Big Data Support Specialist
2 weeks ago
Singapore NTT DATA Services Full timeAbout NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...
-
Cloud Solutions Architect
3 days ago
Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full timeAbout the RoleAs a Cloud DevOps Engineer with ST Engineering Cloud and Data Centre Solutions PTE. LTD., you will be responsible for designing, building, and maintaining AWS infrastructure using infrastructure as code tools like GitLab, Terraform, Sentinel, and Ansible.This is an excellent opportunity to work on cutting-edge technologies and architectures,...
-
Data Architect for Big Data Solutions
3 hours ago
Singapore PALO IT SINGAPORE PTE. LTD. Full timeJob Summary PALO IT SINGAPORE PTE. LTD. is a global technology consultancy that crafts tech as a force for good, designing, developing and scaling digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We are seeking an experienced Data Architect for Big Data Solutions to work on acquiring,...
-
Enterprise Big Data Sales Director
3 days ago
Singapore SINGDATA CLOUD PTE. LTD. Full timeAbout SINGDATA CLOUD PTE. LTD.SINGDATA CLOUD PTE. LTD. is a Singapore-based company that specializes in providing innovative cloud-native and AI-native data infrastructure solutions to modern enterprises. Our "Single-Engine" approach simplifies data platform architecture, delivering superior performance and return on investment (ROI) to our clients.Job...
-
Senior Big Data Solution Architect
2 months ago
Singapore Tencent Singapore Full timeResponsibilities: Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between users and industries to create innovative solutions for smart industries via technological advancements such as cloud, AI, and network security. While driving the digitalization of...
-
Data Architect for Cloud Solutions
3 days ago
Singapore EVOLUTION RECRUITMENT SOLUTIONS PTE. LTD. Full timeJob Title: Data Architect for Cloud SolutionsSalary: SGD $120,000 - SGD $180,000 per annumAbout the Role:Evolving as a Databricks Engineer, you will lead the migration of on-premises data warehouses to Databricks and design robust integrated governed data infrastructure. You should have a sound knowledge of Databricks and good understanding of cloud...
-
Cloud Data Engineer
4 weeks ago
Singapore ITSOFT SOLUTIONS PTE. LTD. Full timeRoles & ResponsibilitiesAs a Data Expert you are the bridge between business problems and innovative solutions, using a powerful blend of well-defined methodologies, statistics, mathematics, domain expertise, consulting, and software engineering. You'll wear many hats, and each day you will dive deep into the heart of our business, understanding its...
-
Singapore AVENSYS CONSULTING PTE. LTD. Full timeJob OverviewAvensys Consulting Pte Ltd, a global IT professional services company headquartered in Singapore, seeks a seasoned Data Engineering Leader to spearhead cloud and big data solutions. With a strong background in AWS services, Databricks, and Informatica IDMC, this individual will design and implement cutting-edge data storage, processing, and...
-
Big Data Solution Architect
3 days ago
Singapore Tencent Singapore Full timeJob OverviewTencent Singapore is seeking a skilled Big Data Solution Architect to join our Cloud & Smart Industries Group (CSIG). This role involves promoting the company's cloud and industry Internet strategy, driving digitalization of various industries, and creating innovative solutions for smart industries.
-
Azure Cloud Solutions Engineer
1 week ago
Singapore NTT Data Singapore Full timeCompany Overview">NTT Data Singapore is a leading IT services company that offers end-to-end solutions to clients across various industries.We are currently seeking an experienced Azure Cloud Solutions Engineer to join our team in Singapore.">Job Summary">The successful candidate will be responsible for designing and implementing scalable and resilient cloud...
-
Data Engineer
3 weeks ago
Singapore Singtel Full timeCompany OverviewSingtel, a leading telecommunications company in Singapore, has partnered with the Singapore Institute of Technology to launch The Catalyst Programme. This innovative Work-Study Programme (WSP) aims to develop and groom talent in the ICT sector over a 3-year period.About The RoleWe are seeking an experienced Data Engineer to join our team and...
-
Big Data Solutions Engineer
3 days ago
Singapore SAKSOFT PTE LIMITED Full timeSAKSOFT PTE LIMITED seeks a highly skilled Big Data Solutions Engineer to join our team.We are looking for a talented professional with 9+ years of experience in big data engineering to design and implement scalable, fault-tolerant ETL pipelines on our big data platform. The ideal candidate will have hands-on experience with Java, Unix Shell scripting, and...
-
Cloud Solutions Expert
2 weeks ago
Singapore NTT DATA Full timeAbout the RoleWe are seeking an experienced Cloud Solutions Expert to join our team at NTT DATA. As a seasoned professional, you will be responsible for driving sales growth and delivering innovative cloud solutions to our clients.Salary Estimate: $120,000 - $180,000 per year, based on location and experience.Job DescriptionIn this role, you will work...
-
Big Data Engineering Specialist
3 weeks ago
Singapore Unison Consulting Pte Ltd Full timeAbout UsUnison Consulting Pte Ltd is a leading consulting firm that specializes in data engineering solutions.We are seeking a highly skilled Big Data Engineering Specialist to join our team.Job DescriptionJob Title: Big Data Engineering SpecialistEstimated Salary: $120,000 - $180,000 per annumAs a Big Data Engineering Specialist at Unison Consulting Pte...
-
Big Data Architect with Cloud Expertise
6 days ago
Singapore COMBUILDER PTE LTD Full timeWe are seeking a highly skilled and experienced Big Data Architect to design, develop, and deploy big data solutions at CombBuilder PTE LTD.The ideal candidate will have strong expertise in designing and architecting large-scale data platforms using advanced technologies such as Cloudera, Azure Cloud, and Kubernetes, among others.Key Responsibilities:Design...
-
Singapore Databricks Full timeAt Databricks, we are on a mission to accelerate innovation in big data, cloud, and AI. As an Enterprise Account Executive, you will play a critical role in driving revenue growth and expanding our business in the ASEAN region.The key responsibilities of this position include:Elevating Databricks' Unified Analytics Platform powered by Spark and launching the...
-
Singapore U3 INFOTECH PTE. LTD. Full timeJob DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at U3 INFOTECH PTE. LTD. The ideal candidate will have a strong background in designing and delivering intelligent data solutions, with expertise in big data technologies and cloud platforms.About the RoleThis is a permanent position, based in Beach Road. As a Senior Data...
-
Data Architect
2 days ago
Singapore CAPGEMINI SINGAPORE PTE. LTD. Full timeAre you passionate about crafting innovative data solutions that drive impactful business decisions? We are seeking a highly skilled Data Architect to join our team in Singapore. In this role, you will play a key part in building cutting-edge platforms that process and analyze vast datasets with efficiency and scalability.This is an exciting opportunity to...