Databricks Engineer with Data Migration Expertise
6 days ago
About the Role:
We are seeking an experienced Databricks Engineer to lead end-to-end data migration projects from on-premises environments to Databricks with minimal downtime. This is a fantastic opportunity for someone who is passionate about working with big data technologies and has expertise in AWS or Azure services.
Key Responsibilities:
- Lead data migration projects, ensuring seamless transitions with minimal downtime.
- Collaborate with architects to design solutions that meet functional and non-functional requirements.
- Design and implement scalable data pipelines using Databricks, leveraging AWS or Azure services.
- Develop and maintain high-quality Pyspark codes, build CI/CD pipelines, and configure Databricks clusters.
- Optimize data processing using Auto Loader, DLT pipelines, and leverage optimization techniques (Zordering, Auto Compaction, vacuuming).
- Identify and mitigate risks, ensuring data availability and integrity.
- Stay up-to-date with AWS, Databricks services, and data engineering best practices to recommend new technologies and techniques.
Requirements and Qualifications:
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
- A minimum of 5 years of experience in data engineering, with expertise in AWS or Azure services, Databricks, and/or Informatica IDMC.
- Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.
- Strong knowledge of SQL and NoSQL databases.
- Familiarity with data modelling and schema design.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Estimated Salary Range: $120,000 - $180,000 per annum, depending on location and experience.
About ZENITH INFOTECH (S) PTE LTD:
Zenith Infotech (S), a reputable tech recruitment firm in Singapore, assists clients in finding top talent. Our client values innovative thinkers and skilled professionals who can drive growth and success.
-
Data Architect with Databricks Expertise
6 days ago
Singapore AVENSYS CONSULTING PTE. LTD. Full timeWe are seeking a highly skilled Data Architect to join our team at AVENSYS CONSULTING PTE. LTD. This is an exciting opportunity to work on challenging projects and expand your skill set as a Databricks Engineer.The ideal candidate will have a strong background in data architecture, cloud solutions, and data governance. They will be responsible for designing...
-
Singapore HELIUS TECHNOLOGIES PTE. LTD. Full timeAbout Helius TechnologiesHelius Technologies PTE. LTD. is a leading technology company providing innovative solutions to businesses worldwide.Job Title: Data Architect with Expertise in Cloud MigrationEstimated Salary: SGD 12,000 - 18,000 per monthAbout the RoleWe are seeking an experienced Data Architect to join our team. As a key member of our data...
-
Databricks Data Architect
1 day ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeWe are seeking an experienced Databricks Data Architect to join our team at ZENITH INFOTECH (S) PTE LTD.Job Description:A Databricks Data Architect is responsible for designing and implementing data architecture on Databricks, ensuring high-quality data management, security, and compliance. The role involves migrating from as-is on-prem data warehouse to...
-
Big Data Migration Engineer
6 days ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeJob DescriptionZenith Infotech is seeking a highly skilled Big Data Migration Engineer to lead our team in migrating data from on-premises environments to Databricks.Key Responsibilities:Design and implement end-to-end data migration projects with minimal downtimeCollaborate with architects to develop solution designs meeting functional and non-functional...
-
Databricks Engineer
6 days ago
Singapore KRIS INFOTECH PTE. LTD. Full timeRoles & ResponsibilitiesJob Description: Responsible for migrating from as-is on-perm data warehouse to Databricks and sound knowledge of Databricks. Requires good understanding of data architecture, cloud solutions, building and maintaining a robust, integrated, and governed data infrastructure. The role involves extracting valuable insights from data...
-
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeJob OverviewZenith Infotech (S) Pte Ltd is seeking a highly skilled Data Infrastructure Engineer to lead our cloud data migration projects. This role involves designing and implementing robust, integrated, and governed data infrastructure on Databricks.About the RoleWe are looking for a seasoned engineer with hands-on experience in Databricks to design and...
-
Big Data Migration Specialist
2 days ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeAt Zenith Infotech (S) Pte Ltd, we are seeking an experienced Big Data Migration Specialist to join our team. The ideal candidate will have a strong background in data engineering and migration, with expertise in AWS services, Databricks, and Informatica IDMC.About the RoleThis is a key role within our organization, responsible for migrating data from...
-
Databricks Engineer
6 days ago
Singapore AVENSYS CONSULTING PTE. LTD. Full timeRoles & ResponsibilitiesJob DescriptionAvensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in...
-
Singapore ADECCO PERSONNEL PTE LTD Full timeAre you a skilled data engineer looking to take your career to the next level? ADECCO PERSONNEL PTE LTD is seeking an experienced Cloud Migration Engineer to join our team.Job Overview:We are looking for a highly motivated and detail-oriented individual to lead our cloud migration efforts. As a Cloud Migration Engineer, you will be responsible for overseeing...
-
Senior Data Migration Specialist
4 days ago
Singapore KRIS INFOTECH PTE. LTD. Full timeJob OverviewKRIS INFOTECH PTE. LTD. is seeking an experienced Senior Data Migration Specialist to join our team in Singapore.About the RoleWe are looking for a highly skilled professional with expertise in data migration, specifically in Informatica PowerCenter and IDMC. The successful candidate will be responsible for leading the migration process, ensuring...
-
Singapore AVENSYS CONSULTING PTE. LTD. Full timeWe are currently seeking a highly skilled Data Engineer to join our team at Avensys Consulting Pte. Ltd. in Singapore.This is an exciting opportunity to expand your skill set, achieve job satisfaction, and work-life balance.A successful candidate will be responsible for migrating from as-is on-prem data warehouse to Databricks with minimal downtime. The role...
-
Data Architect for Cloud Data Migration
2 days ago
Singapore EVOLUTION RECRUITMENT SOLUTIONS PTE. LTD. Full timeWe are seeking a highly skilled Data Architect to lead our cloud data migration project.The successful candidate will be responsible for migrating our on-premises data warehouse to Databricks, ensuring minimal downtime and maximum efficiency.About the Role:Design and implement a robust and integrated data infrastructure on AWS using Databricks.Work closely...
-
Cloud Migration Engineer
6 days ago
Singapore ADECCO PERSONNEL PTE LTD Full timeRoles & ResponsibilitiesJob Description:A ETL Eng will oversee the migration specializing in Informatica PowerCenter to IDMC. This role involves leading the migration efforts, ensuring seamless transition, and leveraging the advanced features of IDMC. The ideal person will have extensive experience in data integration, migration projects and hands-on...
-
Cloud Migration Engineer
6 days ago
Singapore KRIS INFOTECH PTE. LTD. Full timeRoles & ResponsibilitiesJob Description: A ETL Eng will oversee the migration specializing in Informatica PowerCenter to IDMC. This role involves leading the migration efforts, ensuring seamless transition, and leveraging the advanced features of IDMC. The ideal person will have extensive experience in data integration, migration projects and hands-on...
-
Cloud Migration Engineer
2 days ago
Singapore ADECCO PERSONNEL PTE LTD Full timeRoles & ResponsibilitiesJob Description:A ETL Eng will oversee the migration specializing in Informatica PowerCenter to IDMC. This role involves leading the migration efforts, ensuring seamless transition, and leveraging the advanced features of IDMC. The ideal person will have extensive experience in data integration, migration projects and hands-on...
-
Databricks Engineer
6 days ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeRoles & ResponsibilitiesA Databricks Engineer is responsible for migrating from as-is on-perm data warehouse to Databricks and sound knowledge of Databricks. Requires good understanding of data architecture, cloud solutions, building and maintainirobust, integrated, and governed data infrastructure. The role involves extracting valuable insights from...
-
Data Migration Architect
2 days ago
Singapore KRIS INFOTECH PTE. LTD. Full timeWe are seeking a skilled Cloud Data Engineer - ETL Specialist to join our team at KRIS INFOTECH PTE. LTD.Job Description:OverviewThe ideal candidate will have extensive experience in data engineering, with expertise in AWS or Azure services, Databricks, and/or Informatica IDMC.ResponsibilitiesManage the end-to-end migration process from informatica...
-
Data Integration Engineer
2 days ago
Singapore AVENSYS CONSULTING PTE. LTD. Full timeWe are seeking a highly skilled Data Integration Engineer to join our team at Avensys Consulting Pte Ltd. As a Data Integration Engineer, you will play a crucial role in migrating our data integration processes from Informatica PowerCenter to Informatica IDMC.Key ResponsibilitiesLead the end-to-end migration process from Informatica PowerCenter to...
-
Databricks Engineer: Cloud Native Expert
6 days ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeWe are seeking a highly skilled Databricks Engineer to join our team at Zenith Infotech (S) Pte Ltd. This is a 6-12 months contract role that offers a competitive salary of $7,000-$8,250.The ideal candidate will have a strong background in data engineering, with expertise in AWS or Azure services, Databricks, and/or Informatica IDMC. They will be responsible...
-
Databricks Engineer
6 days ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeRoles & ResponsibilitiesZenith Infotech (S), a tech recruitment firm with 27 years of presence in Singapore, is assisting one of our reputable clients to lookout for Databricks Engineer with 5 years of experience. Job Scope:• Lead end to end data migration project from on-premises environments to Databricks with minimal downtime.• Work with architects...