Data Architect and Cloud Engineer

5 days ago

Singapore beBeeCloudEngineer Full time $120,000 - $180,000
Job Title

Data Architect - Cloud Engineer Position

About the Role

We are seeking an experienced Data Architect to join our team as a Cloud Engineer. The successful candidate will design, implement, and maintain robust data infrastructure solutions using AWS, Databricks, and Informatica IDMC.

Responsibilities
  • Design and architect data storage solutions using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake.
  • Create, manage, and optimize data pipelines for ingesting, processing, and transforming data using AWS services like AWS Glue, AWS Data Pipeline, and AWS Lambda, Databricks for advanced data processing, and Informatica IDMC for data integration and quality.
  • Integrate data from various sources into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.
  • Develop ETL processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
  • Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements.
  • Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring compliance with data privacy regulations.
  • Implement automation for routine tasks using AWS services like AWS Step Functions, AWS Lambda, Databricks Jobs, and Informatica IDMC for workflow automation.
Requirements and Qualifications
  • Bachelor's or master's degree in computer science, data engineering, or a related field.
  • Minimum 10 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC.
  • Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.
  • Evaluate potential technical solutions and make recommendations to resolve data issues especially on performance assessment for complex data transformations and long running data processes.
  • Strong knowledge of SQL and NoSQL databases.
  • Familiarity with data modeling and schema design.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
Preferred Skills
  • Experience with big data technologies like Apache Spark and Hadoop on Databricks.
  • Knowledge of data governance and data cataloguing tools, especially Informatica IDMC.
  • Familiarity with data visualization tools like Tableau or Power BI.
  • Knowledge of containerization and orchestration tools like Docker and Kubernetes.
  • Understanding of DevOps principles for managing and deploying data pipelines.
  • Experience with version control systems (e.g., Git) and CI/CD pipelines.

  • Cloud Data Architect

    1 week ago

    Singapore beBeeData Full time $120,000 - $180,000

    Cloud Engineering Leader RoleThis is an exceptional opportunity for a highly skilled Cloud Engineering Lead to spearhead our organization's cloud-based data initiatives. The selected individual will be responsible for designing, building, and maintaining scalable data pipelines and platforms in the cloud, enabling advanced analytics and data-driven...

  • Cloud Data Architect

    7 days ago

    Singapore beBeeData Full time

    Cloud Engineering Leader Role This is an exceptional opportunity for a highly skilled Cloud Engineering Lead to spearhead our organization's cloud-based data initiatives. The selected individual will be responsible for designing, building, and maintaining scalable data pipelines and platforms in the cloud, enabling advanced analytics and data-driven...

  • Cloud Data Engineering Architect

    1 week ago

    Singapore beBeeDataEngineering Full time $90,000 - $120,000

    Experience the cutting-edge of cloud data engineering as a GCP DevOps Architect. In this role, you will design and automate scalable Google Cloud Lakehouse architectures integrated with MicroStrategy One BI.Job Summary:This is a unique opportunity to join an innovative team and lead large-scale cloud data programs in Agile environments. As a seasoned GCP...

  • Solutions Architect, Hybrid Cloud

    2 weeks ago

    Singapore NTT Data Full time $90,000 - $120,000 per year

    Join to apply for the Solutions Architect, Hybrid Cloud role at NTT DATA, Inc. 3 days ago Be among the first 25 applicants Join to apply for the Solutions Architect, Hybrid Cloud role at NTT DATA, Inc. Get AI-powered advice on this job and more exclusive features. Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is...

  • Cloud Data Architect

    1 week ago

    Singapore beBeeData Full time $90,000 - $120,000

    Job Title: Cloud Data Architect">We are seeking a highly skilled Cloud Data Architect to join our team. As a Cloud Data Architect, you will play a key role in designing and implementing cloud-based data architectures that meet the needs of our global business units.Key Responsibilities:Collaborate with cross-functional teams to define and deliver data...

  • Cloud Data Architect

    6 days ago

    Singapore beBeeDataEngineering Full time $180,000 - $240,000

    Job Title: Cloud Data Engineering LeadWe are seeking a highly skilled and experienced Cloud Data Engineering professional to spearhead our cloud-based data initiatives. This role requires strong leadership skills, a deep understanding of cloud architecture, and the ability to drive innovation in data engineering.Key Responsibilities:Leadership & StrategyLead...

  • Cloud Data Architect

    1 week ago

    Singapore beBeeCloudDataArchitect Full time $90,000 - $120,000

    Job Title: Cloud Data ArchitectAbout the Job:We are seeking an experienced Cloud Data Architect to lead our data platform engineering and migration projects. As a key member of our team, you will be responsible for designing and implementing scalable and secure cloud-based data architectures.Key Responsibilities:Evaluate Hive Metastore state, migration...

  • Senior Cloud Data Architect

    1 week ago

    Singapore beBeeDataEngineering Full time $90,000 - $120,000

    Data Engineering RoleWe are seeking a skilled Data Engineer to join our team and build a robust data infrastructure that leverages analytics platforms. This role involves designing, architecting, and integrating data storage solutions using cloud-based services like AWS and Databricks. The ideal candidate will have expertise in designing, architecting, and...

  • Cloud Data Architect Specialist

    2 weeks ago

    Singapore beBeeData Full time $80,000 - $120,000

    Cloud Data Architect SpecialistWe are seeking a highly skilled Cloud Data Architect Specialist to design, build and maintain scalable, secure and efficient cloud data architectures on platforms like AWS, Azure or Google Cloud.Key Responsibilities:Design and implement cloud data architectures that meet business needs and drive digital...

  • Data Architect

    5 days ago

    Singapore beBeeCloudEngineer Full time $96,000 - $144,000

    Job Title: Data Engineer - Cloud ArchitectAre you a seasoned data engineer looking for a new challenge? Do you have experience in cloud technologies and architecting scalable data systems?This role is perfect for someone who wants to work on complex data challenges, collaborate with cross-functional teams, and drive continuous improvement.We are seeking a...