Advanced Data Infrastructure Specialist

5 days ago

Singapore beBeeDataEngineering Full time $180,000 - $220,000
Key Data Engineering Role

Job Overview:


A skilled Data Engineer is required to build and maintain a robust data infrastructure that leverages analytics platforms. This role involves designing, architecting, and integrating data storage solutions using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB. The ideal candidate will also have expertise in Databricks' Delta Lake and Informatica IDMC for metadata management and data cataloging.

Key Responsibilities:
• Design data storage solutions and integrate various AWS services, including Databricks' Delta Lake, and Informatica IDMC for metadata management and data cataloging.

• Create, manage, and optimize data pipelines using AWS Glue, AWS Data Pipeline, and AWS Lambda, along with Databricks for advanced data processing and Informatica IDMC for data integration and quality.

• Integrate data from various sources into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.

• Develop ETL processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.

• Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.

• Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring compliance with data privacy regulations. Employ Informatica IDMC for data governance and compliance.

• Implement automation for routine tasks, such as data ingestion, transformation, and monitoring, using AWS services like AWS Step Functions, AWS Lambda, Databricks Jobs, and Informatica IDMC for workflow automation.

• Maintain clear and comprehensive documentation of data infrastructure, pipelines, and configurations in both AWS and Databricks environments, with metadata management facilitated by Informatica IDMC.

Requirements and Qualifications:
• Bachelor's or master's degree in computer science, data engineering, or a related field.

• Minimum 10 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC.

• Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.

• Strong knowledge of SQL and NoSQL databases.

• Familiarity with data modeling and schema design.

• Excellent problem-solving and analytical skills.

• Strong communication and collaboration skills.

• Certifications in AWS, Databricks, and Informatica are a plus.

  • Advanced Infrastructure Specialist

    2 days ago

    Singapore beBeeDevops Full time $90,000 - $120,000

    Job Title: Advanced Infrastructure SpecialistThe role of the Senior DevOps Engineer is to create and maintain continuous deployment processes and tools for various components in a data protection platform. Key Responsibilities:Design, develop, and maintain SDLC pipelines to support software development, testing, deployment, and security.Collaborate with...

  • Advanced Data Infrastructure Specialist

    22 hours ago

    Singapore beBeeDataEngineering Full time

    Key Data Engineering Role Job Overview: A skilled Data Engineer is required to build and maintain a robust data infrastructure that leverages analytics platforms. This role involves designing, architecting, and integrating data storage solutions using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB. The ideal candidate...

  • Data Infrastructure Specialist

    6 days ago

    Singapore beBeeInfrastructure Full time $80,000 - $160,000

    Job Title: Data Infrastructure SpecialistAbout the RoleWe are seeking an experienced Data Infrastructure Specialist to join our team. The successful candidate will have a strong background in storage systems and management, with excellent technical knowledge of SAN, NAS, and Object Storage administration.Key Responsibilities- Support regional storage...

  • Advanced Network Infrastructure Specialist

    5 days ago

    Singapore beBeeNetwork Full time $102,240 - $124,960

    Job Title: Advanced Network Infrastructure SpecialistWe are seeking a seasoned network engineer to join our organization. This role is responsible for implementing and maintaining network solutions based on provided guidelines and scripts.Key Responsibilities:Implement network configurations according to provided specifications and procedures.Collaborate...

  • Infrastructure Specialist

    4 days ago

    Singapore EPERGNE SOLUTIONS PTE. LTD. Full time

    Epergne Solutions is seeking an Infrastructure Specialist. **Responsibilities** Deployment of IT infrastructure storage and backup systems for Level 2 and Level 3 environments. Deployment and administration of Data Protection solution Rubrik, an advanced data security and management solution, across multiple countries for large infrastructures **Skills...

  • Data Center Infrastructure Specialist

    6 days ago

    Singapore beBeeMechanical Full time $60,000 - $90,000

    Job Title: Data Center Infrastructure SpecialistWe are seeking an experienced Data Center Infrastructure Specialist to join our team. The ideal candidate will have a strong background in mechanical and electrical engineering, with expertise in CRAC (Computer Room Air Conditioning) and WDS (Water Detection System) infrastructure.Key Responsibilities:The...

  • Data Centre Infrastructure Specialist

    4 days ago

    Singapore beBeeinfrastructure Full time $90,000 - $120,000

    Job Title: Infrastructure SpecialistWe are seeking an experienced Infrastructure Specialist to manage our data center facilities.The ideal candidate will have a strong background in building technologies, mechanical and electrical services, as well as experience in data center facility and vendor management.

  • Data Infrastructure Specialist

    1 week ago

    Singapore beBeeDataInfrastructure Full time $120,000 - $180,000

    Job Title: Data Infrastructure SpecialistWe are seeking an experienced Data Infrastructure Specialist to join our team. In this role, you will be responsible for designing, implementing, and maintaining efficient data pipelines to integrate data from various sources.Key Responsibilities:Design and implement ETL (Extract, Transform, Load) processes to...

  • Data Engineer

    5 days ago

    Singapore Keppel Infrastructure Full time

    The Data Engineer supports the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable and secure manner. Key responsibilities are: - Define optimal solutions for data collection, processing and...

  • Data Engineer

    3 days ago

    Singapore Keppel Infrastructure Full time

    The Data Engineer supports the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable and secure manner. The key responsibilities are: - Define optimal solutions for data collection, processing and...