Advanced Data Infrastructure Specialist

5 days ago

Singapore beBeeDataEngineering Full time

Key Data Engineering Role

Job Overview:

A skilled Data Engineer is required to build and maintain a robust data infrastructure that leverages analytics platforms. This role involves designing, architecting, and integrating data storage solutions using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB. The ideal candidate will also have expertise in Databricks' Delta Lake and Informatica IDMC for metadata management and data cataloging.

Key Responsibilities:

• Design data storage solutions and integrate various AWS services, including Databricks' Delta Lake, and Informatica IDMC for metadata management and data cataloging.
• Create, manage, and optimize data pipelines using AWS Glue, AWS Data Pipeline, and AWS Lambda, along with Databricks for advanced data processing and Informatica IDMC for data integration and quality.
• Integrate data from various sources into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.
• Develop ETL processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
• Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.
• Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring compliance with data privacy regulations. Employ Informatica IDMC for data governance and compliance.
• Implement automation for routine tasks, such as data ingestion, transformation, and monitoring, using AWS services like AWS Step Functions, AWS Lambda, Databricks Jobs, and Informatica IDMC for workflow automation.
• Maintain clear and comprehensive documentation of data infrastructure, pipelines, and configurations in both AWS and Databricks environments, with metadata management facilitated by Informatica IDMC.

Requirements and Qualifications:

• Bachelor's or master's degree in computer science, data engineering, or a related field.
• Minimum 10 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC.
• Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.
• Strong knowledge of SQL and NoSQL databases.
• Familiarity with data modeling and schema design.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Certifications in AWS, Databricks, and Informatica are a plus.

  • Advanced Infrastructure Specialist

    7 days ago

    Singapore beBeeinfrastructure Full time $12,400

    Job Title: Advanced Infrastructure SpecialistOverview of the RoleWe are seeking a highly skilled Advanced Infrastructure Specialist to join our dynamic team. In this role, you will be responsible for designing and implementing robust infrastructure solutions to support the development and deployment of innovative software applications.Key...

  • Advanced Infrastructure Specialist

    6 days ago

    Singapore beBeeinfrastructure Full time

    Job Title: Advanced Infrastructure Specialist Overview of the Role We are seeking a highly skilled Advanced Infrastructure Specialist to join our dynamic team. In this role, you will be responsible for designing and implementing robust infrastructure solutions to support the development and deployment of innovative software applications. Key...

  • Data Infrastructure Specialist

    2 weeks ago

    Singapore beBeeStorage Full time $80,000 - $120,000

    Job Title: Data Infrastructure SpecialistWe are seeking a highly skilled and experienced Data Infrastructure Specialist to join our team. As a Data Infrastructure Specialist, you will play a key role in designing, implementing, and maintaining data infrastructure solutions that meet the evolving needs of our organization.Key Responsibilities:Design and...

  • Data Infrastructure Specialist

    2 weeks ago

    Singapore beBeeInfrastructure Full time

    Job Title: Data Infrastructure Specialist About the Role We are seeking an experienced Data Infrastructure Specialist to join our team. The successful candidate will have a strong background in storage systems and management, with excellent technical knowledge of SAN, NAS, and Object Storage administration. Key Responsibilities - Support regional storage...

  • Data Infrastructure Specialist

    1 week ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Data Infrastructure SpecialistWe are seeking a highly skilled Data Infrastructure Specialist to join our team. The ideal candidate will have a strong background in building and maintaining data infrastructure that detects unauthorized privileged access in logs, applying confidence scoring with AI and data engineering best practices.

  • Advanced Enterprise Infrastructure Expert

    1 week ago

    Singapore beBeeinfrastructure Full time $60,000 - $120,000

    Enterprise Infrastructure Specialist Job SummaryWe are seeking a highly skilled Enterprise Infrastructure Specialist to join our team. In this role, you will be responsible for designing and managing technically advanced enterprise infrastructure, evaluating new tools and deploying advanced strategies to achieve performance tuning and resiliency,...

  • Senior Data Infrastructure Specialist

    1 week ago

    Singapore beBeeData Full time $120,000 - $180,000

    Job Title:Senior Data Infrastructure SpecialistAbout the RoleWe are seeking a highly skilled Senior Data Infrastructure Specialist to lead our data engineering efforts. The ideal candidate will have extensive experience in designing and implementing scalable data architectures, as well as building and maintaining complex data models.Design and implement...

  • Advanced System Infrastructure Specialist

    6 days ago

    Singapore beBeeInfrastructure Full time

    Job Title: Advanced System Infrastructure Specialist "> Key Responsibilities: The primary role of the Advanced System Infrastructure Specialist involves overseeing and administering multiple systems to ensure seamless operations. This includes Active Directory management, Windows Update Services, DNS record maintenance, and Group Policy administration. ...

  • Advanced System Infrastructure Specialist

    7 days ago

    Singapore beBeeInfrastructure Full time $80,000 - $144,000

    Job Title: Advanced System Infrastructure Specialist">Key Responsibilities:The primary role of the Advanced System Infrastructure Specialist involves overseeing and administering multiple systems to ensure seamless operations. This includes Active Directory management, Windows Update Services, DNS record maintenance, and Group Policy...

  • Advanced Data Infrastructure Specialist

    1 week ago

    Singapore beBeeData Full time $60,000 - $80,000

    Data Center Technician Role OverviewAs a skilled Data Center Technician, you will be responsible for installing, configuring, testing, troubleshooting, and maintaining hardware and server software. Your expertise in data center operations will enable you to deploy new infrastructure, diagnose issues, and resolve problems efficiently.