Big Data Solutions Architect

4 days ago

Singapore beBeeData Full time
Job Description

We are seeking a highly skilled Big Data Engineer to design, build, and maintain scalable, reliable big data platforms while driving automation and standardization across development and operations.

This is an exciting opportunity to bridge the gap between data engineering and DevOps, ensuring seamless data pipelines, efficient CI/CD workflows, and robust infrastructure management to support data-driven business growth.

Responsibilities
  1. Big Data Platform Development & Operations:
  • Architect and deploy distributed big data ecosystems for real-time and batch data processing, ensuring high availability and performance at scale.
  • Optimize data pipelines for ingestion, transformation, and storage, leveraging tools like NiFi, Airflow, or Luigi to automate workflows.
  • Manage cluster resources and monitor platform health using tools like YARN, Prometheus, Grafana, or Datadog, resolving issues to maintain 99.9% uptime.
  • Implement end-to-end CI/CD pipelines using Jenkins, GitLab CI/CD, or GitHub Actions, ensuring automated testing, deployment, and rollback capabilities.
Cross-Functional Collaboration:
  • Partner with data engineers, data scientists, and software developers to understand requirements and deliver scalable solutions for data processing and analytics.
  • Participate in technical design reviews, advocating for cloud-native, containerized architectures (e.g., Docker, Kubernetes) and microservices.
  • Train and mentor teams on DevOps methodologies, fostering a culture of collaboration and continuous improvement.
Security & Compliance:
  • Ensure data platforms adhere to security standards through encryption, IAM policies, and vulnerability scanning.
  • Monitor and mitigate security risks, such as data breaches or unauthorized access, implementing proactive threat detection and incident response protocols.
Required Skills & Qualifications

To be successful in this role, you should have:

  • At least 2 years' experience with Hive, Hadoop, Spark, Python
  • Good knowledge and experience with Linux
  • Experience with containerization technologies such as Docker and Kubernetes
  • Familiarity with DevOps best practices and tools such as Git, Jenkins
  • Good learning attitude
  • Good English speaking and writing
Benefits

This is an excellent opportunity to join our team and contribute to the development of cutting-edge big data solutions.

You will have the chance to work with a talented team of professionals, learn from experienced colleagues, and develop your skills in a dynamic and supportive environment.

Others

Please submit your application, including your resume and a cover letter outlining your relevant experience and qualifications.

  • Big Data Architect

    3 days ago

    Singapore People Profilers Full time

    Job Description: - Provide leadership and drive architecture and the design of Big Data solutions - Design and implement high performance systems supporting large volume real time and batched data processes - Ensure implementation Data Governance and security best practices for Big Data environments - Provide technical guidance and mentorship to the team to...

  • Senior Big Data Solution Architect

    2 weeks ago

    Singapore Lightspeed Studios Full time

    Senior Big Data Solution Architect page is loaded Senior Big Data Solution Architect Apply remote type Onsite locations Singapore-CapitaSky time type Full time posted on Posted 30+ Days Ago job requisition id R104094 Business Unit What the Role Entails Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry...

  • Senior Big Data Solution Architect

    2 weeks ago

    Singapore Lightspeed Studios Full time

    Senior Big Data Solution Architect page is loadedSenior Big Data Solution Architect Apply remote type Onsite locations Singapore-CapitaSky time type Full time posted on Posted 30+ Days Ago job requisition id R104094Business Unit What the Role Entails Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry...

  • Senior Big Data Solution Architect

    5 days ago

    Singapore Lightspeed Studios Full time

    Senior Big Data Solution Architect page is loaded Senior Big Data Solution Architect Apply remote type Onsite locations Singapore-CapitaSky time type Full time posted on Posted 30+ Days Ago job requisition id R Business Unit What the Role Entails Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry...

  • Senior Big Data Solution Architect

    2 weeks ago

    Singapore Lightspeed Studios Full time

    Senior Big Data Solution Architect page is loadedSenior Big Data Solution ArchitectApply remote type Onsite locations Singapore-CapitaSky time type Full time posted on Posted 30+ Days Ago job requisition id R104094Business UnitWhat the Role EntailsCloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet...

  • Big Data Architect

    1 day ago

    Singapore Unison Consulting Pte Ltd Full time

    Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. - Optimize data...

  • Senior Big Data Solution Architect

    1 day ago

    Singapore Tencent Full time

    Senior Big Data Solution ArchitectApply remote type Onsite locations Singapore-CapitaSky time type Full time posted on Posted 15 Days Ago job requisition id R104094Business UnitWhat the Role EntailsCloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between...

  • Senior Big Data Solution Architect

    2 weeks ago

    Singapore Tencent Full time

    Responsibilities: Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between users and industries to create innovative solutions for smart industries via technological advancements such as cloud, AI, and network security. While driving the digitalization of...

  • Senior Big Data Solution Architect

    2 days ago

    Singapore Tencent Full time

    **Business Unit**: **What the Role Entails**: Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between users and industries to create innovative solutions for smart industries via technological advancements such as cloud, AI, and network security. While...

  • Big Data Solutions Specialist

    5 days ago

    Singapore beBeeTechnical Full time

    Job DescriptionAs a Resident Solutions Architect (RSA), you will be part of the Professional Services team and work with clients on short to medium term customer engagements solving their big data problems using Apache Spark and the Databricks Data Intelligence Platform.You will be in a customer-facing role that requires deep hands-on expertise in Apache...