Kafka Architect

2 weeks ago

Singapore ALEPHYS PTE. LTD. Full time

Overview We are looking for a highly skilled Kafka Engineer / Architect who can design, build, and operate enterprise-scale streaming platforms. This role is hands-on and combines responsibilities across architecture, cluster installation, administration, and application development . The ideal candidate has deep knowledge of Kafka internals, Confluent Platform components, and event-driven application design. Architecture & Design Design scalable and fault-tolerant Confluent Platform / Confluent Cloud architectures (on-prem, cloud, hybrid). Define data streaming strategies including topic design, partitioning, replication, retention, and compaction policies. Architect disaster recovery (DR), geo-replication, and high availability solutions. Establish security, governance, and compliance models (TLS, mTLS, SASL, RBAC, ACLs). Installation & Management Install, configure, and upgrade Confluent Platform components (Brokers, Schema Registry, Connect, ksqlDB, Control Center). Manage Kafka clusters in bare metal, VM, Kubernetes (CFK/Strimzi), or cloud environments . Implement monitoring, alerting, and observability (Prometheus, Grafana, Control Center, Splunk, Datadog). Perform capacity planning, scaling, and performance tuning of Kafka clusters. Ensure data reliability and cluster stability through proactive health checks and troubleshooting. Development & Integration Build producers, consumers, and stream-processing applications using Java, Python, Kafka Streams, or ksqlDB. Develop Kafka Connect pipelines for integrating databases, APIs, and data lakes/warehouses. Implement schema evolution and governance using Confluent Schema Registry (Avro, Protobuf, JSON Schema). Partner with developers to build event-driven microservices and optimize client-side performance. Establish CI/CD pipelines and automate deployments using Terraform, Ansible, Helm, or GitOps . Operations & Support Provide day-to-day operational support for Kafka environments. Lead incident troubleshooting, root cause analysis, and recovery efforts. Manage security patches, upgrades, and audit compliance . Tune stateful streaming workloads (RocksDB, memory, JVM, network). Work with cross-functional teams (data, security, infra) to ensure enterprise adoption. Required Skills & Experience 7+ years in software engineering or infrastructure roles, with 3–5 years focused on Kafka/Confluent . Strong hands-on expertise in Kafka cluster administration and application development . Proficiency in Confluent Platform components : Brokers, Connect, Schema Registry, ksqlDB, Control Center. Solid understanding of Kafka internals (ISR, partitioning, leader election, log compaction). Experience with security protocols : TLS, mTLS, SASL (SCRAM, Kerberos, OAuth), ACLs, RBAC. Strong programming skills in Java, Scala, or Python . Familiarity with event-driven patterns (CDC, CQRS, event sourcing). Experience with Kubernetes (CFK)and IaC (Terraform, Ansible, Helm). Knowledge of stream processing (Kafka Streams, Flink, Spark Streaming). Strong problem-solving skills with ability to dive into cluster issues, performance bottlenecks, and production outages . Preferred Qualifications Exposure to CI/CD pipelines and DevOps practices. Why This Role?You’ll work end-to-end: architecting, installing, managing, and developing Kafka-based solutions. Direct impact on building real-time, event-driven enterprise platforms . Opportunity to work with cutting-edge Confluent technologies at scale. #J-18808-Ljbffr

  • Kafka Architect

    4 days ago

    Singapore ALEPHYS PTE. LTD. Full time

    Overview We are looking for a highly skilled Kafka Engineer / Architect who can design, build, and operate enterprise-scale streaming platforms. This role is hands-on and combines responsibilities across architecture, cluster installation, administration, and application development . The ideal candidate has deep knowledge of Kafka internals, Confluent...

  • Kafka - DevOps

    2 days ago

    Central Singapore Emprego SG Full time

    **Location** Singapore, Central Singapore **Job Type** Contract **Salary** $6,500 - $8,500 Per Month **Date Posted** 7 hours ago Additional Details **Job ID** 3532 **Job Views** 1 Roles & Responsibilities **Role:Kafka - DevOps** **JD**: **Key Responsibilities** - Experience in architecting a highly resilient **Apache Kafka/Confluent Kafka...

  • Java Architect

    12 hours ago

    Singapore JONDAVIDSON PTE. LTD. Full time

    Design and lead scalable, secure Java systems for core banking (transactions, risk, compliance). Drive microservices, cloud-native architecture, and digital transformation in a regulated environment. Key Responsibilities Architect Java/microservices solutions; integrate with legacy & third-party systems Lead teams, mentor on Spring Boot, security,...

  • Solution Architect

    4 days ago

    Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Proven experience as a Solution Architect with hands-on.NET Core development experience. - Strong expertise in event-driven architecture and related technologies. - In-depth knowledge of microservices design and implementation. - Experience with messaging brokers like Apache Kafka, RabbitMQ, or Azure Event Hubs. - Proficiency in Cloud platforms (AWS, Azure,...

  • ENTERPRISE ARCHITECT

    2 days ago

    Singapore Upper Spring Consulting Full time

    Overview We are representing our client in the marine sector to look for a strategic Enterprise Architect to lead the design and evolution of the enterprise technology landscape. This role requires broad expertise across cloud platforms (preferably Azure), data streaming (Kafka), data architecture, DevOps, security, AI, and software product development. A...

  • Solution Architect

    7 days ago

    Singapore INFRASOFT TECHNOLOGIES PTE LTD Full time

    Experience on designing and developing Cloud-native solutions - Experience on Cloud migration, integration patterns, high availability patterns, etc. (e.g. REST APIs, Container platforms, Event-driven architecture, etc) - Experience with Java/Spring/Angular, Oracle/PostgreSQL DB, Linux, API, Kafka etc. - Functional/Business knowledge (of his current/past...

  • App Architect

    1 week ago

    Singapore DXC Technology Full time

    **Posting Title**:Application Architect** **Job Summary**: An Application Architect architects and designs technical solutions for IT-related systems. The responsibilities of an Application Architect include working with developers to ensure solutions are technically sound, mentoring junior level staff, and identify and address issues that affect product...

  • .NET Core Solution Architect

    6 days ago

    Singapore LYNEER CORP (SINGAPORE) PTE. LTD. Full time

    Proven experience as a Solution Architect with hands-on.NET Core development experience. - Strong expertise in event-driven architecture and related technologies. - In-depth knowledge of microservices design and implementation. - Experience with messaging brokers like Apache Kafka, RabbitMQ, or Azure Event Hubs. - Proficiency in Cloud platforms (AWS, Azure,...

  • Quantexa Data Architect

    4 days ago

    Singapore Capgemini Full time

    **Key Responsibilities**: **Architecture & Implementation** - Design and implement end-to-end data pipelines and entity resolution solutions using Quantexa, Spark, and Scala. - Architect real-time streaming solutions utilizing Kafka, Flink, and Kubernetes. **Team Leadership & Collaboration** - Lead cross-functional teams of data engineers, analysts, and...

  • Data Architect

    1 week ago

    Singapore Capgemini Full time

    Job Description We are seeking a highly skilled and experienced Quantexa Data Architect to lead the design and implementation of advanced data solutions leveraging the Quantexa platform. The ideal candidate will possess deep expertise in data engineering, entity resolution, and graph analytics, with a proven track record of delivering scalable solutions...