Matteo Merli, Apache Pulsar PMC Chair and CTO @ StreamNative

Matteo Merli is the Apache Pulsar PMC Chair and CTO at StreamNative. He was one of the original co-creators of Pulsar while at Yahoo!, co-founder of Streamlio, committer and PMC of Apache Pulsar and Apache BookKeeper.

Replicated Subscriptions: Taking Geo-Replication to the Next Level

Wed Jun 16, 1:00 PM - 1:35 PM, PT

Replicated subscriptions is a powerful feature that was recently added to Pulsar. It allows for applications to implement very sophisticated cluster-level failover strategies, by keeping the subscription status in-sync across different clusters.

With replicated subscriptions, a consumer can switch to a different cluster and resume the consumption from a position very close to where it left off before.

This session will explore various patterns of cluster failover, when it is appropriate to use them and the different tradeoffs of each approach.

After that, we will dive into the implementation of the replicated subscriptions mechanism, to show how using a distributed protocol, Pulsar is able to establish associations for a given message across multiple different data-centers, while exchanging control messages through the replication data path.