Apache Pulsar at Yahoo!

March 9, 2018

Christian Hasker

Last month, at Microsoft in Sunnyvale, we held our very first Apache Pulsar Bay Area meetup. I’d like to thank our gracious hosts from Microsoft, Avrilia Floratou and Asvhin Agrawal, who will be presenting at our next meetup on March 20th.

We were fortunate enough to have Joe Francis from Yahoo presenting on how Yahoo uses Apache Pulsar. Joe manages the Cloud Services team at Yahoo/Oath and led the growth of Pulsar from conception to a full-fledged cloud service that handles around 500 billion messages a day.

You can watch Joe’s presentation here:

Next, Matteo Merli of Streamlio, who developed Apache Pulsar while at Yahoo, gave a presentation on Pulsar’s unique segment-centric architecture, and how it provides benefits over the partition-based approach of systems like Apache Kafka. Pulsar has an architecture composed of two layers: a stateless serving layer, comprised of a set of brokers that receive and deliver messages, and a stateful persistence layer, comprised of a set of Apache BookKeeper storage nodes called bookies that durably store messages.

You can watch Matteo’s presentation here:

If you are in the Bay Area please join the meetup group. We’re going to do our very best to provide great educational content at each event. If there’s a subject you’re interested in or if you would like to present at our meetup please contact us at info@streaml.io. We hope to see you at a future event!