Resources and tutorials

A collection of information on streaming and real-time from Streamlio and around the web

Architecture and Key Concepts

tech notes

Key Concepts

Learn about key concepts in streaming messaging and real-time processing.

tech notes

Key Concepts

Learn about key concepts in streaming messaging and real-time processing.

solution brief

Streamlio Real-Time Solution

Read about the Streamlio unified solution for messaging, processing and storage for streaming and real-time data in this solution brief.

solution brief

Streamlio Real-Time Solution

Read about the Streamlio unified solution for messaging, processing and storage for streaming and real-time data in this solution brief.

video

Miroservices Part 3: Security Considerations

In this final video of a three-part series, Christian Hasker of Streamlio interviews JJ about what security considerations enterprises should think about when adopting microservices.

video

Miroservices Part 3: Security Considerations

In this final video of a three-part series, Christian Hasker of Streamlio interviews JJ about what security considerations enterprises should think about when adopting microservices.

video

Microservices Part 2: How to break up a monolithic application: guidelines and best practices

In this second video of a three-part series, Christian Hasker of Streamlio interviews JJ, an expert in microservices about how to actually break apart a monolithic application into microservices. JJ provides some guidelines and best practices.

video

Microservices Part 2: How to break up a monolithic application: guidelines and best practices

In this second video of a three-part series, Christian Hasker of Streamlio interviews JJ, an expert in microservices about how to actually break apart a monolithic application into microservices. JJ provides some guidelines and best practices.

video

Microservices Part 1: What are they, what aren't they? An interview with an expert

Breaking apart monolithic applications into microservices, and adopting microservices-based architectures for new applications is a hot trend within enterprises. In this first video of a three-part series, Christian Hasker of Streamlio interviews JJ Jeyappragash, an expert in microservices, who explains what microservices are, and more importantly, what they are not.

video

Microservices Part 1: What are they, what aren't they? An interview with an expert

Breaking apart monolithic applications into microservices, and adopting microservices-based architectures for new applications is a hot trend within enterprises. In this first video of a three-part series, Christian Hasker of Streamlio interviews JJ Jeyappragash, an expert in microservices, who explains what microservices are, and more importantly, what they are not.

video

Introduction to microservices and real-time data processing

Karthik Ramasamy, co-founder of Streamlio, gave this talk at a meetup at Narvar (corp.narvar.com). In this presentation, designed for developers that are thinking about moving away from monolithic application architectures, he shares thoughts about microservices and real-time data processing.

video

Introduction to microservices and real-time data processing

Karthik Ramasamy, co-founder of Streamlio, gave this talk at a meetup at Narvar (corp.narvar.com). In this presentation, designed for developers that are thinking about moving away from monolithic application architectures, he shares thoughts about microservices and real-time data processing.

Messaging and Queuing

presentation

Pulsar -- Distributed Pub/Sub Platform

A deeper technical dive into Apache Pulsar* architecture, features, and use cases, presented at a tech talk by the Yahoo! team in November 2016.

presentation

Pulsar -- Distributed Pub/Sub Platform

A deeper technical dive into Apache Pulsar* architecture, features, and use cases, presented at a tech talk by the Yahoo! team in November 2016.

presentation

Pulsar, a highly scalable, low latency pub-sub messaging system

Presentation by the Yahoo! team at the Bay Area Hadoop meetup in October 2016 providing a brief technical overview of Apache Pulsar*.

presentation

Pulsar, a highly scalable, low latency pub-sub messaging system

Presentation by the Yahoo! team at the Bay Area Hadoop meetup in October 2016 providing a brief technical overview of Apache Pulsar*.

blog

Open-Sourcing Pulsar, Pub-Sub Messaging at Scale

Read about the origins, development, and use cases of Apache Pulsar*, the open-source messaging and queuing solution developed at Yahoo!, in this blog post from the Yahoo! team.

blog

Open-Sourcing Pulsar, Pub-Sub Messaging at Scale

Read about the origins, development, and use cases of Apache Pulsar*, the open-source messaging and queuing solution developed at Yahoo!, in this blog post from the Yahoo! team.

video

Unified queuing and streaming: Part 2

In this video Sanjeev Kulkarni of Streamlio discusses a retail use case that would need both queuing and streaming. He whiteboards how Apache Pulsar is uniquely able to handle both use cases within one distributed messaging system.

video

Unified queuing and streaming: Part 2

In this video Sanjeev Kulkarni of Streamlio discusses a retail use case that would need both queuing and streaming. He whiteboards how Apache Pulsar is uniquely able to handle both use cases within one distributed messaging system.

video

Unified queuing and streaming: Part 1

In this short video, Sanjeev Kulkarni and Christian Hasker of Streamlio discuss the differences between queuing and streaming. Apache Pulsar, the next generation distributed pub/sub system is unique in that it can handle both queuing and streaming use cases. Sanjeev presents a definition of each, and explains when it would make sense to use one vs the other.

video

Unified queuing and streaming: Part 1

In this short video, Sanjeev Kulkarni and Christian Hasker of Streamlio discuss the differences between queuing and streaming. Apache Pulsar, the next generation distributed pub/sub system is unique in that it can handle both queuing and streaming use cases. Sanjeev presents a definition of each, and explains when it would make sense to use one vs the other.

video

Migrating an Apache Kafka application to Apache Pulsar with no code changes

In this 201 level video, Sijie Guo of Streamlio demonstrates how to migrate an existing Kafka application to Apache Pulsar with no code change using the Kafka API wrapper. It can be used to migrate an application to take advantage of next generation messaging features in Pulsar such as multi-datacenter support, multi-tenancy, strong durability guarantees, and unified messaging and queuing architecture.

video

Migrating an Apache Kafka application to Apache Pulsar with no code changes

In this 201 level video, Sijie Guo of Streamlio demonstrates how to migrate an existing Kafka application to Apache Pulsar with no code change using the Kafka API wrapper. It can be used to migrate an application to take advantage of next generation messaging features in Pulsar such as multi-datacenter support, multi-tenancy, strong durability guarantees, and unified messaging and queuing architecture.

video

Install Apache Pulsar and get up and running in 4 minutes

Development 101 series: in this quick 4-minute video, Sanjeev Kulkarni shows you how easy it is to download, install and get Apache Pulsar up and running on your laptop. For more information on Apache Pulsar visit streaml.io or the project at pulsar.apache.org.

video

Install Apache Pulsar and get up and running in 4 minutes

Development 101 series: in this quick 4-minute video, Sanjeev Kulkarni shows you how easy it is to download, install and get Apache Pulsar up and running on your laptop. For more information on Apache Pulsar visit streaml.io or the project at pulsar.apache.org.

video

How Apache Pulsar uses Apache BookKeeper to store topics

In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses how Apache Pulsar uses Apache BookKeeper to store replicated logs for hundreds of thousands of topics.

video

How Apache Pulsar uses Apache BookKeeper to store topics

In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses how Apache Pulsar uses Apache BookKeeper to store replicated logs for hundreds of thousands of topics.

video

Message guarantees in Apache Pulsar with Apache BookKeeper

In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses what happens to a message when it enters Apache Pulsar and the guarantees that are provided.

video

Message guarantees in Apache Pulsar with Apache BookKeeper

In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses what happens to a message when it enters Apache Pulsar and the guarantees that are provided.

video

How Apache Pulsar stores cursors using Apache BookKeeper

In this expert developer whiteboard session, Ivan Kelly, PMC member of Apache BookKeeper and engineer at Streamlio talks about cursor management. This is very hard for other messaging systems to do but is no sweat for Apache Pulsar, which leverages Apache BookKeeper. Make sure to read Ivan’s blog post on the subject at streaml.io/blog.

video

How Apache Pulsar stores cursors using Apache BookKeeper

In this expert developer whiteboard session, Ivan Kelly, PMC member of Apache BookKeeper and engineer at Streamlio talks about cursor management. This is very hard for other messaging systems to do but is no sweat for Apache Pulsar, which leverages Apache BookKeeper. Make sure to read Ivan’s blog post on the subject at streaml.io/blog.

video

Multi-tenant Messaging with Apache Pulsar (and Monopoly!)

In this quick video tutorial (using Monopoly) we’ll take a look at the multi-tenant capabilities in the Apache Pulsar (incubating) messaging system. Pulsar was designed as an enterprise grade solution to meet the following requirements at Yahoo:

  • Ensure that strict SLAs are met
  • Guarantee isolation between tenants
  • Enforce resource utilization quotas
  • Provide per-tenant and system-wide security
  • Ensure low-cost operations and simpler manageability

video

Multi-tenant Messaging with Apache Pulsar (and Monopoly!)

In this quick video tutorial (using Monopoly) we’ll take a look at the multi-tenant capabilities in the Apache Pulsar (incubating) messaging system. Pulsar was designed as an enterprise grade solution to meet the following requirements at Yahoo:

  • Ensure that strict SLAs are met
  • Guarantee isolation between tenants
  • Enforce resource utilization quotas
  • Provide per-tenant and system-wide security
  • Ensure low-cost operations and simpler manageability

video

Introduction to the Apache Pulsar Messaging System

This short demo shows you how to easily get up and running with Apache Pulsar. Apache Pulsar is an open-source distributed pub-sub messaging system originally created at Yahoo and now part of the Apache Software Foundation. Built from the ground up as a multi-tenant system, it includes support for isolation, authentication, authorization and quotas. With built-in geo-replication and durable storage backed by Apache BookKeeper it is horizontally scalable and can be distributed across multiple data centers.

Pulsar has run in production at massive scale at Yahoo for more than three years, and today powers the message part of the Streamlio platform.

video

Introduction to the Apache Pulsar Messaging System

This short demo shows you how to easily get up and running with Apache Pulsar. Apache Pulsar is an open-source distributed pub-sub messaging system originally created at Yahoo and now part of the Apache Software Foundation. Built from the ground up as a multi-tenant system, it includes support for isolation, authentication, authorization and quotas. With built-in geo-replication and durable storage backed by Apache BookKeeper it is horizontally scalable and can be distributed across multiple data centers.

Pulsar has run in production at massive scale at Yahoo for more than three years, and today powers the message part of the Streamlio platform.

video

Apache Pulsar (incubating) Concepts and Terminology

Apache Pulsar (incubating) is an enterprise-grade publish-subscribe (aka pub-sub) messaging system that was originally developed at Yahoo. It is one of the core components of the Streamlio end-to-end real-time solution. This whiteboard session introduces the core concepts and terminology needed to work with Pulsar.

video

Apache Pulsar (incubating) Concepts and Terminology

Apache Pulsar (incubating) is an enterprise-grade publish-subscribe (aka pub-sub) messaging system that was originally developed at Yahoo. It is one of the core components of the Streamlio end-to-end real-time solution. This whiteboard session introduces the core concepts and terminology needed to work with Pulsar.

Real-time Processing

whitepaper

Dhalion: Self Regulating Stream Processing in Heron

VLDB 2017 paper from Microsoft Research on the design and evaluation of Dhalion, a system that provides self-regulation capabilities to underlying streaming systems, and its implementation in the Heron stream processing engine.

whitepaper

Dhalion: Self Regulating Stream Processing in Heron

VLDB 2017 paper from Microsoft Research on the design and evaluation of Dhalion, a system that provides self-regulation capabilities to underlying streaming systems, and its implementation in the Heron stream processing engine.

whitepaper

Low Latency Stream Processing: Apache Heron with Infiniband & Intel Omni-Path

This research paper dives into integrating the Heron distributed stream processing system with two high performance interconnects, Infiniband and Intel OmniPath, and how they can be utilized to improve performance of distributed streaming applications.

whitepaper

Low Latency Stream Processing: Apache Heron with Infiniband & Intel Omni-Path

This research paper dives into integrating the Heron distributed stream processing system with two high performance interconnects, Infiniband and Intel OmniPath, and how they can be utilized to improve performance of distributed streaming applications.

whitepaper

Twitter Heron: Towards Extensible Streaming Engines

Paper from the 2017 IEEE International Conference on Data Engineering discussing how Twitter transformed Heron from a system tailored for Twitter’s applications and software stack to a system that efficiently handles applications with diverse characteristics on top of various Big Data platforms.

whitepaper

Twitter Heron: Towards Extensible Streaming Engines

Paper from the 2017 IEEE International Conference on Data Engineering discussing how Twitter transformed Heron from a system tailored for Twitter’s applications and software stack to a system that efficiently handles applications with diverse characteristics on top of various Big Data platforms.

whitepaper

Streaming@Twitter

Paper from the Bulletin of the IEEE Computer Society Technical Committee on Data Engineering that describes the design goals of Heron including how Heron’s architecture achieves task isolation and resource reservation to ease debugging, troubleshooting, and seamless use of shared cluster infrastructure with other critical services.

whitepaper

Streaming@Twitter

Paper from the Bulletin of the IEEE Computer Society Technical Committee on Data Engineering that describes the design goals of Heron including how Heron’s architecture achieves task isolation and resource reservation to ease debugging, troubleshooting, and seamless use of shared cluster infrastructure with other critical services.

presentation

Real-Time Analytics: Algorithms and Systems

An in-depth overview of streaming analytics applications, algorithms, and platforms. This presentation walks through the evoluation, current challenges, and technologies for streaming analytics on big data.

presentation

Real-Time Analytics: Algorithms and Systems

An in-depth overview of streaming analytics applications, algorithms, and platforms. This presentation walks through the evoluation, current challenges, and technologies for streaming analytics on big data.

video

Twitter Heron on Apache Aurora

Maosong Fu of Twitter explains why Twitter replaced Apache Storm with Heron for real-time processing and how Twitter uses Apache Aurora to manage their Heron infrastructure.

video

Twitter Heron on Apache Aurora

Maosong Fu of Twitter explains why Twitter replaced Apache Storm with Heron for real-time processing and how Twitter uses Apache Aurora to manage their Heron infrastructure.

video

Heron: Real-Time Stream Data Processing at Twitter

Twitter developed and deployed Heron as a replacement for the Apache Storm in order to handle growing needs for scale, performance, and ease of operations. Karthik Ramasamy, co-founder of Streamlio, explains the design and deployment of Heron in this 2015 presentation from the @Scale conference.

video

Heron: Real-Time Stream Data Processing at Twitter

Twitter developed and deployed Heron as a replacement for the Apache Storm in order to handle growing needs for scale, performance, and ease of operations. Karthik Ramasamy, co-founder of Streamlio, explains the design and deployment of Heron in this 2015 presentation from the @Scale conference.

presentation

Stream Processing and Anomaly Detection

An overview of the streaming and real-time data processing needs at Twitter, the technology used to address those needs, and the use of real-time processing for detection of anomalies in the Twitter environment as presented at the O’Reilly Velocity conference in 2015.

presentation

Stream Processing and Anomaly Detection

An overview of the streaming and real-time data processing needs at Twitter, the technology used to address those needs, and the use of real-time processing for detection of anomalies in the Twitter environment as presented at the O’Reilly Velocity conference in 2015.

video

Flying Faster with Heron

See Karthik Ramasamy, co-founder of Streamlio, provide a technical overview of the design and implementation of the Heron real-time engine, developed and open-sourced by his team at Twitter, in this 2015 presentation from QCon San Francisco.

video

Flying Faster with Heron

See Karthik Ramasamy, co-founder of Streamlio, provide a technical overview of the design and implementation of the Heron real-time engine, developed and open-sourced by his team at Twitter, in this 2015 presentation from QCon San Francisco.

whitepaper

Storm@Twitter

Apache Storm was the technology previously used by Twitter to handle real0time stream data processing. This 2014 ACM SIGMOD paper describes the use of Storm at Twitter.

whitepaper

Storm@Twitter

Apache Storm was the technology previously used by Twitter to handle real0time stream data processing. This 2014 ACM SIGMOD paper describes the use of Storm at Twitter.

video

Running Heron on Google Kubernetes Engine

In this hands-on demo, Chris Kellogg, engineer at Streamlio, shows how easy it is to set up the Heron streaming engine up and get it running on Google Kubernetes Engine, powered by Kubernetes.

video

Running Heron on Google Kubernetes Engine

In this hands-on demo, Chris Kellogg, engineer at Streamlio, shows how easy it is to set up the Heron streaming engine up and get it running on Google Kubernetes Engine, powered by Kubernetes.

video

Experiences in production with Heron

In this video, Karthik Ramasamy, co-creator of Heron while working at Twitter and now co-founder of Streamlio, talks about lessons learned running Heron in production at massive scale at Twitter. He also presents feedback regarding common issues in development. While the presentation is Heron specific, these lessons can be applied to other streaming systems as well.

video

Experiences in production with Heron

In this video, Karthik Ramasamy, co-creator of Heron while working at Twitter and now co-founder of Streamlio, talks about lessons learned running Heron in production at massive scale at Twitter. He also presents feedback regarding common issues in development. While the presentation is Heron specific, these lessons can be applied to other streaming systems as well.

video

Introduction to the Heron Stream Processing Engine's Architecture

In this video Karthik Ramasamy, co-creator of Twitter Heron, and co-founder of Streamlio, presents an overview of the design goals for the Heron stream processing engine. He also looks at the overall architecture of Heron, which has been used in production at Twitter for 3 years.

video

Introduction to the Heron Stream Processing Engine's Architecture

In this video Karthik Ramasamy, co-creator of Twitter Heron, and co-founder of Streamlio, presents an overview of the design goals for the Heron stream processing engine. He also looks at the overall architecture of Heron, which has been used in production at Twitter for 3 years.

video

Microsoft: Self-regulating stream processing in Heron, Part 4

In this final video in a 4-part series, Microsoft Cloud and Information Services Lab researcher, Avrilia Floratou presents the policy for service-level objectives in Dhalion, a self-healing process for Twitter Heron stream processing. She also presents the experiments that she and Ashvin Agrawal conducted on Dhalion, and also talks about future work. This video is the fourth in a 4-part series and is based on a presentation that was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017.

video

Microsoft: Self-regulating stream processing in Heron, Part 4

In this final video in a 4-part series, Microsoft Cloud and Information Services Lab researcher, Avrilia Floratou presents the policy for service-level objectives in Dhalion, a self-healing process for Twitter Heron stream processing. She also presents the experiments that she and Ashvin Agrawal conducted on Dhalion, and also talks about future work. This video is the fourth in a 4-part series and is based on a presentation that was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017.

video

Microsoft: Self-regulating stream processing in Heron, Part 3

In this second video in a 4-part series, Microsoft Cloud and Information Services Lab researcher, Ashvin Agrawal presents some of the policies related to dynamic resource provisioning in Dhalion, a self-healing process for Twitter Heron stream processing. This video is the third in a 4-part series and is based on a presentation that was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017.

video

Microsoft: Self-regulating stream processing in Heron, Part 3

In this second video in a 4-part series, Microsoft Cloud and Information Services Lab researcher, Ashvin Agrawal presents some of the policies related to dynamic resource provisioning in Dhalion, a self-healing process for Twitter Heron stream processing. This video is the third in a 4-part series and is based on a presentation that was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017.

video

Microsoft: Self-regulating stream processing in Heron, Part 2

In this 2nd video in a 4-part series, by Microsoft Cloud and Information Services Lab researcher, Avrilia Floratou, she talks about some of the operational challenges with streaming systems, and introduces Dhalion, a self-healing process for Twitter Heron stream processing. This video is the second in a 4-part series and is based on a presentation that was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017.

video

Microsoft: Self-regulating stream processing in Heron, Part 2

In this 2nd video in a 4-part series, by Microsoft Cloud and Information Services Lab researcher, Avrilia Floratou, she talks about some of the operational challenges with streaming systems, and introduces Dhalion, a self-healing process for Twitter Heron stream processing. This video is the second in a 4-part series and is based on a presentation that was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017.

video

Microsoft: Self-regulating stream processing in Heron, Part 1

This presentation in 4 parts, by Microsoft Cloud and Information Services Lab researchers, Avrilia Floratou, and Ashvin Agrawal, was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017. Avrilia and Ashvin have worked on a self-healing process for Twitter Heron stream processing engine called Dhalion. This video is the first in a 4-part series and focuses on introducing the Heron streaming system.

video

Microsoft: Self-regulating stream processing in Heron, Part 1

This presentation in 4 parts, by Microsoft Cloud and Information Services Lab researchers, Avrilia Floratou, and Ashvin Agrawal, was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017. Avrilia and Ashvin have worked on a self-healing process for Twitter Heron stream processing engine called Dhalion. This video is the first in a 4-part series and focuses on introducing the Heron streaming system.

video

Heron Delivery Semantics, Part 2

In Part 2 Sanjeev Kulkarni, co-creator of Heron and co-founder of Streamlio, examines the difference between effectively once semantics and exactly once semantics in streaming systems. Exactly once is a very expensive mechanism, and often effectively once achieves the same goal.

video

Heron Delivery Semantics, Part 2

In Part 2 Sanjeev Kulkarni, co-creator of Heron and co-founder of Streamlio, examines the difference between effectively once semantics and exactly once semantics in streaming systems. Exactly once is a very expensive mechanism, and often effectively once achieves the same goal.

video

Heron Delivery Semantics, Part 1

Sanjeev Kulkarni, co-creator of Heron stream processing engine, and co-founder of Streamlio, outlines the different delivery mechanisms supported in Heron. He explains the difference between at most once semantics, at least once semantics, effectively once semantics, and exactly once semantics. These terms can all be very confusing. In Part 1 Sanjeev focuses on at most and at least once semantics. In Part 2 he dives more deeply into effectively once, and exactly once.

video

Heron Delivery Semantics, Part 1

Sanjeev Kulkarni, co-creator of Heron stream processing engine, and co-founder of Streamlio, outlines the different delivery mechanisms supported in Heron. He explains the difference between at most once semantics, at least once semantics, effectively once semantics, and exactly once semantics. These terms can all be very confusing. In Part 1 Sanjeev focuses on at most and at least once semantics. In Part 2 he dives more deeply into effectively once, and exactly once.

video

Heron Stream Processing Architecture and Terminology

Heron is a real-time stream processing engine, built at and proven in production at massive scale at Twitter. This short video provides an overview of Heron for architects and developers interested in learning about its architecture and terminology.

video

Heron Stream Processing Architecture and Terminology

Heron is a real-time stream processing engine, built at and proven in production at massive scale at Twitter. This short video provides an overview of Heron for architects and developers interested in learning about its architecture and terminology.

Streaming Storage

whitepaper

DistributedLog: A High Performance Replicated Log Service

This paper from the 2017 IEEE International Conference on Data Engineering describes DistributedLog, the open source log solution used to support applications ranging from transactional database journaling to real-time data ingestion and analytics.

whitepaper

DistributedLog: A High Performance Replicated Log Service

This paper from the 2017 IEEE International Conference on Data Engineering describes DistributedLog, the open source log solution used to support applications ranging from transactional database journaling to real-time data ingestion and analytics.

presentation

Apache BookKeeper: A High Performance and Low Latency Storage Service

Presentation sharing experiences with Apache BookKeeper, from the motivation and key design decisions of BookKeeper to implementation details and descriptions of use cases built on it.

presentation

Apache BookKeeper: A High Performance and Low Latency Storage Service

Presentation sharing experiences with Apache BookKeeper, from the motivation and key design decisions of BookKeeper to implementation details and descriptions of use cases built on it.

whitepaper

A Technical Review of Kafka and DistributedLog

Blog post from the Apache BookKeeper team discussing the differences between Apache Kafka and DistributedLog from a technical perspective.

whitepaper

A Technical Review of Kafka and DistributedLog

Blog post from the Apache BookKeeper team discussing the differences between Apache Kafka and DistributedLog from a technical perspective.

presentation

Apache BookKeeper as a Distributed Store

In this presentation from ApacheCon 2016, JV Jujjuri describes how Salesforce uses Apache BookKeeper distributed storage. audio

presentation

Apache BookKeeper as a Distributed Store

In this presentation from ApacheCon 2016, JV Jujjuri describes how Salesforce uses Apache BookKeeper distributed storage. audio

presentation

Cloud Messaging Service

Streamlio co-founder Matteo Merli, previously tech lead for Cloud Messaging Service at Yahoo!, covers the design decisions and deployment leveraging Apache BookKeeper for Yahoo!s multi-tenant messaging service.

presentation

Cloud Messaging Service

Streamlio co-founder Matteo Merli, previously tech lead for Cloud Messaging Service at Yahoo!, covers the design decisions and deployment leveraging Apache BookKeeper for Yahoo!s multi-tenant messaging service.

presentation

Building reliable systems with Apache BookKeeper

Mathieu Moral and Ivan Kelley explain key considerations for building resilient distributed systems and how Apache BookKeeper implements a resilient storage solution for distributed logging.

presentation

Building reliable systems with Apache BookKeeper

Mathieu Moral and Ivan Kelley explain key considerations for building resilient distributed systems and how Apache BookKeeper implements a resilient storage solution for distributed logging.

whitepaper

Durability with BookKeeper

Paper from ACM SIGOPS Operating Systems review that provides an overview of how Apache BookKeeper transparently implements replication for high availability and striping for high performance.

whitepaper

Durability with BookKeeper

Paper from ACM SIGOPS Operating Systems review that provides an overview of how Apache BookKeeper transparently implements replication for high availability and striping for high performance.

video

How Apache Pulsar uses Apache BookKeeper to store topics

In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses how Apache Pulsar uses Apache BookKeeper to store replicated logs for hundreds of thousands of topics.

video

How Apache Pulsar uses Apache BookKeeper to store topics

In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses how Apache Pulsar uses Apache BookKeeper to store replicated logs for hundreds of thousands of topics.

video

Message guarantees in Apache Pulsar with Apache BookKeeper

In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses what happens to a message when it enters Apache Pulsar and the guarantees that are provided.

video

Message guarantees in Apache Pulsar with Apache BookKeeper

In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses what happens to a message when it enters Apache Pulsar and the guarantees that are provided.