Resources

Resource Library

webcast

Real-Time IoT Analytics with Apache Pulsar

Streamlio's David Kjerrumgaard explains how Apache Pulsar can be used in IoT data processing in this webcast.

solution brief

Streamlio Cloud Datasheet

Read this datasheet for an overview of Streamlio Cloud, a cloud-native service for fast data.

video

Configuring Tiered Storage in Apache Pulsar

A step-by-step demonstration of configuring Apache Pulsar's tiered storage to use Amazon S3 as a storage offload tier.

video

Using Pulsar Functions: Log Topics

See Streamlio's Sanjeev Kulkarni explain and demonstrate how to log information from within Pulsar Functions.

video

Using Pulsar Functions: Runtime Parameters

How to use pass parameters into a Pulsar Function, including a demo of an example.

video

Using Pulsar Functions: Composing Functions

An explanation of how multiple Pulsar Functions can be connected to perform multi-step data processing.

video

Introduction to Pulsar Functions, Part 2

An explanation of how to write a Pulsar Function and deploy that function to a Pulsar cluster using a simple example.

video

Introduction to Pulsar Functions, Part 1

A look at the motivation for the creation of Apache Pulsar Functions and how they differ from other approaches to stream processing.

solution brief

Bloor InBrief - Streamlio

Read this perspective on Streamlio's technology and impact by industry analyst firm Bloor.

solution brief

How Streamlio Uses Apache Pulsar

Learn how and why Streamlio uses Apache Pulsar to power its fast data platform.

whitepaper

Benchmarking Enterprise Streaming Data and Message Queuing Platforms

Report from industry analyst firm Gigaom surveys technology for streaming messaging and compares performance of leading solutions including Apache Pulsar.

webcast

Integrating the Enterprise with a Streaming Data Approach

This webinar from Gigaom and Streamlio discusses the evolving options for streaming data and message queueing technologies and reviews a benchmark comparison of Apache Kafka and Apache Kafka, two of the technologies profiled.

webcast

Building Data-Driven Microservices

Dr. Karthik Ramasamy discusses technology and best practices for designing and implementing data-driven microservices.

video

Unified queuing and streaming: Part 1

Explains the differences between message queuing and streaming.

video

Unified queuing and streaming: Part 2

A dive into a use case requiring queuing and streaming.

video

Migrating an Apache Kafka application to Apache Pulsar with no code changes

Walks through how to migrate Kafka applications to Pulsar.

webcast

Evaluating Streaming Data Solutions

Sanjeev Kulkarni dives into the requirements you need to consider when evaluating technology options and discusses how Apache Pulsar can help address them.

video

Install Apache Pulsar and get up and running in 4 minutes

A step-by-step demonstration of setting up Apache Pulsar on your laptop.

solution brief

Streamlio Technology Brief

Overview of Streamlio's solution for connecting, processing, and moving streaming data

video

How Apache Pulsar uses Apache BookKeeper to store topics

How Apache Pulsar uses Apache BookKeeper to store and replicate topics.

video

Running Heron on Google Kubernetes Engine

Demo showing how to set up Apache Heron on GKE.

video

Message guarantees in Apache Pulsar with Apache BookKeeper

How Apache Pulsar processes messages in order to ensure that guarantees are met.

video

How Apache Pulsar stores cursors using Apache BookKeeper

How Apache Pulsar uses Apache BookKeeper to store and manage cursors.

video

Experiences in production with Heron

Lessons learned from running Apache Heron in production at Twitter.

video

Introduction to the Heron Stream Processing Engine's Architecture

Karthik Ramasamy presents an overview of the design goals and architecture of Apache Heron

video

Multi-tenant Messaging with Apache Pulsar (and Monopoly!)

An explanation of multi-tenancy in Apache Pulsar using a comparison to the Monopoly board game

video

Introduction to the Apache Pulsar Messaging System

A short demo on how to easily get up and running with the Apache Pulsar pub-sub messaging system

video

Heron Delivery Semantics, Part 1

Sanjeev Kulkarni outlines the different delivery semantics supported in Apache Heron, starting with at most once and at least once

video

Heron Delivery Semantics, Part 2

Sanjeev Kulkarni examines the difference between effectively once and exactly one semantics in Apache Heron

video

Heron Stream Processing Architecture and Terminology

An introduction to the architecture and processing design of the Apache Heron real-time stream processing engine

video

Apache Pulsar Concepts and Terminology

An overview of Apache Pulsar concepts and terminology as an introduction to Pulsar

whitepaper

Dhalion: Self Regulating Stream Processing in Heron

VLDB paper from Microsoft Research covering the self-regulating features of Dhalion and its implementation for Apache Heron

whitepaper

Low Latency Stream Processing: Apache Heron with Infiniband & Intel Omni-Path

Read how to deploy Heron with Infiniband and IntelOmniPath for extreme performance

whitepaper

Twitter Heron: Towards Extensible Streaming Engines

Paper from IEEE on the Apache Heron goals and architecture

whitepaper

DistributedLog: A High Performance Replicated Log Service

IEEE paper on DistributedLog, the open source log solution built on Apache BookKeeper

presentation

Apache BookKeeper: A High Performance and Low Latency Storage Service

Presentation about BookKeeper's origins, design and use cases

presentation

Pulsar -- Distributed Pub/Sub Platform

A technical dive into the Apache Pulsar architecture, features, and use cases

presentation

Pulsar, a highly scalable, low latency pub-sub messaging system

Presentation by Yahoo! providing a brief technical overview of Apache Pulsar

blog

Open-Sourcing Pulsar, Pub-Sub Messaging at Scale

Read about the origins and usage of Pulsar at Yahoo in this blog

whitepaper

A Technical Review of Kafka and DistributedLog

Technical comparison of how Apache Kafka and Apache BookKeeper store data

whitepaper

Streaming@Twitter

IEEE paper covering the design goals and architecture of Apache Heron

presentation

Apache BookKeeper as a Distributed Store

Presentation on how Salesforce uses Apache BookKeeper

presentation

Real-Time Analytics: Algorithms and Systems

An in-depth overview of streaming applications, algorithms, and platforms

presentation

Cloud Messaging Service

This presentation explains the motivations and design decisions that went into the creation of Apache Pulsar at Yahoo!

presentation

Stream Processing and Anomaly Detection

Presentation on the use of streaming and real-time processing for anomaly detection at Twitter

presentation

Building reliable systems with Apache BookKeeper

Presentation on key considerations in the design of resilient systems such as Apache BookKeeper

whitepaper

Durability with BookKeeper

An ACM paper providing an overview of replication and striping for performance and availability in BookKeeper