Try It Now
Here at Streamlio we’re committed to providing free online education to help you develop the next generation of event-driven and microservice applications. Our video library will be growing quickly with short tutorials.
If there’s a topic you are particularly interested in, get in touch and we’ll do our best to prioritize that content.
In this final video of a three-part series, Christian Hasker of Streamlio interviews JJ about what security considerations enterprises should think about when adopting microservices.
In this second video of a three-part series, Christian Hasker of Streamlio interviews JJ, an expert in microservices about how to actually break apart a monolithic application into microservices. JJ provides some guidelines and best practices.
Breaking apart monolithic applications into microservices, and adopting microservices-based architectures for new applications is a hot trend within enterprises. In this first video of a three-part series, Christian Hasker of Streamlio interviews JJ Jeyappragash, an expert in microservices, who explains what microservices are, and more importantly, what they are not.
In this video Sanjeev Kulkarni of Streamlio discusses a retail use case that would need both queuing and streaming. He whiteboards how Apache Pulsar is uniquely able to handle both use cases within one distributed messaging system.
In this short video, Sanjeev Kulkarni and Christian Hasker of Streamlio discuss the differences between queuing and streaming. Apache Pulsar, the next generation distributed pub/sub system is unique in that it can handle both queuing and streaming use cases. Sanjeev presents a definition of each, and explains when it would make sense to use one vs the other.
In this 201 level video, Sijie Guo of Streamlio demonstrates how to migrate an existing Kafka application to Apache Pulsar with no code change using the Kafka API wrapper. It can be used to migrate an application to take advantage of next generation messaging features in Pulsar such as multi-datacenter support, multi-tenancy, strong durability guarantees, and unified messaging and queuing architecture.
Development 101 series: in this quick 4-minute video, Sanjeev Kulkarni shows you how easy it is to download, install and get Apache Pulsar up and running on your laptop. For more information on Apache Pulsar visit streaml.io or the project at pulsar.apache.org.
In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses how Apache Pulsar uses Apache BookKeeper to store replicated logs for hundreds of thousands of topics.
Karthik Ramasamy, co-founder of Streamlio, gave this talk at a meetup at Narvar (corp.narvar.com). In this presentation, designed for developers that are thinking about moving away from monolithic application architectures, he shares thoughts about microservices and real-time data processing.
In this hands-on demo, Chris Kellogg, engineer at Streamlio, shows how easy it is to set up the Heron streaming engine up and get it running on Google Kubernetes Engine, powered by Kubernetes.
This presentation in 4 parts, by Microsoft Cloud and Information Services Lab researchers, Avrilia Floratou, and Ashvin Agrawal, was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017. Avrilia and Ashvin have worked on a self-healing process for Twitter Heron stream processing engine called Dhalion. This video is the first in a 4-part series and focuses on introducing the Heron streaming system.
In this expert developer whiteboard session Ivan Kelly, Apache BookKeeper PMC member and engineer at Streamlio, discusses what happens to a message when it enters Apache Pulsar and the guarantees that are provided.
In this video, Karthik Ramasamy, co-creator of Heron while working at Twitter and now co-founder of Streamlio, talks about lessons learned running Heron in production at massive scale at Twitter. He also presents feedback regarding common issues in development. While the presentation is Heron specific, these lessons can be applied to other streaming systems as well.
In this expert developer whiteboard session, Ivan Kelly, PMC member of Apache BookKeeper and engineer at Streamlio talks about cursor management. This is very hard for other messaging systems to do but is no sweat for Apache Pulsar, which leverages Apache BookKeeper. Make sure to read Ivan’s blog post on the subject at streaml.io/blog.
In this video Karthik Ramasamy, co-creator of Twitter Heron, and co-founder of Streamlio, presents an overview of the design goals for the Heron stream processing engine. He also looks at the overall architecture of Heron, which has been used in production at Twitter for 3 years.
In this final video in a 4-part series, Microsoft Cloud and Information Services Lab researcher, Avrilia Floratou presents the policy for service-level objectives in Dhalion, a self-healing process for Twitter Heron stream processing. She also presents the experiments that she and Ashvin Agrawal conducted on Dhalion, and also talks about future work. This video is the fourth in a 4-part series and is based on a presentation that was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017.
In this second video in a 4-part series, Microsoft Cloud and Information Services Lab researcher, Ashvin Agrawal presents some of the policies related to dynamic resource provisioning in Dhalion, a self-healing process for Twitter Heron stream processing. This video is the third in a 4-part series and is based on a presentation that was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017.
In this 2nd video in a 4-part series, by Microsoft Cloud and Information Services Lab researcher, Avrilia Floratou, she talks about some of the operational challenges with streaming systems, and introduces Dhalion, a self-healing process for Twitter Heron stream processing. This video is the second in a 4-part series and is based on a presentation that was first delivered at the VLDB (Very Large Database) conference at the Technical University of Munich, Germany in September 2017.
In this quick video tutorial (using Monopoly) we’ll take a look at the multi-tenant capabilities in the Apache Pulsar (incubating) messaging system. Pulsar was designed as an enterprise grade solution to meet the following requirements at Yahoo:
This short demo shows you how to easily get up and running with Apache Pulsar. Apache Pulsar is an open-source distributed pub-sub messaging system originally created at Yahoo and now part of the Apache Software Foundation. Built from the ground up as a multi-tenant system, it includes support for isolation, authentication, authorization and quotas. With built-in geo-replication and durable storage backed by Apache BookKeeper it is horizontally scalable and can be distributed across multiple data centers.
Pulsar has run in production at massive scale at Yahoo for more than three years, and today powers the message part of the Streamlio platform.
In Part 2 Sanjeev Kulkarni, co-creator of Heron and co-founder of Streamlio, examines the difference between effectively once semantics and exactly once semantics in streaming systems. Exactly once is a very expensive mechanism, and often effectively once achieves the same goal.
Sanjeev Kulkarni, co-creator of Heron stream processing engine, and co-founder of Streamlio, outlines the different delivery mechanisms supported in Heron. He explains the difference between at most once semantics, at least once semantics, effectively once semantics, and exactly once semantics. These terms can all be very confusing. In Part 1 Sanjeev focuses on at most and at least once semantics. In Part 2 he dives more deeply into effectively once, and exactly once.
Heron is a real-time stream processing engine, built at and proven in production at massive scale at Twitter. This short video provides an overview of Heron for architects and developers interested in learning about its architecture and terminology.
Apache Pulsar (incubating) is an enterprise-grade publish-subscribe (aka pub-sub) messaging system that was originally developed at Yahoo. It is one of the core components of the Streamlio end-to-end real-time solution. This whiteboard session introduces the core concepts and terminology needed to work with Pulsar.
This is a short video showing you how to install and get started with the Streamlio sandbox. The Streamlio sandbox integrates best of breed compute, messaging and storage, proven in production at Twitter and Yahoo. By the end of this tutorial you will be able to run your first real-time data application with Streamlio.