Oliver White

Chief Storyteller
March 19, 2019

How To Build, Integrate, and Deploy Real-Time Streaming Pipelines On Kubernetes

In this webinar with Lightbend's Craig Blitz, Product Director, and Kiki Carter, Principal Enterprise Architect, we review how Lightbend’s Pipelines module enables you to develop components ("streamlets") using the appropriate technology, wire them together as pipelines, and deploy them with Kubernetes without all the manual, time-consuming labor.

Read More

Chaoran Yu

Senior Engineer

Stavros Kontopoulos

Senior Engineer
February 26, 2019

How To Manage And Monitor Apache Spark On Kubernetes - Part 1: Spark-Submit VS Kubernetes Operator

In this two-part blog series, we introduce the concepts and benefits of working with both spark-submit and the Kubernetes Operator for Spark. In Part 1, we introduce both tools and review how to get started monitoring and managing your Spark clusters on Kubernetes. In Part 2, we do a deeper dive into using Kubernetes Operator for Spark.

Read More

Chaoran Yu

Senior Engineer

Stavros Kontopoulos

Senior Engineer
February 26, 2019

How To Manage And Monitor Apache Spark On Kubernetes - Part 2: Deep Dive On Kubernetes Operator For Spark

In the first part of this blog series, we introduced the usage of spark-submit with a Kubernetes backend, and the general ideas behind using the Kubernetes Operator for Spark. In this second part, we are going to take a deep dive in the most useful functionalities of the Operator, including the CLI tools and the webhook feature. At the end, we review the advantages and disadvantages of both spark-submit and Operator.

Read More

Oliver White

Chief Storyteller
February 22, 2019

A Glimpse At The Future Of Apache Spark 3.0 With Deep Learning And Kubernetes

In this special guest webinar with Holden Karau, speaker, author and Developer Advocate at Google, we’ll take a walk through some of the interesting Spark 3.0 JIRA tickets, look at external components being developed (like deep learning support), and also talk about the future of running real-time Spark workloads on Kubernetes.

Read More

Oliver White

Chief Storyteller
December 10, 2018

Hands On With Spark: Creating A Fast Data Pipeline With Structured Streaming And Spark Streaming

In this talk by Gerard Maas, O’Reilly author and Senior Software Engineer at Lightbend, we focus on choosing the right Fast Data stream processing features of Apache Spark, taking a practical, code-driven look at the two APIs available for this: the mature Spark Streaming and its younger sibling, Structured Streaming.

Read More

Oliver White

Chief Storyteller
September 14, 2018

Free O'Reilly eBook: "Designing Fast Data Application Architectures" With The SMACK Stack

You’re probably heard of the “SMACK Stack”, but you may not know that three Lightbend experts–Sean GloverStavros Kontopoulos, and Gerard Maas–that recently teamed up with O’Reilly Media on a free eBook about working with the SMACK stack for Fast Data applications (available in PDF, EPUB, and MOBI formats–or all 3 in a .zip folder)!

Read More
October 13, 2017

Design Streaming Fast Data Applications with Spark, Akka, Kafka and Cassandra on Mesos & DC/OS

In this webinar with Craig Pottinger, Senior Consultant at Lightbend, we examine the design choices around building streaming systems with technologies like Akka Streams, Apache Kafka, Apache Spark, Apache Flink, Mesosphere DC/OS and Lightbend Reactive Platform, all of which come integrated with Lightbend Fast Data Platform.

Read More
April 3, 2017

How To Get Monitoring Right For Streaming And Fast Data Systems Built With Spark, Mesos, Akka, Cassandra and Kafka

In this Lightbend webinar, we present what to look for in an effective monitoring solution for streaming and Fast Data applications, including a demo of Lightbend Monitoring using sample scenarios to show how we can help your team not just in production, but also during development to catch performance issues before you even deploy.

Read More
March 13, 2017

Building Streaming And Fast Data Applications With Spark, Mesos, Akka, Cassandra And Kafka

In this webinar with Sean Glover, Senior Consultant at Lightbend and industry veteran, we examine the rise of streaming systems built around Spark, Mesos, Akka, Cassandra and Kafka, their role in handling endless streams of data to gain real-time insights, and how Lightbend Fast Data Platform (FDP) brings them together in a comprehensive, easy to use, integrated platform, which includes installation, integration, and monitoring tools tuned for various deployment scenarios, plus sample applications.

Read More
Questions?