February 28, 2019

How To Deploy Kubeflow On Lightbend Platform With OpenShift - Part 3: Kubeflow Support Components

In Part 2 of “How To Deploy And Use Kubeflow On OpenShift”, we looked at Installation and some of the additional components used by Kubeflow, such as Ambassador, Spartakus, Argo, Minio, etc. In this post, we will describe and show how to use some of them.

Read More
February 28, 2019

How To Deploy Kubeflow On Lightbend Platform With OpenShift - Part 9: Managing Models

In the last article in “How To Deploy And Use Kubeflow On OpenShift”, we looked at deployment operations using Kubeflow pipelines. In this final part of the series, we look at model management as the last component of Kubeflow that we will describe, ModelDB.

Read More

Chaoran Yu

Senior Engineer

Stavros Kontopoulos

Senior Engineer
February 26, 2019

How To Manage And Monitor Apache Spark On Kubernetes - Part 1: Spark-Submit VS Kubernetes Operator

In this two-part blog series, we introduce the concepts and benefits of working with both spark-submit and the Kubernetes Operator for Spark. In Part 1, we introduce both tools and review how to get started monitoring and managing your Spark clusters on Kubernetes. In Part 2, we do a deeper dive into using Kubernetes Operator for Spark.

Read More

Chaoran Yu

Senior Engineer

Stavros Kontopoulos

Senior Engineer
February 26, 2019

How To Manage And Monitor Apache Spark On Kubernetes - Part 2: Deep Dive On Kubernetes Operator For Spark

In the first part of this blog series, we introduced the usage of spark-submit with a Kubernetes backend, and the general ideas behind using the Kubernetes Operator for Spark. In this second part, we are going to take a deep dive in the most useful functionalities of the Operator, including the CLI tools and the webhook feature. At the end, we review the advantages and disadvantages of both spark-submit and Operator.

Read More

Oliver White

Chief Storyteller
February 22, 2019

A Glimpse At The Future Of Apache Spark 3.0 With Deep Learning And Kubernetes

In this special guest webinar with Holden Karau, speaker, author and Developer Advocate at Google, we’ll take a walk through some of the interesting Spark 3.0 JIRA tickets, look at external components being developed (like deep learning support), and also talk about the future of running real-time Spark workloads on Kubernetes.

Read More

Oliver White

Chief Storyteller
December 10, 2018

Hands On With Spark: Creating A Fast Data Pipeline With Structured Streaming And Spark Streaming

In this talk by Gerard Maas, O’Reilly author and Senior Software Engineer at Lightbend, we focus on choosing the right Fast Data stream processing features of Apache Spark, taking a practical, code-driven look at the two APIs available for this: the mature Spark Streaming and its younger sibling, Structured Streaming.

Read More
Questions?