In this two-part blog series, we introduce the concepts and benefits of working with both spark-submit and the Kubernetes Operator for Spark. In Part 1, we introduce both tools and review how to get started monitoring and managing your Spark clusters on Kubernetes. In Part 2, we do a deeper dive into using Kubernetes Operator for Spark.

In the first part of this blog series, we introduced the usage of spark-submit with a Kubernetes backend, and the general ideas behind using the Kubernetes Operator for Spark. In this second part, we are going to take a deep dive in the most useful functionalities of the Operator, including the CLI tools and the webhook feature. At the end, we review the advantages and disadvantages of both spark-submit and Operator.

In this special guest webinar with Holden Karau, speaker, author and Developer Advocate at Google, we’ll take a walk through some of the interesting Spark 3.0 JIRA tickets, look at external components being developed (like deep learning support), and also talk about the future of running real-time Spark workloads on Kubernetes.

The Lightbend engineering teams have released Lightbend Orchestration 1.7.1., Lagom 1.4.11, and sbt 1.3.18 for your immediate use. Enjoy!

In this webinar with special guest Fabio Tiriticco, we will explore how Akka is the perfect companion to Kubernetes, providing the application level requirements needed to successfully deploy and manage your cloud-native services with technologies built specifically for cloud-native applications, like Kubernetes.

Although Scala 2.12 was released almost two years ago, it was not straightforward to upgrade Apache Spark to use it. This article describes the role of several Lightbend engineers in making this a happy reality.

In this talk by Gerard Maas, O’Reilly author and Senior Software Engineer at Lightbend, we focus on choosing the right Fast Data stream processing features of Apache Spark, taking a practical, code-driven look at the two APIs available for this: the mature Spark Streaming and its younger sibling, Structured Streaming.

Hi everyone. sbt 1.2.8 patch release is available.

Lightbend CTO and Co-Founder, Jonas Bonér, releases a new white paper describing how to use Akka and Kubernetes for cloud-native applications.

In this webinar by Lightbend’s Eric Loots, Scala & Tooling Practice Lead, and Kikia Carter, Principal Enterprise Architect, we use a simple yet powerful visualization of a 5-node, Raspberry Pi-based cluster to reveal the inner workings of Akka Cluster.

Hi everyone. We have two patch releases sbt 1.2.7 and sbt 0.13.18.

In this Lightbend podcast, we sit down with Wade Waldron, Microservices Practice Lead at Lightbend, to discuss a question that we hear frequently from Lightbend customers and the OSS community: should we use Play Framework, Lagom Framework, or Akka HTTP for our next application?

In this "Tales From The Road" story by Michael Read, Senior Consultant at Lightbend, we take a look at achieving operational visibility into the difficult-to-monitor area of asynchronous microservices communication.

In a recent survey, 75% of over 2400 developers revealed that they are already using (or planning to use) microservices to enable real-time streaming use cases, showing that a key characteristic of Fast Data architectures is the use of microservices for streaming functionality...

The Scala compiler has included an inliner starting in Scala version 2.0.

In this intermediate level presentation for Architects, Data Scientists, Developers with O’Reilly author and Lightbend Principal Architect, Boris Lublinsky, we will define an alternative approach to model serving, based on treating the model itself as data.

Learn from the expert engineers at Lightbend on how to choose an application to rewrite using a Reactive approach.

In this webinar with Mike Kelland, VP of Global Services at Lightbend, we will share some details of our specialized enablement strategy that allows teams of all sizes to successfully adopt Fast Data technologies and techniques.

Make sure to register with our 15% discount before November 1st to see Martin Odersky, Seth Tissue, Sean Glover and many many more.

From real-time data streaming expert and VP of Fast Data Engineering at Lightbend, Dean Wampler, Ph.D., comes the 2nd Edition of his popular O'Reilly eBook Fast Data Architectures for Streaming Applications.