Webinar

The How and Why of Fast Data Analytics with Spark

SHARE THIS VIDEO

The How and Why of Fast Data Analytics with Spark

With Justin Pihony

Spark fast-data

Is your big data pipeline bloated and ready for an upgrade? By now you’ve probably heard the praise surrounding Apache Spark and are wondering if it’s exactly what you’re looking for. In this webinar, you’ll get an overview of what Spark is and gain an understanding of why it is indeed the right tool to improve your pipeline.

Subscribe

Related Videos

How To Get Monitoring Right For Streaming & Fast Data Systems

Webinar

fast-data monitoring

How To Get Monitoring Right For Streaming & Fast Data Systems

with Paul Jasek

The increasingly real-time requirements of today’s applications are changing how users expect services and products to be delivered and consumed.

Enterprises are responding to this by embracing Reactive system architectures coupled with best-in-class data processing tools to create a new class of programs called Fast Data applications. These applications are sparking the emergence of new business models and new services that take advantage of real-time insights to drive user retention, growth, and profitability.

While streaming and Fast Data applications are powerful and create significant competitive advantages, they also impose challenges for monitoring and managing the health of the overall system, which ingest constant streams of data from tens or even hundreds of individual, distributed microservices, data sources, and external endpoints. Businesses must therefore rethink their approach if they wish to take full advantage of the Fast Data revolution.

In this webinar by Lightbend’s Alan Ngai, VP of Cloud Services, and Hugh McKee, Global Solutions Architect, we review:

  • Why traditional monitoring solutions, built for legacy monolithic applications, are unable to effectively manage these intricately interconnected, distributed, and clustered systems.
  • What to look for in an effective monitoring solution for streaming and Fast Data applications.
  • How Lightbend Monitoring’s deep telemetry, automated discovery, configuration, topology visualization, and data-science-driven anomaly detection capabilities help ensure the health, availability and performance of your applications.
  • How Lightbend Monitoring helps businesses not just in production but also during development, so they can optimize their applications for performance from Day 1.
  • A live demo that includes a product walkthrough and sample scenarios so you can understand how your team can use Lightbend Monitoring to quickly troubleshoot problems and issues, and reduce MTTR.

Building Streaming And Fast Data Applications With Spark Mesos Akka Cassandra And Kafka

Webinar

fast-data akka mesos spark

Building Streaming And Fast Data Applications With Spark Mesos Akka Cassandra And Kafka

with Sean Glover

It’s become clear to many business that the ability to extract real-time actionable insights from data is not only a source of competitive advantage, but also a way to defend their existing business models from disruption. So while legacy models such as nightly batch jobs aren’t disappearing, an era of fast, streaming data (aka “Fast Data”) is upon us, and represents the state of the art for gaining real-time perishable insights that can then be used to serve existing customers better, acquiring new markets and keep the competition at bay.

That said, distributed, Fast Data architectures are much harder to build, and carry their own set of challenges. Enterprises looking to move quickly are presented with a growing ecosystem of technologies, which often delays fast decisions and provides its own set of risks:

  • With so many choices, what tools should you use?
  • How do you avoid making rookie mistakes?
  • e best patterns and practices for streaming applications?

In this webinar with Sean Glover, Senior Consultant at Lightbend and industry veteran, we examine the rise of streaming systems built around Spark, Mesos, Akka, Cassandra and Kafka, their role in handling endless streams of data to gain real-time insights. Sean then reviews how the Lightbend Fast Data Platform (FDP) brings them together in a comprehensive, easy to use, integrated platform, which includes installation, integration, and monitoring tools tuned for various deployment scenarios, plus sample applications.

Fast Data: Selecting The Right Streaming Technologies For Data Sets That Never End

Webinar

fast-data

Fast Data: Selecting The Right Streaming Technologies For Data Sets That Never End

with Dean Wampler

Why have stream-oriented data systems become so popular, when batch-oriented systems have served big data needs for many years? Batch-mode processing isn’t going away, but exclusive use of these systems is now a competitive disadvantage. You’ll learn that, while fast data architectures are much harder to build, they represent the state of the art for dealing with mountains of data that require immediate attention.

In this webinar, Lightbend’s Big Data Architect, Dr. Dean Wampler, examines the rise of streaming systems for handling time-sensitive problems. We’ll explore the characteristics of fast data architectures, and the open source tools for implementing them.

We’ll also take a brief look at Lightbend’s upcoming Fast Data Platform (FDP), a comprehensive solution of OSS and commercial technologies. FDP includes installation, integration, and monitoring tools tuned for various deployment scenarios, plus sample applications to help you sort out which tools to use for which purposes.

We’ll cover:

  • Learn step-by-step how a basic fast data architecture works
  • Understand why event logs are the core abstraction for streaming architectures, while message queues are the core integration tool
  • Use methods for analyzing infinite data sets, where you don’t have all the data and never will
  • Take a tour of open source streaming engines, and discover which ones work best for different use cases
  • Get recommendations for making real-world streaming system responsive, resilient, elastic, and message driven
  • Explore an example streaming application for the IoT: telemetry ingestion and anomaly detection for home automation systems

Modernizing Infrastructures for Fast Data with Spark, Akka, Kafka, Cassandra & Mesos

Webinar

fast-data spark akka

Modernizing Infrastructures for Fast Data with Spark, Akka, Kafka, Cassandra & Mesos

with Dean Wampler

The need to process data more quickly is morphing Big Data architectures into Fast Data architectures. This session discusses the forces driving this trend and the most popular tools that have emerged to address particular design challenges.

How to deploy Spark to Mesos, EC2 or standalone with Typesafe

Webinar

DevOps Reactive Spark Mesos

How to deploy Spark to Mesos, EC2 or standalone with Typesafe

with Iulian Dragoș

In this webinar with Iulian Dragos, Spark team lead at Typesafe Inc., we reveal how Typesafe supports running Spark in various deployment modes, along with the improvements we made to Spark to help integrate backpressure signals into the underlying technologies, making it a better fit for Reactive Streams. He also show you the functionalities at work, and how to make it simple to deploy to Spark on Mesos with Typesafe.