How to deploy Spark to Mesos, EC2 or standalone with Typesafe

Let's talk about Spark. In this fantastic webinar, Iulian Dragos, Spark team lead at Typesafe, shows how Typesafe supports running Spark in various deployment modes. He also discusses the improvements we recently made to Spark to help integrate backpressure signals into the underlying technologies, making it a better (dare we say AWESOME?) fit for Reactive Streams. He'll show you how to deploy Spark in various deployment modes: Standalone, Spark on Mesos, and Spark with Mesosphere’s Datacenter Operating Systems (DCOS). This last option is especially helpful for our customers in need of support. Typesafe is proud to be the official commercial support provider of Spark on Apache Mesos, along with DCOS.

View on Slideshare

Since 2014, Typesafe has been actively contributing to the Apache Spark project, and has become a certified development support partner of Databricks, the company started by the creators of Spark. Typesafe and Mesosphere have forged a partnership in which Typesafe is the official commercial support provider of Spark on Apache Mesos, along with Mesosphere DCOS.

In this webinar, we reveal how Typesafe supports running Spark in various deployment modes, along with the improvements we made to Spark to help integrate backpressure signals into the underlying technologies, making it a better fit for Reactive Streams. He also show you the functionalities at work, and how to make it simple to deploy to Spark on Mesos with Typesafe.

• Various deployment modes for Spark: Standalone, Spark on Mesos, and Spark with Mesosphere DCOS
• Overview of Mesos and how it relates to Mesosphere DCOS
• Deeper look at how Spark runs on Mesos
• How to manage coarse-grained and fine-grained scheduling modes on Mesos
• What to know about a client vs. cluster deployment
• A demo running Spark on Mesos

Watch the full video

Watch on YouTube

Learn to master Spark

As your business goes Reactive and uses Spark, Scala and Akka, a ton of development work lays ahead. Now, more than ever, staying ahead of the curve is important. 

As the official commercial support provider for Spark, we provide hands-on, lab-based approaches to learning all the relevant functionalities to master Spark.

Start with the Introductory Workshop For Developers by Dean Wampler, Ph.D. which is designed to teach developers how to implement data processing pipelines and analytics using Apache Spark. Also read a case study with our customer UniCredit, and their Fast Data system built with Spark, Akka, Scala, and Play. And be sure to read our incredibly popular white paper called Fast Data: Big Data Evolved including understanding Fast Data architecture, and the role of Kafka, Cassandra, and Spark.

Don't waste your time searching for the right information: We've got the stuff!

LEARN MORE ABOUT TRAINING