The modern "data center" is a complex arena, with physical and virtual servers, multiple OS environments, and complex networking that frequently spans multiple locations. The need to simplify has never been greater. Mesos, an innovative open-source cluster management platform, transforms the whole data center into a single pool of compute, memory, and storage resources that can be allocated, automated, and scaled as if working with a single super-computer. Mesos is an ideal environment for deploying containerized applications at scale, and it's generating a huge buzz in the big data world as a saner environment for running Spark and Hadoop. Mesos in Action introduces the Apache Mesos cluster manager and the concept of application-centric infrastructure. It guides readers from their first steps in deploying a highly-available Mesos cluster through deploying applications in production and writing native Mesos frameworks. It will show how to scale to thousands of nodes, while providing resource isolation between processes using Linux and Docker containers. It contains practical techniques for deploying applications using popular key frameworks, including Marathon, Chronos, and Aurora. Along the way, the book dives into Mesos internals, including fault tolerance, slave attributes, and resource scheduling and Mesos administration, including logging, monitoring, framework authorization, and slave recovery. Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.
Release on 2017-08-02 | by David Blomquist,Tomasz Janiszewski
Author: David Blomquist,Tomasz Janiszewski
Pubpsher: Packt Publishing Ltd
Over 50 recipes on the core features of Apache Mesos and running big data frameworks in Mesos About This Book Learn to install and configure Mesos to suit the needs of your organization Follow step-by-step instructions to deploy application frameworks on top of Mesos, saving you many hours of research and trial and error Use this practical guide packed with powerful recipes to implement Mesos and easily integrate it with other application frameworks Who This Book Is For This book is for system administrators, engineers, and big data programmers. Basic experience with big data technologies such as Hadoop or Spark would be useful but is not essential. A working knowledge of Apache Mesos is expected. What You Will Learn Set up Mesos on different operating systems Use the Marathon and Chronos frameworks to manage multiple applications Work with Mesos and Docker Integrate Mesos with Spark and other big data frameworks Use networking features in Mesos for effective communication between containers Configure Mesos for high availability using Zookeeper Secure your Mesos clusters with SASL and Authorization ACLs Solve everyday problems and discover the best practices In Detail Apache Mesos is open source cluster sharing and management software. Deploying and managing scalable applications in large-scale clustered environments can be difficult, but Apache Mesos makes it easier with efficient resource isolation and sharing across application frameworks. The goal of this book is to guide you through the practical implementation of the Mesos core along with a number of Mesos supported frameworks. You will begin by installing Mesos and then learn how to configure clusters and maintain them. You will also see how to deploy a cluster in a production environment with high availability using Zookeeper. Next, you will get to grips with using Mesos, Marathon, and Docker to build and deploy a PaaS. You will see how to schedule jobs with Chronos. We'll demonstrate how to integrate Mesos with big data frameworks such as Spark, Hadoop, and Storm. Practical solutions backed with clear examples will also show you how to deploy elastic big data jobs. You will find out how to deploy a scalable continuous integration and delivery system on Mesos with Jenkins. Finally, you will configure and deploy a highly scalable distributed search engine with ElasticSearch. Throughout the course of this book, you will get to know tips and tricks along with best practices to follow when working with Mesos. Style and approach This step-by-step guide is packed with powerful recipes on using Apache Mesos and shows its integration with containers and big data frameworks.