Back To Schedule
Thursday, October 29 • 2:40pm - 3:20pm
ELK and Monasca Crossing: Logging as an OpenStack Service

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Monitoring and log management are two closely related siblings, necessary to guarantee the stability and availability of an OpenStack system. Monasca is a scalable, multi-tenant, high performance, fault-tolerant OpenStack Monitoring as a Service (MONaaS) solution described at https://wiki.openstack.org/wiki/Monasca. In this session we present our work on integrating additional log management functionality into Monasca, to bring the two siblings together in one tool - tailored for OpenStack'ers.

The technical basis of our work consists of Elasticsearch, Logstash and Kibana, aka ELK. The ELK stack has probably become the most widely used open source tool for centralized log management. It also finds frequent adoption among OpenStack users, as demonstrated in various sessions at previous summits. The goal of our work in the Monasca project is to:

1. give operators a unified turn-key solution to manage all logs from their multiple OpenStack systems;
2. provide OpenStack tenants a service that allows for managing logs from their applications running on OpenStack - accessible from Horizon.

As part of this talk we will dive into our architecture to show how to meet our primary design goals: scalability, multi-tenancy, resilience and extensibility. One important aspect is our integration with Monasca that uses common components, such as Kafka, and common architectural patterns. Another highlight that we will point out is our newly implemented REST API, that facilitates Logging as a Service in the spirit of Loggly. Here, authentication happens via Keystone, which extends the existing ELK stack by adding multi-tenancy, applying the tenant model of OpenStack.

Finally, we will give a demo of our solution.

Keywords: monasca, elk stack, elasticsearch, fujitsu, hp, logging, log management, monitoring


Witold Bedyk

Software Engineer, Fujitsu Enabling Software Technology
avatar for Roland Hochmuth

Roland Hochmuth

Tech Lead and Software Architect on Monasca, HP
I am the Tech Lead and Software Architect on Monasca, the open-source Monitoring-as-a-Service (at-scale) OpenStack project (https://wiki.openstack.org/wiki/Monasca). We focus on developing a highly performant, scalable and reliable turn-key monitoring solution that leverages the industries... Read More →
avatar for Martin Roderus

Martin Roderus

Product Manager, Fujitsu EST
Martin Roderus is a product manager at Fujitsu for cloud management software. His current focus is on monitoring and log management in OpenStack environments, as well as workload management. He joined Fujitsu in 2012 as a software engineer, developing iPaaS and SaaS cloud applications... Read More →

Thursday October 29, 2015 2:40pm - 3:20pm JST

Attendees (0)