A Reactive Language for Analyzing Cloud Logs
Log analysis is required in many domains, and especially in the emerging field of cloud computing. Cloud applications are often built by composing diverse services. When something goes wrong, finding the root cause of the problem can be difficult. Many services are only reachable through their Application Programming Interfaces (APIs) with no possibility for live introspection. In this context, logs become an essential tool for monitoring and debugging. Cloud services typically generate very large quantities of log messages, with formats that may not be well specified and may vary over time. In this paper, we present CloudLens, a language for the analysis of semi-structured textual data as found in logs, and specify its formal semantics. CloudLens is a reactive language and views logs as streams of objects. Our objective is to facilitate exploring the contents of logs interactively and to write reusable analyses succinctly, using familiar constructs. We implemented an interpreter for the Apache Zeppelin notebook to provide an interactive IDE. Our prototype implementation is open source and we report on a detailed case study using logs from the Apache OpenWhisk project.
Slides (cloudlens-rebls18.pdf) | 4.91MiB |
Pre-Print (rebls18.pdf) | 807KiB |
Sun 4 NovDisplayed time zone: Guadalajara, Mexico City, Monterrey change
15:30 - 17:00 | |||
15:30 22mTalk | Composable Higher-Order Reactors as the Basis for a Live Reactive Programming Environment REBLS Bjarno Oeyen Vrije Universiteit Brussel, Humberto Rodriguez Avila Vrije Universiteit Brussel, Sam Van den Vonder , Wolfgang De Meuter Vrije Universiteit Brussel File Attached | ||
15:52 22mTalk | Explicitly Comprehensible Functional Reactive Programming REBLS Media Attached File Attached | ||
16:15 22mTalk | A Reactive Language for Analyzing Cloud Logs REBLS Guillaume Baudart IBM Research, Louis Mandel IBM Research, Olivier Tardieu IBM Research, Mandana Vaziri IBM Research File Attached | ||
16:37 22mTalk | Visualizing Reactive Execution History using Propagation Traces REBLS Takumi Hikosaka Ritsumeikan University, Tetsuo Kamina Oita University, Katsuhisa Maruyama Ritsumeikan University File Attached |