© 2018 Percona. 1 Peter Zaitsev Analyzing MySQL Logs with ClickHouse CEO, Percona April 27,2018 © 2018 Percona. 2 ClickHouse is my love at the first sight © 2018 Percona. 3 Why ? Fast and 5 Why Keep and Analyze Raw Logs ? Raw Logs Contain ultimate level of detail You build any summaries from Raw Events You can’t recover Raw Events from Summaries Audit Trace Application/User Path Path © 2018 Percona. 6 Why Not ? Generating Full Query Logs can be Expensive Logs can Consume a lot of Space Logs can be expensive to query © 2018 Percona. 7 Clickhouse Answers • 10x+

immediate and manual trigger Access Control • RBAC • AD/LDAP integration Audit Log • Operations recorded for audit Distribution Policy • Based on content trust • Based on vulnerability • Based

analysis Fraud & spam detection DDoS protection Application performance monitoring Logs & metrics Security events and logs. SIEM Analytics of corporate networks Telemetry Industrial monitoring Sensor data 1. Clickhouse-keeper — 100% совместимый с ZooKeeper по протоколу и модели данных • Compressed logs and snapshots • No issues with zxid overflow • No issues with large packets • Better memory usage

k8s ● Есть сетевая FS (MooseFS) ● Уже есть небольшой Clickhouse cluster для хранения performance logs Взгляд с практической стороны Устанавливаем оператор ● https://github.com/Altinity/clickhouse-operator/