### Prometheus Deep Dive Monitoring. At scale Richard Hartmann & Frederic Branczyk @TwitchiH & @fredbrancz 2018-12-12 ## Who are we? ## Richard "RichiH" Hartmann • Swiss army chainsaw environments in mind It’s the second project to ever join CNCF and the de facto standard in cloud-native monitoring Kubelets, sidecars, microservices, ALL the cloud-native But it’s a monolithic application …why you need for operations? • Power and cooling • Network connectivity • Observability, a.k.a. Monitoring • The rest you can fix ## Three main features • Storage backend Caveat: Prometheus 2.0 comes

## Zero instrumentation monitoring with your first steps in eBPF eBPF Summit ## What will we be doing?  ## How are we going easier: ☐ First approach: C, LLVM/CLANG, tc ☐ Second approach: gobpf, bcc - Non-instrumentation monitoring  https://github

and Network Monitoring by using eBPF Natalia Reka Ivanko, Isovalent eBPF Summit ## I ntroduction ● Wide variety of eBPF use cases (logging, CPU over overhead) • Today: ☐ Network Monitoring and Threat

and user groups 349 7. IT services 354 8. Web monitoring 357 1 Web monitoring items 366 2 Real life scenario 368 9. Virtual machine monitoring 377 Virtual machine discovery key fields 380 discovery 399 2 Active agent auto-registration 406 3 Low-level discovery 408 15. Distributed monitoring 433 1 Proxies 433 16. Encryption 436 1 Using certificates 439 2 Using pre-shared keys 445 964 7 Macros 983 8 Setting time periods 995 9 Command execution ..... 995 10 Recipes for monitoring ..... 996 11 Performance tuning ..... 997 12 Version compatibility ..... 1000 13 Database

8 Service monitoring 476 1 Service tree 476 2 SLA 480 3 Setup example 481 9 Web monitoring 486 1 Web monitoring items 495 2 Real-life scenario 496 10 Virtual machine monitoring 504 1 VMware VMware monitoring item keys 506 2 Virtual machine discovery key fields 524 3 JSON examples for VMware items 527 4 VMware monitoring setup example 531 11 Maintenance 535 12 Regular expressions discovery 600 2 Active agent autoregistration 608 3 Low-level discovery 611 16 Distributed monitoring 663 1 Proxies 663 1 Encryption 668 1 Using certificates 675 2 Using pre-shared keys 681

user groups 473 8. Service monitoring 479 9. Web monitoring 482 1 Web monitoring items 491 2 Real life scenario 493 10. Virtual machine monitoring 500 1 Virtual machine discovery 592 2 Active agent autoregistration 601 3 Low-level discovery 604 16. Distributed monitoring 650 1 Proxies 651 17. Encryption 654 1 Using certificates 662 2 Using pre-shared . 1369 10 Setting time periods ..... 1370 11 Command execution ..... 1371 12 Recipes for monitoring ..... 1372 13 Performance tuning ..... 1373 14 Version compatibility ..... 1376 15 Database

284 7. IT services ..... 288 8. Web monitoring ..... 291 1 Web monitoring items ..... 296 2 Real life scenario ..... 297 9. Virtual machine monitoring ..... 303 Virtual machine discovery key 2 Active agent auto-registration ..... 329 3 Low-level discovery ..... 331 15. Distributed monitoring ..... 343 1 Proxies ..... 344 2 Nodes ..... 346 16. Web interface ..... 350 1 Frontend Macros ..... 850 8 Setting time periods ..... 904 9 Command execution ..... 904 10 Recipes for monitoring ..... 905 11 Performance tuning ..... 906 12 Version compatibility ..... 909 13 Database

Drivers • Integrations • 1. Kyuubi On Apache Kudu • Monitoring • 1. Monitoring Kyuubi - Logging System • 2. Monitoring Kyuubi - Server Metrics • 3. Trouble Shooting • SQL References apache.org/docs/latest/sql-data-sources.html ## Monitoring In this section, you will learn how to monitor Kyuubi with logging, metrics etc.. • 1. Monitoring Kyuubi - Logging System ☐ 1.1. Logs of Kyuubi Logs ☐ 1.4. Further Readings • 2. Monitoring Kyuubi - Server Metrics ☐ 2.1. Configurations 2.2. Metrics • 3. Trouble Shooting 3.1. Common Issues ### 1. Monitoring Kyuubi - Logging System Kyuubi uses

第14章 CLUSTER MONITORING OPERATOR 的 CONFIGMAP 参考 120 14.1. CLUSTER MONITORING 配置参考 120 14.2. ADDITIONAL ALERTMANAGER CONFIG 120 14.3. ALERTMANAGER MAIN CONFIG 121 14.4. CLUSTER MONITORING CONFIGURATION Prometheus 开源项目及其更广的生态系统。监控堆栈包括以下组件： - 默认平台监控组件。在 OpenShift Container Platform 安装过程中，默认会在 openshift-monitoring 项目中安装一组平台监控组件。这为包括 Kubernetes 服务在内的 OpenShift Container Platform 核心组件提供了监控。默认监控堆栈还为集群启用远程健康状态监 控。下图中的默认安装部分说明了这些组件。 - 用于监控用户定义项目的组件。在选择性地为用户定义的项目启用监控后，会在 openshift-user-workload-monitoring 项目中安装其他监控组件。这为用户定义的项目提供了监控。下图中的用户部分说明了这些组件。 ![Image](/uploads/documents/0/4/f/e/04fe58e7dc381e67aaf370bac8ffbf7f/p9_1

Start 7 3.2 Configurations 15 3.3 Deploying Kyuubi 20 3.4 Kyuubi Security Overview 56 3.5 Monitoring 74 3.6 Tools 87 3.7 Clients 95 3.8 Extensions 133 3.9 Connectors 182 3.10 Overview 182 delegation token are as follows: ### 3.5 Monitoring In this section, you will learn how to monitor Kyuubi with logging, metrics etc.. #### 3.5.1 Monitoring Kyuubi - Logging System Kyuubi uses Apache Readings • Monitoring Kyuubi - Events System • Monitoring Kyuubi - Server Metrics • Trouble Shooting • Spark Online Documentation – Monitoring and Instrumentation #### 3.5.2 Monitoring Kyuubi - Server