Methods to achieve high SLOs on a large scale Kubernetes cluster Kang FAN, Jinghua YAO Why SLO? SLO (Service-Level Objective). Within service-level agreements (SLAs), SLOs are the objectives that must Correctness SLO …… Punishment SLA SLI defines an indicator, which can represent user experience. SLO is the object that try to meets all SLIs in a period of time. SLA = SLO + Punishment. SLA/SLO/SLI What by end users ContainerCrashLoopBackOff, FailedPostStartHook, Unhealthy… Trace system Increase of SLO Data Collect Audit log Event The unhealthy node Monitoring Isolation Recover Degrade Data

achieve our SLO goal this quarter? ● Is our network bandwidth saturated this year? ● What is the resource usage for our server farm across the years?Prometheus at scale ● Did we achieve our SLO goal this

流量视图提供统一的拓扑图界面，让您的视角可以统揽全局 •附加组件 •Jaeger，为SolarMesh提供分布式链路追踪的能力 •Grafana，为SolarMesh提供流量的实时仪表盘 •SLO，为SolarMesh提供服务质量检测的能力 SolarMesh的特点 Copyright © 2021 Cloud To Go 控制端与业务端隔离 控制面与数据面隔离 solarmesh坏了，istio还在，业务不会中断 多集群统一纳管，为流量运维提供上帝视角 3. 可视化、规范化Istio操作，告别terminal 4. 反应集群真实情况，流量可视化监控 5. 为istio核心组件提供监控能力 6. 服务质量(SLO)检测能力 7. 一键部署分布式链路追踪组件jaeger 8. 一键部署数据可视化工具grafana，进一步提升流量监控的体验 9. …… Copyright © 2021 Cloud To

singlelogout.url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty.registration.my-relying- party1.singlelogout.reponse-url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration singlelogout.url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration.my-relying- party2.assertingparty.singlelogout.reponse-url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty singlelogout: url: "https://myapp/logout/saml2/slo" reponse-url: "https://remoteidp2.slo.url" binding: "POST" assertingparty:

singlelogout.url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty.registration.my-relying- party1.singlelogout.response-url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration singlelogout.url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration.my-relying- party2.assertingparty.singlelogout.response-url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty singlelogout: url: "https://myapp/logout/saml2/slo" response-url: "https://remoteidp2.slo.url" binding: "POST" assertingparty:

singlelogout.url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty.registration.my-relying- party1.singlelogout.reponse-url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration singlelogout.url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration.my-relying- party2.assertingparty.singlelogout.reponse-url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty singlelogout: url: "https://myapp/logout/saml2/slo" reponse-url: "https://remoteidp2.slo.url" binding: "POST" assertingparty:

singlelogout.url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty.registration.my-relying- party1.singlelogout.response-url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration singlelogout.url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration.my-relying- party2.assertingparty.singlelogout.reponse-url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty singlelogout: url: "https://myapp/logout/saml2/slo" response-url: "https://remoteidp2.slo.url" binding: "POST" assertingparty:

singlelogout.url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty.registration.my-relying- party1.singlelogout.response-url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration singlelogout.url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration.my-relying- party2.assertingparty.singlelogout.reponse-url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty singlelogout: url: "https://myapp/logout/saml2/slo" response-url: "https://remoteidp2.slo.url" binding: "POST" assertingparty:

singlelogout.url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty.registration.my-relying- party1.singlelogout.response-url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration singlelogout.url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration.my-relying- party2.assertingparty.singlelogout.response-url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty singlelogout: url: "https://myapp/logout/saml2/slo" response-url: "https://remoteidp2.slo.url" binding: "POST" assertingparty:

singlelogout.url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty.registration.my-relying- party1.singlelogout.response-url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration singlelogout.url=https://remoteidp2.slo.url spring.security.saml2.relyingparty.registration.my-relying- party2.assertingparty.singlelogout.response-url=https://myapp/logout/saml2/slo spring.security.saml2.relyingparty singlelogout: url: "https://myapp/logout/saml2/slo" response-url: "https://remoteidp2.slo.url" binding: "POST" assertingparty: