通过Golang + eBPF实现无侵入应用可观测 张海彬 阿里云 应用可观测技术专家 目 录 eBPF简介 01 eBPF在云原生场景下的应用 02 微服务可观测的挑战 03 Golang + eBPF实现数据采集 04 构建完整的应用可观测系统 05 eBPF简介 第一部分 eBPF简介 01. eBPF简介 eBPF = extended Berkeley Packet 内存管理，文件管理， 夯机宕机，资源异 常… 应用组件异常：线程池满，数据库连接无法获取， OOM，文件读取错误… 无法自顶向下端到端 串联导致棘手问题频 发。 Kubernetes下的可观测 Golang + eBPF实现数据采 集 第四部分 eBPF在可观测领域的优势 无侵入 多语言/多协议/多框架 全栈覆盖 无侵入性 • 无需修改代码 • 无需重启应用 • Verifier保证运行安全 程序跟其他的用户空间的程序没有太大区别  编译成二进制文件，可以适应不同运行环境  libbpf 扮演bpf程序装载机角色  开发人员只需要关注bpf程序的正确性和性能，不 需要关注其他依赖关系 通过Golang加载eBPF程序 01. 副标题 func loadSync() error { // Allow the current process to lock memory for eBPF

Development Setup Requirements Vagrant Setup Local Development in Vagrant Box Making Changes Add/update a golang dependency Debugging Building Container Images Developer images Official release images Update posts Books Talks Further Documents API Reference Introduction How to access the API CLI Client Golang Package Compatibility Guarantees API Reference Reference Command Cheatsheet Command utilities: AGE echo-a-5995597649-f5d5g 1/1 Running 0 4m51s echo-b-54c9bb5f5c-p6lxf 1/1 Running 0 4m50s echo-b-host-67446447f7-chvsp

-c authaudit-logger -ti -- /opt/kafka_2.11 [2017-12-07 03:08:54,513] WARN Not authorized to read from topic credit-ca [2017-12-07 03:08:54,517] ERROR Error processing message, terminating cons org.apache HTTP/1.1 200 OK Accept-Ranges: bytes Content-Length: 28 Date: Tue, 31 Oct 2017 14:30:56 GMT Etag: "1c-54bb868cec400" Last-Modified: Mon, 27 Mar 2017 15:58:08 GMT Server: Apache/2.4.25 (Unix) Content-Type: /contrib/k8s/k8s-unmanaged.sh kube-system/cilium-hqpk7 kube-system/kube-addon-manager-minikube kube-system/kube-dns-54cccfbdf8-zmv2c kube-system/kubernetes-dashboard-77d8b98585-g52k5 kube-system/storage-provisioner See

Init:0/1 0 53s cilium-operator-788c55554-gkpbf 0/1 ContainerCreating 0 54s cilium-tdzcx 0/1 Init:0/1 0 53s coredns-77b578f78d-km6r4 payments [2017-12-07 03:08:54,513] WARN Not authorized to read from topic credit-card-payments. (org.apache.kafka.clients.consumer.internals.Fetcher) [2017-12-07 03:08:54,517] ERROR Error processing HTTP/1.1 200 OK Accept-Ranges: bytes Content-Length: 28 Date: Tue, 31 Oct 2017 14:30:56 GMT Etag: "1c-54bb868cec400" Last-Modified: Mon, 27 Mar 2017 15:58:08 GMT Server: Apache/2.4.25 (Unix) Content-Type:

Development Setup Requirements Vagrant Setup Local Development in Vagrant Box Making Changes Add/update a golang dependency Optional: Docker and IPv6 Debugging Building Container Images Developer images Official posts Books Talks Further Documents API Reference Introduction How to access the API CLI Client Golang Package Compatibility Guarantees API Reference Hubble internals Hubble Architecture Hubble server 6m15s hubble-relay-5684848cc8-6ldhj 0/1 ContainerCreating 0 2s hubble-ui-54c6bc4cdc-h5drq 0/1 Pending 0 2s kube-apiserver-kind-control-plane

Development Setup Requirements Vagrant Setup Local Development in Vagrant Box Making Changes Add/update a golang dependency Add/update a new Kubernetes version Optional: Docker and IPv6 Debugging Building Container posts Books Talks Further Documents API Reference Introduction How to access the API CLI Client Golang Package Compatibility Guarantees API Reference Hubble internals Hubble Architecture Hubble server 6m15s hubble-relay-5684848cc8-6ldhj 0/1 ContainerCreating 0 2s hubble-ui-54c6bc4cdc-h5drq 0/1 Pending 0 2s kube-apiserver-kind-control-plane

Development Setup Requirements Vagrant Setup Local Development in Vagrant Box Making Changes Add/update a golang dependency Add/update a new Kubernetes version Optional: Docker and IPv6 Debugging Building Container posts Books Talks Further Documents API Reference Introduction How to access the API CLI Client Golang Package Compatibility Guarantees API Reference Internals Hubble internals Hubble Architecture payments [2017-12-07 03:08:54,513] WARN Not authorized to read from topic credit-card-payments. (org.apache.kafka.clients.consumer.internals.Fetcher) [2017-12-07 03:08:54,517] ERROR Error processing

Development Setup Requirements Vagrant Setup Local Development in Vagrant Box Making Changes Add/update a golang dependency Add/update a new Kubernetes version Optional: Docker and IPv6 Debugging Building Container posts Books Talks Further Documents API Reference Introduction How to access the API CLI Client Golang Package Compatibility Guarantees API Reference Internals Hubble internals Hubble Architecture READY STATUS RESTARTS AGE kube-system cilium-operator-855979b54b-w8rsm 1/1 Running 0 1d Validate that the CiliumEndpointSlice CRD has been registered

jYXGY2wEH0tGJjNRROGJhZJVNR+qAqJBioj9d/TwXEgwLP8eAy9aVtJB K1rIylnMQltx/SIhgiymjHLCtKlVoIS4l0frT9FiF54Qi/JeJlwGJIW3W2XgcY9ODT0Q5g3PSmlZ8KTR imTf9Fy7WJEPA08b3fimYWsz9enuS/gECEUGV3M1MvrzpAQju27NUEOpSMZH "KRuXtz5dURAyPkcjcUvA". The host key fingerprints are: RSA SHA256:3IvYMkU05lQSKBxOVZUJMzdtXpz3RJl3dEQsg3UWc54 ECDSA SHA256:xd1xnkBpn49DUbuP8uWro2mu1GM4MtnqR2WEWg1fS3o ED25519 SHA256:Hk3+/4+X7NJBHl6/e/6xFhNXsbHBsOvt6i8YEFUepko OpenSSH server package to enable secure remote access to your server. [ ] Install OpenSSH server 54 Import SSH identity: [ No v ] You can import your SSH keys from Github or Launchpad. Import Username:

through the gRPC protocol. The atuned process contains a frontend gRPC service layer (implemented by Golang) and a backend service layer, the former of which manages optimization configurations and data and parameter search. A-Tune software architecture A-Tune client (atune-adm) A-Tune server (atuned/Golang) gRPC service Configuration Analysis Tuning Database Backend server (HTTP/Python 3) MPI/CPI