North-South Load Balancing of Kubernetes Services with eBPF/XDP Martynas Pumputis (Isovalent) October 28, 2020 10.0.0.1 10.0.0.2 10.0.0.3 httpd httpd “httpd” service 10.0.0.1:30000 10.0.0.2:30000

CapEx Growth = Unprecedented 2.2 Internet vs. Leading USA-Based LLM: Total Current Users Outside North America Note: LLM data is for monthly active mobile app users. App not available in select countries Francisco Gross Bookings 34% 0% East Asia & Pacific Sub-Saharan Africa South Asia North America Middle East & North Africa Latin America & Caribbean Europe & Central Asia Ride Share Autonomous Taxi Year 3 Consumer / User AI Adoption = Unprecedented Internet vs. ChatGPT Users – Percent Outside North America (1990-2025), Per ITU & Sensor Tower57 AI User Adoption (ChatGPT as Proxy) = Materially

OF THIS SOFTWARE. Copyright 1985-1998, 2001 The Open Group Copyright 2002 Red Hat Inc., Durham, North Carolina. Permission to use, copy, modify, distribute, and sell this software and its documentation Copyright 2001-2004 Red Hat Inc., Durham, North Carolina. Copyright (c) 2003 by the XFree86 Project, Inc. Copyright 2004-2005 Red Hat Inc., Raleigh, North Carolina. All Rights Reserved. Permission is DEALINGS IN THE SOFTWARE. Copyright (c) 1995 X Consortium Copyright 2004 Red Hat Inc., Durham, North Carolina. All Rights Reserved. Permission is hereby granted, free of charge, to any person obtaining

n t i m e b y 0, t h e s e c on d b y 1 an d s o on . F or e x am p l e : type Direction = enum north, east, south, west var x = south # ‘x‘ is of type ‘Direction‘; its value is ‘south‘ echo x # writes Direction = enum north, east, south, west BlinkLights = enum off, on, slowBlink, mediumBlink, fastBlink LevelSetting = array[north..west, BlinkLights] var level: LevelSetting level[north] = on level[south] level[east] = fastBlink echo repr(level) # --> [on, fastBlink, slowBlink, off] echo low(level) # --> north echo len(level) # --> 4 echo high(level) # --> west T h e s y n t ax f or n e s t e d ar r ay s (

除⾮您对此启动脚本做了自定义 化并且存放到了不同的前缀目录 下。 9 Quick Start S3 bucket region QSS3BucketRegion cn-north-1 S3 bucket 对应的 region。请不要 更改 此选项，除⾮您对此启动 脚本做了自定义化并且存放到了 不同 region 的 bucket 下面。 Other parameters KEYPAIR USERNAME@HOSTNAME 样例：ssh -qTfnN -D 40011 -i "rocketMQ.pem" ec2-user@ec2-54-223- 36-247.cn-north-1.compute.amazonaws.com.cn 2. 设置好 ssh Tunnel 之后需要在浏览器中设置 proxy，浏览器有很多自动选择 Proxy 的插件，本文使用 SwitchyOmega -k /Users/username/tmp/rocketmq.pem 2. 登录到 Bastion Host 举例：ssh -A ec2-user@ec2-52-80-195-90.cn-north- 1.compute.amazonaws.com.cn 3. 从 Bastion Host 登录到 Nameserver 或者 Broker Node, 如何获取 Nameserver 或者

除⾮您对此启动脚本做了⾃定义 化并且存放到了不同的前缀⽬录 下。 9 Quick Start S3 bucket region QSS3BucketRegion cn-north-1 S3 bucket 对应的 region。请 不要更改 此选项，除⾮您对此 启动脚本做了⾃定义化并且存放 到了不同 region 的 bucket 下 面。 Other parameters KEYPAIR USERNAME@HOSTNAME 样例：ssh -qTfnN -D 40011 -i "rocketMQ.pem" ec2-user@ec2-54-223-36- 247.cn-north-1.compute.amazonaws.com.cn 2. 设置好 ssh Tunnel 之后需要在浏览器中设置 proxy，浏览器有很多自动选择 Proxy 的插件，本文使用 SwitchyOmega -k /Users/username/tmp/rocketmq.pem 2. 登录到 Bastion Host 举例：ssh -A ec2-user@ec2-52-80-195-90.cn-north-1.compute.amazonaws.com.cn 3. 从 Bastion Host 登录到 Nameserver 或者 Broker Node, 如何获取 Nameserver 或者

高可用部署 1) 软件及脚本下载  依赖应用包下载： https://f2c-north-rel-1251506367.cos.ap-beijing.myqcloud.com/install-sccript /cmp/app_packages.zip  自动化脚本下载： https://f2c-north-rel-1251506367.cos.ap-beijing.myqcloud.com/install-sccript Alertmanager 进行监控告警  使用 Grafana 进行数据可视化 杭州飞致云信息科技有限公司 24 7.2 下载部署包  Prometheus 监控工具： https://f2c-north-rel-1251506367.cos.ap-beijing.myqcloud.com/deployment-packages /CentOS/%E9%83%A8%E7%BD%B2%E5%8C% nsul%E7%9B%91%E6%8E%A7%E5%91%8A%E8%AD%A6-CentOS7-2021-10-30. zip  Exporter 被监控节点数据收集工 具: https://f2c-north-rel-1251506367.cos.ap-beijing.myqcloud.com/deployment-packa ges/CentOS/%E9%83%A8%E7%BD%B2%E5%8C%

APISIX do？ • Handle L4、L7 traffic：HTTP、HTTPS、TCP、UDP、MQTT、Dubbo、gRPC… • Replace Nginx to handle north-south traffic • Replace Envoy to handle east-west traffic between services • k8s ingress controller (Username/Password: admin) The future of API Gateway Full Traffic • North-South API Gateway -> East-West Microservice • East-west service mesh -> North-south access layer • Envoy、Kong、Apache APISIX：full traffic

type Direction = enum north, east, south, west The implied order is: north < east < south < west. The comparison operators can be used with enumeration types. Instead of north etc., the enum value can can also be quali�ed with the enum type that it resides in, Direction.north . For better interfacing to other programming languages, the �elds of enum types can be assigned an explicit ordinal value. decided from the context. If the type of foo is ambiguous, a static error will be produced. ord(north) == 0 ord(east) == 1 ord(south) == 2 ord(west) == 3 # Also allowed: ord(Direction.west) == 3

compass: 1 enum CompassPoint { 2 case north 3 case south 4 case east 5 case west 6 } The values defined in an enumeration (such as north, south, east, and west) are its enumeration value set by default, unlike languages like C and Objective-C. In the CompassPoint example above, north, south, east and west don’t implicitly equal 0, 1, 2 and 3. Instead, the different enumeration cases appsdissected.com 1 directionToHead = .south 2 switch directionToHead { 3 case .north: 4 print("Lots of planets have a north") 5 case .south: 6 print("Watch out for penguins") 7 case .east: