Analytics Spring 2020 2/25: State Management Vasiliki (Vasia) Kalavri vkalavri@bu.edu ## State in dataflow computations Any non-trivial streaming computation maintains state: • rolling aggregations jpg) ## Streaming state ## Unmanaged • No explicit state primitives - Users define state using arbitrary types - The system is unaware of which parts of an operator constitute state ## Managed • Explicit Explicit state primitives including state types and interfaces - The system is aware of state and can transparently checkpoint it, restore it, re-scale it ![Image](/uploads/documents/b/9/f/d/b9fd594d

THE STATE OF GO What’s New since Go 1.20 白明 Tony Bai 《Go语言精进之路》作者 tonybai.com博主 那段时间错过的Go版本 2022.3 Go 1.18 泛型落地 2022.8 Go 1.19 修订Go内存模型文档、支持Soft memory limit 2023.3 Go 1.20 引入Profile-Guided Optimizations

## GPU Resource Management On JDOS 梁永清 liangyongqing1@jd.com ## 提供的服务 ## Experiment ## Training 1. 用于实验的 GPU 容器 2. 基于 Kubeflow 的机器学习训练服务 3. 模型管理和模型 Serving 服务 ## Serving 均基于容器，不对业务方直接提供 GPU 物理机

## +24 ## Back To Basics Lifetime Management ## PHIL NASH ## 20 24 September 15 - 20 ## C++ is complex  mostly for historical sonarsource.com/blog/beyond-the-rules-of-three-five-and-zero/ ## +24 ## Back To Basics Lifetime Management ## PHIL NASH ## 20 24 September 15 - 20

Scalability • Durability • Simplicity • Performance ## CHALLENGES Dependency Management Go's Dependency Management story isn't good (yet). We realized our deficiencies in this space later than Dependency Management Go's Dependency Management story isn't good (yet). We realized our deficiencies in this space later than we should have. # Managing Dependencies Dependency Management Working Working Group 2 Dep tool as "official experiment" Prototype for dependency management integrated with go tool  #

24. June # Secrets Management at Scale with Vault & Rancher  Bastian Hofman Senior Field Engineer SUSE bastian.hofmann@suse Operations & Infrastructure Management (Run & Manage) K8s Version Management GitOps Continuous Delivery Cluster Templates & Config Enforcement Node Pool Management RBAC, OPA, Pod & Network Network Policies Cluster Provisioning & Lifecycle Management  kubernetes ![Image](/uploads/documents/4/7/a/c/47acf68

## Node Operator: Kubernetes Node Management Made Simple 陈俊(Joe)，Ant Financial ## Agenda • Background and Motivation • Introduction of Operators • Node-Operator • Advanced Topic: Kube-on-Kube-Operator Master & Node Components reliably • Canary Rollout • Master & Node Component Versions Management  Worker Order Complicated architecture Work order deployment system can not meet the requirements of resource management. ## Operator 

Toward Standard C++ Dependency Management ## BILL HOFFMAN & BRET BROWN ## 20 23 October 01 - 06 ## Libraries: A First Step Toward Standard C++ Dependency Management October 3, 2023 Bloomberg Engineering portable as the code they contain! ✓ Projects should be “cattle,” not “pets”! ## Why dependency management? Consensus: Managing dependencies == way too hard Q: Which of these do you find frustrating about following names: jsonlogConfig.cmake Jsonlog-config.cmake # ... CMake gives you some dependency management tips here ... Aside: Coloring and bolding added for emphasis ## Motivation: What would we design

## State of the UI: Leveraging Kubernetes Dashboard and Shaping its Future Spencer Sugarman UX Researcher, Google Dan Romlein UX Designer, Google ## Talk Goals 1. What Dashboard is and why you should plugins or integrations 集成第三方插件 2. Feature parity with kubectl 功能与kubectl保持一致 3. Multi-cluster management 多集群管理 4. Improved security 提高安全性 1. Third-party plugins or integrations 集成第三方插件 Which response → Cluster Operator, running Kubernetes on-prem and in the cloud ## ☐☐☑ 3. Multi-cluster management 多集群管理 Most survey takers said that it is very or extremely important to see resources from multiple

Elasticity policies and state migration Vasiliki (Vasia) Kalavri vkalavri@bu.edu Streaming applications are long-running • Workload will change • Conditions might change • State is accumulated over time terminate processes • Adjust dataflow channels and network connections • Re-partition and migrate state in a consistent manner • Block and unblock computations to ensure result correctness ## Automatic Re-configuration requires state migration with correctness guarantees. ## State migration ## State migration strategies ## • Stop-and-restart • halt the whole computation, take a state snapshot of all operators