对于使用 AI 辅助软件开发特别感兴趣。因此， 本期技术雷达讨论了许多代码辅助工具，如 GitHub Copilot、Tabnine 和 Codeium。我们兴奋于 open-source LLMs for coding 在工具领域可能带来的变革，并且我们看到了在编码之外的辅助领域中工具和能力的爆炸式增 长，如用户故事编写辅助、用户研究、电梯演讲和其他基于语言的任务。同时，我们希望开发人员能够负责任 积极的影响？虽然衡量标准可能变得更加细致入微，但真正的生产力衡量仍然难以捉摸。 本期主题 © Thoughtworks, Inc. All Rights Reserved. 7 众多大语言模型 大语言模型（LLMs）为现今人工智能的许多重要突破奠定了基础。目前的应用多使用类似聊天的界面进行交 互，例如 ChatGPT 或 Google Bard。生态中的主要竞争者（例如 OpenAI 的 ChatGPT，Google 合并队列 71. Google Bard 72. Google Cloud 工作站 73. Gradio 74. KWOK 75. Llama 2 76. Maestro 77. Open-source LLMs for coding 78. OpenCost 79. OpenRewrite 80. OrbStack 81. Pixie 82. Tabnine 暂缓 — 采纳 83. Playwright

and test ML experiments with Helm • Manage training jobs and pipelines with Argo • Serve trained models for inference with TF Serving • Rapid prototyping with self-service Jupyter notebook from JupyterHub what you use, scale down when idle • Parallel training instead of sequential: huge time saver for large trainings Kubeflow • Machine Learning Toolkit for Kubernetes • To make ML workflows on Kubernetes • JupyterHub to create and manage interactive Jupyter notebooks • Model serving – serve exported models with TF Serving or Seldon • Additional components for storage, workflow, etc. Artificial Intelligence

fleet Kubernetes makes magic at ebay Model + Controller How we model our datacenter Operation in large scale Q&A About ebay 177M Active buyers worldwide $22.7B Amount of eBay Inc. GMV $2.6B Reported like? Replica Config LoadBalancer Rolling Update Quota Docker Image Volume RBAC Kubernetes models applications How about Kubernetes itself? How about the fleet Kubernetes running on? Onboard

? ? ? Kubernetes Kops Kubernetes Operations Kubernetes Kops Kubernetes Operations “Kops models a cluster then realizes it in a cloud” - Kris Nova Kubernetes Kops Kubernetes Operations Statically dealing with YAML Kops 1.4 And we had a lot of it.. Kops 1.4 $: git checkout tags/v1.4.4 $: cd upup/models/cloudup $: find . | xargs wc -l | grep total total 1076 The next release Kops 1.5 wanted new

Methods to achieve high SLOs on a large scale Kubernetes cluster Kang FAN, Jinghua YAO Why SLO? SLO (Service-Level Objective). Within service-level agreements (SLAs), SLOs are the objectives that must meets all SLIs in a period of time. SLA = SLO + Punishment. SLA/SLO/SLI What we concern about Large k8s Cluster What happened about the cluster 1 Is there something unexpected happened in the cluster 1 Are all software components working fine 2 How many failures occurred on the cluster SLIs on Large k8s Cluster 1. Cluster health state A combination value indicates the risk in the cluster. Currently

utilization using hybrid deployment of online and offline services. • Support Service Mesh. • Large-scale and high-performance autoscaling capabilities. • Multi-tenant and quota management. • etc to reconcile business quota. Ø ValidatingWebhook to validate pod add request. DynamicQuota Large-scale and high-performance Autoscaling Motivation: Ø Reduce container OOM from bursted traffic.

Resource orchestration optimization of kubernetes cluster in large scale Patrickxie ( 谢谆志） Background Cloud has been the general trend. How to manage so many clusters ,resources and businesses

检测项 Ver.1 优化点 检测代码在膨胀 检测能力迭代需要加速 检测框架 Ver.2 { 动态定制 动态扩展 Ver.2 DSL DSL (Domain-Specific Language) • 领域特定语言指专注于某个应用程序领域的计算机语言 • 目标受众为非程序员、业务员或最终客户 典型的 DSL • 正则表达式 Ver.2 动态化 Dynamic Engine

力。不同重复造轮子只是适 配不同 API 如何基于 K8s ，构建出一个既用户友好，又高可扩展，还 统一、标准化的应用管理平台？ 简单的“客户端”抽象： DCL (Data Configuration Language) 对 K8s 资源进行抽象实际上就是在操纵 YAML 数据，通过 DCL 来完成相比于 CRD + controller 更简单 CUE • 功能强大：专注于操纵数据，而不是写 代码 •

tionFalse）。如果不 健康Node的阈值达到 --unhealthy-zone-threshold （默认为0.55），那么驱逐速率将被降低：如果集群很⼩（即⼩于 或等于 --large-cluster-size-threshold 个Node，默认50），那么驱逐就会停⽌；否则驱逐速率降低到 --secondary- node-eviction-rate （默认0.01