Kubernetes Engine) TKEx AI Training Jobs Big Data Jobs Online Services NodeProblemDetector Dynamic Scheduler DynamicQuotaManager MultiClusterManager De-Scheduler Rosource Manage & Schedule Ceres during Pod upgrade Ø Upgrade jitter (a few ms) for keep-alive services Flexible and dynamic resource management Dynamic Scheduler is to solve the problem of unbalanced node load in the cluster. Ø Base node periodically. Ø Dynamic-Scheduler query node score directly from node to make decisions during predicate and priority stage. Dynamic Scheduler Kube-scheduler Dynamic scheduler Node Node Node

Business 1 Business 2 Business 3 Business N … How to ensure load balancing of cluster nodes ？ Dynamic-Scheduler Node1 Node2 Kube-scheduler Pod Request Load Level Request Load Level Real Load Level requests but low load. Dynamic-Scheduler Node1 Node2 Kube-scheduler Pod Request Load Level Request Load Level Real Load Level Real Load Level Assigned to Node1 Dynamic-scheduler Node1 has a lower load Dynamic-Scheduler Node1 Node2 Dynamic-scheduler- node-annotator 5m Load Prometheus 1h Load 1d Load 5m Load 1h Load 1d Load telegraf Record to node annotation telegraf Dynamic-Scheduler

Spark 3.0 will add support for dynamic resource allocation, external shuffle service, Kerberos etc. How it works Spark on Kubernetes Spark-operator Gaps for spark Ø Dynamic Resource Allocation Ø Spark efficiency. Summary p Queue priority p Queue reclaim p Queue plugin p Hierarchical queue p Dynamic resource allocation p External shuffle service p Resource reservation p Job preemption p … Future

Continuous Integration Pipeline • Data Analytics • … Asynchronous Event Driven Stateless High dynamic Short Duration 14 - 一键部署Spark集群 - 无需管理服务器节点 - 灵活弹性，无限扩容 容器调度与编排 Spark-Master Serverless

self-driving approach Motivation: microservices ● Increased operational cost ○ a lot of components ○ dynamic dependencies ○ fast deployment iteration ● Solution: automation Cluster management system ● Automation

(Domain-Specific Language) • 领域特定语言指专注于某个应用程序领域的计算机语言 • 目标受众为非程序员、业务员或最终客户 典型的 DSL • 正则表达式 Ver.2 动态化 Dynamic Engine Command Policy Executor Task Node Node Node Global Job Custom Job Node Script Image

Internal. All rights reserved. 容器云设计– 存储方案 • 存储方案选择，主要给服务组件提供服务，如MySQL，Redis等 数据持久化 数据共享 K8S Dynamic Provisioning StorageClass 需求 存储技术 使用方案 RBD 对象存储 S3/FastDFS/TFS 应用自己管理 16 2017 Lenovo Internal

decision-making at the point of data collection. Fast, insight-driven decision-making in highly dynamic and dangerous conditions is, more often than not, the difference be- tween life and death. Booz

Security Test (SAST) 靜態應用安全測試 : Interactive Application Security Test (IAST) 動態應用安全測試 (黑箱測試): Dynamic Application Security Test (DAST) 軟體元件分析: Software Component Analysis (SCA) 測試 提交 部署 生產 持續整合

defined, storageClassName: ## If set to "-", storageClassName: "", which disables dynamic provisioning ## If undefined (the default) or set to null, no storageClassName spec is ##