Real-time Data Stream �� Visualization QuickBI DataV Log Service / Dashboard ��� Stream Processing SparkStreaming Function Compute Hadoop HIVE Big Data Analytics Batch Processing Pig PAI MaxCompute

Registry Private Zone ENI Pod 使用场景 Use cases • Multimedia processing • IoT sensor messages processing • Stream processing at scale • Chat bots • Batch jobs or scheduled tasks • HTTP REST

JAKARTA EE 2019 开发者报告 Config Server Service Discovery Circuit Breaker Gateway Load Balancer Distributed Tracing Messaging Serverless Task Spring Boot Build anything 快速构建应用 Spring Cloud Coordinate Circuit Breaker 实现 2019.7 Spring Cloud Alibaba 毕业 2019.8 Apache RocketMQ 成为 官方推荐的 Spring Cloud Stream 实现 2019.10 Spring Cloud Alibaba 官网在 Spring 官方网站上线 2019.11 Github Star 突破 1w 2020.2 Spring

Scheduler Framework》 The IEEE ISPA 2018 (16th IEEE International Symposium on Parallel and Distributed Processing with Applications) 能力扩展：GPU支持 资源-访问代价树 四类通信方式分类中，通信开销最大的是SOC，其次是PXB，再次是PHB，PIX通信方式 的GPU之间的通信开销最小。 in Container Clouds》 The IEEE ISPA 2018 (16th IEEE International Symposium on Parallel and Distributed Processing with Applications) 生态 Next Tencent Kubernetes Engine

strategies and operate our edge devices in a clustered fashion. It really does support distributed processing across devices.” Ben Reif Lead Developer Booz Allen Hamilton 4 www.susergs.com Advancing strategies and operate our edge devices in a clus- tered fashion. It really does support distrib- uted processing across devices.” Pioneering a New Frontier in Military Tactics As the innovation team at Booz Booz Allen have come to understand, many organiza- tions continue to operate outdated data processing methodologies—struggling to capitalize on the opportunity the edge rep- resents. This has resulted

Solution is Kubernetes: • Highly Scalable • Easy to explore hyper-parameters space • Easy to do distributed training But really, Data Scientists shouldn’t have to care about containers, kubernetes and that stuff • Pachyderm can version datasets and trigger new trainings when changes occur • Distributed File Systems • NFS • HDFS • … Classic DevOps solutions: • Containers • CI/CD • Autoscaling

the zones in your cluster have uneven available resources due to node variations or unevenly distributed pre-existing workloads, this might prevent perfectly even spreading of your pods across zones systemd) 20 Supplement Kubernetes Resource Management with vSphere DRS What is DRS? The vSphere Distributed Resource Scheduler (DRS) is a load balancer for VMs deployed on a hypervisor cluster. It has advanced

the zones in your cluster have uneven available resources due to node variations or unevenly distributed pre-existing workloads, this might prevent perfectly even spreading of your pods across zones systemd) 20 Supplement Kubernetes Resource Management with vSphere DRS What is DRS? The vSphere Distributed Resource Scheduler (DRS) is a load balancer for VMs deployed on a hypervisor cluster. It has advanced

写优化 - 3 事务优化 精心设计 key 格式 一个 k8s 对象的索引和数据在同一分区内 跨分区分布式事务 -> 分区内单机事务 读优化 - 1 Range 读 Unary -> Stream 代替分页，降低延迟 内存高效复用，避免 OOM 读优化 - 2 多分片并发读 通过并发，大大减少读时延 读优化 - 3 读写分离 follower 可以无限扩展，没有 raft

are? • Sensitive information • Passwords • OAuth tokens • ssh keys etc. • Stored in etcd • distributed Key-Value data store • How about their security? • Default K8s setup • etcd contents not encrypted