## GPU Resource Management On JDOS 梁永清 liangyongqing1@jd.com ## 提供的服务 ## Experiment ## Training 1. 用于实验的 GPU 容器 2. 基于 Kubeflow 的机器学习训练服务 3. 模型管理和模型 Serving 服务 ## Serving 均基于容器，不对业务方直接提供 GPU 物理机

## Ozone User Group Summit Nov 10, 2022  We believe that data can make what is impossible today, possible tomorrow ## CLOUDERA SNAPSHOTS • A single object - multiple versions • A group of objects as a unit ☐ Consistent with each other ☐ Point in time, together as a group • Examples : ☐ Application updating multiple rows of of a table to get to a consistent state ☐ Application updating a group of tables to move from one state to another - Easy rollback for a DB/table to last App consistent view ## APP CONSISTENT VIEW EXAMPLE

在金融行业的架构探索和明天 ## Resource Scheduling & Container Technology for Financial Service 余军 Gopher China 2015 ## 关于我 ☐ ~19y+ Linux & opensource experience ☐ Co-founder of Shanghai Linux User Group (1997) p14_2.jpg) ## Algorithm 1 DRF pseudo-code $R = \langle r_{1}, \cdots, r_{m} \rangle$ ▷ total resource capacities $C = \langle c_{1}, \cdots, c_{m} \rangle$ ▷ consumed resources, initially 0 $s_{i}$ \max_{j=1}^{m} \{ u_{i,j} / r_{j} \}$ else return ▷ the cluster is full end if ① Mesos 采用了DRF(Dominant Resource Fairness) 调度机制。YARN自带FIFO、Capacity Scheduler和Fair Scheduler(借鉴了Mesos的DRF)。 ② Mesos中的DRF调度算法过分的

## +21 ## Compile-Time Compression and Resource Generation with C++20 ## ASHLEY ROLL 20 21 October 24-29 ## I ntroduction Explore how C++20's constexper features can: • Generate data from code that take a user-supplied lambda to generate the data needed to render our desired compile-time resource! - These are effectively templated functions, but we will use the cleaner auto parameter syntax

## Greenplum资源管理器 姚珂男/Pivotal kyao@pivotal.io ## Agenda • Greenplum数据库 • Resource Queue • Resource Group ## Greenplum数据库 • 基于PostgreSQL • 分布式 • OLAP • MPP(Massively Parallel Processing) ## Greenplum数据库 6d5e7818fe3eb6bc09e8312568f4d7a/p4_1.jpg) ## Resource Queue • SQL语句并发控制 • 基于cost的并发控制 • 基于priority的CPU控制 • 内存控制 ## Running Example • CREATE RESOURCE QUEUE rq WITH ( active_statements = 6, min_cost = 50000, priority = high, memory_limit = '1024MB' ); • CREATE ROLE r1 RESOURCE QUEUE rq; • SELECT * FROM gp_toolkit.gp_resqueue_status; ## 内存控制 • virtual memory note keeping

## Group Replication原理解析与实践经验 徐春阳 ## QCon 全球软件开发大会 10⽉17-19⽇上海·宝华万豪酒店  扫码锁定席位 ## 九 折即将结束 团购还享更多优惠，折扣有效期至9月17日 扫描右方二维码即可查看大会信息及购票 用户线程执行事务（sql）流程  group_replication_trans_before_commit 被唤醒后 将有关事务的日志写入到本地通道。后面的所有任务，例如，将这个事务日志利用paxos协议进行全局一致性广播，验证是否跟 当心secondary节点变成可写节点 ## Group_replication_bootstrap_group参数须谨慎 规避大事务 DDL操作注意事项 ## Secondary节点变成可写节点 正常情况下，Single primary 模式下，secondary节点只读 不管my.cnf的read_only参数是如何设置， 当节点被执行stop group_replicaiton的命令后，节点马上变成可读写。

/c/484c9d62390ce6f7d8cf5e435c4c269f/p5_1.jpg) • MySQL Replication 数据冗余存储 • Shared Storage • Group Replication • MySQL Cluster ## MySQL 复制工作流 二进制日志 会话 转储 中继日志  • Group Replication • MySQL Cluster # 主动 接管 共享 存储 被动 版权所有 2015, Oracle 和 / ## 适用于 MySQL 的 Oracle VM 模板 .jpg) 数据路由 • MySQL Replication • Shared Storage • Group Replication • MySQL Cluster 数据冗余存储 ## MySQL Group Replication • MySQL Group Replication是什么？ “任何一个都可以更新 MySQL 的复制插件,内建自动分化散式的回复,冲突处理

range accepts EHCache 2.x as well * added "contentLength()" method to Resource abstraction * URL-based Resource variants introspect "last-modified" and "content-length" response collections and nested collections (fixed regression) * ConversionService properly handles nested Resource arrays in Map values (fixed regression) * ConversionService does not accidentally use copy constructor any value type * SpringTemplateLoader for FreeMarker supports last-modified timestamp through Resource abstraction * HibernateJpaDialect correctly closes borrowed connections even for nested JDBC executions

Extending Flask-RESTful • Content Negotiation • Custom Fields & Inputs ○ Response Formats ☐ Resource Method Decorators Custom Error Handlers • Intermediate Usage ○ Project Structure Use With Blueprints flask_restful import Resource, Api app = Flask(__name__) api = Api(app) class HelloWorld(Resource): def get(self): return {'hello': 'world'} api.add_resource(HelloWorld, '/') defining methods on your resource. A basic CRUD resource for a todo application (of course) looks like this: from flask import Flask, request from flask_restful import Resource, Api app = Flask(__name__)

• Co-location @ Alibaba • Kubernetes vs YARN • Kubernetes & YARN: a hybrid architecture • Resource Isolation • Future ## What/Why co-location ## Data center Avg utilization ![Image](/uploads/d in co-location • Resource sharing: Make services and jobs share a single cluster and have them run on the same hardware • Resource Isolation: Rely on scheduling efficiency and resource isolation to guarantee guarantee the SLA. ## Why co-location • Two separated cluster cause huge resource wastage. Increase resource utilization. • 1 hour peak traffic on double 11 requires a lot of extra resources. However,