PFS SPDK: Storage Performance Development Kit
1 基于SPDK的CurveBS PFS存储引擎10/17/22 2 Why ●为了减少使用cpu做内存copy,减少系统调用 ●发挥某些被操作系统屏蔽的功能,例如nvme write zero ●根据阿里《When Cloud Storage Meets RDMA》的说法 ●在100Gbps网络带宽时,内存带宽成为瓶颈 ●Intel Memory Latency Checker (MLC)测试得到的CPU内存带宽是 7/22 6 对PFS的修改 ●基于阿里开源的PFS ●不再基于daemon模式,而是直接使用pfs core api ●依然向外提供管理工具, 例如 pfs ls、cp、rm等 ●增加spdk驱动10/17/22 7 新增PFS接口 ●增加pfs_pwritev和pfs_preadv接口 ●ssize_t pfs_preadv(int fd, const struct iovec f由若干地址不连 续的block组成,一次IO提交可以提高效率。10/17/22 8 PFS+SPDK 的部分读写的实现 ●某些盘只支持4k单位读写,但是CurveBS支持512字节读写 ●可能存在部分写的并发冲突 ●引入并发的range lock解决冲突10/17/22 9 PFS+SPDK 的DMA支持 ●ssize_t pfs_writev_dma(int fd, const struct0 码力 | 23 页 | 4.21 MB | 5 月前3OID CND Asia Slide: CurveFS
CURVE Roadmap � CURVE Community � You can take awayCURVE Roadmap ● Features ○ Supports RDMA and SPDK ○ Further reduce I/O latency and improve throughput ○ Support data lifecycle management ○ Curve0 码力 | 24 页 | 3.47 MB | 5 月前3Curve 分布式存储设计
文件存储支持分布式缓存、完善冷热数据分层存储能力 2. 完善混合云、公有云上部署架构 3. 完善高性能3副本存储引擎,支持混合盘 4. 文件存储支持数据存储到HDFS、rados等引擎 2. 性能 1. 完善RDMA/SPDK方案,发布稳定版本 2. 更高性能硬件选型、适配及性能调优 3. 大文件读写性能优化,RAFT优化,降低写放大 3. 功能 1. 文件存储支持回收站/生命周期管理/配额/用户权限等 2.0 码力 | 20 页 | 4.13 MB | 5 月前3Raft在Curve存储中的工程实践
Curve对raft的优化Curve块存储RAFT应用 Curve块存储 • 高性能、更稳定、易运维 • 支持NBD(network block device)、iscsi • 支持RDMA和SPDK Curve块存储架构 • client:接受用户请求。 • mds:保存元数据,包括topo信息、块设备信息、 数据分布信息等,持久化到etcd中。 • chunkserver:采用raft协议3副本的方式保存块0 码力 | 29 页 | 2.20 MB | 5 月前3openEuler 21.03 技术白皮书
brings about a substantial performance improvement, letting io_uring deliver a performance close to SPDK. io_uring is more effective when the queue depth is relatively high. 13. Enhanced commercial0 码力 | 21 页 | 948.66 KB | 1 年前3openEuler 21.03 技术白皮书
提高 DDR 持久性内存的性能。 12. 支持 io_uring:io_uring 是一个新的异步 IO 框架, 支持 polling 模式,在 polling 模式下,性能提升 显著,与 SPDK 接近,在队列深度较高时性能更好。 13. IMA 商用增强:在开源 IMA 方案基础上,增强安 全性、提升性能、提高易用性,助力商用落地。 14. 支持 per-task 栈检查:增强对0 码力 | 18 页 | 1.30 MB | 1 年前3Oracle VM VirtualBox 5.1.32 User Manual
recording (cap- turing) levels • Storage: fixed hang when using the emulated NVMe controller with the SPDK (bug #16945) • Mouse: double click was not working with a precision touchpad (bug #14632) • Linux #15189, #15925, #16170, #16682, #16794 and others) • Storage: fixed possible crash when using Intels SPDK • API: use the correct file name of the VM machine state if the VM settings directory is renamed when the VM is running • NVMe: fixed compatibility with the Storage Performance Development Kit (SPDK, bug #16368) • VBoxSVC: fixed a crash under rare circumstances 277 15 Change log • VBoxManage:0 码力 | 363 页 | 4.18 MB | 1 年前3Oracle VM VirtualBox 5.1.26 User Manual
recording (cap- turing) levels • Storage: fixed hang when using the emulated NVMe controller with the SPDK (bug #16945) • Mouse: double click was not working with a precision touchpad (bug #14632) • Linux #15189, #15925, #16170, #16682, #16794 and others) • Storage: fixed possible crash when using Intels SPDK • API: use the correct file name of the VM machine state if the VM settings directory is renamed when the VM is running • NVMe: fixed compatibility with the Storage Performance Development Kit (SPDK, bug #16368) • VBoxSVC: fixed a crash under rare circumstances • VBoxManage: added a sanity check0 码力 | 361 页 | 4.18 MB | 1 年前3Oracle VM VirtualBox 5.2.40 User Manual
recording (cap- turing) levels • Storage: fixed hang when using the emulated NVMe controller with the SPDK (bug #16945) • Mouse: double click was not working with a precision touchpad (bug #14632) • Linux #16170, #16682, #16794 and others) 297 15 Change log • Storage: fixed possible crash when using Intels SPDK • API: use the correct file name of the VM machine state if the VM settings directory is renamed, snapshots when the VM is running • NVMe: fixed compatibility with the Storage Performance Development Kit (SPDK, bug #16368) • VBoxSVC: fixed a crash under rare circumstances • VBoxManage: added a sanity check0 码力 | 387 页 | 4.27 MB | 5 月前3Oracle VM VirtualBox 5.2.0 User Manual
recording (cap- turing) levels • Storage: fixed hang when using the emulated NVMe controller with the SPDK (bug #16945) • Mouse: double click was not working with a precision touchpad (bug #14632) • Linux #15189, #15925, #16170, #16682, #16794 and others) • Storage: fixed possible crash when using Intels SPDK • API: use the correct file name of the VM machine state if the VM settings directory is renamed when the VM is running • NVMe: fixed compatibility with the Storage Performance Development Kit (SPDK, bug #16368) • VBoxSVC: fixed a crash under rare circumstances • VBoxManage: added a sanity check0 码力 | 375 页 | 4.22 MB | 1 年前3
共 26 条
- 1
- 2
- 3