## 基于SPDK的CurveBS PFS存储引擎 ## Why ·为了减少使用cpu做内存copy，减少系统调用 发挥某些被操作系统屏蔽的功能，例如nvme write zero ·根据阿里《When Cloud Storage Meets RDMA》的说法 ·在100Gbps网络带宽时，内存带宽成为瓶颈 Intel Memory Latency Checker (MLC)测试得到的CPU内存带宽是61Gbps 也合适 ## 对PFS的修改 ## 基于阿里开源的PFS ·不再基于daemon模式，而是直接使用pfs core api ·依然向外提供管理工具，例如 pfs ls、cp、rm等 ·增加spdk驱动 ## 新增PFS接口 ·增加pfs_pwritev和pfs_preadv接口 • size_t pfs_preadv(int fd, const struct iovec *iov, int vector的接口主要是为了与brpc的iobuf对接，iobuf由若干地址不连续的block组成，一次IO提交可以提高效率。 ## PFS+SPDK 的部分读写的实现 某些盘只支持4k单位读写，但是CurveBS支持512字节读写 可能存在部分写的并发冲突 ·引入并发的range lock解决冲突 ## PFS+SPDK 的DMA支持 .ssize_t pfs_writev_dma(int fd, const struct

Roadmap √ CURVE Community √ You can take away ## CURVE Roadmap ## • Features o Supports RDMA and SPDK ☐ Further reduce I/O latency and improve throughput ☐ Support data lifecycle management ☐ Curve

存储能力 2. 完善混合云、公有云上部署架构 3. 完善高性能3副本存储引擎，支持混合盘 4. 文件存储支持数据存储到HDFS、rados等引擎 ### 2. 性能 1. 完善RDMA/SPDK方案，发布稳定版本 2. 更高性能硬件选型、适配及性能调优 3. 大文件读写性能优化，RAFT优化，降低写放大 ### 3. 功能 1. 文件存储支持回收站/生命周期管理/配额/用户权限等

答疑 ## Curve块存储RAFT应用 ## Curve块存储 • 高性能、更稳定、易运维 • 支持NBD(network block device)、iscsi • 支持RDMA和SPDK ## Curve块存储架构 • client：接受用户请求。 • mds：保存元数据，包括topo信息、块设备信息、数据分布信息等，持久化到etcd中。 - chunkserver：采用

brings about a substantial performance improvement, letting io_uring deliver a performance close to SPDK. io_uring is more effective when the queue depth is relatively high. 13. Enhanced commercial use

大块顺序写性能, 提高 DDR 持久性内存的性能。 12. 支持 io_uring: io_uring 是一个新的异步 IO 框架，支持 polling 模式，在 polling 模式下，性能提升显著，与 SPDK 接近，在队列深度较高时性能更好。 13. IMA 商用增强：在开源 IMA 方案基础上，增强安全性、提升性能、提高易用性，助力商用落地。 14. 支持 per-task 栈检查：增强对 ROP

recording (capturing) levels - Storage: fixed hang when using the emulated NVMe controller with the SPDK (bug #16945) • Mouse: double click was not working with a precision touchpad (bug #14632) - Linux #15189, #15925, #16170, #16682, #16794 and others) • Storage: fixed possible crash when using Intels SPDK • API: use the correct file name of the VM machine state if the VM settings directory is renamed when the VM is running - NVMe: fixed compatibility with the Storage Performance Development Kit (SPDK, bug #16368) - VBoxSVC: fixed a crash under rare circumstances - VBoxManage: added a sanity check

recording (capturing) levels - Storage: fixed hang when using the emulated NVMe controller with the SPDK (bug #16945) • Mouse: double click was not working with a precision touchpad (bug #14632) - Linux #15189, #15925, #16170, #16682, #16794 and others) • Storage: fixed possible crash when using Intels SPDK • API: use the correct file name of the VM machine state if the VM settings directory is renamed when the VM is running - NVMe: fixed compatibility with the Storage Performance Development Kit (SPDK, bug #16368) - VBoxSVC: fixed a crash under rare circumstances - VBoxManage: added a sanity check

recording (capturing) levels - Storage: fixed hang when using the emulated NVMe controller with the SPDK (bug #16945) • Mouse: double click was not working with a precision touchpad (bug #14632) - Linux #15189, #15925, #16170, #16682, #16794 and others) • Storage: fixed possible crash when using Intels SPDK • API: use the correct file name of the VM machine state if the VM settings directory is renamed when the VM is running - NVMe: fixed compatibility with the Storage Performance Development Kit (SPDK, bug #16368) - VBoxSVC: fixed a crash under rare circumstances - VBoxManage: added a sanity check

recording (capturing) levels - Storage: fixed hang when using the emulated NVMe controller with the SPDK (bug #16945) • Mouse: double click was not working with a precision touchpad (bug #14632) - Linux #16170, #16682, #16794 and others) ## 15 Change log • Storage: fixed possible crash when using Intels SPDK • API: use the correct file name of the VM machine state if the VM settings directory is renamed when the VM is running - NVMe: fixed compatibility with the Storage Performance Development Kit (SPDK, bug #16368) - VBoxSVC: fixed a crash under rare circumstances - VBoxManage: added a sanity check