CurveBS IO Processing FlowCurveBS I/O processing flow Before introducing IO processing flow, we first describe the overall architecture, data organization and topology structure of CURVE. CurveBS uses the central sockets. l Nebdserver: Accepts requests from NEBDClient and calls Curve Client for corresponding processing. it can receive requests from different NEBDClients.3. Through the above splitting, NebdClient NebdClient replaces Curve Client and directly interfaces with upper services. There is no logical processing in NEBDClient, it just proxy requests and has limited retries, which ensuring that NEBDClient0 码力 | 13 页 | 2.03 MB | 6 月前3
Curve Cloud NativeCurve integrate to Cloud NativeCurve intro • Curve is an distributed storage system • High performance • Easiser operation • Cloud native • Curve is composed of two parts • Curve Block Storage Storage (CurveBS) • CurveBS: a high performance cloud native distributed block storage • Curve File System (CurveFS) • CurveFS: a high performance cloud native file system (Based on CurveBS / S3 compatible storage lifecycle(backup, failure, recovery) DEEP INSIGHTS Plan to Support metrics, alerts, log processing and workload analysis AUTO PILOT Plan to Support horizontal/vertical scaling, auto config tuning0 码力 | 9 页 | 2.85 MB | 6 月前3
Curve Detail Introduction for CNCFHigh performance Cloud native Distributed storage system https://www.opencurve.io/Agenda • CurveBS Architecture • CurveBS Topology • CurveBS Data Organization • MetaData Server (MDS) • ChunkServer ChunkServer • Client • CurveBS IO processing flow • CurveBS Performance considerations • Cloud NativeAgenda • CurveFS Architecture • CurveFS Data Organization • CurveFS file Organization •0 码力 | 23 页 | 6.53 MB | 6 月前3
BRPC与UCX集成指南UCP把若干个UCT组合起 来,自动选择最快路径传输。 ●高级特性 –大消息报文的自动分片传输 –Active message, atomic operation, tag match, stream27 典型的RDMA栈28 UCX 编程的一些基本概念 ●Context –收集机器资源(内存,网卡等),在应用的各个部分共享 ●Worker –完成ucx的功能,可以在应用程序中调用的函数(不是单独执行的线程) –连接对象,在ep上请求发送和接收29 UCP 消息接口类型 ●Active message –速度最快,被brpc使用作为消息传递 –消息通过回调函数接收 –消息异步发送 ●Tag –MPI使用 ●Stream –官方不推荐30 WORKER ●worker是UCX通讯中的核心概念,它是一个进度引擎(progress engine) ●worker既不是协程也不是线程,而是一个状态机,可以通过不停地调用0 码力 | 66 页 | 16.29 MB | 6 月前3
Curve文件系统元数据Proto(接口定义)* * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either0 码力 | 15 页 | 80.33 KB | 6 月前3
Curve for CNCF MainCurve High performance Cloud native Distributed storage system https://www.opencurve.io/Agenda • What is Curve • Use Cases • CurveBS • Key Features • Comparing to Ceph • CurveFS • Comparing RoadmapWhat is Curve • Curve is an distributed storage system • Components • Curve Block Storage (CurveBS) • CurveBS: a high performance cloud native distributed block storage • Curve File System0 码力 | 21 页 | 4.56 MB | 6 月前3
Estimation of Availability and Reliability in CurveBSBefore Failure). 𝐴𝐹𝑅 = 1 𝑀𝑇𝐵𝐹/(24 ∗ 365) ∗ 100 In CurveBS, the data on one disk is distributed in about 50 copysets, which means when a disk fails, up to 50 other disks will restore the data faulty areas to prevent data loss caused by server problems. In addition, each disk of Curve is distributed on an average of 50 Copysets. Therefore, the probability of failure of another disk related to0 码力 | 2 页 | 34.51 KB | 6 月前3
CurveFS方案设计在数据库等场景,文件的目录层级较少,文件数量较少,文件很大。这种情况inode比较聚集,一般分布在几个复制组上。inode数量少。 以上这两种情况,以20TB为例,数据量在MB级别,client获取数据可以使用stream类型的rpc? ③ 正常使用场景,有一定的目录层级,文件分配数量较多,文件较小。这种情况inode比较分散,一般分布在多个复制组上,inode数量较多。 client获取数据可以并发从多个复制组中获取。0 码力 | 14 页 | 619.32 KB | 6 月前3
OID CND Asia Slide: CurveFStake awayPerformance in database scenario Solution architecture ● CURVE provides underlying distributed shared storage services ● Polardb for PostgreSQL provides database services Solution features0 码力 | 24 页 | 3.47 MB | 6 月前3
共 9 条
- 1













