## HBase Read Path h openi nx@apache.org ## Abstract ☐ A i ent Si de ☐ Server Si de Tuni ng ## Part-1 Client Si de ## A i ent Scanner  and shorter STWtime. ## End-to-end off heap on the read-path (HBASE-114)  branch-1.5

## HBase Practice At Xiaomi huzheng@xiaomi.com ## About This Talk • Async HBase Client ☐ WhyAsync HBase Client ○ Implementation ☐ Performance • How do we tuning G1GC for HBase ☐ CMS vs G1 o Tuning Tuning G1GC G1GC in XiaoMi HBase Cluster ## Part-1Async HBase Client ## WhyAsync HBase Client? Blocking Client (Single Thread) ![Image](/uploads/documents/4/4/8/2/4482a28355610ca65c1d5f9c0c49bd2b/p4_2 using blocking client ## WhyAsync HBase Client? • Region Server / Master STW GC • Slow RPC to HDFS • Region Server Crash • High Load • Network Failure BTW: HBase may also suffer from fault amplification

## HBase Practice At Xi ao tianj.y1990@mail.com openi nx@apache.org ## Part-1 Problems In Practice ## Probl en s in Xi aoM ☐ Problem 1. How to satisfy the regular demand of scanning table with affecting analysis need to scan a large number of data from hbase ☐ They are executed by map reduce or spark, that put a heavy burden ## Scan snapshot directly ☐ HBase already provides this table's snapshot Input Format (C i ent Si deRegi onScanner) ☐ Construct regions by snapshot files ☐ Read data without any HBase RPC requests ☐ Required READ access to reference files and HFiles ## Snapshot ACL ☐ HDFS ACL could

## HBase基本介绍 田志鹏 20190714 今天讲的内容比较基础, 而且偏理论, 因为我个人也没有太多实际使用经验, 纸上谈兵. 上次分位点估算当时没解决的两个问题已更新ppt. ## APACHE HBASE Apache HBase $ ^{™} $ is the Hadoop database, a distributed, scalable, big data store store. Use Apache HBase $ ^{™} $ when you need random, realtime read/write access to your Big Data. This project's goal is the hosting of very large tables -- billions of rows X millions of columns -- clusters of commodity hardware. Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable ... 先来一段HBase官网的自我介绍. blabla翻译一下 重点看其中的红字, 什么hadoop数据库

## cloudera ## HBase最佳实践及优化 陈飚 cb@cloudera.com Cloudera ## 关于我 陈飚 Cloudera售前技术经理、资深方案架构师 http://biaobean.pro  原Intel 年后开始Hadoop 产品开发及方案顾问，先后负责Hadoop 产品化、HBase 性能调优，以及行业解决方案顾问 ## HBase的历史 HBase是Google BigTable的开源实现 • BigTable利用GFS作为其文件存储系统 • HBase使用HDFS作为其文件存储系统 2007年2月建立了HBase的原型版本 2006年 Google发表了BigTable论文 2006年底由PowerSet的Chad 2006年底由PowerSet的Chad Walters和Jim Kellerman发起了HBase项目，依据BigTable的论文重构关系数据库 2007年10月建立了第一个可用的HBase版本 2008年成为Apache Hadoop的一个子项目 ## HBase的模型特性 Hadoop database and NoSQL database • 基本的数据库操作CRUD • 强一致性

## Rust 异步 Runtime 的兼容层 施继成 @ DatenLord ## [Table_CompanyName] 6.17-6.18 @Shanghai ## Table of Contents ## # Rust async runtime Introduce what's rust async runtime 2 ## #Async runtime binding

CHINA CONF 2023 第三届中国 Rust 开发者大会 6.17-6.18 @Shanghai # Rust 异步并发框架在移动端的应用 陈明煜 chenmingyu4@huawei.com 华为 公共开发部 嵌入式软件能力中心 ## 😍 ## Rust 异步并发框架在移动端的应用 Applications of Rust Runtime in Mobile  ## 目录 Table of Contents # #1 Rust 异步简介 Overview of asynchronous Rust #2 社区并发框架介绍以及与移动端的不适配性 Introduction to third party Runtime crates Rust 异步机制 Asynchronous Rust 异步并发框架是许多大型应用、系统具备的底层能力。 区别于多线程编程模型，它带来以下优势： ■ 任务调度颗粒度更小，充分利用线程资源 ■ 更可控的线程数 ■ 单个任务资源占用：几十 KB -> 几百 Byte 任务切换时间：10 微秒 -> 100 纳秒 Rust 语言并没有提供异步并发框架， 只提供异步所需的基本特性：

## TiDB: HBase分布式事务与SQL实现 ## About me • TiDB & Codis founder • Golang expert • Distributed database developer • Currently, CEO and co-founder of PingCAP liuqi@pingcap.com https://github.com/pingcap/tidb com/pingcap/tidb weibo: @goroutine ## Agenda • HBase introduction • TiDB features • Google percolator and omid • Internals of TiDB over HBase ## Features of HBase • Linear and modular scalability. - Strictly server side Filters MVCC ## What did they say? “Nothing is hotter than SQL-on-Hadoop, and now SQL-on-HBase is fast approaching equal hotness status” Form HBaseCon 2015 We want more! SQL + Transaction(ACID)

### 1. Background For reducing the Java GC impact to p99/p999 RPC latency, HBase 2.x has made an off-heap read and write path. The KV are allocated from the JVM off-heap, and the memory area in off-heap In above pictures, the p999 latency is almost the same as G1GC STW cost ( $ \sim $ 100ms). After HBASE-11425, almost all memory allocations should be in the offheap, there should be rarely heap allocation ByteBuffAllocator.  In HBASE-11425, we have introduced an off-heap memory management policy as following: 1. Set a max memory

### 13. 客户端Client的编程实现 主讲人：古月 ## 话题模型  服务模型（客户端/服务器） ## • 创建功能包 $ cd ~/catkin_ws/src $ catkin_create_pkg learning_service c564ba4d556568db04/p3_2.jpg) ## • 创建客户端代码（C++） #include #include int main(int argc, char** argv) // 发现/spawn服务后，创建一个服务客户端，连接名为/spawn的service ## // 初始化turtlesim::spawn的请求数据 response.name.c_str()); return 0; }; ## 如何实现一个客户端 turtle_spawn.cpp • 初始化ROS节点； • 创建一个Client实例； - 等待Server处理之后的应答结果。 • 发布服务请求数据; ## - 配置客户端代码编译规则 ## Declare a C++ executable ## With