## TokuDB索引结构 网易杭州研究院---胡争（博客：openinx.github.io） ## TokuDB简介 - 基于分形树实现的MySQL存储引擎 • Tokutek公司2007年研发，2013年开源 • 2015年Percona公司收购Tokutek公司 • TokuDB内部的K-V存储引擎为ft-index • TokuMx: ft-index + MongoDB Server层代码 • 超高压缩率（TokuDB 4M vs InnoDB 16K） 更高性能，更低成本！ ## 分形树索引结构（一）  ## 分形树结构（二） • msg buffer - 先进先出队列 • BasementNode (OMT) - 弱平衡二叉树 弱平衡二叉树 – 增删改查期望复杂度 $ O(\log N) $ • 页大小默认4M。 - 扇出fanout默认 $$ 4,16 $$ 区间。 ## 分形树结构（三） ## • 叶子节点 - 数据量维持在 $$ 1M,4M $$ 区间 - 数据量小于1M则合并 - 数据量大于4M则分裂。 ## • 非叶子节点 - 扇出（fanout）维持在 $$ 4,16 $$ 区间 - 扇出小于4则合并

CloudWeGo INTRODUCTION TO OPEN SOURCE PROJECTS CloudWeGo开源项目介绍 CLOUDWEGO 目录 第一章 项目介绍 1.1 CloudWeGo 的项目和用户 01 1.2 CloudWeGo 如何帮助企业用户 解决微服务构建中遇到的问题 02 1.2.1 提供免费企业用户支持 第二章 不同场景下的解决方案 2.1 Golang RPC框架 Kitex Hertz、Kitex 重写经典的 Istio Bookinfo 项目 2.4 Rust 首选 RPC框架 Volo 33 2.4.1 架构设计（框架特点/框架性能/扩展能力） 项目介绍 CloudWeGo是一套由字节跳动开源的、可快速构建企业级云原生微服务架构的中间件集合。在github开源后获得超过1w的star和超142位贡献者。 项目官网：https://www.cloudwego.io/ github: github: https://github.com/cloudwego CloudWeGo 开源的主打项目 Golang RPC框架：Kitex（目前已是字节内部使用最广泛的RPC框架，高峰QPS达到数十亿） Golang HTTP框架：Hertz（超大级企业HTTP框架，适用于网关、服务网格等多场景） Rust RPC框架：Volo（Rust首选RPC框架） CloudWeGo的用户

# Java 应用与开发 Java EE 体系结构 王晓东 wangxiaodong@ouc.edu.cn 计算机科学与技术系 November 6, 2018  ## 参考书目 1. 吕海东，张坤编著，Java EE 企业级应用开发实例教程，清华大学出版社，2010 软件系统是由许多小的组件构建和装配起来的 采用标准规范开发 J2EE, MS.NET 全面采用框架技术 Struts、Spring、Hibernate、AJAX、WebWork 软件系统采用分层结构和设计模式 MVC 工厂化流水线开发模式 CVS 可视化软件建模 UML、RUP、ROSE ## 软件开发现状 面向 Internet 开发企业级 Web 应用 面向对象 OOA/OOD/OOP，Java、C# 软件系统是由许多小的组件构建和装配起来的 采用标准规范开发 J2EE、MS.NET 全面采用框架技术 Struts、Spring、Hibernate、AJAX、 WebWork 软件系统采用分层结构和设计模式 MVC 工厂化流水线开发模式 CVS 可视化软件建模 UML、RUP、ROSE ## 软件开发现状 面向 Internet 开发企业级 Web 应用 面向对象 OOA/OOD/OOP，Java、C#

# Scrapy Documentation Release 0.16.5 Scrapinghub May 12, 2016 Powered by TCPDF (www.tcpdf.org) 1 Getting help 3 2 First steps 5 2.1 Scrapy at a glance 5 2.2 Installation guide 8 2.3 Scrapy Items 24 3.3 Spiders 28 3.4 Link Extractors 36 3.5 Selectors 38 3.6 Item Loaders 44 3.7 Scrapy shell 51 3.8 Item Pipeline 54 3.9 Feed exports 57 4 Built-in services 63 4.1 Logging 63 packages 102 5.11 Scrapy Service (scrapyd) 102 5.12 AutoThrottle extension ..... 113 5.13 Jobs: pausing and resuming crawls ..... 114 5.14 DjangoItem ..... 116 6 Extending Scrapy ..... 119 6.1

### Scrapy 2.6 documentation Scrapy is a fast high-level web crawling [https://en.wikipedia.org/wiki/Web_crawler] and web scraping [https://en.wikipedia.org/wiki/Web_scraping] framework, used to crawl the scrapy tag [https://stackoverflow.com/tags/scrapy]. • Ask or search questions in the Scrapy subreddit [https://www.reddit.com/r/scrapy/]. • Search for questions on the archives of the scrapy-users forum/scrapy-users]. • Ask a question in the #scrapy IRC channel. • Report bugs with Scrapy in our issue tracker [https://github.com/scrapy/scrapy/issues]. • Join the Discord community Scrapy Discord

### Scrapy 2.7 documentation Scrapy is a fast high-level web crawling [https://en.wikipedia.org/wiki/Web_crawler] and web scraping [https://en.wikipedia.org/wiki/Web_scraping] framework, used to crawl the scrapy tag [https://stackoverflow.com/tags/scrapy]. • Ask or search questions in the Scrapy subreddit [https://www.reddit.com/r/scrapy/]. • Search for questions on the archives of the scrapy-users forum/scrapy-users]. • Ask a question in the #scrapy IRC channel. • Report bugs with Scrapy in our issue tracker [https://github.com/scrapy/scrapy/issues]. • Join the Discord community Scrapy Discord

# Scrapy Documentation Release 2.11.1 Scrapy developers Feb 14, 2024 Powered by TCPDF (www.tcpdf.org) ## FIRST STEPS 1 Getting help 3 2 First steps 5 2.1 Scrapy at a glance 5 2.2 Installation guide 7 2.3 Scrapy Tutorial 11 2.4 Examples 23 3 Basic concepts 25 3.1 Command line tool 25 3.2 Spiders 35 3.3 Selectors 49 3.4 Items 68 3.5 Item Loaders 74 3.6 Scrapy shell 84 3 and resuming crawls ..... 224 5.14 Coroutines ..... 225 5.15 asyncio ..... 230 6 Extending Scrapy ..... 235 6.1 Architecture overview ..... 235 6.2 Add-ons ..... 238 6.3 Downloader Middleware

# Scrapy Documentation Release 0.9 Insophia May 12, 2016 Powered by TCPDF (www.tcpdf.org) 1 Getting help 3 2 First steps 5 2.1 Scrapy at a glance 5 2.2 Installation guide 7 2.3 Scrapy Tutorial 19 3.2 Spiders 23 3.3 Link Extractors 29 3.4 XPath Selectors 31 3.5 Item Loaders 36 3.6 Scrapy shell 44 3.7 Item Pipeline 47 4 Built-in services 51 4.1 Logging 51 4.2 Stats Collection Images 81 6 Extending Scrapy 87 6.1 Architecture overview 87 6.2 Downloader Middleware 89 6.3 Spider Middleware 94 6.4 Extensions 98 7 Reference 103 7.1 scrapy-ctl.py 103 7.2 Requests

### Scrapy 0.14 documentation This documentation contains everything you need to know about Scrapy. ## Getting help Having trouble? We’d like to help! • Try the FAQ – it’s got answers to some common archives of the scrapy-users mailing list [http://groups.google.com/group/scrapy-users/], or post a question [http://groups.google.com/group/scrapy-users/]. • Ask a question in the #scrapy IRC channel. • Report bugs with Scrapy in our issue tracker [https://github.com/scrapy/scrapy/issues]. ## First steps ## Scrapy at a glance Understand what Scrapy is and how it can help you. ## I nstallation guide

# Scrapy Documentation Release 2.0.1 Scrapy developers May 19, 2020 Powered by TCPDF (www.tcpdf.org) ## FIRST STEPS 1 Getting help 3 2 First steps 5 2.1 Scrapy at a glance 5 2.2 Installation guide 7 2.3 Scrapy Tutorial 11 2.4 Examples 22 3 Basic concepts 23 3.1 Command line tool 23 3.2 Spiders 33 3.3 Selectors 44 3.4 Items 61 3.5 Item Loaders 65 3.6 Scrapy shell 76 3 and resuming crawls ..... 193 5.14 Coroutines ..... 194 5.15 asyncio ..... 196 6 Extending Scrapy ..... 197 6.1 Architecture overview ..... 197 6.2 Downloader Middleware ..... 200 6.3 Spider