了解决易用性的问题，近年来 SQL-0N-HADOOP 技术大量涌现 出来，几乎成为当前 Hadoop 开发使用的一个技术热点趋势。 这 些 技 术 包 括：Hive、Pivotal HAWQ、SPARK SQL、Impala、 Prest、Drill、Tajo 等等很多，这些技术有些是在 Mapreduce 上做 了优化。例如 Spark 采用内存中的 Mapreduce 技术，号称性能比 基于文件的的 Mapreduce 倍；有的则采用 C/C++ 语言替 代 Java 语言重构 Hadoop 和 Mapreuce（如 MapR 公司及国内某 知名电商的大数据平台）；而有些则直接绕开了 Mapreduce 另起 炉灶，如 Impala、hawq 采用借鉴 MPP 计算思想来做查询优化和 内存数据 Pipeline 计算，以此来提高性能。 虽然 SQL-On-Hadoop 比原始的 Mapreduce 虽然在易用上有所提 高，但在 SQL，如 SQL 2003 OLAPWINDOW 函数，几乎都不支持。以 TPC-DS 测试（用于评测决策支持系统（大数据或数据仓库）的标准 SQL 测试集 ,99 个 SQL）为例，包括 SPARK、Impala、Hive，只能支 持其中的 1/3 左右。 Big Date2.indd 15 16-11-22 下午3:38 16 由于 HADOOP 本身 Append-only 的特性，SQL-On-Hadoop

算的巨大成本， 并带来较大的应用灵活性。这种情况下适合MPP引擎支撑下的ROLAP生产模式。 MPP引擎的选型 目前开源的比较受关注的OLAP引擎很多，比如Greenplum、Apache Impala、Presto、Doris、Cl ickHouse、Druid、TiDB等等，但缺乏实践案例的介绍，所以我们也没有太多的经验可以借鉴。 于是，我们就结合自身业务的需求，从引擎建设成本出发，并立足于公司技术生态融合、集成、 们平台部门选择了2018年刚进入Apache社 区的Doris。 Doris简介及特点 Doris是基于MPP架构的OLAP引擎，主要整合了Google Mesa（数据模型）、Apache Impala（MPP Query Engine）和Apache ORCFile （存储格式，编码和压缩）的技术。 Doris的系统架构如下，主要分为FE和BE两个组件，FE主要负责查询的解析、编译、优化、调度

Management Customizing DBeaver DBeaver User Guide 21.2. Page 4 of 263. Oracle Apache Hive/Spark/Impala MongoDB Cassandra InfluxDB Redis Clickhouse Command-Line Reset UI settings Reset workspace multiple implementation of storage systems which utilize Hive on server-side - including Apache Spark, Impala, etc. Most of them support standard Hive JDBC driver which is used in DBeaver to communicate with DBeaver will download everything automatically (if you have internet access). Apache Hive/Spark/Impala Apache Hive Connection setup DBeaver User Guide 21.2. Page 219 of 263. DBeaver User Guide 21

Management Customizing DBeaver DBeaver User Guide 6.2. Page 4 of 263. Oracle Apache Hive/Spark/Impala MongoDB Cassandra InfluxDB Redis Clickhouse Command-Line Reset UI settings Reset workspace multiple implementation of storage systems which utilize Hive on server-side - including Apache Spark, Impala, etc. Most of them support standard Hive JDBC driver which is used in DBeaver to communicate with DBeaver will download everything automatically (if you have internet access). Apache Hive/Spark/Impala Apache Hive Connection setup DBeaver User Guide 6.2. Page 219 of 263. DBeaver User Guide 6.2

backup/restore Task management Task scheduler MockData generation Schema compare Apache Hive/Spark/Impala MongoDB Cassandra InfluxDB Redis AWS DynamoDB Google BigTable DBeaver extensions - Office multiple implementation of storage systems which utilize Hive on server-side - including Apache Spark, Impala, etc. Most of them support standard Hive JDBC driver which is used in DBeaver to communicate with DBeaver will download everything automatically (if you have internet access). Apache Hive/Spark/Impala Apache Hive Connection setup DBeaver User Guide 6.3. Page 227 of 274. DBeaver User Guide 6.3

backup/restore Task management Task scheduler MockData generation Schema compare Apache Hive/Spark/Impala MongoDB Cassandra InfluxDB Redis AWS DynamoDB Google BigTable DBeaver extensions - Office multiple implementation of storage systems which utilize Hive on server-side - including Apache Spark, Impala, etc. Most of them support standard Hive JDBC driver which is used in DBeaver to communicate with DBeaver will download everything automatically (if you have internet access). Apache Hive/Spark/Impala Apache Hive Connection setup DBeaver User Guide 7.0. Page 227 of 277. DBeaver User Guide 7.0

backup/restore Task management Task scheduler MockData generation Schema compare Apache Hive/Spark/Impala MongoDB Cassandra InfluxDB Redis AWS DynamoDB Google BigTable DBeaver extensions - Office multiple implementation of storage systems which utilize Hive on server-side - including Apache Spark, Impala, etc. Most of them support standard Hive JDBC driver which is used in DBeaver to communicate with DBeaver will download everything automatically (if you have internet access). Apache Hive/Spark/Impala Apache Hive Connection setup DBeaver User Guide 7.1. Page 230 of 281. DBeaver User Guide 7.1

backup/restore Task management Task scheduler MongoDB Cassandra InfluxDB Redis Apache Hive/Spark/Impala Google Bigtable Couchbase AWS DynamoDB Google BigTable DBeaver extensions - Office, Debugger multiple implementation of storage systems which utilize Hive on server-side - including Apache Spark, Impala, etc. Most of them support standard Hive JDBC driver which is used in DBeaver to communicate with DBeaver will download everything automatically (if you have internet access). Apache Hive/Spark/Impala Apache Hive Connection setup DBeaver User Guide 7.2. Page 230 of 281. DBeaver User Guide 7.2

MongoDB Cassandra InfluxDB Redis AWS DynamoDB Google Bigtable Couchbase Apache Hive/Spark/Impala Installing extensions - Themes, version control, etc Command Line Reset UI settings Reset workspace multiple implementation of storage systems which utilize Hive on server-side - including Apache Spark, Impala, etc. Most of them support standard Hive JDBC driver which is used in DBeaver to communicate with DBeaver will download everything automatically (if you have internet access). Apache Hive/Spark/Impala Apache Hive Connection setup DBeaver User Guide 7.3. Page 275 of 300. DBeaver User Guide 7.3

Cassandra InfluxDB Redis AWS DynamoDB AWS DocumentDB Google Bigtable Couchbase Apache Hive/Spark/Impala Installing extensions - Themes, version control, etc Command Line Reset UI settings Reset workspace multiple implementation of storage systems which utilize Hive on server-side - including Apache Spark, Impala, etc. Most of them support standard Hive JDBC driver which is used in DBeaver to communicate with DBeaver will download everything automatically (if you have internet access). Apache Hive/Spark/Impala Apache Hive Connection setup DBeaver User Guide 21.0. Page 293 of 334. DBeaver User Guide 21