Hadoop 迁移到阿里云MaxCompute 技术方案分析型数据存储:对数据进行处理加工后,面向应用场景,将数据以结构化的方式进行存储, 以便分析工具或分析应用能够获取数据。如利用 MPP 数据仓库、Spark SQL 等支持 BI 工具 访问,利用 Hbase 实现低延迟的在线服务等 分析与报表:对数据进行分析和展现以获取洞察。如 BI 工具、jupyter 等。 数据作业编排:将多个数据处理动作(数据移动、处理转换等)编排成为工作流并周期性地 EMR(开源流计算组件) 分析型数据存储 数据仓库: GreenPlum/Impala/Presto/Hive NoSQL:Hbase 数据仓库:MaxCompute/ Hologres/分析 型数据库 NoSQL:云数据库 Hbase 版/表格存储 分析与报表 BI 工具 Notebook QuickBI PAI Notebook 组件 EMR Notebook Alibaba Cloud MaxCompute 解决方案 25 网络环境(私有网络、经典网络、VPC 专) 有无专线 常用组件(Hive、Spark、Storm、HBase、Flink、Kafa、Impala、Sqoop、Kylin、Flume) 机器配置(CPU 核数、内存大小) 数据量及存储类型 作业量及作业类型(SQL 脚本上传)0 码力 | 59 页 | 4.33 MB | 1 年前3
Comprehensive Rust(Español) 2024127 Cambio de API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211 34.1.8 Updating Client and Service . . . . . . . . . . . . . . . . . . . . . . . 211 34.2 Working With AIDL Types . . 347 XIV Concurrencia: tarde 353 63 Te damos la bienvenida 354 64 Conceptos básicos de Async 355 64.1 async/await . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 355 64.2 Future . . . . . . . . . . . . . . . . . . . . . . 368 67 Ejercicios 371 67.1 La Cena de Filósofos --- Async . . . . . . . . . . . . . . . . . . . . . . . . . . 371 67.2 Aplicación de chat de difusión . .0 码力 | 389 页 | 1.04 MB | 10 月前3
Curve核心组件之mds – 网易数帆03 MDS各组件详细介绍 Q&A基本架构 • 元数据节点 MDS 管理元数据信息 收集集群状态信息,自动调度 • 数据节点 Chunkserver 数据存储 副本一致性 • 客户端 Client 对元数据增删改查 对数据增删改查 • 快照克隆服务器MDS各个组件 MDS是中心节点,负责元数据管理、集群状态收集与调度。MDS包含以下几个部分: • Topology: 管理集群的 topo copyset-4: (cs6, cs9, cs12)COPYSET client MDS leader Chunk server 1、发起请求 2、查询元数据 5、返回结果 5、返回结果 user 3、查询leader节点 4、向leader cs发起请求 1. 用户发起请求(fd, offset, length) ; 2. Client 向 mds 查询请求的元数据, 并缓存到本地,请求转换为对 (CopysetId ,chunkId, offset in chunk, length in chunk); 3. Client 向 chunkserver 查询 chunk 所在的 copyset的leader Chunkserver节点; 4. Client 向 leader 发送读写请求client (IP, port, CopysetId, chunkId, offset in chunk, length0 码力 | 23 页 | 1.74 MB | 6 月前3
PlantUML 1.2020.23 Guía de Referencia del Lenguajethis example. @startuml concise "Client" as Client concise "Server" as Server concise "Response freshness" as Cache Server is idle Client is idle @Client 0 is send Client -> Server@+25 : GET +25 is await await +75 is recv +25 is idle +25 is send Client -> Server@+25 : GET\nIf-Modified-Since: 150 +25 is await +50 is recv +25 is idle @100 <-> @275 : no need to re-request from server @Server 25 is recv +25 +25 is work +25 is send Server -> Client@+25 : 200 OK\nExpires: 275 +25 is idle +75 is recv +25 is send Server -> Client@+25 : 304 Not Modified +25 is idle @Cache 75 is fresh +200 is stale @enduml Guía0 码力 | 305 页 | 3.11 MB | 1 年前3
PlantUML 1.2020.22 Guía de Referencia del Lenguajethis example. @startuml concise "Client" as Client concise "Server" as Server concise "Response freshness" as Cache Server is idle Client is idle @Client 0 is send Client -> Server@+25 : GET +25 is await await +75 is recv +25 is idle +25 is send Client -> Server@+25 : GET\nIf-Modified-Since: 150 +25 is await +50 is recv +25 is idle @100 <-> @275 : no need to re-request from server @Server 25 is recv +25 +25 is work +25 is send Server -> Client@+25 : 200 OK\nExpires: 275 +25 is idle +75 is recv +25 is send Server -> Client@+25 : 304 Not Modified +25 is idle @Cache 75 is fresh +200 is stale @enduml Guía0 码力 | 293 页 | 3.02 MB | 1 年前3
Guía de referencia de Debian v2.124199 config::ifupdownherramienta estándar para subir o bajar la red (específico de Debian) isc-dhcp-client V:217, I:981 2875 config::low- level cliente DHCP pppoeconf V:0, I:5 186 config::helper ayudante contraseñas para el equipo inteligente editando «/etc/exim4/passwd.client». $ sudo vim /etc/exim4/passwd.client ... $ cat /etc/exim4/passwd.client ^smtp.*\.hostname\.dom:username@hostname.dom:password Configura exim4 como se muestra. $ sudo systemctl start exim4 El nombre del equipo en «/etc/exim4/passwd.client» no debería ser un alias. Compruebe el nombre real del equipo como sigue. $ host smtp.hostname.dom0 码力 | 285 页 | 1.43 MB | 1 年前3
PlantUML 1.2021.2 Guía de Referencia del Lenguaje@enduml 10.16 Complete example Thanks to Adam Rosien for this example. @startuml concise "Client" as Client concise "Server" as Server Guía de Referencia del Lenguaje PlantUML (1.2021.2) 182 / 388 10 "Response freshness" as Cache Server is idle Client is idle @Client 0 is send Client -> Server@+25 : GET +25 is await +75 is recv +25 is idle +25 is send Client -> Server@+25 : GET\nIf-Modified-Since: 150 server @Server 25 is recv +25 is work +25 is send Server -> Client@+25 : 200 OK\nExpires: 275 +25 is idle +75 is recv +25 is send Server -> Client@+25 : 304 Not Modified +25 is idle @Cache 75 is fresh +2000 码力 | 389 页 | 4.12 MB | 1 年前3
PlantUML 1.2021.1 Guía de Referencia del Lenguaje@enduml 10.16 Complete example Thanks to Adam Rosien for this example. @startuml concise "Client" as Client concise "Server" as Server Guía de Referencia del Lenguaje PlantUML (1.2021.1) 180 / 383 10 "Response freshness" as Cache Server is idle Client is idle @Client 0 is send Client -> Server@+25 : GET +25 is await +75 is recv +25 is idle +25 is send Client -> Server@+25 : GET\nIf-Modified-Since: 150 server @Server 25 is recv +25 is work +25 is send Server -> Client@+25 : 200 OK\nExpires: 275 +25 is idle +75 is recv +25 is send Server -> Client@+25 : 304 Not Modified +25 is idle @Cache 75 is fresh +2000 码力 | 384 页 | 4.07 MB | 1 年前3
PlantUML 1.2021.3 Guía de Referencia del Lenguaje@enduml 10.16 Complete example Thanks to Adam Rosien for this example. @startuml concise "Client" as Client concise "Server" as Server Guía de Referencia del Lenguaje PlantUML (1.2021.2) 193 / 406 10 "Response freshness" as Cache Server is idle Client is idle @Client 0 is send Client -> Server@+25 : GET +25 is await +75 is recv +25 is idle +25 is send Client -> Server@+25 : GET\nIf-Modified-Since: 150 server @Server 25 is recv +25 is work +25 is send Server -> Client@+25 : 200 OK\nExpires: 275 +25 is idle +75 is recv +25 is send Server -> Client@+25 : 304 Not Modified +25 is idle @Cache 75 is fresh +2000 码力 | 407 页 | 4.28 MB | 1 年前3
PlantUML 1.2023.11 Guía de Referencia del Lenguajethis example. @startuml concise "Client" as Client concise "Server" as Server concise "Response freshness" as Cache Server is idle Client is idle @Client 0 is send Client -> Server@+25 : GET +25 is await await +75 is recv +25 is idle +25 is send Client -> Server@+25 : GET\nIf-Modified-Since: 150 +25 is await +50 is recv +25 is idle @100 <-> @275 : no need to re-request from server @Server 25 is recv +25 +25 is work +25 is send Server -> Client@+25 : 200 OK\nExpires: 275 +25 is idle +75 is recv +25 is send Server -> Client@+25 : 304 Not Modified +25 is idle @Cache 75 is fresh +200 is stale @enduml Guía0 码力 | 531 页 | 7.53 MB | 1 年前3
共 11 条
- 1
- 2













