Hadoop 迁移到阿里云MaxCompute 技术方案
2.1.1 主流大数据体系架构 Hadoop 及开源生态由一系列的开源组件共同组成,很多用户基于 Hadoop 及开源生态组件构 建企业数据仓库/数据湖、机器学习、实时分析、BI 报表等大数据应用。我们常见的大数据架构 的逻辑组件关系如下图所示: 这些逻辑组件包括: 数据源:数据源包括关系型数据库、日志文件、实时消息等。 数据存储:面向海量数据存储的分布式文件存储服务,支持 机器学习:满足机器学习工作负载的服务。如当前流行的 Spark MLib/ML、Tensorflow 等。 分析型数据存储:对数据进行处理加工后,面向应用场景,将数据以结构化的方式进行存储, 以便分析工具或分析应用能够获取数据。如利用 MPP 数据仓库、Spark SQL 等支持 BI 工具 访问,利用 Hbase 实现低延迟的在线服务等 分析与报表:对数据进行分析和展现以获取洞察。如 MaxCompute 产品的交互式查询服务,特性如下: 兼容 PostgreSQL:兼容 PostgreSQL 协议的 JDBC/ODBC 接口,所有支持 PostgreSQL 数据库的工 具或应用使用默认驱动都可以轻松地连接到 MaxCompute 项目。支持主流 BI 及 SQL 客户端工具的 连接访问,如 Tableau、帆软 BI、Navicat、SQL Workbench/J0 码力 | 59 页 | 4.33 MB | 1 年前3PlantUML 1.2021.2 Guía de Referencia del Lenguaje
"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <> Guía de Referencia del Lenguaje PlantUML 0 码力 | 389 页 | 4.12 MB | 1 年前3PlantUML 1.2021.1 Guía de Referencia del Lenguaje
"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <> Guía de Referencia del Lenguaje PlantUML 0 码力 | 384 页 | 4.07 MB | 1 年前3PlantUML 1.2023.11 Guía de Referencia del Lenguaje
"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components ArrowFontName Impact ArrowColor #FF6655 ArrowFontColor #777777 } () "Data Access" as DA Component "Web Server" as WS << Apache >> DA - [First Component] [First Component] ..> () HTTP : use HTTP - WS @enduml0 码力 | 531 页 | 7.53 MB | 1 年前3PlantUML 1.2021.3 Guía de Referencia del Lenguaje
"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <> Guía de Referencia del Lenguaje PlantUML 0 码力 | 407 页 | 4.28 MB | 1 年前3PlantUML 1.2020.23 Guía de Referencia del Lenguaje
"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> Guía de Referencia del Lenguaje PlantUML (1.2020.23) 111 / 304 6.13 Personalización0 码力 | 305 页 | 3.11 MB | 1 年前3PlantUML 1.2020.22 Guía de Referencia del Lenguaje
"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> Guía de Referencia del Lenguaje PlantUML (1.2020.22) 100 / 292 6.13 Personalización0 码力 | 293 页 | 3.02 MB | 1 年前3PlantUML 1.2019.4 Guía de Referencia del Lenguaje
"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.10 Using Sprite in Stereotype You can use sprites within stereotype components PlantUML (1.2019.4) 81 / 165 6.11 Personalización (Skinparam) 6 DIAGRAMA DE COMPONENTES HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <> [BB] < > [CC] < > 0 码力 | 166 页 | 1.82 MB | 1 年前3PlantUML 1.2019.3 Guía de Referencia del Lenguaje
"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.10 Using Sprite in Stereotype You can use sprites within stereotype components PlantUML (1.2019.3) 81 / 157 6.11 Personalización (Skinparam) 6 DIAGRAMA DE COMPONENTES HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <> [BB] < > [CC] < > 0 码力 | 158 页 | 1.72 MB | 1 年前3PlantUML 1.2019.2 Guía de Referencia del Lenguaje
"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.10 Using Sprite in Stereotype You can use sprites within stereotype components PlantUML (1.2019.2) 81 / 157 6.11 Personalización (Skinparam) 6 DIAGRAMA DE COMPONENTES HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <> [BB] < > [CC] < > 0 码力 | 158 页 | 1.72 MB | 1 年前3
共 17 条
- 1
- 2