Flink如何实时分析Iceberg数据湖的CDC数据 阿里巴巴 李/松/胡争 23选择 Flink Ic+b+1g #2 常DCCDC 分析方案 #1 如3实时写 4F取 ## 未来规划 #4 #见的CDC分析方案 #1 离线 HBase 集u分析 CDC 数a 、CDC记录实时写入HBase。高吞P + 低延迟。 2、小vSg询延迟低。 3、集u可拓展 ci评C 优点 1、增量和全量表割p，时效性不足。 2、r计和l护额外hChang+ S+4表。 3、计算引擎并非原g支UCDC。 4、不支U实时U13+24。 缺点 为何选择 #+ink Iceberg ? #2 Flink 原生支持 C C 数据消费 ebezium 1lHLI W生支持 ./. 数据消费 -- BPDaRDs a mysOl BCB RaAlD sMSPBD .R0 T频更新 高频更新 pache Iceberg feCDCBA方案nd考b的mo？ 保g Iceberg c数R和 源c数R最终一a性 正确性 支持并DBA 吞吐量i够大 pTBA PartitionOBucket级C 并DMerge-On-Rea- Mkh取 支持I量P取便于进一 步数RTransform I量h Apache Iceberg asic Data Metadata

components above to build a modern data stack. For example, you can use Kyuubi, Spark and Iceberg [https://iceberg.apache.org/] to build and manage Data Lakehouse with pure SQL for both data processing, cluster. Lakehouse formation and analytics Easily build an ACID table storage layer via Hudi, Iceberg, or/and Delta Lake. Logical data warehouse Provide a relational abstraction on top of disparate Zookeeper to enable the load balancing for high availability. The data could be stored in Hive, Apache Iceberg, or other DBMSs. In what follows, we will only use Kyuubi and Spark. Installation Install Kyuubi

components above to build a modern data stack. For example, you can use Kyuubi, Spark and Iceberg [https://iceberg.apache.org/] to build and manage Data Lakehouse with pure SQL for both data processing, cluster. Lakehouse formation and analytics Easily build an ACID table storage layer via Hudi, Iceberg, or/and Delta Lake. Logical data warehouse Provide a relational abstraction on top of disparate Zookeeper to enable the load balancing for high availability. The data could be stored in Hive, Apache Iceberg, or other DBMSs. In what follows, we will only use Kyuubi and Spark. Installation Install Kyuubi

components above to build a modern data stack. For example, you can use Kyuubi, Spark and Iceberg [https://iceberg.apache.org/] to build and manage Data Lakehouse with pure SQL for both data processing, cluster. Lakehouse formation and analytics Easily build an ACID table storage layer via Hudi, Iceberg, or/and Delta Lake. Logical data warehouse Provide a relational abstraction on top of disparate Zookeeper to enable the load balancing for high availability. The data could be stored in Hive, Apache Iceberg, or other DBMSs. In what follows, we will only use Kyuubi and Spark. Installation Install Kyuubi

components above to build a modern data stack. For example, you can use Kyuubi, Spark and Iceberg [https://iceberg.apache.org/] to build and manage Data Lakehouse with pure SQL for both data processing, cluster. Lakehouse formation and analytics Easily build an ACID table storage layer via Hudi, Iceberg, or/and Delta Lake. Logical data warehouse Provide a relational abstraction on top of disparate Zookeeper to enable the load balancing for high availability. The data could be stored in Hive, Apache Iceberg, or other DBMSs. In what follows, we will only use Kyuubi and Spark. Installation Install Kyuubi

components above to build a modern data stack. For example, you can use Kyuubi, Spark and Iceberg [https://iceberg.apache.org/] to build and manage Data Lakehouse with pure SQL for both data processing, cluster. Lakehouse formation and analytics Easily build an ACID table storage layer via Hudi, Iceberg, or/and Delta Lake. Logical data warehouse Provide a relational abstraction on top of disparate Zookeeper to enable the load balancing for high availability. The data could be stored in Hive, Apache Iceberg, or other DBMSs. In what follows, we will only use Kyuubi and Spark. Installation Install Kyuubi

components above to build a modern data stack. For example, you can use Kyuubi, Spark and Iceberg [https://iceberg.apache.org/] to build and manage Data Lakehouse with pure SQL for both data processing, cluster. Lakehouse formation and analytics Easily build an ACID table storage layer via Hudi, Iceberg, or/and Delta Lake. Logical data warehouse Provide a relational abstraction on top of disparate Zookeeper to enable the load balancing for high availability. The data could be stored in Hive, Apache Iceberg, or other DBMSs. In what follows, we will only use Kyuubi and Spark. Installation Install Kyuubi

components above to build a modern data stack. For example, you can use Kyuubi, Spark and Iceberg [https://iceberg.apache.org/] to build and manage Data Lakehouse with pure SQL for both data processing, cluster. Lakehouse formation and analytics Easily build an ACID table storage layer via Hudi, Iceberg, Delta Lake or/and Paimon. Logical data warehouse Provide a relational abstraction on top of disparate Zookeeper to enable the load balancing for high availability. The data could be stored in Hive, Apache Iceberg, or other DBMSs. In what follows, we will only use Kyuubi and Spark. Installation Note This following

components above to build a modern data stack. For example, you can use Kyuubi, Spark and Iceberg [https://iceberg.apache.org/] to build and manage Data Lakehouse with pure SQL for both data processing, cluster. Lakehouse formation and analytics Easily build an ACID table storage layer via Hudi, Iceberg, or/and Delta Lake. Logical data warehouse Provide a relational abstraction on top of disparate Zookeeper to enable the load balancing for high availability. The data could be stored in Hive, Apache Iceberg, or other DBMSs. In what follows, we will only use Kyuubi and Spark. Installation Install Kyuubi

components above to build a modern data stack. For example, you can use Kyuubi, Spark and Iceberg [https://iceberg.apache.org/] to build and manage Data Lakehouse with pure SQL for both data processing, cluster. Lakehouse formation and analytics Easily build an ACID table storage layer via Hudi, Iceberg, or/and Delta Lake. Logical data warehouse Provide a relational abstraction on top of disparate Zookeeper to enable the load balancing for high availability. The data could be stored in Hive, Apache Iceberg, or other DBMSs. In what follows, we will only use Kyuubi and Spark. Installation Install Kyuubi