Sync Clickhouse with MySQL/MongoDB Company: Xiaoxin Tech. Industry: Education Team: Big Data Leader: wangchao@xiaoheiban.cn About 100 billion data this year till now 30 million users We use config file needed for a new Clickhouse table ● Init and keep syncing data in one app for a table ● Sync multiple data source to Clickhouse in minutes PTS Provider Transform Sinker ● Major Provider Must config file needed for a new Clickhouse table ● Init and keep syncing data in one app for a table ● Sync multiple data source to Clickhouse in minutes BONUS Time travel history state Create Update Update

A full suite of standard async algorithms based on real-world requirements: E.g., then, when_all, sync_wait, repeat, stop_when, timeout, etc. (not all proposed yet) • A standard set of abstractions (aka handler (aka, receiver) • A small, initial set of generic async algorithms: • E.g., then, when_all, sync_wait, let_* • Utilities for integration with C++20 coroutines5 Example 1: Launching concurrent ex::then(ex::schedule(sched), [] { return compute_intensive(2); }) ); auto [a, b, c] = std::this_thread::sync_wait( std::move(work) ).value(); } Launch three tasks to execute concurrently on a custom execution

Slowest Query © 2018 Percona. 32 Any Killed Queries ? © 2018 Percona. 33 When Did we have failures © 2018 Percona. 34 Long Transactions © 2018 Percona. 35 Queries from bad Transaction ©

erators.html 生产实践 – Async lock Req0 Req1 Req2 Memory cache https://docs.rs/tokio/1.28.2/tokio/sync/ struct.Mutex.html#which-kind-of-mutex-should-you-use 生产实践 – Async lock runtime.spawn(task0) runtime

接口与组合 接口：一切皆组合 Part6 – 语法核心：并发编程 践行哲学，遵循惯例，认清本质，理解原理 • 并发设计 vs. 并行设计 • 并发原语的原理与应用模式 • 低级同步原语 (sync 和 atomic) 并发：优先考虑并发设计 Part7 – 错误处理 践行哲学，遵循惯例，认清本质，理解原理 • 错误处理的几种策略 • 优化 if err != nil • Panic

side, it looks like just the traditional Internet app ➔ But everyone have the chance to download/sync all open data from this platform ➔ On the server side, it is a network, consisting of some/many

Channel 通信，降低锁使用范围。 Tokio - Graceful Stop • futures::future::Abortable 可用于短路一个 stream • tokio_util::sync::CancellationToken 可用于向一个或多个任务发出取 消信号， Task 内使用 tokio::select! 宏执行相关取消操作。 • tokio::signal::ctrl_c

Task IO Task IO Task Executor 高 中 低 线程池 Reactor epoll fd1 fd2 …. 结构化并发 优先级 deadline Async Sync Async IO Async Timer Parallel Calc 事件 到达 注 册 事 件 任务优先级调度 Task priority and quality of service

service mesh ● Reviews-v1 ○ doesn’t call the ratings service. ● Reviews-v2 ○ calls ratings, black stars ● Reviews-v3 ○ calls ratings, red stars Initializing services 1) Deploy bookinfo services with