improvements as usual • ARTEMIS-4136 Mirror sync replication Mirror now has an option to set sync=true. Blocking operations from clients will wait a round trip on the mirror. • ARTEMIS-4065 Paging Counter 18. 0 Full release notes. Highlights: - Dual Mirror support improving capabilities on AMQP Mirror for Disaster Recovery • Journal Retention • Replication integrated with Zookeeper • Connection Routers queues • AMQP Server Connectivity "Basic" SecurityManager implementation that supports replication • Consumer window size support for individual STOMP clients • Improved JDBC connection management

## Sync Clickhouse with MySQL/MongoDB Company: Xiaoxin Tech. ## About Industry: Education Team: Big Data Leader: wangchao@xiaoheiban.cn ## 100 billion data this year till now ![Image](/uploads/ config file needed for a new Clickhouse table ☐ Init and keep syncing data in one app for a table ☐ Sync multiple data source to Clickhouse in minutes ## PTS ## Provider Transform Sinker Major Provider Mutation ## ☀️ ☀️ ☁️ MergedColumnOnlyOutputStream out( data, in_header, new_part_tmp_path, /* sync = */ false, compression_codec, /* skip_offsets = */ false, unused_written_offsets, source_part→index_granularity

## Sync Clickhouse with MySQL/MongoDB Company: Xiaoxin Tech. ## About Industry: Education Team: Big Data Leader: wangchao@xiaoheiban.cn ## 100 billion data this year till now ![Image](/uploads/d config file needed for a new Clickhouse table - Init and keep syncing data in one app for a table • Sync multiple data source to Clickhouse in minutes ## PTS ## Provider Transform Sinker • Major Provider Mutation ## ☀️ ☀️ ☀️ MergedColumnOnlyOutputStream out( data, in_header, new_part_tmp_path, /* sync = */ false, compression_codec, /* skip_offsets = */ false, unused_written_offsets, source_part→index_granularity

20 MoveTables ..... 20 Identifying Candidate Tables ..... 20 Query Rewriting ..... 20 Replication Graph ..... 25 Shard ..... 25 Shard Naming ..... 25 Resharding ..... 26 Tablet ..... 26 project ..... 90 Scalability Philosophy ..... 90 Small instances ..... 90 Durability through replication ..... 91 Consistency model ..... 91 Multi-cell ..... 92 Supported Databases ..... 92 MySQL 3. Push-based metrics system ..... 102 Monitoring with Kubernetes ..... 102 Replication ..... 102 Semi-Sync ..... 102 Database Schema Considerations ..... 103 Point In Time Recovery

## Group Replication原理解析与实践经验 徐春阳 ## QCon 全球软件开发大会 10⽉17-19⽇上海·宝华万豪酒店  扫码锁定席位 ## 九 折即将结束 团购还享更多优惠，折扣有效期至9月17日 扫描右方二维码即可查看大会信息及购票 报名时间：9月1日-9月15日 扫描添加E小欧， 邀您进入EGO会员预报名群 立即报名 TECHNOLOGY EGO ## TABLE OF CONTENTS ## MGR原理 MGR vs SEMI-SYNC MRG实践经验 ## MGR的主要特点: - 支持多节点并发执行事务。如何保证从各个节点并发执行的事务在每个节点以相同的顺序被应用/执行.------paxos协议的功能。 - 自动地事务 用户线程执行事务（sql）流程  group_replication_trans_before_commit 被唤醒后 将有关事务的日志写入到本地通道。后面的所有任务，例如，将这个事务日志利用paxos协议进行全局一致性广播，验证是否跟其他事务冲突等全部

Realm • Great Threading Support • Faster • But Fat ## Threading CoreData Notification Realm Sync When Commit use Batch update ## Network ## Cache Solution NSURLConnection NSURLCache ETag HTTP

20 MoveTables ..... 20 Identifying Candidate Tables ..... 20 Query Rewriting ..... 21 Replication Graph ..... 25 Shard ..... 25 Shard Naming ..... 25 Resharding ..... 26 Tablet ..... 26 a CNCF project .54 Scalability Philosophy .54 Small instances ..... 54 Durability through replication ..... 54 Consistency model ..... 54 Multi-cell ..... 55 Supported Databases ..... 56 MySQL Advanced usage ..... 61 Undocumented features ..... 61 Known limitations ..... 61 Replication ..... 61 Semi-Sync ..... 61 Database Schema Considerations ..... 62 Point In Time Recovery ..... 62

Partitioner Types 12 About the Random Partitioner 12 About Ordered Partitioners 13 About Replication in Cassandra 13 About Replica Placement Strategy 14 SimpleStrategy 14 NetworkTopologyStrategy Partitioner Settings 25 Snitch Settings 26 Configuring the PropertyFileSnitch 26 Choosing Keyspace Replication Options 27 Installing and Initializing a Cassandra Cluster 27 Installing Cassandra Using the endpoint_snitch 71 Performance Tuning Properties 72 column_index_size_in_kb 72 commitlog_sync 72 commitlog_sync_period_in_ms 72 commitlog_total_space_in_mb 72 compaction_preheat_key_cache 72 co

Authentication ..... 639 20.4. Resource Consumption ..... 646 20.5. Write Ahead Log ..... 655 20.6. Replication ..... 666 20.7. Query Planning ..... 673 20.8. Error Reporting and Logging ..... 680 20.9 and Point-in-Time Recovery (PITR) ..... 802 27. High Availability, Load Balancing, and Replication ..... 813 27.1. Comparison of Different Solutions ..... 813 27.2. Log-Shipping Standby 901 30.5. WAL Configuration ..... 902 30.6. WAL Internals ..... 905 31. Logical Replication ..... 907 31.1. Publication ..... 907 31.2. Subscription ..... 908 31.3. Row Filters

364 14.4.6. Increase checkpoint_segments .....364 14.4.7. Disable WAL archival and streaming replication .....364 14.4.8. Run ANALYZE Afterwards .....364 14.4.9. Some Notes About pg_dump .....365 Settings .....432 18.5.2. Checkpoints.....435 18.5.3. Archiving .....436 18.5.4. Streaming Replication.....437 18.5.5. Standby Servers .....438 18.6. Query Planning .....438 18.6.1. Planner Method 24.4.2. Other data migration methods.....533 25. High Availability, Load Balancing, and Replication.....534 25.1. Comparison of different solutions.....534 25.2. Log-Shipping Standby Servers