Kubernetes Operator 实践 —— MySQL 容器化 刘林 搜狗资深工程师 关于我 搜狗商业平台研发部 资深开发工程师 l 主要从事商业平台研发工作，在构建高性能、高可用大规模 系统方面有丰富的实践经验 l 目前专注于云计算、DevOps 等相关领域，负责搜狗商业云 平台的设计研发工作 刘林 1. 背景介绍 2. Operator 的基本原理 3. MySQL MySQL Operator 设计实践 4. 小结 搜狗商业平台 技术体系广 服务多迭代快 搜狗产品矩阵 商业平台 信息流广告 搜索广告 品牌广告 代理商 广告主 技术体系 CRM 广告平台 物料展现 审核平台 大数据平台 基础架构 Golang C++ JavaScript Java Python 质量要求高 业务响应快 故障恢复快 Cluster1 有状态服务容器化 1. 背景介绍 2. Operator 的基本原理 3. MySQL Operator 设计实践 4. 小结 无状态服务 服务调度 有状态服务集群 服务调度 状态保存 集群管理 有状态服务 服务调度 状态保存 带来的新挑战 服务调度 状态存储 集群管理 成员管理 扩缩容 故障迁移 高可用 CoreOS 提出了 operator Deployment StatefulSet

TiDB Operator: Design & Implemention Presented by Yecheng Fu (@cofyc) PingCAP.com Agenda ● TiDB Operator 简介 ● 扩展 Kubernetes 的几种方式 ● TiDB Operator 实现 TiDB Operator 是什么 PingCAP.com Cloud Native Scaling - Handle network, hardware failures, etc. - Backup/Restore/Data migration - ... TiDB Operator TiDB PingCAP.com Kubernetes Pattern - Declarative Model - 用户描述自己的期望，提交给 Kubernetes API Server implemented TiDB Operator Kubernetes Pattern - Declarative Model PingCAP.com Operator Pattern - Extending Kubernetes TiDB Operator TiDB PD API Kubernetes API PingCAP.com Operator Pattern - Custom

Zstandard Compression Algorithm 271 Relaxed Rules for Specifying Table Distribution Columns 271 Resource Groups Features 271 PL/pgSQL Procedural Language Enhancements 272 Replicated Table Data 272 VMware Functions 478 Backing Up and Restoring a Database 479 Completing the Migration 480 Working With Hash Operator Classes in Greenplum 6 480 Migrating from Open Source Greenplum Database to VMware Greenplum 482 Mount Options 493 Disk I/O Settings 493 Synchronizing System Clocks 493 Configuring and Using Resource Groups 494 Enabling iptables (Optional) 494 How to Enable iptables 494 Example iptables Rules

Zstandard Compression Algorithm 257 Relaxed Rules for Specifying Table Distribution Columns 257 Resource Groups Features 258 PL/pgSQL Procedural Language Enhancements 258 Replicated Table Data 258 Concurrency Functions 459 Backing Up and Restoring a Database 460 Completing the Migration 461 Working With Hash Operator Classes in Greenplum 6 461 Migrating from Open Source Greenplum Database to VMware Greenplum 463 Declaring Distribution Keys 534 Custom Distribution Key Hash Functions 535 Example Custom Hash Operator Class 535 Choosing the Table Storage Model 537 Heap Storage 537 Append-Optimized Storage 538

Declaring Distribution Keys 330 Custom Distribution Key Hash Functions 331 Example Custom Hash Operator Class 331 Choosing the Table Storage Model 333 Heap Storage 333 Append-Optimized Storage 334 Understanding Index-Only Scans and Covering Indexes 391 BRIN Indexes 394 Index Maintenance 395 Built-in Operator Classes 396 Creating and Managing Views 397 Creating Views 397 Dropping Views 397 Best Practices Expressions 586 Column References 587 Positional Parameters 587 Subscripts 587 Field Selection 588 Operator Invocations 588 Function Calls 589 Aggregate Expressions 589 Limitations of Aggregate Expressions

Zstandard Compression Algorithm 238 Relaxed Rules for Specifying Table Distribution Columns 239 Resource Groups Features 239 PL/pgSQL Procedural Language Enhancements 239 Replicated Table Data 240 Concurrency Functions 484 Backing Up and Restoring a Database 485 Completing the Migration 485 Working With Hash Operator Classes in Greenplum 6 486 Migrating from Open Source Greenplum Database to VMware Greenplum 487 Declaring Distribution Keys 558 Custom Distribution Key Hash Functions 558 Example Custom Hash Operator Class 559 Choosing the Table Storage Model 561 Heap Storage 561 Append-Optimized Storage 561

Zstandard Compression Algorithm 231 Relaxed Rules for Specifying Table Distribution Columns 231 Resource Groups Features 232 PL/pgSQL Procedural Language Enhancements 232 Replicated Table Data 232 Concurrency Functions 467 Backing Up and Restoring a Database 468 Completing the Migration 468 Working With Hash Operator Classes in Greenplum 6 469 Enabling iptables (Optional) 470 How to Enable iptables 471 Example Declaring Distribution Keys 537 Custom Distribution Key Hash Functions 538 Example Custom Hash Operator Class 538 Choosing the Table Storage Model 540 Heap Storage 541 Append-Optimized Storage 541

Zstandard Compression Algorithm 207 Relaxed Rules for Specifying Table Distribution Columns 207 Resource Groups Features 207 PL/pgSQL Procedural Language Enhancements 208 Replicated Table Data 208 Concurrency Functions 392 Backing Up and Restoring a Database 393 Completing the Migration 394 Working With Hash Operator Classes in Greenplum 6 394 Enabling iptables (Optional) 396 How to Enable iptables 396 Example Declaring Distribution Keys 455 Custom Distribution Key Hash Functions 456 Example Custom Hash Operator Class 456 Choosing the Table Storage Model 458 Heap Storage 458 Append-Optimized Storage 458

Zstandard Compression Algorithm 228 Relaxed Rules for Specifying Table Distribution Columns 228 Resource Groups Features 229 PL/pgSQL Procedural Language Enhancements 229 Replicated Table Data 229 Concurrency Functions 464 Backing Up and Restoring a Database 465 Completing the Migration 466 Working With Hash Operator Classes in Greenplum 6 466 Enabling iptables (Optional) 468 How to Enable iptables 468 Example Declaring Distribution Keys 535 Custom Distribution Key Hash Functions 535 Example Custom Hash Operator Class 535 Choosing the Table Storage Model 537 Heap Storage 538 Append-Optimized Storage 538

Specifying Table Distribution Columns 218 VMware Greenplum v6.19 Documentation VMware, Inc. 8 Resource Groups Features 219 PL/pgSQL Procedural Language Enhancements 219 Replicated Table Data 220 Concurrency Upgrade 301 Backing Up and Restoring a Database 305 Completing the Migration 306 Working With Hash Operator Classes in Greenplum 6 307 Enabling iptables (Optional) 308 Enabling iptables (Optional) 0 How Column Oriented Storage 324 Compression 325 Distributions 325 Resource Queue Memory Management 325 Partitioning 327 Indexes 327 Resource Queues 327 Monitoring and Maintenance 328 ANALYZE 328 Vacuum