# Kubernetes VM Solutions for Multi-Tenant Applications Guangxu Li, Senior Software Engineer, ZTE li.guangxu@zte.com.cn ## Container and VM Ecosystem ## Container VM Kubernetes Docker Swarm Marathon

Usihagr Rorgiistem yCnltusupnge • Usihagr ChartmiicenuaGmtusupnge ## Using Harbor Registry in Tenant Clusters F ol l th w s t ed p s r e a n t ed w e n c a l n u t w i t h c t e t s h e a r b o g i s t Sd4p dockdorgianuadmi-np**** https://:443 ## Using Harbor Chartmuseum in Tenant Clusters You acnonf igcalut stpndipdu hk l h afrrtasmdoHar b h art mountecunnant. Step 1 Add hhee lr usern a m -p a s s w o p r a d s w o < r e p r a m e > https://< LOAD_BALANCER_IP_OF_HARBOR_TENANT> / chartrepo/ < library_n Note • F o c a - f i d e rt - f a n a d e y - f , u s t e ho e u

## Scaling a Multi-Tenant k8s Cluster in a Telco Pablo Moncada eBPF Summit October 28, 2020 ## About MasMovil group • 4th telecom company in Spain - Provides voice and broadband services to +12M customers

Services running at Edge nodes needs little orchestration - Edge nodes count per tenant is so small so needs multi-tenant management/data plane to save cost ## • Edge/Cloud Cluster Management - There tunnel" ## • Multitenant service publishing • Global namespace URL definition http(s)://{hostname}/{Tenant Name}/{Edge Node Name}/{Http WebService Name}/... ## • Host Name • Edge Node Http client access:

Services running at Edge nodes needs little orchestration - Edge nodes count per tenant is so small so needs multi-tenant management/data plane to save cost ## • Edge/Cloud Cluster Management - There tunnel" ## • Multitenant service publishing • Global namespace URL definition http(s)://{hostname}/{Tenant Name}/{Edge Node Name}/{Http WebService Name}/... ## • Host Name • Edge Node Http client access:

* * *|\* * * * *|\* * * * *| |Network Policy and Management|\* * * * *|\* * * * *|\* * *| |Multi-tenant Management|\* * * * *|\* * *|\* * *| |Authentication and Authorization|\* * * * *|\* * * * *|\* * 9ObservabilityMonitoringBuilt-in metrics for multi-tenant and multi-dimensional monitoring; built-in custom monitoring dashboardsSimple metrics displayed Prometheus required for displaying complex metricsLoggingBuilt-in multi-tenant and multi-dimensional log retrieval system that supports on-disk log collection and provides flexibility

253 5.3.7 Migrate Data from SQL Files to TiDB 258 5.3.8 Replicate Incremental Data between TiDB Clusters in Real Time 261 5.4 Advanced Migration 263 5.4.1 Continuous Replication from Databases that Use Guide · 1278 11.7.11 TiDB Binlog Relay Log · 1281 11.7.12 Bidirectional Replication between TiDB Clusters · 1283 11.7.13 TiDB Binlog Glossary · 1288 11.7.14 Troubleshoot · 1288 11.7.15 TiDB Binlog FAQ Data Check in the Sharding Scenario ··· 1865 11.12.4 Data Check for TiDB Upstream and Downstream Clusters ··· 1869 11.12.5 Data Check in the DM Replication Scenario ··· 1871 11.13 TiSpark ··· 1872 11

184 3.11 Community 192 3.12 Appendixes 199 Apache Kyuubi $ ^{™} $ is a distributed and multi-tenant gateway to provide serverless SQL on Data Warehouses and Lakehouses. Kyuubi builds distributed SQL administrators have a single point for configuration, security, and control of remote access to clusters. And end users have an improved experience with seamless data processing with any the Kyuubi engine necessary for Kyuubi in a real-world production environment to ensure high availability because of multi-tenant access. – It effectively prevents single point of failures. – It helps achieve zero downtime for

189 3.11 Community 197 3.12 Appendixes 204 Apache Kyuubi $ ^{™} $ is a distributed and multi-tenant gateway to provide serverless SQL on Data Warehouses and Lakehouses. Kyuubi builds distributed SQL administrators have a single point for configuration, security, and control of remote access to clusters. And end users have an improved experience with seamless data processing with any the Kyuubi engine necessary for Kyuubi in a real-world production environment to ensure high availability because of multi-tenant access. – It effectively prevents single point of failures. – It helps achieve zero downtime for

Contributing Documentations 208 3.13 Appendixes 213 Apache Kyuubi $ ^{™} $ is a distributed and multi-tenant gateway to provide serverless SQL on Data Warehouses and Lakehouses. Kyuubi builds distributed SQL administrators have a single point for configuration, security, and control of remote access to clusters. And end users have an improved experience with seamless data processing with any the Kyuubi engine necessary for Kyuubi in a real-world production environment to ensure high availability because of multi-tenant access. – It effectively prevents single point of failures. – It helps achieve zero downtime for