Horowitz投资，公司在2015年在 旧金山湾区成立，致力于推动开源项目和社区以及商业化 8 面向大数据和AI应用的内存级数据编排系统 数据编排层(Data Orchestration) Java File API HDFS Interface S3 Interface REST API POSIX Interface Alluxio是什么 HDFS Driver S3 Driver OSS Driver Alluxio 服务器 Alluxio 服务器 大数据查询 大数据ETL 模型训练 Alluxio核心功能一：分布式数据缓存 Alluxio 服务器 A B /path1/file1 /path2/file2 C A B C A Alluxio 服务器 Alluxio 服务器 大数据查询 大数据ETL 模型训练 Alluxio核心功能二：灵活多样的数据访问API Alluxio 当本地节点的空间少于1056MB时，数据缓存的调度器不会选择该 节点；转而选择其他节点。 alluxio.user.file.passive.cache.enabled false 当从Alluxio远程worker读文件时，是否缓存文件到Alluxio的本 地worker。 alluxio.user.file.readtype.default CACHE 默认的CACHE_PROMOTE会带来显著的性能开销

elasticsearch-cluster logstash-cluster kafka-groupid=es topic applog logstash kafka-groupid=file file-storage mkdir -p /data/all- log/${namespaces}/${pod-name} ln -sf ${namespaces}/${pod-name} to local 20% eureka k8s-node jm-prod api pod jm-canaryapi pod jm-cannry api yaml-file jm-prod api yaml-file 同步 jm-templates 初始化yaml 初始化yaml nginx.conf 运维平台 修改-nginx-reload 发布 服务注册至注册中心 流量权重分流

How do we parse them ? ? ? Kops 1.4 embed in .go file Kops 1.4 embed in .go file import “text/template” Kops 1.4 embed in .go file import “text/template” parse at runtime How do we develop

/etc/docker/daemon.json { "exec-opts": ["native.cgroupdriver=systemd"], "log-driver": "json-file", "log-opts": { "max-size": "100m" }, "storage-driver": "overlay2", "storage-opts": yaml vi openservice/values.yaml # Default values for openservice. # This is a YAML-formatted file. # Declare variables to be passed into your templates. replicaCount: 3 image: repository: values.yaml vi beehive/values.yaml # Default values for beehive. # This is a YAML-formatted file. # Declare variables to be passed into your templates. replicaCount: 3 image: repository:

Logic A SubService Business Logic A Business Logic A DB Server Business Logic A Business Logic A File Server Business Logic A Business Logic A Cache 需要多少 Services, Deployments, StatefulSets DaemonSets 应用编排架构 应用编排架构 API Gateway APP API Service A APP API Service B APP Cache APP API Service D APP File Server APP 应用编排架构 应用编排架构 基本架构 Kubernetes Cluster Application Registry Application Manager Application

operator – управление кластером как ОДНИМ РЕСУРСОМ ClickHouse Operator ClickHouseInstallation YAML file Лицензия: Apache 2.0, Распространяется как Docker image ClickHouse cluster resources kubectl Operator = deployment + monitoring + operation ClickHouse Operator ClickHouseInstallation YAML file ClickHouse cluster resources Kubernetes API zz zz Monitoring Healthchecks План работ ● Наследование

I am stateful Job I only run for once CronJob I run periodically ConfigMap I read configure file Secret I need confidential data HPA I need auto-scaling Understand Kubernetes in 2 min • kubectl I am stateful Job I only run for once CronJob I run periodically ConfigMap I read configure file Secret I need confidential data HPA I need auto-scaling My Awesome Object I have my own special

Services (w/API) • Node = Container Host w/agent called “Kubelet” • Application Deployment File = Configuration File of desired state • Container Image = Runs in a Pod (~1:1) • Replicas = QTY of Pods that

b. File System Hardening c. Boot Security d. Process Security e. Minimization of Attack Surface f. Network Security g. Auditing h. Authentication and Authorization i. Compliance j. File System

Exporter AZ 2 (Local File) Alert Manager gossip Kubernetes 互相监控 AZ 1 Kube-State-Metrics Kubernetes APIServer cAdvisor Node-Exporter KUN-Agent Alert Manager Prometheus (Local File) Monitor Manager