A Day in the Life of a Data Scientist Conquer Machine Learning Lifecycle on Kubernetes Brian Redmond • Cloud Architect @ Microsoft (18 years) • Azure Global Black Belt Team • Live in Pittsburgh, PA Repeatable/consistent • CI/CD • This has worked well for App Dev. Now time for AI/ML • But, must ensure data scientist are not hindered by structure Why Containers, Kubernetes & Helm? • Container • Contains Scalable • Easy to explore hyper-parameters space • Easy to do distributed training But really, Data Scientists shouldn’t have to care about containers, kubernetes and all that stuff • Pachyderm can

com/developer/article/1627330 Step1: 安装 docker-ce # 安装需要的支撑软件 yum install -y yum-utils device-mapper-persistent-data lvm2 # 添加 yum 源 yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce Step3: 安装 k8s master kubeadm init --config kubeadm.yaml Step4: 配置环境变量 vi /root/.bashrc export KUBECONFIG=/etc/kubernetes/admin.conf source /root/.bashrc Step5: 安装网络插件 calico wget configmap vi 3-configmap.yaml kind: ConfigMap apiVersion: v1 metadata: name: traefik-config data: traefik.yaml: |- serversTransport: insecureSkipVerify: true api:

+ Make a CI host + wget and install kops and kubectl + Configure AWS cli + Create S3 Bucket + Export KOPS variables + Setup Route53 KOPS: Create cluster KOPS: Edit ig nodes KOPS: Edit ig nodes code ● Highly scalable ● Less hardware consuming Connections LOCUST: Fast Forward 3 Cluster 3 Data Centers Cluster 1U Firewall RDS CPU nscd ELB RDS IOPS Pods HPA Evaluation & conclusions

docker # docker info ★配置docker服务使用systemd去管理（以及信任本地镜像仓库） # vi /etc/docker/daemon.json { "data-root": "/docker_data", "registry-mirrors": [ "h�ps://cof-lee.com:5443" ], "insecure-registries": [ "cof-lee /etc/docker/daemon.json <data-root": "/docker_data", "registry-mirrors": [ "h�ps://cof-lee.com:5443" ], "insecure-registries": [ "cof-lee 5.9-0 registry.k8s.io/coredns/coredns:v1.10.1 #可以先下载以上7个镜像，传到每台k8s服务器上，再ctr -n k8s.io images import导入；或者使用内部registry仓库（内部registry镜像仓库里要有以上7个镜 像） ★直接使用命令行方式初始化集群 （以下是非HA模式的master初始化，如果要部署高可用集群，则参考第4章）

监控 日志 链路 限流熔断 https://ego.gocn.vip/f rame/core/logger.html 报警 微服务的治理阶段 监控 日志 链路 限流熔断 export EGO_LOG_EXTRA_KEYS =X-Ego-Uid,X-Ego- OrderID https://ego.gocn.vip/ micro/chapter2/trace.ht ml

Kubernetes Operations Statically linked CLI tool written in Go Kubernetes Kops Kubernetes Operations import “k8s.io/kubernetes” Kubernetes Kops Kubernetes Operations Cluster Model Kubernetes Apply Kops them ? ? ? Kops 1.4 embed in .go file Kops 1.4 embed in .go file import “text/template” Kops 1.4 embed in .go file import “text/template” parse at runtime How do we develop ? ? ? No Yes

重新mount部署proc⽬录mock机器信息 • 守护进程失败会导致当前运⾏的容器⽆法获取 正确proc信息，需要重新注⼊ 解决⽅案⼆：修改GOMAXPROCS • Golang专⽤解决⽅案 • import _ "go.uber.org/automaxprocs" 2C1G的容器在96核宿主机测试结果 问题⼆：K8S宿主机负载不均衡 K8S调度问题：NP-Hard BinPacking Problem

int main() { compile_c(argv[1]); } gcc Self hosting go // golang source code package main import "os" func main() { compile_go(os.Args[1:]) } go Self hosting Self hosting $ uname -s minix

locations with the use of groundbreaking technologies, to enable decision-making at the point of data collection. Fast, insight-driven decision-making in highly dynamic and dangerous conditions is Allen’s innova- tive edge computing solution, SmartEdge, addresses the increasing need to gather data in real time and perform analysis at the point of collection, supplying imme- diate insight which battlefields. The an- alytics enabled and performed by Smart- Edge allow battalions to make real-time, data-driven decisions which dramatically improve operational outcomes and in- crease the probability of

intensive cryptanalytic attacks ● A cryptoperiod is the time during which a key is used to encrypt data Key rotation: cryptoperiod There are lots of factors that influence the choice of cryptoperiod Strength of cryptographic algorithms used ○ Implementation ○ Operating environment ○ Volume of data ○ Re-keying method ○ Number of key copies ○ Personnel turnover ○ Threat model ○ New and disruptive cardholder data against disclosure and misuse. 3.6 Fully document and implement all key-management processes and procedures for cryptographic keys used for encryption of cardholder data, including