...................................................................... 1 Chapter 2. Pulling A Container................................................................................................ static graph, improving ease of use and provides a sophisticated debugging experience. In the container, see /workspace/README.md for information about customizing your PyTorch image. For more information issues, and how to run this container. PyTorch RN-08516-001_v23.07 | 2 Chapter 2. Pulling A Container About this task Before you can pull a container from the NGC container registry: ‣ Install Docker

“Hello TensorFlow” “Hello TensorFlow” Output: 2018-12-19 02:00:58.943154: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled Notebook ��� TensorFlow “Hello TensorFlow” Try it ������ TensorFlow VM vs Docker Container Virtual Machine Docker Container � Docker ��� TensorFlow https://hub.docker.com/editions/community/docker-ce-desktop-mac Docker image $ docker pull tensorflow/tensorflow:nightly-jupyter 4. Start a TensorFlow Docker container $ docker run -it -p 8888:8888 -v $(notebook-examples-path):/tf/notebooks tensorflow/tensorflow:nightly-jupyter

多个环节 • 多种模型 ✗ 海量参数 ✗ 海量数据 从FM到DeepFM rt 增 加了10倍怎么优化？ 2.模型效果优 化困难 1.方案复杂 Data Model Compute Platform 要求:  准确: 低噪声  全面: 同分布 模型选型:  容量大  计算量小 训练推理:  高qps, 低rt  支持超大模型  性价比 流程长、环节多:  推荐场景: 测、语音识别 • 数据集管理 • 主动学习 • 智能标注 itags AI SaaS服务（OCR、语音识别、推荐系统、金融风控、疾病预测等） Infrastructure PAI平台（Platform of Artificial Intelligence） • 一键部署、弹性扩缩 • 多框架、多语言 • 推理优化Blade • 多维度监控+报警 • 自定义镜像 • 全托管+半托管 在线服务(EAS) 生态市场 开发者工具 • CLI • PAIFlow • OpenAPI AI能力 体验中心 开源 PAI平台（Platform of Artificial Intelligence） Deep Learning Container 数据量大而全 先进的模型结构 业务场景复杂 计算力强、性价比高 提供 支撑 支撑 支撑 促进 促进 开源生态 系统 硬件

What is Bloomberg? The Bloomberg Terminal delivers a diverse array of information on a single platform to facilitate financial decision- making. 4 © 2018 Bloomberg Finance L.P. All rights reserved https://commons.wikimedia.org/wiki/File:Nvidia_logo.svg and https://commons.wikimedia.org/wiki/File:Docker_(container_engine)_l ogo.png May be re-distributed in accordance with the terms of the CC-SA 4.0 license h

集群GPU资源概况 作业分配到的GPU数量 TensorFlow on Yarn设计 TensorFlow作业AM页面：� Container所在的机器� 分配到的GPU物理设备号� tensorboard url链接� Container角⾊� Container当前状态� 训练中保存的中间模型� 查看work、ps日志� TensorFlow on Yarn设计 Tensor

TensorFlow ���������� Baylor, Denis, et al. "Tfx: A tensorflow-based production-scale machine learning platform." Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining TensorFlow ���������� Baylor, Denis, et al. "Tfx: A tensorflow-based production-scale machine learning platform." Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

current layers ▪ Linear ▪ ReLU ▪ Sigmoid ▪ Conv2d ▪ ConvTransposed2d ▪ Dropout ▪ etc. 2. Container ▪ net(x) 3. parameters 4. modules ▪ modules: all nodes ▪ children: direct children 5. to(device)

SkyPilot master branch automatically cloned by running: # NOTE: '--platform linux/amd64' is needed for Apple silicon Macs docker run --platform linux/amd64 \ -td --rm --name sky \ -v "$HOME/.sky:/root/.sky:rw"

323 samples, validate on 81 samples Epoch 1/500 2019-09-24 01:07:03.889046: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not co will output the below information: Epoch 1/15 2019-09-24 01:19:01.151247: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not co

be considered as NumPy extension to GPUs. • Computational graphs − PyTorch provides an excellent platform which offers dynamic computational graphs. Thus a user can change them during runtime. • It includes