AI Usage + Cost + Loss Growth = Unprecedented • AI Monetization Threats = Rising Competition + Open-Source Momentum + China’s Rise • AI & Physical World Ramps = Fast + Data-Driven • Global Internet User User + Usage + CapEx Growth = Unprecedented Developers in Leading Chipmaker’s Ecosystem 1 2.1 Source: Leading Chipmaker Details on Page 38 AI User + Usage + CapEx Growth = Unprecedented 2.2 Internet mobile app users. App not available in select countries, including China and Russia, as of 5/25. Source: United Nations / International Telecommunications Union (3/25), Sensor Tower (5/25) 0 Years In

Inference engines DL Compilers Kenrel Libraries Hardware CuDNN NNPack MKL-DNN Hand optimized Open source, automated end-to- end optimization framework for deep learning.TVM Stack High-Level Differentiable tvm.sum(A[k, y] * B[k], axis=k)) HW Interface Specification by Tensor Expression TensorizationVTA: Open & Flexible Deep Learning Accelerator • Runtime JIT compile accelerator micro code • Support heterogenous Interface (ISA) VTA MicroArchitecture VTA Simulator} compiler, driver, hardware design full stack open source Current TVM Stack VTA Runtime & JIT CompilerTSIM: Support for Future Hardware Current TVM Stack

Q OctoML Open Source at O〇ctoML TVM Meetup 11/8/2019 Jared Roesch OctoML is a new company building DL deployment solutions using the Apache (incubating) TVM project. A goal is to nurture the TVM community design and machine learning tr tvm 。 @zxnet 和os 全 W Open Source at OctoML ee We are big believers in the power of open source o 5S$ponsoring multiple employees to contribute to TVML. ee Today octoML Coalesced t1: Tensor t2: Tensor t3: Tensor 13 Acknowledgments e The Apache(incubating) community members. e ASF Mentors and PMC members who make this awesome project Possiblel ee AWS for hosting

maximum generation throughput to 5.76 times. We pretrain DeepSeek-V2 on a high-quality and multi-source corpus consisting of 8.1T tokens, and further perform Supervised Fine-Tuning (SFT) and Reinforcement activated parameters, DeepSeek-V2 and its chat versions still achieve top-tier performance among open-source models. The model checkpoints are available at h t t p s : / / g i t h u b . c o m / d e e p s (Tokens/Sec) (b) Figure 1 | (a) MMLU accuracy vs. activated parameters, among different open-source models. (b) Training costs and inference efficiency of DeepSeek 67B (Dense) and DeepSeek-V2. Contents

hosted models • MXNet Pre-quantized Models • Tested internally with MxNet + MKLDNN path • Will open RFC in a month© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Evaluation opt© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Conclusion • TVM community is pursuing both Automatic- and Pre-quantized model support. Contributions are welcomed. • We VNNI, ARM Dot, Nvidia DP4A • Full pipeline is available. Please try it and give suggestions. • Open-source discussions formed the foundations of both the approaches.

(Qualcomm) PART TWO Alios TVM @ ARM CPU AiOS 1驱动万物智能 Alios TVMQOARM CPU 。 Support TFLite ( Open Source and Upstream Master ) 。， Optimize on INT8 & FP32 AiiOS ! 驱动万物智能 Alios TVM @ ARM CPU INT8 * Kernel Offload to DSP ，loop nests marked as pipeline 。， Implement complete Hexagon runtime based on community PR. ADSPRPC Framework Applications Processor | | DSP Processor

垂直领域优化：针对特定领域 （如医疗、法律）进行优化， 提供高精度结果。  长文本处理：擅长处理长文本 和复杂文档，适合专业场景。  定制化能力：支持用户自定义 训练和微调，适应特定需求。 Open AI o3 mini  小型化设计：轻量级模型， 适合资源有限的环境。  快速响应：优化推理速度， 适合实时交互场景。  通用性强：适用于多种自 然语言处理任务，如对话 生成和文本理解。 年春运（2025年1月14日到2月8日） 相关数据（如日期、全社会跨区域人员流动量、铁路客运 量、公路人员流动量、水路客运量、民航客运量等）”完 成数据提取并写入文件“2025春运数据.txt” Open AI o3mini 响应速度快，能够高效提 取所有需求链接，输出完 整可运行python脚本，代 码运行后生成文件，但数 据采集结果为空。 DeepSeek R1 能够提取所有网址并进行 。 爬虫数据采集  目前DeepSeek R1、Open AI o3mini、Kimi k1.5支持联网查询网址，Claude 3.5 sonnet暂不支持；  四个模型均能根据上传的网页代码，对多个网址链接进行筛选、去重，完全提取出符合指令要求的所有网址链接并形成列表；  在复杂爬虫任务上，DeepSeek R1与Open AI o3min生成的代码均能正常执行数据采集任务，o3响应速度更快，R1数据采集结果更加完

model, regardless of whether you use Gemini language models in Vertex AI, GPT, Claude, or an open source model like Gemma or LLaMA. Besides the prompt, you will also need to tinker with the various configurations February 2025 33 Prompt EMAIL: ``` Hi, I have seen you use Wordpress for your website. A great open source content management system. I have used it in the past too. It comes with lots of great user plugins concerned about confidentiality, you can write these prompts within your Google Cloud account and open Vertex AI Studio. The advantage of Vertex AI Studio is that you can configure the temperature etc

- Impedance mismatch with PyTorch JIT IR and Relay IR - Watch this space :)Big thanks to the community

collaborative seamless integration with the ecosystem of AI/ML software frameworks and librariesArm NN open source project ● Linaro-hosted https://www.mlplatform.org/ ● Git and review servers ● Forums and issue