layers of AI infrastructure: agentic interfaces, enterprise copilots, real-world autonomous systems, and sovereign models. Rapid advances in artificial intelligence, compute infrastructure, and global ‘AI Index: Mapping the $4 Trillion Enterprise Impact’ via Morgan Stanley (10/23) Enabling Infrastructure CPUs Big Data / Cloud GPUs Computing Cycles Over Time – 1960s-2020s, per Morgan Stanley we access and move information is happening much faster… …AI is a compounder – on internet infrastructure, which allows for wicked-fast adoption of easy-to-use broad-interest services. AI Technology

Apache (incubating) TVM project. A goal is to nurture the TVM community and contribute new infrastructure and features. octom|.ai @octoml Q octoML Founding Team - The Octonauts - 四人全外日 Luis Ceze employees to contribute to TVML. ee Today we'ltouch on a few of those contribution areas: o Core Infrastructure Improvements to TVM o_uTVM: support for microcontrollers in TVM o_ Virtual Machine and dynamic o_ Improved NLP support, with focus on transformers QQ octoML Core Infrastructure Refactors ee New Integer Analysis Infrastructure o_ Supports the ability to handle nested division and modulus o_ Improves

and TVM infrastructure. Option 2 – Lower to a sequence of existing Relay operators • We introduced a new Relay dialect – QNN to encapsulate this work • Complete reuse of Relay pass infrastructure • Possible

FBGEMMPyTorch and TVM - Lots of opportunity in PyTorch - Graph optimization - Existing fusion infrastructure fairly limited (CUDA-only, injective-only) - Kernel synthesis - Dynamic shapes, stride specialization

faster—a win for everyone. We see a lot of opportunity to continue to invest 
 in this new infrastructure in ways that will help 
 us grow revenue. Chris Hyams CEO 10 AI in the EnterpriseLesson 3

2023 年前四个月，向量数据库公司融资额 ，超过了 2022 年的总和 （图源：https://www.cbinsights.com/research/generative-ai-infrastructure- vector-database/） 7 / 32 LLM 基础设施：大模型框架及微调 (Fine Tuning) 大模型框架指专门设计用于构建、训练和部署大型机器 学习模型和深度学习模型的软件框架。这些框架提供了