High-level data flow graph and optimizations Directly generate optimized program for new operator workloads and hardware Hardware FrameworksWhy Automation is the Future Clear winner on emerging models BatchMatMul CuDNN w/ TensorCores tvm w/ TensorCores 1.4x better on emerging workloads Transformer related workloads Credit: Siyuan FengWhere are we goingUnified Runtime For Heterogeneous Devices remote_mod[“npufunction0"] func(remote_a, remote_b)Virtual Machine: Supporting Dynamic Workload Dynamic shape workloads More runtime objects: Arrays, Tuples, Trees, ADTs Minimum runtime for dynamic models Credit:

Jay Simons / Daegwon Chae / Alexander Krey2 Context We set out to compile foundational trends related to AI. A starting collection of several disparate datapoints turned into this beast. As soon as trending is ramping materially faster…and the machines can outpace us. The pace and scope of change related to the artificial intelligence technology evolution is indeed unprecedented, as supported by the toward AI in efforts to drive growth and fend off attackers. And global competition – especially related to China and USA tech developments – is acute. The outline for our document is on the next page

High-Level 人 ORGREEE Te Conv2D mized RE -一 一 QQ octoML Transformer Improvements Transformer based models such as BERT have recently become very Popular and require first class instead. We wantto add this form of view as a relay intrinsic to enable highly fused and optimized transformer models. olo o o QQ octoML BERT has many reshape operations, which are currently implemented

elsewhere- Performance matters a lot - Heterogenous computing environment - High variety of workloads - Ever-increasing set of primitives (over 500 aten kernels) - Interpreter methods not delivering transcendentals (exp, tanh, erf, etc) - very general technique, allows clean vectorization - Related work in Gibiansky (2017), Gray (2019), et al. Image from OpenAI- Add relay.nn.sparse_dense for block-sparse

lies in Real-Time Unified Data Layers—platforms that seamlessly support analytics, search, and AI workloads at scale. These systems break down silos, reduce data sprawl, and deliver timely, actionable insights searchable across distributed systems. High-performance querying for analytics, search, and AI workloads at scale. SQL simplicity to unify access across divers data types, reducing complexity in querying architecture ensuring availability and resilience as business needs evolve. By unifying diverse data workloads into a single, scalable platform, a Real-Time UDL helps businesses increase efficiency, enhance

Punctuation 1209 55 Sorting and Related Functions 1211 55.1 Sorting Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1213 55.2 Order-Related Functions . . . . . . . . . recommend that you uninstall all previous Julia versions, ensure that you remove anything Julia related from your PATH variable and then install Julia with one of the methods described below. 3.1 Windows non-English languages, including variants of the ASCII characters with accents and other modifi- cations, related scripts such as Cyrillic and Greek, and scripts completely unrelated to ASCII and English, including

Punctuation 1209 55 Sorting and Related Functions 1211 55.1 Sorting Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1213 55.2 Order-Related Functions . . . . . . . . . recommend that you uninstall all previous Julia versions, ensure that you remove anything Julia related from your PATH variable and then install Julia with one of the methods described below. 3.1 Windows non-English languages, including variants of the ASCII characters with accents and other modifi- cations, related scripts such as Cyrillic and Greek, and scripts completely unrelated to ASCII and English, including

Punctuation 1209 55 Sorting and Related Functions 1211 55.1 Sorting Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1213 55.2 Order-Related Functions . . . . . . . . . recommend that you uninstall all previous Julia versions, ensure that you remove anything Julia related from your PATH variable and then install Julia with one of the methods described below. 3.1 Windows non-English languages, including variants of the ASCII characters with accents and other modifi- cations, related scripts such as Cyrillic and Greek, and scripts completely unrelated to ASCII and English, including

2024诺贝尔化学奖颁发给研发AlphaFold的两位AI专家 未来所有科学研究都将以AI为中心 过去如何做蛋白质研究 AlphaFold 1. X射线晶体衍射 2. 核磁共振 3. 冷冻电子显微镜 1. 利用Transformer的预测能力， 2. 直接从蛋白质的氨基酸序列 3. 中预测蛋白质的3D结构 靠肉眼观察，几年才能发现一个复杂蛋 白质结构，半个世纪预测了20多万种 从数年缩短到几分钟，解开了生物学密码 成功预测了地球存在的2亿种蛋白质结构

Punctuation 1262 56 Sorting and Related Functions 1264 56.1 Sorting Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1266 56.2 Order-Related Functions . . . . . . . . . recommend that you uninstall all previous Julia versions, ensure that you remove anything Julia related from your PATH variable and then install Julia with one of the methods described below. 3.1 Windows non-English languages, including variants of the ASCII characters with accents and other modifi- cations, related scripts such as Cyrillic and Greek, and scripts completely unrelated to ASCII and English, including