Dynamic Model in TVM## Dynamic Model in TVM ## AWS AI Presenter: Haichen Shen, Yao Wang Amazon SageMaker Neo, Deep Engine Science ## Models with dynamism • Control flow (if, loop, etc) • Dynamic shapes ☐ Dynamic inputs: loop Limitation of TVM/graph runtime • Cannot compile and run dynamic models ## Support dynamic model in TVM • Support Any-dim in typing • Use shape function to compute the type at runtime • Virtual "data" input_shape = [tvm.relay.Any(), 3, 224, 224] dtype = "float32" block = get_model('resnet50_v1', pretrained=True) mod, params = relay.frontend.from_mxnet(block, shape={input_name:0 码力 | 24 页 | 417.46 KB | 1 年前3
Model and Operate Datacenter by Kubernetes at eBay (提交版)China 2018 ## Model and Operate Datacenter by Kubernetes at eBay 辛肖刚, Cloud Engineering Manager, ebay 梅岑恺, Senior Operation Manager, ebay ## Agenda About ebay Our fleet ★ Kubernetes makes magic at at ebay Model + Controller How we model our datacenter Operation in large scale Q&A 177M Active buyers worldwide $22.7B Amount of eBay Inc. GMV $2.6B Reported revenue 1.1B Live listings • Network ## Kubernetes • Core components • Addon • Taint ## Operations ## Let's model a datacenter running Kubernetes Onboard  Kalavri vkalavri@bu.edu ## What is a stream? - In traditional data processing processing applications, we know the entire dataset in advance, e.g. tables stored in a database. A data stream is a data set that is produced incrementally over time, rather than being available in full before high-volume, real-time data that might be unbounded • we cannot store the entire stream in an accessible way • we have to process stream elements on-the-fly using limited memory ## Properties of data streams0 码力 | 45 页 | 1.22 MB | 2 年前3
The Future of Cloud Native Applications
with Open Application Model (OAM) and Dapr## Microsoft Ready ## The Future of Cloud Native Applications with Open Application Model (OAM) and Dapr Mark Russinovich Chief Technology Officer, Microsoft Azure @markrussinovich ## Application models /9/bc29b5fbf1de02f8968a900b84d384e5/p4_1.jpg) Open Application Model (OAM) Open Application Model Platform agnostic application model Distributed Application Runtime (Dapr) dapr Building blocks developing cloud and edge applications Microsoft is introducing two new specs, the Open Application Model and Dapr, with the aim of making building cloud, edge and Kubernetes apps easier. ### f in ☐ ☑ ☒0 码力 | 51 页 | 2.00 MB | 2 年前3
Distributed Ranges: A Model for Building Distributed Data Structures, Algorithms, and Views## +23 ## Distributed Ranges: A Model for Building Distributed Data Structures, Algorithms, and Views ## BENJAMIN BROCK ## Notices and Disclaimers For notices, disclaimers, and details about performance std::plus()); } ## Stream Benchmarks shp Stream Benchmarks  mhp Stream Benchmarks  Kalavri vkalavri@bu.edu ## Streaming sources  Where do stream processors read data from? Files, e.g. transaction logs Sockets IoT devices and sensors Databases and KV stores Message queues unpredictable delays • might be producing too fast • stream processor needs to keep up and not shed load • might be producing too slow or become idle • stream processor should be able to make progress • might0 码力 | 33 页 | 700.14 KB | 2 年前3
C++ Memory Model: from C++11 to C++23## +23 ## C++ Memory Model: from C++11 to C++23 ## ALEX DATHSKOVSKY ## 20 23 October 01 - 06 ## About Me: SPEEDATA alex.dathskovsky@speedata.io www.linkedin.com/in/alexdathskovsky https://www.cppnext [Image](/uploads/documents/a/b/8/f/ab8f331d7156e1b708cb39698c0a1f00/p3_1.jpg) ## its a conspiracy man ## Memory Model ## I mportant Question ## Does the processor executes the program you wrote? ## The Answer ## Short0 码力 | 112 页 | 5.17 MB | 1 年前3
DeepSeek-V2: A Strong, Economical, and Efficient
Mixture-of-Experts Language ModelEfficient Mixture-of-Experts Language Model DeepSeek-AI research@deepseek.com ## Abstract We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training DeepSeek-V2 and its chat versions still achieve top-tier performance among open-source models. The model checkpoints are available at https://github.com/deepseek-ai/DeepSeek-V2. DaprDistributed ApplicationMicroservices分布式范围分布式数据结构分段处理分布式算法并行计算Spark StreamingFlink微批处理窗口语义分布式文件系统流数据处理发布/订阅系统Pub/Sub数据流处理消息队列C++内存模型原子操作内存顺序数据依赖性编译器重排Multi-head Latent Attention (MLA)DeepSeekMoEMixture-of-Experts (MoE)Transformer architecturetraining efficiencyApache RocketMQApache Flink分布式流数据平台流处理生态系统项目













