《Efficient Deep Learning Book》[EDL] Chapter 7 - Automation
available computational budget. They can be increased as more resources become available or reduced in resource constrained situations. The likelihood of finding the optimal increases with the number of trials and resources. Alternatively, we can base the search approach on the budget allocation to cap the resource utilization. Multi-Armed Bandit based algorithms allocate a finite amount of resources to a set contrast to the bracket 0, subsequent brackets start with a smaller set of configurations and higher resource allocation per configuration. This ensures that we try successive halves with various values of0 码力 | 33 页 | 2.48 MB | 1 年前3《Efficient Deep Learning Book》[EDL] Chapter 2 - Compression Techniques
choice of the technique depends on several factors like customer preference, consumption delay, or resource availability (extra hands needed for chopping). Personally, I like full apples. Let’s move on from transmission bandwidth is expensive like deep learning models on mobile devices. Mobile devices are resource constrained. Hence, quantization can help to deploy models which would otherwise be too big to shrink the model sizes with an acceptable loss of precision. A smaller model size can be deployed in resource constrained environments like the mobile devices. Quantization has enabled a whole lot of models0 码力 | 33 页 | 1.96 MB | 1 年前3TensorFlow on Yarn:深度学习遇上大数据
TensorFlow on Yarn技术细节揭秘 Yarn支持GPU调度ResourceManager端实现:� 扩展org.apache.hadoop.yarn.api.records.Resource抽象类及其实现,增加:� � public abstract int getGpuCores();� � public abstract void setGpuCores(int gCores);� nodemanager.resource.gpu-cores ((2,2)) � � � NodeManager上可用的GPU卡数是: 2 + 2 = 4� � �� yarn.nodemanager.resource.gpu-cores 0 码力 | 32 页 | 4.06 MB | 1 年前3《Efficient Deep Learning Book》[EDL] Chapter 3 - Learning Techniques
Turns out, using learning techniques to improve sample and label efficiency, often helps to make resource efficient models feasible. By feasible, we mean that the model meets the bar for quality metrics infrastructure. It allows, for example, for the teacher’s predictions to be collected offline if resource constraints prohibit the execution of both the student and the teacher models in tandem. These predictions0 码力 | 56 页 | 18.93 MB | 1 年前3《Efficient Deep Learning Book》[EDL] Chapter 1 - Introduction
Efficiency would also enable applications that couldn’t have otherwise been feasible with the existing resource constraints. Similarly, having models directly on-device would also support new offline applications0 码力 | 21 页 | 3.17 MB | 1 年前3《Efficient Deep Learning Book》[EDL] Chapter 4 - Efficient Architectures
object in the input sample. This model will be used within a mobile application. Mobile devices are resource constrained. Let’s see if we can reduce the model footprint without a significant quality compromise0 码力 | 53 页 | 3.92 MB | 1 年前3
共 6 条
- 1