Models in TVM AWS AI© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Quantization Overview • Represent FP32 numbers with a lower-precision INT8 numbers • Integer number stands All rights reserved. Quantization in TVM • Quantization within TVM - Automatic Quantization • TVM stack ingests a FP32 graph and a small dataset • Finds suitable quantization scale • Produces a quantized its Affiliates. All rights reserved. Quantization Appraoches in TVM Framework FP32 Graph MXNet Parser TF parser …. Relay FP32 Graph Relay Automatic Quantization Relay Int8 Graph Framework Pre-quantized

selecting DCT sizes and quantization steps. 5. Hare -- Enables Gaborish Filtering, Chroma from Luma and estimates quantization steps. 6. Wombat -- Enables error diffusion quantization and DCT heuristics clustering. 8. Kitten -- Optimizes the adaptive quantization for a psychovisual metric. 9. Tortoise -- Enables a more thorough adaptive quantization search. You can force-enable several of the options applied on this mathematical function is also finetuned by the encoder, this is called Adaptive Quantization. Because the encoder is able to pick the best solution for the compression (Depending on what