TensorRT consumes almost the same GPU memory between int8 and float32

后端 未结 0 1655
刺人心
刺人心 2020-12-24 05:05

I use TensorRT engine to speedup the DNN inference. I found TensorRT consumes almost the same GPU memory between int8 and float32. Does the feature map use float32 store mo

相关标签:
回答
  • 消灭零回复
提交回复
热议问题