ABCP: Automatic Blockwise and Channelwise Network Pruning via Joint Search

arXiv (Cornell University)(2023)

引用 2|浏览20
暂无评分
摘要
Currently, an increasing number of model pruning methods are proposed to resolve the contradictions between the computer powers required by the deep learning models and the resource-constrained devices. However, for simple tasks like robotic detection, most of the traditional rule-based network pruning methods cannot reach a sufficient compression ratio with low accuracy loss and are time consuming as well as laborious. In this article, we propose automatic blockwise and channelwise network pruning (ABCP) to jointly search the blockwise and channelwise pruning action for robotic detection by deep reinforcement learning. A joint sample algorithm is proposed to simultaneously generate the pruning choice of each residual block and the channel pruning ratio of each convolutional layer from the discrete and continuous search space, respectively. The best pruning action taking both the accuracy and the complexity of the model into account is obtained finally. Compared with the traditional rule-based pruning method, this pipeline saves human labor and achieves a higher compression ratio with lower accuracy loss. Tested on the mobile robot detection data set, the pruned YOLOv3 model saves 99.5% floating-point operations, reduces 99.5% parameters, and achieves $\boldsymbol {37.3\times }$ speed up with only 2.8% mean of average precision (mAP) loss. On the sim2real detection data set for robotic detection task, the pruned YOLOv3 model achieves 9.6% better mAP than the baseline model, showing better robustness performance.
更多
查看译文
关键词
channelwise network pruning,joint search,automatic blockwise
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要