References

[1] LeCun Y. Generalization and network design strategies. Connectionism in Perspective, 1989, 19: 143--155. Google Scholar http://scholar.google.com/scholar_lookup?title=LeCun Y. Generalization and network design strategies. Connectionism in Perspective, 1989, 19: 143--155&

[2] Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, 2012. 1097--1105. Google Scholar http://scholar.google.com/scholar_lookup?title=Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, 2012. 1097--1105&

[3] Szegedy C, Liu W, Jia Y, et al. Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015. 1--9. Google Scholar http://scholar.google.com/scholar_lookup?title=Szegedy C, Liu W, Jia Y, et al. Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015. 1--9&

[4] He K, Zhang X, Ren S, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016. 770--778. Google Scholar http://scholar.google.com/scholar_lookup?title=He K, Zhang X, Ren S, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016. 770--778&

[5] Girshick R, Donahue J, Darrell T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014. 580--587. Google Scholar http://scholar.google.com/scholar_lookup?title=Girshick R, Donahue J, Darrell T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014. 580--587&

[6] Ren S, He K, Girshick R, et al. Faster R-CNN: towards real-time object detection with region proposal networks. In: Proceedings of Advances in Neural Information Processing Systems, 2015. 91--99. Google Scholar http://scholar.google.com/scholar_lookup?title=Ren S, He K, Girshick R, et al. Faster R-CNN: towards real-time object detection with region proposal networks. In: Proceedings of Advances in Neural Information Processing Systems, 2015. 91--99&

[7] Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015. 3431--3440. Google Scholar http://scholar.google.com/scholar_lookup?title=Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015. 3431--3440&

[8] Chen L C, Papandreou G, Kokkinos I. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Trans Pattern Anal Mach Intell, 2018, 40: 834-848 CrossRef Google Scholar http://scholar.google.com/scholar_lookup?title=DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs&author=Chen L C&author=Papandreou G&author=Kokkinos I&publication_year=2018&journal=IEEE Trans Pattern Anal Mach Intell&volume=40&pages=834-848

[9] LeCun Y, Bengio Y, Hinton G. Deep learning. Nature, 2015, 521: 436--444. Google Scholar http://scholar.google.com/scholar_lookup?title=LeCun Y, Bengio Y, Hinton G. Deep learning. Nature, 2015, 521: 436--444&

[10] Ji Rongrong, Lin Shaohui, Chao Fei, et al. A review of deep neural network compression and acceleration. Journal of Computer Research and Development, 2018, 55(9): 1871-1888 doi: 10.7544/issn1000-1239.2018.20180129. Google Scholar http://scholar.google.com/scholar_lookup?title=Ji Rongrong, Lin Shaohui, Chao Fei, et al. A review of deep neural network compression and acceleration. Journal of Computer Research and Development, 2018, 55(9): 1871-1888 doi: 10.7544/issn1000-1239.2018.20180129&

[11] Li H, Kadav A, Durdanovic I, et al. Pruning filters for efficient convnets. 2016,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Li H, Kadav A, Durdanovic I, et al. Pruning filters for efficient convnets. 2016,&

[12] Han S, Pool J, Tran J, et al. Learning both weights and connections for efficient neural network. In: Proceedings of Advances in Neural Information Processing Systems, 2015. 1135--1143. Google Scholar http://scholar.google.com/scholar_lookup?title=Han S, Pool J, Tran J, et al. Learning both weights and connections for efficient neural network. In: Proceedings of Advances in Neural Information Processing Systems, 2015. 1135--1143&

[13] Chen W, Wilson J, Tyree S, et al. Compressing neural networks with the hashing trick. In: Proceedings of International Conference on Machine Learning, 2015. 2285--2294. Google Scholar http://scholar.google.com/scholar_lookup?title=Chen W, Wilson J, Tyree S, et al. Compressing neural networks with the hashing trick. In: Proceedings of International Conference on Machine Learning, 2015. 2285--2294&

[14] Denton E L, Zaremba W, Bruna J, et al. Exploiting linear structure within convolutional networks for efficient evaluation. In: Proceedings of Advances in Neural Information Processing Systems, 2014. 1269--1277. Google Scholar http://scholar.google.com/scholar_lookup?title=Denton E L, Zaremba W, Bruna J, et al. Exploiting linear structure within convolutional networks for efficient evaluation. In: Proceedings of Advances in Neural Information Processing Systems, 2014. 1269--1277&

[15] Buciluva C, Caruana R, Niculescu-Mizil A. Model compression. In: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2006. 535--541. Google Scholar http://scholar.google.com/scholar_lookup?title=Buciluva C, Caruana R, Niculescu-Mizil A. Model compression. In: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2006. 535--541&

[16] Iandola F N, Han S, Moskewicz M W, et al. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and $<$ 0.5 MB model size. 2016,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Iandola F N, Han S, Moskewicz M W, et al. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and $<$ 0.5 MB model size. 2016,&

[17] Howard A G, Zhu M, Chen B, et al. Mobilenets: Efficient convolutional neural networks for mobile vision applications. 2017,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Howard A G, Zhu M, Chen B, et al. Mobilenets: Efficient convolutional neural networks for mobile vision applications. 2017,&

[18] Schulz K, Sixt L, Tombari F, et al. Restricting the flow: Information bottlenecks for attribution. 2020,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Schulz K, Sixt L, Tombari F, et al. Restricting the flow: Information bottlenecks for attribution. 2020,&

[19] Selvaraju R R, Cogswell M, Das A, et al. Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, 2017. 618--626. Google Scholar http://scholar.google.com/scholar_lookup?title=Selvaraju R R, Cogswell M, Das A, et al. Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, 2017. 618--626&

[20] Molchanov P, Tyree S, Karras T, et al. Pruning convolutional neural networks for resource efficient inference. 2016,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Molchanov P, Tyree S, Karras T, et al. Pruning convolutional neural networks for resource efficient inference. 2016,&

[21] Springenberg J T, Dosovitskiy A, Brox T, et al. Striving for simplicity: the all convolutional net. 2014,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Springenberg J T, Dosovitskiy A, Brox T, et al. Striving for simplicity: the all convolutional net. 2014,&

[22] Molchanov P, Mallya A, Tyree S, et al. Importance estimation for neural network pruning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 11264--11272. Google Scholar http://scholar.google.com/scholar_lookup?title=Molchanov P, Mallya A, Tyree S, et al. Importance estimation for neural network pruning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 11264--11272&

[23] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 2014,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 2014,&

[24] Nilsback M E, Zisserman A. Automated flower classification over a large number of classes. In: Proceedings of 2008 6th Indian Conference on Computer Vision, Graphics & Image Processing, 2008. 722--729. Google Scholar http://scholar.google.com/scholar_lookup?title=Nilsback M E, Zisserman A. Automated flower classification over a large number of classes. In: Proceedings of 2008 6th Indian Conference on Computer Vision, Graphics & Image Processing, 2008. 722--729&

[25] Krizhevsky A, Hinton G. Learning multiple layers of features from tiny images. Handbook of Systemic Autoimmune Diseases, 2009, 1(4). Google Scholar http://scholar.google.com/scholar_lookup?title=Krizhevsky A, Hinton G. Learning multiple layers of features from tiny images. Handbook of Systemic Autoimmune Diseases, 2009, 1(4)&

[26] LeCun Y, Denker J S, Solla S A. Optimal brain damage. In: Proceedings of Advances in Neural Information Processing Systems, 1990. 598--605. Google Scholar http://scholar.google.com/scholar_lookup?title=LeCun Y, Denker J S, Solla S A. Optimal brain damage. In: Proceedings of Advances in Neural Information Processing Systems, 1990. 598--605&

[27] Hassibi B, Stork D G. Second order derivatives for network pruning: Optimal brain surgeon. In: Proceedings of Advances in Neural Information Processing Systems, 1993. 164--171. Google Scholar http://scholar.google.com/scholar_lookup?title=Hassibi B, Stork D G. Second order derivatives for network pruning: Optimal brain surgeon. In: Proceedings of Advances in Neural Information Processing Systems, 1993. 164--171&

[28] Han S, Mao H, Dally W J. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. 2015,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Han S, Mao H, Dally W J. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. 2015,&

[29] Guo Y, Yao A, Chen Y. Dynamic network surgery for efficient dnns. In: Proceedings of Advances in Neural Information Processing Systems, 2016. 1379--1387. Google Scholar http://scholar.google.com/scholar_lookup?title=Guo Y, Yao A, Chen Y. Dynamic network surgery for efficient dnns. In: Proceedings of Advances in Neural Information Processing Systems, 2016. 1379--1387&

[30] He Y, Liu P, Wang Z, et al. Filter pruning via geometric median for deep convolutional neural networks acceleration. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 4340--4349. Google Scholar http://scholar.google.com/scholar_lookup?title=He Y, Liu P, Wang Z, et al. Filter pruning via geometric median for deep convolutional neural networks acceleration. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 4340--4349&

[31] Hu H, Peng R, Tai Y W, et al. Network trimming: A data-driven neuron pruning approach towards efficient deep architectures. 2016,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Hu H, Peng R, Tai Y W, et al. Network trimming: A data-driven neuron pruning approach towards efficient deep architectures. 2016,&

[32] Lin S, Ji R, Li Y, et al. Accelerating Convolutional Networks via Global & Dynamic Filter Pruning. In: Proceedings of 27th International Joint Conference on Artificial Intelligence, 2018. 2425--2432. Google Scholar http://scholar.google.com/scholar_lookup?title=Lin S, Ji R, Li Y, et al. Accelerating Convolutional Networks via Global & Dynamic Filter Pruning. In: Proceedings of 27th International Joint Conference on Artificial Intelligence, 2018. 2425--2432&

[33] Lin M, Ji R, Wang Y, et al. HRank: filter pruning using high-rank feature map. 2020,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Lin M, Ji R, Wang Y, et al. HRank: filter pruning using high-rank feature map. 2020,&

[34] Wang D, Zhou L, Zhang X, et al. Exploring linear relationship in feature map subspace for convnets compression. 2018,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Wang D, Zhou L, Zhang X, et al. Exploring linear relationship in feature map subspace for convnets compression. 2018,&

[35] Lin S, Ji R, Yan C, et al. Towards optimal structured cnn pruning via generative adversarial learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 2790--2799. Google Scholar http://scholar.google.com/scholar_lookup?title=Lin S, Ji R, Yan C, et al. Towards optimal structured cnn pruning via generative adversarial learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 2790--2799&

[36] Gao X, Zhao Y, Dudziak L, et al. Dynamic channel pruning: Feature boosting and suppression. 2018,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Gao X, Zhao Y, Dudziak L, et al. Dynamic channel pruning: Feature boosting and suppression. 2018,&

[37] Huang Z, Wang N. Data-driven sparse structure selection for deep neural networks. In: Proceedings of the European Conference on Computer Vision (ECCV), 2018. 304--320. Google Scholar http://scholar.google.com/scholar_lookup?title=Huang Z, Wang N. Data-driven sparse structure selection for deep neural networks. In: Proceedings of the European Conference on Computer Vision (ECCV), 2018. 304--320&

[38] He Y, Kang G, Dong X, et al. Soft filter pruning for accelerating deep convolutional neural networks. 2018,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=He Y, Kang G, Dong X, et al. Soft filter pruning for accelerating deep convolutional neural networks. 2018,&

[39] Liu Z, Li J, Shen Z, et al. Learning efficient convolutional networks through network slimming. In: Proceedings of the IEEE International Conference on Computer Vision, 2017. 2736--2744. Google Scholar http://scholar.google.com/scholar_lookup?title=Liu Z, Li J, Shen Z, et al. Learning efficient convolutional networks through network slimming. In: Proceedings of the IEEE International Conference on Computer Vision, 2017. 2736--2744&

[40] Zhao C, Ni B, Zhang J, et al. Variational convolutional neural network pruning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 2780--2789. Google Scholar http://scholar.google.com/scholar_lookup?title=Zhao C, Ni B, Zhang J, et al. Variational convolutional neural network pruning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 2780--2789&

[41] Zhuo H, Qian X, Fu Y, et al. Scsp: Spectral clustering filter pruning with soft self-adaption manners. 2018,. arXiv Google Scholar http://scholar.google.com/scholar_lookup?title=Zhuo H, Qian X, Fu Y, et al. Scsp: Spectral clustering filter pruning with soft self-adaption manners. 2018,&

[42] Paszke A, Gross S, Chintala S, et al. Automatic differentiation in PyTorch. In: Proceedings of Conference and Workshop on Neural Information Processing Systems, 2017. Google Scholar http://scholar.google.com/scholar_lookup?title=Paszke A, Gross S, Chintala S, et al. Automatic differentiation in PyTorch. In: Proceedings of Conference and Workshop on Neural Information Processing Systems, 2017&