Wide compression: Tensor ring nets

W Wang, Y Sun, B Eriksson… - Proceedings of the …, 2018 - openaccess.thecvf.com
tensor ring factorization, we introduce Tensor Ring Networks (TR-Nets), which significantly
compress … Our results show that our TR-Nets approach is able to compress LeNet-5 by 11× …

Neural Network Compression Based on Tensor Ring Decomposition

K Xie, C Liu, X Wang, X Li, G Xie… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
large highorder tensor, we only need to store the set of small core tensors as the parameters
of the compressed … -Perpiñán, “Low-rank compression of neural nets: Learning the rank of …

Deep Convolutional Neural Network Compression Method: Tensor Ring Decomposition with Variational Bayesian Approach

W Liu, M Zhang, C Shi, N Zhang, J Liu - Neural Processing Letters, 2024 - Springer
… stack deeper and wider. Tensor decomposition can not only compress DNN models but also
… About tensor ring (TR) decomposition of tensor decomposition, there are two problems: (1) …

Nonlinear Tensor Ring Network

XP Li, Q Liu, HC So - arXiv preprint arXiv:2111.06532, 2021 - arxiv.org
… are compressed via tensor ring decomposition. Furthermore, to mitigate the accuracy loss
caused by compression… Thereby, the TT decomposition might result in large intermediate cores …

Reduced storage direct tensor ring decomposition for convolutional neural networks compression

M Gabor, R Zdunek - arXiv preprint arXiv:2405.10802, 2024 - arxiv.org
… low-rank CNNs compression method that is based on reduced storage direct tensor ring
, and it is characterized by large parameter and FLOPS compression rates, while preserving …

Compressing recurrent neural networks with tensor ring for action recognition

Y Pan, J Xu, M Wang, J Ye, F Wang, K Bai… - Proceedings of the AAAI …, 2019 - aaai.org
… and large in middle cores, eg, like an olive (Zhao et al. 2016). To address this issue, we
propose to use the tensor ringtensor and then factorized using TRD. Since this corresponding …

RingCNN: Exploiting algebraically-sparse ring tensors for energy-efficient CNN-based computational imaging

CT Huang - 2021 ACM/IEEE 48th Annual International …, 2021 - ieeexplore.ieee.org
… However, for simplicity the parameter compression in eCNN was not implemented; instead,
we increase the size by 1.5× to 960 KB and 480 KB, respectively, to support large models. …

Semi-tensor product-based tensordecomposition for neural network compression

H Zhao, Y Liu, X Huang, C Zhu - arXiv preprint arXiv:2109.15200, 2021 - arxiv.org
… , Tensor Train (TT) and Tensor Ring (TR) are common decompositions for low rank compression
of … That means the performance of TR-Nets and TT-Nets in compressing wider neural …

Heuristic rank selection with progressively searching tensor ring network

N Li, Y Pan, Y Chen, Z Ding, D Zhao, Z Xu - Complex & Intelligent Systems, 2021 - Springer
… And our algorithm can compress LeNet5 [12] with compression … and TR-Nets [26] compresses
deep neural network via tensor ring … Further, for large-scale datasets, we will explore more …

A novel rank selection scheme in tensor ring decomposition based on reinforcement learning for deep neural networks

Z Cheng, B Li, Y Fan, Y Bao - ICASSP 2020-2020 IEEE …, 2020 - ieeexplore.ieee.org
… In this paper, we focus on using tensor ring decomposition to compress deep convolutional
neural networks… Note if the input channel I and output channel O are large, we can further de- …