| Zhao et al. (2015) (auto-encoder) | 4.76 | Stacked What-Where Auto-encoders | |
| DNN-2 (Trainable Activations) | 3.6 | Trainable Activations for Image Classification | - |
| DNN-3 (Trainable Activations) | 3.0 | Trainable Activations for Image Classification | - |
| DNN-5 (Trainable Activations) | 2.8 | Trainable Activations for Image Classification | - |
| PMM (Parametric Matrix Model) | 2.62 | Parametric Matrix Models | - |
| Perceptron with a tensor train layer | 1.8 | Tensorizing Neural Networks | |
| MLP (ideal number of groups) | 1.67 | On the Ideal Number of Groups for Isometric Gradient Propagation | - |
| Convolutional PMM (Parametric Matrix Model) | 1.01 | Parametric Matrix Models | - |
| Explaining and Harnessing Adversarial Examples | 0.8 | Explaining and Harnessing Adversarial Examples | |
| Sparse Activity and Sparse Connectivity in Supervised Learning | 0.8 | Sparse Activity and Sparse Connectivity in Supervised Learning | - |