Main Results¶
Commands¶
The following make command runs all the main results described in our reproducibility report.
make cifar10 DENSITY=0.05,0.1,0.2,0.5
make cifar100 DENSITY=0.05,0.1,0.2,0.5
make cifar10_tune DENSITY=0.05,0.1,0.2,0.5
Use the -n flag to see which commands are executed.
Note that these runs are executed sequentially, although we include parallel processes for cifar10 runs of a particular method.
Eg: cifar10.Random.RigL runs RigL Random for densities 0.05,0.1,0.2,0.5, seed=0 in parallel.
It may be preferable to run specific make commands in parallel for this reason. See make help for an exhaustive list.
Table of Results¶
Shown for 80% sparsity (20% density) on CIFAR10. For exhaustive results and their analysis refer to our report.
Method |
Accuracy (Test) |
FLOPS (Train, Test) |
|---|---|---|
Small Dense |
91.0 ± 0.07 |
0.20x, 0.20x |
Static |
91.2 ± 0.16 |
0.20x, 0.20x |
SET |
92.7 ± 0.28 |
0.20x, 0.20x |
RigL |
92.6 ± 0.10 |
0.20x, 0.20x |
SET (ERK) |
92.9 ± 0.16 |
0.35x, 0.35x |
RigL (ERK) |
93.1 ± 0.09 |
0.35x, 0.35x |
Pruning |
93.2 ± 0.27 |
0.41x, 0.27x |
RigL_2x |
93.0 ± 0.21 |
0.41x, 0.20x |
RigL_2x (ERK) |
93.3 ± 0.09 |
0.70x, 0.35x |