Octave Convolution

MXNet implementation for:

Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution

ImageNet

Ablation

• Loss: Softmax
• Learning rate: Cosine (warm-up: 5 epochs, lr: 0.4)
• MXNet API: Symbol API

Note:

• Top-1 / Top-5, single center crop accuracy is shown in the table. (testing script)
• All residual networks in ablation study adopt pre-actice version[1] for convenience.

Others

• Learning rate: Cosine (warm-up: 5 epochs, lr: 0.4)
• MXNet API: Gluon API

Citation

@article{chen2019drop,
  title={Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution},
  author={Chen, Yunpeng and Fan, Haoqi and Xu, Bing and Yan, Zhicheng and Kalantidis, Yannis and Rohrbach, Marcus and Yan, Shuicheng and Feng, Jiashi},
  journal={Proceedings of the IEEE International Conference on Computer Vision},
  year={2019}
}

Third-party Implementations

• PyTorch Implementation with imagenet training log and pre-trained model by d-li14
• MXNet Implementation with imagenet training log by terrychenism
• Keras Implementation with cifar10 results by koshian2

Acknowledgement

• Thanks MXNet, Gluon-CV and TVM!
• Thanks @Ldpe2G for sharing the code for calculating the #FLOPs (link)
• Thanks Min Lin (Mila), Xin Zhao (Qihoo Inc.), Tao Wang (NUS) for helpful discussions on the code development.

Reference

[1] He K, et al "Identity Mappings in Deep Residual Networks".

[2] Christian S, et al "Rethinking the Inception Architecture for Computer Vision"

[3] Zhang H, et al. "mixup: Beyond empirical risk minimization.".

License

The code and the models are MIT licensed, as found in the LICENSE file.