90006111

open access

Version of Record

Bayesian estimation and model averaging of convolutional neural networks by hypernetwork

English (英語)

Nonlinear Theory and Its Applications, IEICE

10(1)

45-59

電子情報通信学会

2019

2019-06-20

Neural networks have a rich ability to learn complex representations and have achieved remarkable results in various tasks. However, they are prone to overfitting owing to the limited number of training samples and regularizing the learning process of neural networks is essential. In this paper, we propose a regularization method that estimates the parameters of a large convolutional neural network as probabilistic distributions using a hypernetwork, which generates the parameters of another network. Additionally, we perform model averaging to improve the network performance. Then, we apply the proposed method to a large model such as wide residual networks. The experimental results demonstrate that our method and its model averaging outperform the commonly used maximum a posteriori estimation with L2 regularization.

image recognition

学術雑誌論文

Cpyright©2019 IEICE