Jizhong Liang

Improving deep neural networks using softplus units

2015

Recently, DNNs have achieved great improvement for acoustic modeling in speech recognition tasks. However, it is difficult to train the models well when the depth grows. One main reason is that when training DNNs with …