Ensemble of online sequential extreme learning machine based on cross-validation

Abstract The online sequential extreme learning machine (OS-ELM) was proposed as an evolution of the Extreme learning machine (ELM) in 2006. The learning algorithm can learn data by fixing or changing the size of the chunk (a block of data). Compared with other online algorithms, it has faster training speed, and the generalization performance is better. The proposed ensemble of neural networks further demonstrates that the use of the neural network sets with multiple consensus schemes has a greater improvement over the stability of a single network. The basic idea of cross-validation is to group the original data sets, part of which is to train as the training set and the other part of which is to verify as the test set, so the algorithm can reduce the over-fitting problem of the data to a certain extent, and extract more valid information in the limited data set. In this paper, a new ensemble of online sequential extreme learning machine based on cross-validation (ENOS-ELM) is proposed. Through application of cross-validation and integration to the training stage, the accuracy of the algorithm in classification is further improved.