文献类型：期刊文献

英文题名：Pseudoinverse Learning Algorithom for Fast Sparse Autoencoder Training

作者：Xu, Bingxin[1]; Guo, Ping[2]

第一作者：徐冰心

机构：[1] Beijing Union University, Beijing Key Laboratory of Information Service Engineering, Beijing, 100101, China; [2] School of Systems Scineces, Beijing Normal University, Image Processing and Pattern Recognition Laboratory, Beijing, 100875, China

第一机构：北京联合大学北京市信息服务工程重点实验室

年份：2018

外文期刊名：2018 IEEE Congress on Evolutionary Computation, CEC 2018 - Proceedings

收录：EI(收录号：20184606066477)

语种：英文

外文关键词：Matrix algebra - Signal encoding - Gradient methods - Input output programs - Deep neural networks

摘要：Sparse autoencoder is one approach to automatically learn features from unlabeled data and received significant attention during the development of deep neural networks. However, the learning algorithm of sparse autoencoder suffers from slow learning speed because of gradient descent based algorithms have many drawbacks. In this paper, a fast learning algorithm for sparse autoenceder is proposed which based on pseudoinverse learning algorithm (PIL). The proposed method calculates encoder weight matrix by truncating the pseudoinverse matrix of input data. The pseudoinverse truncation matrix is used as the weights of encoder, and then the input data is mapped to the hidden layer space through the biased ReLU activation function. The decoder weights are also can computed by the PIL. Unlike the gradient descent based algorithm, the proposed method does not require a time-consuming iterative optimization process and select many user-dependent parameters such as learning rate or momentum constant too. The experimental results indicate the superiority of proposed method which is very efficient and also can learned the sparsity of samples. ? 2018 IEEE.