Scinovex
article Open AccessTop 10% cited

Research on the deep learning of the small sample data based on transfer learning

AIP conference proceedings · 2017 · Vol. 1864 · pp. 020018–020018
Wei Zhao

Abstract

The Convolutional Neural Network of Deep Learning has been a huge success in the field of image recognition, however, it requires a lot of data samples to train a network of deep learning. In actual work, it’s too difficult to get a large number of training samples, and it will be easy to overfitting under the condition of the limited dataset. According to this problem, design a kind of Deep Convolutional Neural Network which based on the Transfer Learning to solve the problem of the small sample dataset. First of all, it uses the method of Data Augmentation to enlarge the number of sample dataset. Secondly, it uses the Transfer Learning to transfer the trained network (CNN) from the big sample dataset to our small sample dataset for secondary training, It use a Global Average Pooling instead of the fully connected layers to train the network, and wo use Soft max for classification. The method solves the problem of the small sample dataset in the deep learning, and improve the operation efficiency. The experimental results show that it has high recognition rate of the classification in small sample dataset.

Domain Adaptation and Few-Shot LearningAdvanced Neural Network ApplicationsMachine Learning and Data ClassificationOverfittingComputer scienceTransfer of learningArtificial intelligencePoolingDeep learningSample (material)Convolutional neural networkMachine learningField (mathematics)
Citations
144
FWCI
6.23
field-weighted impact
References
23
Percentile
97%
vs. same field & year
Citations per year
References
A Fast Learning Algorithm for Deep Belief Nets
Neural Computation · 2006 · 16,253 citations
Face recognition: a convolutional neural-network approach
IEEE Transactions on Neural Networks · 1997 · 3,098 citations
Backpropagation Applied to Handwritten Zip Code Recognition
Neural Computation · 1989 · 11,706 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.

Research on the deep learning of the small sample data based on transfer learning · Scinovex