Scinovex
articleTop 1% cited

Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources

Neural Computation · 1999 · Vol. 11(2) · pp. 417–441
Te-Won LeeMark GirolamiTerrence J. Sejnowski

Abstract

An extension of the infomax algorithm of Bell and Sejnowski (1995) is presented that is able blindly to separate mixed signals with sub- and supergaussian source distributions. This was achieved by using a simple type of learning rule first derived by Girolami (1997) by choosing negentropy as a projection pursuit index. Parameterized probability distributions that have sub- and supergaussian regimes were used to derive a general learning rule that preserves the simple architecture proposed by Bell and Sejnowski (1995), is optimized using the natural gradient by Amari (1998), and uses the stability analysis of Cardoso and Laheld (1996) to switch between sub- and supergaussian regimes. We demonstrate that the extended infomax algorithm is able to separate 20 sources with a variety of source distributions easily. Applied to high-dimensional data from electroencephalographic recordings, it is effective at separating artifacts such as eye blinks and line noise from weaker electrical signals that arise from sources in the brain.

Blind Source Separation TechniquesEEG and Brain-Computer InterfacesNeural dynamics and brain functionInfomaxIndependent component analysisNegentropyAlgorithmStability (learning theory)Parameterized complexitySimple (philosophy)Models of neural computationArtificial intelligencePattern recognition (psychology)

MeSH terms

AlgorithmsBlinkingBrainElectroencephalographyHumansModels, StatisticalNormal DistributionArtifacts

Funding

  • Howard Hughes Medical Institute
Citations
1,959
FWCI
40.27
field-weighted impact
References
59
Percentile
100%
vs. same field & year
Citations per year
Cited by
Dictionary Learning Algorithms for Sparse Representation
Neural Computation · 2003 · 838 citations
Brain Computer Interfaces, a Review
Sensors · 2012 · 2,030 citations
Natural Gradient Works Efficiently in Learning
Neural Computation · 1998 · 2,666 citations
Face recognition by independent component analysis
IEEE Transactions on Neural Networks · 2002 · 1,928 citations
Independent component analysis: algorithms and applications
Neural Networks · 2000 · 8,703 citations
References
Natural Gradient Works Efficiently in Learning
Neural Computation · 1998 · 2,666 citations
Equivariant adaptive source separation
IEEE Transactions on Signal Processing · 1996 · 1,350 citations
A Fast Fixed-Point Algorithm for Independent Component Analysis
Neural Computation · 1997 · 3,396 citations
Blind signal separation: statistical principles
Proceedings of the IEEE · 1998 · 1,859 citations
Independent component analysis: algorithms and applications
Neural Networks · 2000 · 8,703 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.