Scinovex
articleTop 10% cited

Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm

IEEE Transactions on Signal Processing · 1997 · Vol. 45(3) · pp. 600–616
I.F. GorodnitskyBhaskar D. Rao

Abstract

We present a nonparametric algorithm for finding localized energy solutions from limited data. The problem we address is underdetermined, and no prior knowledge of the shape of the region on which the solution is nonzero is assumed. Termed the FOcal Underdetermined System Solver (FOCUSS), the algorithm has two integral parts: a low-resolution initial estimate of the real signal and the iteration process that refines the initial estimate to the final localized energy solution. The iterations are based on weighted norm minimization of the dependent variable with the weights being a function of the preceding iterative solutions. The algorithm is presented as a general estimation tool usable across different applications. A detailed analysis laying the theoretical foundation for the algorithm is given and includes proofs of global and local convergence and a derivation of the rate of convergence. A view of the algorithm as a novel optimization method which combines desirable characteristics of both classical optimization and learning-based algorithms is provided. Mathematical results on conditions for uniqueness of sparse solutions are also given. Applications of the algorithm are illustrated on problems in direction-of-arrival (DOA) estimation and neuromagnetic imaging.

Sparse and Compressive Sensing TechniquesNumerical methods in inverse problemsPhotoacoustic and Ultrasonic ImagingUnderdetermined systemAlgorithmCompressed sensingSolverNorm (philosophy)MathematicsUniquenessConvergence (economics)Mathematical optimizationComputer science
Citations
1,821
FWCI
6.82
field-weighted impact
References
34
Percentile
98%
vs. same field & year
Citations per year
Cited by
A sparse signal reconstruction perspective for source localization with sensor arrays
IEEE Transactions on Signal Processing · 2005 · 2,559 citations
Dictionary Learning Algorithms for Sparse Representation
Neural Computation · 2003 · 838 citations
A Fast Approach for Overcomplete Sparse Decomposition Based on Smoothed $\ell ^{0}$ Norm
IEEE Transactions on Signal Processing · 2008 · 1,084 citations
An Empirical Bayesian Strategy for Solving the Simultaneous Sparse Approximation Problem
IEEE Transactions on Signal Processing · 2007 · 899 citations
Structured Compressed Sensing: From Theory to Applications
IEEE Transactions on Signal Processing · 2011 · 1,131 citations
Stable recovery of sparse overcomplete representations in the presence of noise
IEEE Transactions on Information Theory · 2005 · 2,215 citations
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
IEEE Transactions on Signal Processing · 2006 · 9,439 citations
Sparse Reconstruction by Separable Approximation
IEEE Transactions on Signal Processing · 2009 · 1,889 citations
References
Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
IEEE Transactions on Pattern Analysis and Machine Intelligence · 1984 · 17,882 citations
Neuromagnetic source imaging with FOCUSS: a recursive weighted minimum norm algorithm
Electroencephalography and Clinical Neurophysiology · 1995 · 575 citations
Matching pursuits with time-frequency dictionaries
IEEE Transactions on Signal Processing · 1993 · 9,047 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.