Scinovex
articleTop 1% cited

Adapting to Unknown Smoothness via Wavelet Shrinkage

Journal of the American Statistical Association · 1995 · Vol. 90(432) · pp. 1200–1224
David L. DonohoIain M. Johnstone

Abstract

Abstract We attempt to recover a function of unknown smoothness from noisy sampled data. We introduce a procedure, SureShrink, that suppresses noise by thresholding the empirical wavelet coefficients. The thresholding is adaptive: A threshold level is assigned to each dyadic resolution level by the principle of minimizing the Stein unbiased estimate of risk (Sure) for threshold estimates. The computational effort of the overall procedure is order N · log(N) as a function of the sample size N. SureShrink is smoothness adaptive: If the unknown function contains jumps, then the reconstruction (essentially) does also; if the unknown function has a smooth piece, then the reconstruction is (essentially) as smooth as the mother wavelet will allow. The procedure is in a sense optimally smoothness adaptive: It is near minimax simultaneously over a whole interval of the Besov scale; the size of this interval depends on the choice of mother wavelet. We know from a previous paper by the authors that traditional smoothing methods—kernels, splines, and orthogonal series estimates—even with optimal choices of the smoothing parameter, would be unable to perform in a near-minimax way over many spaces in the Besov scale. Examples of SureShrink are given. The advantages of the method are particularly evident when the underlying function has jump discontinuities on a smooth background.

Image and Signal Denoising MethodsReservoir Engineering and Simulation MethodsSeismic Imaging and Inversion TechniquesMinimaxSmoothnessWaveletMathematicsClassification of discontinuitiesSmoothingThresholdingFunction (biology)Mathematical optimizationInterval (graph theory)
Citations
4,299
FWCI
52.05
field-weighted impact
References
36
Percentile
100%
vs. same field & year
Citations per year
Cited by
Wavelet-based statistical signal processing using hidden Markov models
IEEE Transactions on Signal Processing · 1998 · 1,647 citations
Minimax estimation via wavelet shrinkage
The Annals of Statistics · 1998 · 1,014 citations
Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency
IEEE Transactions on Signal Processing · 2002 · 1,007 citations
Wavelet transform based on inner product in fault diagnosis of rotating machinery: A review
Mechanical Systems and Signal Processing · 2015 · 506 citations
Density estimation by wavelet thresholding
The Annals of Statistics · 1996 · 765 citations
Wavelet Shrinkage: Asymptopia?
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 1,739 citations
References
Wavelet Shrinkage: Asymptopia?
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995 · 1,739 citations
Robust Locally Weighted Regression and Smoothing Scatterplots
Journal of the American Statistical Association · 1979 · 10,804 citations
Minimax estimation via wavelet shrinkage
The Annals of Statistics · 1998 · 1,014 citations
Optimal Global Rates of Convergence for Nonparametric Regression
The Annals of Statistics · 1982 · 1,497 citations
Estimation of the Mean of a Multivariate Normal Distribution
The Annals of Statistics · 1981 · 2,732 citations
Multivariate Adaptive Regression Splines
The Annals of Statistics · 1991 · 8,036 citations
Theory of Point Estimation
Technometrics · 1999 · 4,285 citations
A theory for multiresolution signal decomposition: the wavelet representation
IEEE Transactions on Pattern Analysis and Machine Intelligence · 1989 · 20,882 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.