Scinovex
articleTop 1% cited

Local Computations with Probabilities on Graphical Structures and Their Application to Expert Systems

Steffen L. LauritzenDavid J. Spiegelhalter

Abstract

SUMMARY A causal network is used in a number of areas as a depiction of patterns of ‘influence’ among sets of variables. In expert systems it is common to perform ‘inference’ by means of local computations on such large but sparse networks. In general, non-probabilistic methods are used to handle uncertainty when propagating the effects of evidence, and it has appeared that exact probabilistic methods are not computationally feasible. Motivated by an application in electromyography, we counter this claim by exploiting a range of local representations for the joint probability distribution, combined with topological changes to the original network termed ‘marrying’ and ‘filling-in‘. The resulting structure allows efficient algorithms for transfer between representations, providing rapid absorption and propagation of evidence. The scheme is first illustrated on a small, fictitious but challenging example, and the underlying theory and computational aspects are then discussed.

Bayesian Modeling and Causal InferenceAI-based Problem Solving and PlanningLogic, Reasoning, and KnowledgeComputationGraphical modelComputer scienceExpert systemStatistical physicsTheoretical computer scienceAlgorithmArtificial intelligencePhysics
Citations
3,933
FWCI
107.74
field-weighted impact
References
164
Percentile
100%
vs. same field & year
Citations per year
Cited by
Turbo decoding as an instance of Pearl's "belief propagation" algorithm
IEEE Journal on Selected Areas in Communications · 1998 · 907 citations
A Unifying Review of Linear Gaussian Models
Neural Computation · 1999 · 877 citations
Link prediction techniques, applications, and performance: A survey
Physica A Statistical Mechanics and its Applications · 2020 · 496 citations
Good error-correcting codes based on very sparse matrices
IEEE Transactions on Information Theory · 1999 · 3,695 citations
Factorial Hidden Markov Models
Machine Learning · 1997 · 1,178 citations
EXPERT SYSTEMS WITH APPLICATIONS
Expert Systems with Applications · 2004 · 1,660 citations
References
Conditional Independence in Statistical Theory
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1979 · 1,517 citations
Learning representations by back-propagating errors
Nature · 1986 · 30,045 citations
Optimal Statistical Decisions.
Journal of the American Statistical Association · 1972 · 3,492 citations
Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
IEEE Transactions on Pattern Analysis and Machine Intelligence · 1984 · 17,882 citations
Evaluating Influence Diagrams
Operations Research · 1986 · 1,266 citations
The Statistical Analysis of Compositional Data
Technometrics · 1988 · 3,414 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.

Local Computations with Probabilities on Graphical Structures and Their Application to Expert Systems · Scinovex