Scinovex
bookTop 1% cited

Dynamic Programming

Science · 1966 · Vol. 153(3731) · pp. 34–37
Richard Bellman

Abstract

Little has been done in the study of these intriguing questions, and I do not wish to give the impression that any extensive set of ideas exists that could be called a "theory." What is quite surprising, as far as the histories of science and philosophy are concerned, is that the major impetus for the fantastic growth of interest in brain processes, both psychological and physiological, has come from a device, a machine, the digital computer. In dealing with a human being and a human society, we enjoy the luxury of being irrational, illogical, inconsistent, and incomplete, and yet of coping. In operating a computer, we must meet the rigorous requirements for detailed instructions and absolute precision. If we understood the ability of the human mind to make effective decisions when confronted by complexity, uncertainty, and irrationality then we could use computers a million times more effectively than we do. Recognition of this fact has been a motivation for the spurt of research in the field of neurophysiology. The more we study the information processing aspects of the mind, the more perplexed and impressed we become. It will be a very long time before we understand these processes sufficiently to reproduce them. In any case, the mathematician sees hundreds and thousands of formidable new problems in dozens of blossoming areas, puzzles galore, and challenges to his heart's content. He may never resolve some of these, but he will never be bored. What more can he ask?

Economic theories and modelsUniquenessBottleneckComputer scienceFormalism (music)Mathematical economicsDynamic programmingMathematicsCalculus (dental)Mathematical optimizationAlgorithm
Citations
13,052
FWCI
1289.77
field-weighted impact
References
0
Percentile
100%
vs. same field & year
Citations per year
Cited by
Comparison and Evaluation of Methods for Liver Segmentation From CT Datasets
IEEE Transactions on Medical Imaging · 2009 · 1,115 citations
Dynamic Version of the Economic Lot Size Model
Management Science · 2004 · 2,076 citations
Conditional Choice Probabilities and the Estimation of Dynamic Models
The Review of Economic Studies · 1993 · 1,046 citations
Linear Programming: Foundations and Extensions
Journal of the Operational Research Society · 1998 · 912 citations
A unifying computational framework for motor control and social interaction
Philosophical Transactions of the Royal Society B Biological Sciences · 2003 · 1,224 citations
Related articles
The Mathematical Theory of Optimal Processes
Econometrica · 1965 · 4,258 citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25,702 citations
Markov Decision Processes: Discrete Stochastic Dynamic Programming.
Journal of the American Statistical Association · 1995 · 8,424 citations
Learning to Predict by the Methods of Temporal Differences
Machine Learning · 1988 · 3,908 citations
Dynamic Programming and Markov Processes.
Journal of the American Statistical Association · 1961 · 3,447 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.