DocumentCode
2568273
Title
Bernoulli´s principle of insufficient reason and conservation of information in computer search
Author
Dembski, William A. ; Marks, Robert J.
Author_Institution
Southwestern Baptist Theological Seminary, Fort Worth, TX, USA
fYear
2009
fDate
11-14 Oct. 2009
Firstpage
2647
Lastpage
2652
Abstract
Conservation of information (COI) popularized by the no free lunch theorem is a great leveler of search algorithms, showing that on average no search outperforms any other. Yet in practice some searches appear to outperform others. In consequence, some have questioned the significance of COI to the performance of search algorithms. An underlying foundation of COI is Bernoulli´s Principle of Insufficient Reason(PrOIR) which imposes of a uniform distribution on a search space in the absence of all prior knowledge about the search target or the search space structure. The assumption is conserved under mapping. If the probability of finding a target in a search space is p, then the problem of finding the target in any subset of the search space is p. More generally, all some-to-many mappings of a uniform search space result in a new search space where the chance of doing better than p is 50-50. Consequently the chance of doing worse is 50-50. This result can be viewed as a confirming property of COI. To properly assess the significance of the COI for search, one must completely identify the precise sources of information that affect search performance. This discussion leads to resolution of the seeming conflict between COI and the observation that some search algorithms perform well on a large class of problems.
Keywords
information retrieval; search problems; computer search; conservation of information; no free lunch theorem; principle of insufficient reason; search algorithms; search target; uniform search space distribution; Computer science; Cybernetics; Entropy; Information resources; Optimization methods; Robustness; USA Councils; Bernoulli´s principle of insufficient reason; Bernoulli´s principle of non-sufficient reason; Bertrand´s paradox; active information; conservation of generalization performance; conservation of information; endogenous information; equal distribution of ignorance; evolutionary search; no free lunch theorem; principle of indifference; uniform distribution;
fLanguage
English
Publisher
ieee
Conference_Titel
Systems, Man and Cybernetics, 2009. SMC 2009. IEEE International Conference on
Conference_Location
San Antonio, TX
ISSN
1062-922X
Print_ISBN
978-1-4244-2793-2
Electronic_ISBN
1062-922X
Type
conf
DOI
10.1109/ICSMC.2009.5346119
Filename
5346119
Link To Document