Title :
Bernoulli´s principle of insufficient reason and conservation of information in computer search
Author :
Dembski, William A. ; Marks, Robert J.
Author_Institution :
Southwestern Baptist Theological Seminary, Fort Worth, TX, USA
Abstract :
Conservation of information (COI) popularized by the no free lunch theorem is a great leveler of search algorithms, showing that on average no search outperforms any other. Yet in practice some searches appear to outperform others. In consequence, some have questioned the significance of COI to the performance of search algorithms. An underlying foundation of COI is Bernoulli´s Principle of Insufficient Reason(PrOIR) which imposes of a uniform distribution on a search space in the absence of all prior knowledge about the search target or the search space structure. The assumption is conserved under mapping. If the probability of finding a target in a search space is p, then the problem of finding the target in any subset of the search space is p. More generally, all some-to-many mappings of a uniform search space result in a new search space where the chance of doing better than p is 50-50. Consequently the chance of doing worse is 50-50. This result can be viewed as a confirming property of COI. To properly assess the significance of the COI for search, one must completely identify the precise sources of information that affect search performance. This discussion leads to resolution of the seeming conflict between COI and the observation that some search algorithms perform well on a large class of problems.
Keywords :
information retrieval; search problems; computer search; conservation of information; no free lunch theorem; principle of insufficient reason; search algorithms; search target; uniform search space distribution; Computer science; Cybernetics; Entropy; Information resources; Optimization methods; Robustness; USA Councils; Bernoulli´s principle of insufficient reason; Bernoulli´s principle of non-sufficient reason; Bertrand´s paradox; active information; conservation of generalization performance; conservation of information; endogenous information; equal distribution of ignorance; evolutionary search; no free lunch theorem; principle of indifference; uniform distribution;
Conference_Titel :
Systems, Man and Cybernetics, 2009. SMC 2009. IEEE International Conference on
Conference_Location :
San Antonio, TX
Print_ISBN :
978-1-4244-2793-2
Electronic_ISBN :
1062-922X
DOI :
10.1109/ICSMC.2009.5346119