Title :
Simple explanation of the no free lunch theorem of optimization
Author :
Ho, Yu-chi ; Pepyne, David L.
Author_Institution :
Div. of Eng. & Appl. Sci., Harvard Univ., Cambridge, MA, USA
Abstract :
The no free lunch theorem of optimization (NFLT) is an impossibility theorem telling us that a general-purpose universal optimization strategy is impossible, and the only way one strategy can outperform another is if it is specialized to the structure of the specific problem under consideration. Since virtually all decision and control problems can be cast as optimization problems, an appreciation of the NFLT and its consequences is essential for control engineers. We present a framework for conceptualizing optimization problems that leads useful insights and a simple explanation of the NFLT
Keywords :
matrix algebra; optimisation; general-purpose universal optimization strategy; impossibility theorem; no free lunch theorem; Centralized control; Contracts; Mathematics; Military computing; Space exploration; Traveling salesman problems;
Conference_Titel :
Decision and Control, 2001. Proceedings of the 40th IEEE Conference on
Conference_Location :
Orlando, FL
Print_ISBN :
0-7803-7061-9
DOI :
10.1109/.2001.980896