Resource allocation: Sequential design for analyses involving several types of data

In analyzing the reliability of complex systems, several types of data from full-system tests to component level tests are commonly available and are used. After a preliminary analysis, additional resources may be available and we wish to identify the best new data to collect to maximally improve the prediction of system reliability. In this paper we present methodology for selection of an appropriate criteria for choosing between different allocations, and how to determine what new data should be collected to improve our understanding of the response. Issues discussed including computational efficiency of the methodt, discrepancies between reliability estimate from individual data sources and incorporating cost into a comparison of different data types.