SPIE - Education Evaluating Imaging Technology Using Observer Performance SC357

The tutorial provides a framework for dealing with problems in imaging technology evaluation using performance measures. The use of receiver operating characteristic (ROC) analysis for describing decision accuracy is covered in some detail. Experimental design and data analysis using the ROC, AFROC and LROC approaches are included. The advantages and limitations of each method are discussed. Examples are drawn from a variety of diagnostic tasks including the evaluation of display stations and of computer aided diagnosis (CAD). The analysis of agreement and reliability using mixture distribution analysis is discussed briefly.