SPIE - Education ROC Analysis and Observer Studies to Evaluate Imaging Technology SC1127

Short of a clinical trial, observer studies are used to measure the performance of radiologists and to compare different imaging technologies with the aim of understanding how the technology might be used clinically. The goal of this course is to provide guidance on how to design, conduct, and analyze an observer study. We will examine how to plan an observer study, step by step, and then how to implement the plan in detail. The focus will be on pitfalls and common mistakes. We will review basic ROC analysis and commonly used methods for analyzing multireader, multicase (MRMC) ROC observer data. Related software and sample-size estimation will also be discussed and demonstrated using real datasets. The participants will take part in some simulated reader studies using a computer interface, compete for prizes, and depart with a better understanding of reader studies of diagnostic imaging devices.