Speech-assisted radiology system for retrieval, reporting and annotation

We present a system capable of interpreting speech commands given by a radiologist in order to accurately diagnose a set of findings and impressions for medical images, such as MRI, CT, PET, etc. The system is also extended to interpret search cues from speech in order to retrieve previously annotated images and previously diagnosed patients, enabling computer aided differential diagnosis (CADD). This system uses advanced radiology techniques such as structured reporting and PACS to help radiologists by providing a natural and configurable spoken English interface. Finally, we experimentally show that the system provides a significant improvement in accuracy over existing methods.