no code implementations • CVPR 2017 • Zizhao Zhang, Yuanpu Xie, Fuyong Xing, Mason McGough, Lin Yang
In this paper, we propose MDNet to establish a direct multimodal mapping between medical images and diagnostic reports that can read images, generate diagnostic reports, retrieve images by symptom descriptions, and visualize attention, to provide justifications of the network diagnosis process.