no code implementations • 10 Aug 2017 • Zizhao Zhang, Pingjun Chen, Manish Sapkota, Lin Yang
In this paper, we introduce the semantic knowledge of medical images from their diagnostic reports to provide an inspirational network training and an interpretable prediction mechanism with our proposed novel multimodal neural network, namely TandemNet.