1 code implementation • 16 May 2022 • Thomas Eiter, Nelson Higuera, Johannes Oetsch, Michael Pritz
Our pipeline covers (i) training neural networks for object classification and bounding-box prediction of the CLEVR scenes, (ii) statistical analysis on the distribution of prediction values of the neural networks to determine a threshold for high-confidence predictions, and (iii) a translation of CLEVR questions and network predictions that pass confidence thresholds into logic programs so that we can compute the answers using an ASP solver.
no code implementations • AAAI Workshop CLeaR 2022 • Thomas Eiter, Nelson Nicolas Higuera, Johannes Oetsch, Michael Pritz
We present a neuro-symbolic visual question answering (VQA) approach for the CLEVR dataset that is based on the combination of deep neural networks and answer-set programming (ASP), a logic-based paradigm for declarative problem solving.