Exploring multi-answer visual question answering with object detection: a systematic review

Nidaul Hasanati, Taufik Djatna, Imas Sukaesih Sitanggang, Arif Imam Suroso

Abstract


Visual question answering (VQA) is a challenging research area that enables machines to answer natural language questions based on visual content by jointly understanding images and text. Conventional VQA systems typically produce a single answer for each image–question pair. However, many real world visual questions are ambiguous or complex, allowing multiple valid answers to exist. This systematic literature review (SLR) focuses on multi answer VQA systems and the use of object detection, following the PRISMA 2020 guidelines. We analyzed 58 peer-reviewed journal articles retrieved from the Scopus database published between 2020 and 2025. Ten of these studies clearly stated that generating multiple answers was their main goal. Forty-eight others indirectly supported answer variability by using object-based or multi-instance reasoning. Through this review, we examine the current methodologies for supporting multi-answer generation, including model architecture, datasets, and evaluation metrics. Most multi answer generation approaches utilize attention mechanisms, graph neural networks, and transformer-based models. Additionally, we propose a taxonomy of multi-answer VQA organized along four dimensions. Limitations are identified in datasets and evaluation metrics (i.e., answer ambiguity/subjectivity). Future research should focus on improving model interpretability and designing an evaluation framework that incorporates subjective and context-sensitive responses.

Keywords


Multi-answer; Multi-label; Multiple answers; Object detection; Systematic review; Visual question answering

Full Text:

PDF


DOI: http://doi.org/10.11591/ijict.v15i3.pp1097-1114

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Nidaul Hasanati, Taufik Djatna, Imas Sukaesih Sitanggang, Arif Imam Suroso

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

The International Journal of Informatics and Communication Technology (IJ-ICT)
p-ISSN 2252-8776, e-ISSN 2722-2616
This journal is published by the Intelektual Pustaka Media Utama (IPMU).

Web Analytics View IJICT Stats