Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering - Artificial Intelligence Applications and Innovations Access content directly
Conference Papers Year : 2020

Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering

Abstract

Question Answering (QA) and Question Generation (QG) have been subjects of an intensive study in recent years and much progress has been made in both areas. However, works on combining these two topics mainly focus on how QG can be used to improve QA results. Through existing Natural Language Processing (NLP) techniques, we have implemented a tool that addresses these two topics separately. We further use them jointly in a pipeline. Thus, our goal is to understand how these modules can help each other. For QG, our methodology employs a detailed analysis of the relevant content of a sentence through Part-of-speech (POS) tagging and Named Entity Recognition (NER). Ensuring loose coupling with the QA task, in the latter we use Information Retrieval to rank sentences that might contain relevant information regarding a certain question, together with Open Information Retrieval to analyse the sentences. In its current version, the QG tool takes a sentence to formulate a simple question. By connecting QG with the QA component, we provide a means to effortlessly generate a test set for QA. While our current QA approach shows promising results, when enhancing the QG component we will, in the future, provide questions for which a more elaborated QA will be needed. The generated QA datasets contribute to QA evaluation, while QA proves to be an important technique for assessing the ambiguity of the questions.
Fichier principal
Vignette du fichier
500087_1_En_33_Chapter.pdf (380.63 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04060662 , version 1 (06-04-2023)

Licence

Attribution

Identifiers

Cite

Pedro Azevedo, Bernardo Leite, Henrique Lopes Cardoso, Daniel Castro Silva, Luís Paulo Reis. Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering. 16th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2020, Neos Marmaras, Greece. pp.396-407, ⟨10.1007/978-3-030-49186-4_33⟩. ⟨hal-04060662⟩
9 View
7 Download

Altmetric

Share

Gmail Facebook X LinkedIn More