Expressivity and Accuracy of By-Example Structured Queries on Wikipedia

Author

Atzori, Maurizio ; Zaniolo, Carlo

Author_Institution

Math/CS Dept., Univ. of Cagliari, Cagliari, Italy

fYear

2015

Firstpage

239

Lastpage

244

Abstract

This paper discusses expressivity and accuracy of the By-Example Structured (BESt) Query paradigm implemented on the SWiPE system through the Wikipedia interface. We define an experimental setting based on the natural language questions made available by the QALD-4 challenge, in which we compare SWiPE against Xser, a state-of-the-art Question Answering system, and plain keyword search provided by the Wikipedia Search Engine. The experiments show that SWiPE outperforms the results provided by Wikipedia, and it also performs sensibly better than Xser, obtaining an overall 85% of totally correct answers vs. 68% of Xser. Among all answered questions, we obtain a precision of 100% and recall 96%. SWiPE is also able to answer more questions than the other systems. A formal characterization of the set of SPARQL queries supported by the BESt Query paradigm is also provided.

Keywords

Web sites; natural language processing; query processing; question answering (information retrieval); search engines; BESt query paradigm; QALD-4 challenge; SPARQL queries; SWiPE system; Wikipedia interface; Wikipedia search engine; Xser; by-example structured queries; expressivity; natural language questions; plain keyword search; question answering system; Aggregates; Electronic publishing; Encyclopedias; Pattern matching; Resource description framework;

fLanguage

English

Publisher

ieee

Conference_Titel

Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE), 2015 IEEE 24th International Conference on

Conference_Location

Larnaca

Type

conf

DOI

10.1109/WETICE.2015.15

Filename

7194368