Improved sentence retrieval using local context and sentence length |
| |
| Authors: | Alen Doko Maja Štula Ljiljana Šeri? |
| |
| Institution: | 1. JP Croatian Telecommunications d.o.o. Mostar, Kralja Tvrtka 18, Mostar, Bosnia and Herzegovina;2. Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, University of Split, R. Boškovi?a 32, Split, Croatia |
| |
| Abstract: | In this paper we propose improved variants of the sentence retrieval method TF–ISF (a TF–IDF or Term Frequency–Inverse Document Frequency variant for sentence retrieval). The improvement is achieved by using context consisting of neighboring sentences and at the same time promoting the retrieval of longer sentences. We thoroughly compare new modified TF–ISF methods to the TF–ISF baseline, to an earlier attempt to include context into TF–ISF named tfmix and to a language modeling based method that uses context and promoting retrieval of long sentences named 3MMPDS. Experimental results show that the TF–ISF method can be improved using local context. Results also show that the TF–ISF method can be improved by promoting the retrieval of longer sentences. Finally we show that the best results are achieved when combining both modifications. All new methods (TF–ISF variants) also show statistically significant better results than the other tested methods. |
| |
| Keywords: | Sentence retrieval TF&ndash ISF Context Sentence length |
| 本文献已被 ScienceDirect 等数据库收录！ |
