NTCIR-2 as a Rosetta stone in laboratory experiments of IR systems |
| |
| Institution: | 1. Dept. of Structural Eng., NTNU- Norw. University of Science and Techn., 7491 Trondheim, Norway;2. Civil & Env. Eng., Eng. Quad. E-319, Princeton University, Princeton, NJ 08544, USA;3. Thayer School of Engineering, Dartmouth College, Hanover, NH 03755, USA |
| |
| Abstract: | This paper presents a laboratory based evaluation study of cross-language information retrieval technologies, utilizing partially parallel test collections, NTCIR-2 (used together with NTCIR-1), where Japanese–English parallel document collections, parallel topic sets and their relevance judgments are available. These enable us to observe and compare monolingual retrieval processes in two languages as well as retrieval across languages. Our experiments focused on (1) the Rosetta stone question (whether a partially parallel collection helps in cross-language information access or not?) and (2) two aspects of retrieval difficulties namely “collection discrepancy” and “query discrepancy”. Japanese and English monolingual retrieval systems are combined by dictionary based query translation modules so that a symmetrical bilingual evaluation environment is implemented. |
| |
| Keywords: | |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
