:::

詳目顯示

回上一頁
題名:TREC現況及其對資訊檢索研究之影響
書刊名:圖書與資訊學刊
作者:江玉婷陳光華 引用關係
作者(外文):Chiang, Yu-tingChen, Kuang-hua
出版日期:1999
卷期:29
頁次:頁36-59
主題關鍵詞:評估資訊檢索測試集TRECEvaluationInformation retrievalTest collectionText REtrieval Conference
原始連結:連回原系統網址new window
相關次數:
  • 被引用次數被引用次數:期刊(3) 博士論文(0) 專書(0) 專書論文(0)
  • 排除自我引用排除自我引用:3
  • 共同引用共同引用:12
  • 點閱點閱:97
     測試集為一在規範化環境中測量資訊檢索效益的機制,研究者常藉著 它來改進資訊檢索系統。然而,過去所使用的測試集規模通常很小,無法有效 模擬真實的資訊檢索環境。自1992年起,一個稱為TREC(Text REtrieval Conference) 的評估會議每年在美國舉行。它是一個大型的實驗室測試機制, 可以比較不同檢索系統的效能,並提供一個論壇讓參與者相互切磋討論。今日, TREC在資訊檢索領域中已成為倍受矚目的標竿測試環境。本文試圖對TREC 作一個概覽性的介紹,包括它所使用的測試集、測量準則、測試項目及過去的 發展概況。另外,也透過一些相關文獻的分析,對TREC在資訊檢索評估領域 中的價值及所扮演的角色作一簡要的評述。
     Test Collection is a mechanism which is used to explore relative benefits of different retrieval system in a normalized environment, and researchers traditionally use it to improve their retrieval systems. However, for many cases in the past, the scale of Test Collection was quite small, thus it can not simulate the real state of information retrieval task. Since 1992, a series of annual benchmarking evaluation exercises, called TREC (Text REtrieval Conference), have launched in the USA. TREC experiments were designed to allow large-scale laboratory testing, compare the effectiveness and performance of different information retrieval techniques, and provide a forum for research groups to discuss their work together. Today, TREC has become the major experimental effort in the IR field. In this paper, we present an overview of TREC, the test collection, the test measures,, the main tasks and specific'tracks', and the development during the past six years. Besides, we also briefly review the performance and the evaluation of IR.
期刊論文
1.Burgin, Robert(1992)。Variations in Relevance Judgements and the Evaluation of Retrieval Performance。Information Processing and Management,28(5),619-627。  new window
2.Harter, Stephen P.、Hert, Carol A.(1997)。Evaluation of Information Retrieval Systems: Approaches, Issues, and Methods。Annual Review of Information Science and Technology,32,3-94。  new window
3.Callan, J. P.、Broglio, J.、Croft, W. B.(199505)。TREC and TIPSTER Experiments with INQUERY。Information Processing and Management,31(3),327-343。  new window
4.Belkin, N. J.(199505)。Combining the Evidence of Multiple Query Representations for Information Retrieval。Information Processing and Management,31(3),431-448。  new window
5.Harman, Donna K.(1998)。The Text REtrieval Conferences (TRECs), Providing a Test-Bed for Information Retrieval Systems。Bulletin of the American Society for Information Science,24(4),12-13。  new window
6.Wallis, Peter、Thom, James A.(1996)。Relevance Judgements for Assessing Recall。Information Processing and Management,32(3),273-286。  new window
7.Beaulieu, Micheline、Robertson, Stephen E.、Rasmussen, Edie M.(1996)。Evaluation Interactive System in TREC。Journal of the American Society for Information Science,47(1),85-94。  new window
8.Harter, Stephen P.(1996)。Variations in Relevance Assessments and the Measurement of Retrieval Effectiveness。Journal of American Society for Information Science,47(1),37-49。  new window
9.Shaw, William M.、Burgin, Robert、Howell, P.(1997)。Performance Standards and Evaluations in IR Test Collections : Vector-Space and Other Retrieval Models。Information Processing and Management,33(1),15-36。  new window
10.Smeaton, Alan F.、Harman, Donna(1997)。The TREC Experiments and Their Impact on Europe。Journal of Information Science,23(2),169-174。  new window
11.Sparck Jones, K.(1995)。Reflections on TREC。Information Processing & Management,31(3),291-314。  new window
12.Harter, S. P.(1996)。Variations in relevance assessments and the measurement of retrieval effectiveness。Journal of the American Society for Information Science,47(1),37-49。  new window
會議論文
1.Voorhees, Ellen M.、Harman, Donna K.(1997)。Overview of the Sixth Text REtrieval Conference (TREC-6)。The Sixth Text Retrieval Conference,(會議日期: November 19-21, 1997)。Gaithersburg, Maryland。  new window
2.Harman, Donna K.(1995)。Overview of the Fourth Text REtrieval Conference (TREC-4)。The Fourth Text REtrieval Conference,(會議日期: November 1-3, 1995)。Gaithersburg, Maryland。  new window
3.Callan, James P.、Croft, W. Bruce(1993)。An Evaluation of Query Processing Strategies Using the TIPSTER Collection。The 16th ACM-SIGIR International Conference on Research and Development in Information Retrieval,(會議日期: June-July 1, 1993)。Pittsburgh, USA。354。  new window
4.Voorhees, Ellen M.、Harman, Donna K.(1996)。Overview of the Fifth Text REtrieval Conference (TREC-5)。The Fifth Text Retrieval Conference,(會議日期: November 20-22. 1996)。Gaithersburg, Maryland。  new window
5.Voorhees, Ellen M.(1998)。Variations in Relevance Judgements and the Measurement of Retrieval Effectiveness。The 21st ACM-SIGIR International Conference on Research and Development in Information Retrieval--Melbourne,(會議日期: 1998/08/24-08/28)。Australia。  new window
6.Voorhees, Ellen M.、Harman, Donna. K.(1997)。Evaluation Techniques and Measures。The Sixth Text Retrieval Conference,(會議日期: November 19-21.1997)。Gaithersburg. Maryland。  new window
7.Lewis, David D.、Voorhees, Ellen M.、Harman, Donna K.(1996)。The TREC-5 Filtering Track。The Fifth Text REtrieval Conference,(會議日期: November 20-22, 1996)。Gaithersburg, Maryland。  new window
8.Jones, Karan Spark、Voorhees, Eellen M.、Harman, Donna K.(1997)。Summary Performance Comparisons TREC-2, TREC-3,TREC-4, TREC-5, TREC-6。The Sixth Text REtrieval Conference,(會議日期: November 19-21, 1997)。Gaithersburg, Maryland。  new window
圖書
1.黃慕萱(19960000)。資訊檢索中「相關」概念之研究。臺北:臺灣學生。new window  延伸查詢new window
其他
1.TREC-1 routing topics,http://trec.nist.gov/data/topics/trec6/topics.1-50.txt。  new window
2.TREC-3 adhoc topics,http://trec.nist.gov/data/topics/trec6/topics.151-200.txt。  new window
3.TREC-4 adhoc topics,http://trec.nist.gov/data/topics/trec6/topics.201-250.txt。  new window
4.Topic creation,http://trec.nist.gov/presentations/TREC6/ll.html。  new window
5.TREC-6 Routing Task Results,http://trec.nist.gov/pubs/trec6/t6_proceedings.html。  new window
6.What are the TREC-7 tracks?,http://trec.nist.gov/faq.html#Q9。  new window
圖書論文
1.Harman, Donna K.(1997)。The TREC Conference。Readings in Information Retrieval。San Francisco:Morgan Kaufmann Publishers, Inc.。  new window
2.Donna K. Harman(1994)。Overview of the Third Text REtrieval Conference (TREC-3)。Overview of the Sixth Text REtrieval Conference。  new window
 
 
 
 
第一頁 上一頁 下一頁 最後一頁 top