oai:www.ldc.upenn.edu:LDC2003T16
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2003T16 |
| Metadata | ||
| Title: | SummBank 1.0 | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Radev, Dragomir, et al. SummBank 1.0 LDC2003T16. Web Download. Philadelphia: Linguistic Data Consortium, 2003 | |
| Contributor: | Radev, Dragomir | |
| Teufel, Simone | ||
| Saggion, Horacio | ||
| Lam, Wai | ||
| Blitzer, John | ||
| Celebi, Arda | ||
| Drabek, Elliott | ||
| Liu, Danyu | ||
| Qi, Hong | ||
| Allison, Tim | ||
| Date (W3CDTF): | 2003 | |
| Date Issued (W3CDTF): | 2003-12-18 | |
| Description: | *Introduction* SummBank 1.0 was produced by the Linguistic Data Consortium (LDC) and contains 40 news clusters in English and Chinese, 360 multi-document, human-written summaries, and nearly 2 million single document and multi-document extracts created by automatic and manual methods. The data was created for the Summer 2001 Johns Hopkins University Workshop which focused on text summarization in a cross-lingual information retrieval framework. The goal was to gather a corpus of original documents and summaries for use as gold standards by the documents summarization community. *Data* In the summer of 2001, researchers gathered at Johns Hopkins to study cross-lingual text summarization. LDC supplied this group with a corpus of 18,147 bilingual document pairs covering 1997-2000 from the Hong Kong News Parallel Text (LDC2000T46) corpus. These document pairs were used in single-document summarization experiments. However, LDC also created 40 clusters of news articles from this corpus for use in multi-document summarization experiments. LDC had annotators create 40 queries (“Y2K readiness”, “Flower shows”, etc.) which they used in their own information retrieval engine to select candidate sets of documents. Human judges then selected the ten most relevant documents for each cluster. In addition to providing the raw documents and clusters of documents, LDC had human annotators judge each sentence’s relevance to its cluster’s query. The judges used a scale of 0 (not relevant at all) to 10 (very relevant). There were a total of five human judges on this project, and each sentence was judged by 3 judges. These scores were used to judge a summarizer’s performance and to create automatic extractive summaries. Finally, the judges were also asked to write summaries at various compression rates for each cluster. This distribution includes roughly two million text files, totalling approximately 13GB uncompressed. The text files are encoded either as UTF-8 for English or GB or Big-5 for Chinese. MEAD was the summarizer that was reimplemented and upgraded during the workshop; versions of the software are available from the MEAD website. *Samples* For an example of the data in this corpus, please view this sample (). *Updates* Additional information, updates, bug fixes may be available on the SummBank website. | |
| Extent: | Corpus size: 17825792 KB | |
| Identifier: | LDC2003T16 | |
| https://catalog.ldc.upenn.edu/LDC2003T16 | ||
| ISBN: 1-58563-274-0 | ||
| ISLRN: 352-475-235-734-5 | ||
| DOI: 10.35111/7v71-fh28 | ||
| Language: | Yue Chinese | |
| English | ||
| Language (ISO639): | yue | |
| eng | ||
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2003T16 | |
| Rights Holder: | Portions © 1997-2000 The Government of the Hong Kong Special Administrative Region (HKSAR), © 2000, 2003 Trustees of the University of Pennsylvania | |
| Type (DCMI): | Text | |
| Type (OLAC): | primary_text | |
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2003T16 | |
| DateStamp: | 2024-09-04 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Radev, Dragomir; Teufel, Simone; Saggion, Horacio; Lam, Wai; Blitzer, John; Celebi, Arda; Drabek, Elliott; Liu, Danyu; Qi, Hong; Allison, Tim. 2003. Linguistic Data Consortium. | |
| Terms: | area_Asia area_Europe country_CN country_GB dcmi_Text iso639_eng iso639_yue olac_primary_text | |