oai:www.ldc.upenn.edu:LDC2001T58
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2001T58 |
| Metadata | ||
| Title: | TDT3 Multilanguage Text Version 2.0 | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Graff, David, Christopher Cieri, and Stephanie Strassel. TDT3 Multilanguage Text Version 2.0 LDC2001T58. Web Download. Philadelphia: Linguistic Data Consortium, 2001 | |
| Contributor: | Graff, David | |
| Cieri, Christopher | ||
| Strassel, Stephanie | ||
| Date (W3CDTF): | 2001 | |
| Description: | *Introduction* Topic Detection and Tracking (TDT) refers to automatic techniques for finding topically related material in streams of data such as newswire and broadcast news. The TDT3 corpus was created to support three TDT3 tasks: to find topically homogeneous sections (segmentation), to detect the occurrence of new events (detection) and to track the reoccurrence of old or new events (tracking). *Data* TDT3 Multilanguage Text Corpus Version 2.0 is the first general release of this collection (Version 1.0 was made available only to participants in the TDT 1999 and 2000 evaluation tests). It contains data from the same nine sources found in TDT2, plus two additional English television sources. Like TDT2, it provides both manually-created and automatically-generated text for most sources. For TDT3, the daily collection took place over a period of three months (October - December 1998). The sources and approximate number of stories per source are as follows: English sources Thousands of stories New York Times Newswire Service 6.9 Associated Press Worldstream Service 7.3 Cable News Network, "Headline News" 9.0 American Broadcasting Co., "World News Tonight" 1.0 Public Radio International, "The World" 1.6 Voice of America, English news programs 3.9 MS-NBC, "News with Brian Williams" 0.7 National Broadcasting Co., "NBC Nightly News" 0.8 Total English stories: 31.2 thousand Mandarin sources Thousands of stories Xinhua News Agency 5.2 Zaobao News Agency 3.8 Voice of America, Mandarin Chinese news programs 3.8 Total Mandarin stories: 12.8 thousand The goal of Topic Detection and Tracking - Phase 3 (TDT3) is to create core technology to monitor multiple streams of news in multiple languages and media (newswire, radio, television, web sites or some future combination or innovation), segmenting the streams into individual stories, detecting new topics and tracking all stories discussing them. In additional to the TDT2 tasks of segmentation, detection and tracking, TDT3 adds the tasks of first story detection and story-link detection. The goal of the latter is to detect links between stories that discuss the same topic even though the topic has not been defined in advance. There are two types of files in this publication: asr_sgm -- text data output from automatic speech recognition (ASR) systems in English and Mandarin, formatted in "TIPSTER- style" SGML, derived from the audio recordings of radio and TV broadcasts. tkn_sgm -- reference text data (newswire, closed captions and manual transcripts), formatted in "TIPSTER-style" SGML *Samples* Please view this asr_sgm sample and tkn_sgm sample. *Updates* 07/21/16 - Topic tables added. 07/01/16 - Topic tables updated to v4.0. | |
| Extent: | Corpus size: 371712 KB | |
| Identifier: | LDC2001T58 | |
| https://catalog.ldc.upenn.edu/LDC2001T58 | ||
| ISBN: 1-58563-193-0 | ||
| ISLRN: 567-570-426-915-3 | ||
| DOI: 10.35111/psn9-3h87 | ||
| Language: | English | |
| Mandarin Chinese | ||
| Language (ISO639): | eng | |
| cmn | ||
| License: | LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2001T58 | |
| Rights Holder: | Portions © 1998 American Broadcasting Company, The Associated Press, Cable News Network, LP, LLLP, National Broadcasting Company, Inc., New York Times, Public Radio International, SPH AsiaOne Ltd, Xinhua News Agency, © 1998-2001 Trustees of the University of Pennsylvania The World is a co-production of Public Radio International and the British Broadcasting Corporation and is produced at WGBH Boston. | |
| Type (DCMI): | Text | |
| Type (OLAC): | primary_text | |
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2001T58 | |
| DateStamp: | 2020-11-30 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Graff, David; Cieri, Christopher; Strassel, Stephanie. 2001. Linguistic Data Consortium. | |
| Terms: | area_Asia area_Europe country_CN country_GB dcmi_Text iso639_cmn iso639_eng olac_primary_text | |