OLAC Record oai:www.ldc.upenn.edu:LDC2019T17

Metadata
Title:		TAC KBP Cold Start - Comprehensive Evaluation Data 2012-2017
Access Rights:		Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining
Bibliographic Citation:		Ellis, Joe, Jeremy Getman, and Stephanie Strassel. TAC KBP Cold Start - Comprehensive Evaluation Data 2012-2017 LDC2019T17. Web Download. Philadelphia: Linguistic Data Consortium, 2019
Contributor:		Ellis, Joe
		Getman, Jeremy
		Strassel, Stephanie
Date (W3CDTF):		2019
Date Issued (W3CDTF):		2019-11-15
Description:		*Introduction* TAC KBP Cold Start - Comprehensive Evaluation Data 2012-2017 was developed by the Linguistic Data Consortium (LDC) and contains Chinese, English and Spanish data produced in support of the TAC KBP Cold Start evaluation track conducted from 2012 to 2017. This includes source documents, queries, assessments, manual runs and final assessments. Text Analysis Conference (TAC) is a series of workshops organized by the National Institute of Standards and Technology (NIST). TAC was developed to encourage research in natural language processing and related applications by providing a large test collection, common evaluation procedures, and a forum for researchers to share their results. Through its various evaluations, the Knowledge Base Population (KBP) track of TAC encourages the development of systems that can match entities mentioned in natural texts with those appearing in a knowledge base and extract novel information about entities from a document collection and add it to a new or existing knowledge base. In the Cold Start track, systems were evaluated on their ability to construct a new knowledge base (KB) from information provided in a text collection in combination with technologies developed in other TAC KBP tracks -- slot filling, information extraction, question answering and entity discovery & linking. Specifically, Cold Start systems were required to find all entities in the text, and the KB must have ideally included every person, organization, and geo-political entity as well as all of the targeted relations between them. To facilitate the evaluation of those KBs, LDC annotators created sets of queries, human-generated responses to the queries, and assessments of both human and system responses. More information about Cold Start and other TAC KBP evaluations can be found on the NIST TAC website. *Data* The source data in this release is comprised of English and Spanish newswire and web text collected by LDC that was used in the 2012, 2014 and 2015 evaluations and in the 2016 pilot collection. The source collections for the 2016 and 2017 evaluations, which also includes Chinese data, are available in TAC KBP Evaluation Source Corpora 2016-2017 (LDC2019T12). The archived 2013 Cold Start source data collection is available from NIST upon request. Queries are presented in XML, while all other documents are plain text. All text data is encoded as UTF-8. Tools provided by the evaluation track coordinators are also included. *Acknowledgement* This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorised to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government. *Samples* Please view the following samples * Query * Source * Assessment * Manual Run *Updates* None at this time.
Extent:		Corpus size: 1245487 KB
Identifier:		LDC2019T17
		https://catalog.ldc.upenn.edu/LDC2019T17
		ISBN: 1-58563-908-7
		ISLRN: 535-918-219-858-1
		DOI: 10.35111/h7h3-zk92
Language:		Mandarin Chinese
		English
		Spanish
Language (ISO639):		cmn
		eng
		spa
License:		LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf
Medium:		Distribution: Web Download
Publisher:		Linguistic Data Consortium
Publisher (URI):		https://www.ldc.upenn.edu
Relation (URI):		https://catalog.ldc.upenn.edu/docs/LDC2019T17
Rights Holder:		Portions © 2007-2010 Agence France Presse, © 2000, 2007-2010 The Associated Press, © 2007, 2009-2010 China News Agency (Taiwan), © 2007-2009 Los Angeles Times-Washington Post, © 2007-2010, 2013 New York Times,© 2010 Washington Post Bloomberg, © 2007-2010, 2013 Xinhua News Agency,© 2003, 2005, 2006, 2007, 2009, 2011, 2018, 2019 Trustees of the University of Pennsylvania
Type (DCMI):		Text
Type (OLAC):		primary_text
OLAC Info
Archive:		The LDC Corpus Catalog
Description:		http://www.language-archives.org/archive/www.ldc.upenn.edu
GetRecord:		OAI-PMH request for OLAC format
GetRecord:		Pre-generated XML file
OAI Info
OaiIdentifier:		oai:www.ldc.upenn.edu:LDC2019T17
DateStamp:		2020-11-30
GetRecord:		OAI-PMH request for simple DC format
Search Info
Citation:		Ellis, Joe; Getman, Jeremy; Strassel, Stephanie. 2019. Linguistic Data Consortium.
Terms:		area_Asia area_Europe country_CN country_ES country_GB dcmi_Text iso639_cmn iso639_eng iso639_spa olac_primary_text