OLAC Record oai:www.ldc.upenn.edu:LDC2019T19

Metadata
Title:		TAC KBP Entity Discovery and Linking - Comprehensive Evaluation Data 2016-2017
Access Rights:		Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining
Bibliographic Citation:		Ellis, Joe, Jeremy Getman, and Stephanie Strassel. TAC KBP Entity Discovery and Linking - Comprehensive Evaluation Data 2016-2017 LDC2019T19. Web Download. Philadelphia: Linguistic Data Consortium, 2019
Contributor:		Ellis, Joe
		Getman, Jeremy
		Strassel, Stephanie
Date (W3CDTF):		2019
Date Issued (W3CDTF):		2019-12-05
Description:		*Introduction* TAC KBP Entity Discovery and Linking - Comprehensive Evaluation Data 2016-2017 was developed by the Linguistic Data Consortium (LDC) and contains training and evaluation data produced in support of the TAC KBP Entity Discovery and Linking (EDL) tasks in 2016 and 2017. It includes queries, knowledge base (KB) links, equivalence class clusters for NIL entities, and entity type information for each of the queries. The EDL reference KB, to which EDL data are linked, is available separately in TAC KBP Entity Discovery and Linking - Comprehensive Training and Evaluation Data 2014-2015 (LDC2019T02). Source documents referenced by the files in this package are available separately in TAC KBP Evaluation Source Corpora 2016-2017 (LDC2019T12). Text Analysis Conference (TAC) is a series of workshops organized by the National Institute of Standards and Technology (NIST). TAC was developed to encourage research in natural language processing and related applications by providing a large test collection, common evaluation procedures, and a forum for researchers to share their results. Through its various evaluations, the Knowledge Base Population (KBP) track of TAC encourages the development of systems that can match entities mentioned in natural texts with those appearing in a knowledge base and extract novel information about entities from a document collection and add it to a new or existing knowledge base. The goal of the Entity Discovery and Linking (EDL) track is to conduct end-to-end entity extraction, linking and clustering. For producing gold standard data, given a document collection, annotators (1) extract (identify and classify) entity mentions (queries), link them to nodes in a reference Knowledge Base (KB) and (2) perform cross-document co-reference on within-document entity clusters that cannot be linked to the KB. More information about the TAC KBP EDL task and other TAC KBP evaluations can be found on the NIST TAC website. *Data* Source data for the annotations in this corpus was Chinese, English and Spanish newswire and discussion forum text collected by LDC. The annotation files are presented as UTF-8 encoded tab delimited files. A summary of the data by year, task, and mentions is below: Year Task Mentions 2016 eval 24,373 2017 eval 25,040 *Acknowledgement* This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government. *Samples* Please view this sample. *Updates* None at this time.
Extent:		Corpus size: 3820 KB
Identifier:		LDC2019T19
		https://catalog.ldc.upenn.edu/LDC2019T19
		ISBN: 1-58563-910-9
		ISLRN: 733-869-870-645-2
		DOI: 10.35111/qex0-ny26
Language:		Mandarin Chinese
		English
		Spanish
Language (ISO639):		cmn
		eng
		spa
License:		LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf
Medium:		Distribution: Web Download
Publisher:		Linguistic Data Consortium
Publisher (URI):		https://www.ldc.upenn.edu
Relation (URI):		https://catalog.ldc.upenn.edu/docs/LDC2019T19
Rights Holder:		Portions © 2013 New York Times, © 2013 Xinhua News Agency, © 2013, 2018, 2019 Trustees of the University of Pennsylvania
Type (DCMI):		Text
Type (OLAC):		primary_text
OLAC Info
Archive:		The LDC Corpus Catalog
Description:		http://www.language-archives.org/archive/www.ldc.upenn.edu
GetRecord:		OAI-PMH request for OLAC format
GetRecord:		Pre-generated XML file
OAI Info
OaiIdentifier:		oai:www.ldc.upenn.edu:LDC2019T19
DateStamp:		2020-11-30
GetRecord:		OAI-PMH request for simple DC format
Search Info
Citation:		Ellis, Joe; Getman, Jeremy; Strassel, Stephanie. 2019. Linguistic Data Consortium.
Terms:		area_Asia area_Europe country_CN country_ES country_GB dcmi_Text iso639_cmn iso639_eng iso639_spa olac_primary_text