oai:www.ldc.upenn.edu:LDC2018T18
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2018T18 |
| Metadata | ||
| Title: | BOLT Information Retrieval Comprehensive Training and Evaluation | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Griffitt, Kira, and Stephanie Strassel. BOLT Information Retrieval Comprehensive Training and Evaluation LDC2018T18. Web Download. Philadelphia: Linguistic Data Consortium, 2018 | |
| Contributor: | Griffitt, Kira | |
| Strassel, Stephanie | ||
| Date (W3CDTF): | 2018 | |
| Date Issued (W3CDTF): | 2018-09-17 | |
| Description: | *Introduction* BOLT Information Retrieval Comprehensive Training and Evaluation was developed by the Linguistic Data Consortium (LDC) and consists of all data produced in support of the Information Retrieval (IR) task within the DARPA Broad Operational Language Translation (BOLT) Program, including annotations, source documents and scoring software. The BOLT program developed machine translation and information retrieval for less formal genres, focusing particularly on user-generated content. LDC supported BOLT by collecting informal data sources -- discussion forums, text messaging and chat -- in Chinese, Egyptian Arabic and English. The collected data was translated and annotated for various tasks including word alignment, treebanking, propbanking and co-reference. The material in this release relates to the IR task, which sought to support development of systems that could: (1) take as input a natural language English query sentence; (2) return relevant responses to that query from a large corpus of informal documents in the three BOLT languages (Arabic, Chinese, and English); and (3) translate responses from non-English documents into English. *Data* BOLT Information Retrieval Comprehensive Training and Evaluation contains the pilot, dry run, and evaluation data developed for each phase of the BOLT IR task, including: (1) natural-language IR queries, system responses to queries, and manually-generated assessment judgments for system responses; (2) discussion forum source documents in Arabic, Chinese and English; (3) scoring software for each evaluation phase; and (4) experimental data developed in Phase 2. Source data is presented as a series of zip archives containing xml files. Queries and responses data are presented as XML as well. Judgments are included as tab delimited files. *Acknowledgement* This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-11-C-0145. The content does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred. *Samples* Please view the following samples: * Source Data * Query * Assessment * Response Assessment *Updates* None at this time. | |
| Extent: | Corpus size: 7743680 KB | |
| Identifier: | LDC2018T18 | |
| https://catalog.ldc.upenn.edu/LDC2018T18 | ||
| ISBN: 1-58563-855-2 | ||
| ISLRN: 384-402-057-006-6 | ||
| DOI: 10.35111/sd50-6m36 | ||
| Language: | Egyptian Arabic | |
| Mandarin Chinese | ||
| English | ||
| Language (ISO639): | arz | |
| cmn | ||
| eng | ||
| License: | LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2018T18 | |
| Rights Holder: | Portions © 2012-2016, 2018 Trustees of the University of Pennsylvania | |
| Type (DCMI): | Text | |
| Type (OLAC): | primary_text | |
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2018T18 | |
| DateStamp: | 2020-11-30 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Griffitt, Kira; Strassel, Stephanie. 2018. Linguistic Data Consortium. | |
| Terms: | area_Africa area_Asia area_Europe country_CN country_EG country_GB dcmi_Text iso639_arz iso639_cmn iso639_eng olac_primary_text | |