oai:www.ldc.upenn.edu:LDC2024T07
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2024T07 |
| Metadata | ||
| Title: | LORELEI Uyghur Incident Language Pack | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Tracey, Jennifer, et al. LORELEI Uyghur Incident Language Pack LDC2024T07. Web Download. Philadelphia: Linguistic Data Consortium, 2024 | |
| Contributor: | Tracey, Jennifer | |
| Strassel, Stephanie | ||
| Arrigo, Michael | ||
| Wright, Jonathan | ||
| Graff, David | ||
| Bies, Ann | ||
| Date (W3CDTF): | 2024 | |
| Date Issued (W3CDTF): | 2024-08-15 | |
| Description: | *Introduction* LORELEI Uyghur Incident Language Pack (LDC2024T07) was developed by the Linguistic Data Consortium and consists of approximately 28 million words of Uyghur monolingual text, 500,000 words of English monolingual text, 3.3 million words of parallel and comparable Uyghur-English text, and 200,000 words of data annotated for Simple Named Entities and Situation Frames. It contains all of the text data, annotations, supplemental resources and related software tools for the Uyghur language that were used in the DARPA LORELEI / LoReHLT 2016 Evaluation. The LORELEI (Low Resource Languages for Emergent Incidents) program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs and Incident Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources. Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation. The evaluation protocol was based on a scenario in which an unforeseen event triggered a need for humanitarian and logistical support in a region where the incident language had received little or no attention in natural language processing (NLP) research. Evaluation participants provided NLP solutions, including information extraction and machine translation, based on limited resources and with very little time for development. *Data* Uyghur is spoken mainly in northwestern China, as well as in Kazakhstan, Kyrgyzstan, and Uzbekistan. Data was collected in the following genres: news, social network, weblog, newsgroup, discussion forum, and reference material. Named entity annotation identified entities to be detected by systems for scoring purposes. Situation frame analysis was designed to extract basic information about needs and relevant issues for planning a disaster response effort. Also included in this release are lexical and grammatical resources as well as three tools: two to recreate original source data from the processed XML material and the other to condition text data users download from Twitter. Monolingual, parallel and comparable text are presented in XML with associated dtds. Situation frame annotation data is presented as tab delimited files. All text is UTF-8 encoded. The knowledge base for entity linking annotation for this corpus and all LORELEI Representative Language and Incident Language Packs is available separately as LORELEI Entity Detection and Linking Knowledge Base (LDC2020T10). *Sponsorship* This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-15-C-0123. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DARPA. *Samples* Please view these samples: * English LTF XML * English PSM XML * Uyghur LTF XML * Uyghur PSM XML * Full Entity Annotation XML * Mentions Annotation XML * Needs Annotation XML *Updates* None at this time. | |
| Extent: | Corpus size: 1411703 KB | |
| Identifier: | LDC2024T07 | |
| https://catalog.ldc.upenn.edu/LDC2024T07 | ||
| ISLRN: 103-077-458-497-7 | ||
| DOI: 10.35111/99s0-qz09 | ||
| Language: | English | |
| Uighur | ||
| Language (ISO639): | eng | |
| uig | ||
| License: | LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2024T07 | |
| Rights Holder: | Portions © 2014 Autonomous Nonprofit Organization “TV-Novosti”, © 2014-2016 Bagdax.Cn, © 2014 Bloomberg LP, © 2014 BreakingNews.ie, © 2014 Cable News Network, LP, LLLP, © 2014 CBC/Radio-Canada, © 2014 CBS Local Media, a division of CBS Radio Inc., © 2016 China Central Television, © 2014 China Daily Information Co., © 2014-2016 China National Radio, © 2012-2016 China Radio International, © 2014 Condé Nast, © 2014 euronews, © 2014 Firstpost, © 2014 Guardian News and Media Limited or its affiliated companies, © 2014 Institute of Remote Sensing and Digital Earth, © 2014 izda.com, © 2016 KagSay.Com, © 2016 Karwan.Cn, © 2016 Maxukum.Com, © 2014 NDTV Convergence Limited, © 2014 New York Times, © 2014 news.okyan.com, © 2014 npr, © 2014-2016 Nur.cn, © 2014 philly.com, © 2014 Reuters, © 2013-2016 RFA. Used with the permission of Radio Free Asia, 2025 M St., NW, Suite 300, Washington, DC 20036. http://www.rfa.org, © 2014 The Charlotte Observer, © 2014 The Inquisitr News, © 2014 The Washington Post, © 2014-2015 TRT WORLD, © 2015-2016 turkistantimes.com, © 2015-2016, Umidwar www.alkuyi.com, © 2014 USA TODAY, a division of Gannett Satellite Information Network, LLC, © 2014, 2016 Uzzar.Cn, © 2014-2016 uynews.com, © 2014-2015 Www.Anatuprak.Cn, © 2014 www.baxtax.cn, © 2014 www.istiqlalhewer.com, © 2014-2016 www.leglek.com, © 2014-2016 www.people.com.cn, © 2009-2016 www.tianshannet.com, © 2014 www.uzunyol.cn, © 2014 XINHUANET.com, © 2016, 2024 Trustees of the University of Pennsylvania | |
| Type (DCMI): | Software | |
| Text | ||
| Type (OLAC): | primary_text | |
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2024T07 | |
| DateStamp: | 2024-08-15 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Tracey, Jennifer; Strassel, Stephanie; Arrigo, Michael; Wright, Jonathan; Graff, David; Bies, Ann. 2024. Linguistic Data Consortium. | |
| Terms: | area_Asia area_Europe country_CN country_GB dcmi_Software dcmi_Text iso639_eng iso639_uig olac_primary_text | |