oai:www.ldc.upenn.edu:LDC2010T16
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2010T16 |
| Metadata | ||
| Title: | Indian Language Part-of-Speech Tagset: Bengali | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Bali, Kalika, Monojit Choudhury, and Priyanka Biswas. Indian Language Part-of-Speech Tagset: Bengali LDC2010T16. Web Download. Philadelphia: Linguistic Data Consortium, 2010 | |
| Contributor: | Bali, Kalika | |
| Choudhury, Monojit | ||
| Biswas, Priyanka | ||
| Date (W3CDTF): | 2010 | |
| Date Issued (W3CDTF): | 2010-09-17 | |
| Description: | *Introduction* Indian Language Part-of-Speech Tagset: Bengali, was developed by Microsoft Research (MSR) India to support the task of Part-of-Speech Tagging (POS) and other data-driven linguistic research on Indian Languages in general. It was created as a part of the Indian Language Part-of-Speech Tagset (IL-POST) project, a collaborative effort among linguists and computer scientists from MSR India, AU-KBC (Anna Universtiy, Chennai), Delhi University, IIT Bombay, Jawaharlal Nehru University (Delhi) and Tamil University (Tamilnadu). The goal of the IL-POST project is to provide a common tagset framework for Indian Languages that offers flexibility, cross-linguistic compatibility and resuability across those languages. It supports a three-level hierarchy of Categories, Types and Attributes. The corpus mainly consists therefore of two different levels of information for each lexical token: (a) lexical Category and Types, and (b) set morphological attributes and their associated values in the context. Bengali (also referred to as Bangla) is a member of the Eastern Indo-Aryan language group. It is native to the region of Bengal which consists of Bangladesh, the Indian state of West Bengal, and parts of the Indian states of Tripura and Assam. It is spoken by more than 210 million people as a first or a second language with around 100 million speakers in Bangladesh, about 85 million speakers in India, and others in immigrant communities in the United Kingdom, USA and the Middle East. *Data* This corpus contains 7168 sentences (102933 words) of manually annotated text from modern standard Bengali sources including blogs, Wikipedia, Multikulti and a portion of the EMILLE/CIIL corpus . The annotated data is structured into two folders, Bangla1 (3684 sentences, 51091 words) and Bangla2 (3484 sentences, 51842 words), which represent the two stages in which the data was annotated. All annotated data is provided in both xml and text files. Each data file contains between 3,000-5,000 words. The XML file contains metadata about the material, such as language, encoding and data size. *Annotation Procedure* The Annotation Guidelines for Bangla included in this release contain a detailed description of the annotation methodology. *Updates* Additional information, updates, bug fixes may be available in the LDC catalog entry for this corpus at LDC2010T16. *Samples* Please examine this XML excerpt for an example of the data in this corpus. | |
| Extent: | Corpus size: 9134 KB | |
| Identifier: | LDC2010T16 | |
| https://catalog.ldc.upenn.edu/LDC2010T16 | ||
| ISBN: 1-58563-561-8 | ||
| ISLRN: 651-762-041-881-0 | ||
| DOI: 10.35111/60yc-6w23 | ||
| Language: | Bengali | |
| Language (ISO639): | ben | |
| License: | Microsoft Research India License Agreement: https://catalog.ldc.upenn.edu/license/microsoft-research-india-license-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2010T16 | |
| Rights Holder: | Portions © 2010 Microsoft Research Labs India, Pvt. Ltd., © 2010 Trustees of the University of Pennsylvania | |
| Type (DCMI): | Text | |
| Type (OLAC): | primary_text | |
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2010T16 | |
| DateStamp: | 2024-03-06 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Bali, Kalika; Choudhury, Monojit; Biswas, Priyanka. 2010. Linguistic Data Consortium. | |
| Terms: | area_Asia country_BD dcmi_Text iso639_ben olac_primary_text | |