Large Corpora for Turkic Languages and Unsupervised Morphological Analysis
Authors | |
---|---|
Year of publication | 2012 |
Type | Article in Proceedings |
Conference | Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12) |
MU Faculty or unit | |
Citation | BAISA, Vít and Vít SUCHOMEL. Large Corpora for Turkic Languages and Unsupervised Morphological Analysis. Online. In Seniz Demir, Ilknur Durgar El-Kahlout, Mehmet Ugur Dogan. Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12). Istanbul, Turkey: European Language Resources Association (ELRA), 2012, p. 28-32. ISBN 978-2-9517408-7-7. |
web | http://www.lrec-conf.org/proceedings/lrec2012/workshops/02.Turkic%20Languages%20Proceedings.pdf |
Field | Linguistics |
Keywords | corpus; turkic languages; unsupervised morphological analysis |
Description | In this article we describe six new web corpora for Turkish, Azerbaijani, Kazakh, Turkmen, Kyrgyz and Uzbek languages. The data for these corpora was automatically crawled from the web by SpiderLing. Only minimal knowledge of these languages was required to obtain the data in raw form. Corpora are tokenized only since morphological analyzers and disambiguators for these languages are not available (except for Turkish). Subsequent experiment with unsupervised morphological segmentation was carried out on the Turkish corpus. In this experiment we achieved encouraging results. We used data provided for MorphoChallenge competition for the purpose of evaluation. |
Related projects: |