Genre Annotation of Web Corpora: Scheme and Issues

Publikace nespadá pod Filozofickou fakultu, ale pod Fakultu informatiky. Oficiální stránka publikace je na webu



Rok publikování 2020
Druh Článek ve sborníku
Konference Proceedings of the Future Technologies Conference
Fakulta / Pracoviště MU

Fakulta informatiky

Klíčová slova Corpus annotation; Inter-annotator agreement; Text genre; Web corpora
Popis Unlike traditional corpora made from printed media in the past decades, sources of web corpora are not categorised and described well, thus making it difficult to control the content of the corpus. This paper presents an attempt to classify genres in a large English web corpus through supervised learning. A set of genres suitable for web corpora users is defined based on a research of related work. A genre annotation scheme with active learning rounds is introduced. A collection of web pages representing various genres that was created for this task and a scheme of consequent human annotation of the data set is described. Measuring the inter-annotator agreement revealed that either the problem may not be well defined, or that our expectations concerning the precision and recall of the classifier cannot be met. Eventually, the project was postponed at that point. Possible solutions of the issue are discussed at the end of the paper.
Související projekty: