Finding Multiwords of More Than Two Words

Investor logo
Investor logo

Warning

This publication doesn't include Faculty of Arts. It includes Faculty of Informatics. Official publication website can be found on muni.cz.
Authors

KILGARRIFF Adam RYCHLÝ Pavel KOVÁŘ Vojtěch BAISA Vít

Year of publication 2012
Type Article in Proceedings
Conference Proceedings of the 15th EURALEX International Congress
MU Faculty or unit

Faculty of Informatics

Citation
Field Linguistics
Keywords collocations; multiword expressions; multiwords; corpus lexicography; word sketches
Description The prospects for automatically identifying two-word multiwords in corpora have been explored in depth, and there are now well-established methods in widespread use. (We use ‘multiwords’ to include collocations, colligations, idioms and set phrases etc.) But many multiwords are of more than two words and research for items of three and more words has been less successful. We present three complementary strategies, all implemented and available in the Sketch Engine. The first, ‘multiword sketches’, starts from the word sketch for a word and lets a user click on a collocate to see the third words that go with the node and collocate. In the word sketch for take, one collocate is care. We can click on that to find ensure, avoid: take care to ensure, take care to avoid. The second, ‘commonest match’, will find these full expressions, including the to. We look at all the examples of a collocation (represented as a pair/triple of lemmas plus grammatical relation(s)) and find the commonest forms and order of the lemmas, plus any other words typically found in that same collocation. For baby and bathwater we find throw the baby out with the bathwater. The third, ‘multi level tokenization’, allows intelligent handling of items like in front of, which are, arguably, best treated as a single token, so lets us find its collocates: mirror, camera, crowd. While the methods have been tested and exemplified with English, we believe they will work well for many languages.
Related projects:

You are running an old browser version. We recommend updating your browser to its latest version.