Publication

Back to overview

Syntactic Concordancing and Multi-Word Expression Detection

Type of publication Peer-reviewed
Publikationsform Original article (peer-reviewed)
Project An Integer Linear Programming Approach to Text-to-Text Generation
Show all

Original article (peer-reviewed)

Journal International Journal of Data Mining, Modelling and Management
Volume (Issue) 5(2)
Page(s) 158 - 181
Title of proceedings International Journal of Data Mining, Modelling and Management

Abstract

Concordancers are tools that display the contexts of a given word in a corpus. Also called KWIC (Key Word in Context), these tools are nowadays indispensable in the work of lexicographers, linguists, and translators. We present an enhanced type of concordancer that integrates syntactic information on sentence structure as well as statistical information on word co-occurrence in order to detect and display those words from the context that are most strongly related to the word under investigation. This tool considerably alleviates the users’ task, by highlighting syntactically well-formed word combinations that are likely to form complex lexical units, i.e., multi-word expressions. One of the key distinctive features of the tool is its multilingualism, as syntax-based multi-word expression detection is available for multiple languages, and parallel concordancing enables users to consult the version of a source context in another language, when multilingual parallel corpora are available. In this article, we describe the underlying methodology and resources used by the system, its architecture, and its recently developed online version. We also provide relevant performance evaluation results for the main system components, focusing on the comparison between syntax-based and syntax-free approaches.
-