Title: Beyond SoNaR: towards the facilitation of large corpus building efforts
Authors: Reynaert, Martin
Schuurman, Ineke
Hoste, Veronique
Oostdijk, Nelleke
Van Gompel, Maarten #
Issue Date: 2012
Publisher: European Language Resources Association (ELRA)
Host Document: Proceedings of the Eighth International conference on Language Resources and Evaluation (LREC) vol:8 pages:2897-2904
Conference: International conference on Language Resources and Evaluation (LREC) edition:8 location:Istanbul (Turkey)
Abstract: In this paper we report on the experiences gained in the recent construction of the SoNaR corpus, a 500 MW reference corpus of contemporary, written Dutch. It shows what can realistically be done within the confines of a project setting where there are limitations to the duration in time as well to the budget, employing current state-of-the-art tools, standards and best practices. By doing so we aim to pass on insights that may be beneficial for anyone considering to undertake an effort towards building a large, varied yet balanced corpus for use by the wider research community. Various issues are discussed that come into play while compiling a large corpus, including approaches to acquiring texts, the arrangement of IPR, the choice of text formats, and steps to be taken in the preprocessing of data from widely different origins. We describe FoLiA, a new XML format geared at rich linguistic annotations. We also explain the rationale behind the investment in the high-quali ty semi-automatic enrichment of a relatively small (1 MW) subset with very rich syntactic and semantic annotations. Finally, we present some ideas about future developments and the direction corpus development may take, such as setting up an integrated work flow between web services and the potential role for ISOcat. We list tips for potential corpus builders, tricks they may want to try and further recommendations regarding technical developments future corpus builders may wish to hope for.
Publication status: published
KU Leuven publication type: IC
Appears in Collections:Formal and Computational Linguistics (ComForT), Leuven
# (joint) last author

Files in This Item:
File Description Status SizeFormat
Beyond-LREC2012.pdf Published 380KbAdobe PDFView/Open


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science