HeLI, a Word-Based Backoff Method for Language Identification

Show full item record



Permalink

http://hdl.handle.net/10138/174332

Citation

Jauhiainen , T S , Linden , B K J & Jauhiainen , H A 2016 , HeLI, a Word-Based Backoff Method for Language Identification . in Proceedings of the Third Workshop on NLP for Similar Languages, Varieties and Dialects : VarDial3, Osaka, Japan, December 12 2016 . pp. 153-162 , Joint Workshop on Language Technology for Closely Related Languages, Varieties and Dialects , Osaka , Japan , 11/12/2016 . < https://www.aclweb.org/anthology/W16-4820.pdf >

Title: HeLI, a Word-Based Backoff Method for Language Identification
Author: Jauhiainen, Tommi Sakari; Linden, Bo Krister Johan; Jauhiainen, Heidi Annika
Contributor: University of Helsinki, Department of Modern Languages 2010-2017
University of Helsinki, Department of Modern Languages 2010-2017
University of Helsinki, Department of Modern Languages 2010-2017
Date: 2016
Language: eng
Number of pages: 10
Belongs to series: Proceedings of the Third Workshop on NLP for Similar Languages, Varieties and Dialects VarDial3, Osaka, Japan, December 12 2016
ISBN: 978-4-87974-716-7
URI: http://hdl.handle.net/10138/174332
Abstract: In this paper we describe the Helsinki language identification method, HeLI, and the resources we created for and used in the 3rd edition of the Discriminating between Similar Languages (DSL) shared task, which was organized as part of the VarDial 2016 workshop. The shared task comprised of a total of 8 tracks, of which we participated in 7. The shared task had a record number of participants, with 17 teams providing results for the closed track of the test set A. Our system reached the 2nd position in 4 tracks (A closed and open, B1 open and B2 open) and in this paper we are focusing on the methods and data used for those tracks. We describe our word-based back-off method in mathematical notation. We also describe how we selected the corpus we used in the open tracks.
Subject: 6121 Languages
113 Computer and information sciences
Rights:


Files in this item

Total number of downloads: Loading...

Files Size Format View
VarDial320.pdf 572.2Kb PDF View/Open

This item appears in the following Collection(s)

Show full item record