Training and evaluation of TreeTagger on Amazigh corpus

Amri Samir and Zenkouar Lahbib

International Journal of Intelligent Enterprise, 2019, vol. 6, issue 2/3/4, 230-241

Abstract: Part-of-speech (POS) tagging has high importance in the domain of natural language processing (NLP). POS tagging determines grammatical category to any token, such as noun, verb, adjective, person, gender, etc. Some of the words are ambiguous in their categories and what tagging does is to clear of ambiguous word according to their context. Many taggers are designed with different approaches to reach high accuracy. In this paper we present a Machine Learning algorithm, which combines decision trees model and HMM model to tag Amazigh unknown words. In case of statistical methods such as TreeTagger, this will have added practical advantages also. This paper presents creation of a POS tagged corpus and evaluation of TreeTagger on Amazigh text. The results of experiments on Amazigh text show that TreeTagger provides overall tagging accuracy of 93.19%, specifically, 94.10% on known words and 70.29% on unknown words.

Keywords: Amazigh; corpus; machine learning; POS tagging; TreeTagger. (search for similar items in EconPapers)
Date: 2019
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.inderscience.com/link.php?id=101130 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ids:ijient:v:6:y:2019:i:2/3/4:p:230-241

Access Statistics for this article

More articles in International Journal of Intelligent Enterprise from Inderscience Enterprises Ltd
Bibliographic data for series maintained by Sarah Parker ().