Next Article in Journal
Analysis of Data Persistence in Collaborative Content Creation Systems: The Wikipedia Case
Previous Article in Journal
Efficient Detection of Ventricular Late Potentials on ECG Signals Based on Wavelet Denoising and SVM Classification
Previous Article in Special Issue
MiNgMatch—A Fast N-gram Model for Word Segmentation of the Ainu Language
Open AccessArticle

Improving Basic Natural Language Processing Tools for the Ainu Language

1
Department of Computer Science, Kitami Institute of Technology, 165 Koen-cho, Kitami, Hokkaido 090-8507, Japan
2
Department of Electronics and Information Engineering, Faculty of Engineering, Hokkai Gakuen University, 1-1, Nishi 11-chome, Minami 26-jo, Chuo-ku, Sapporo, Hokkaido 064-0926, Japan
*
Author to whom correspondence should be addressed.
Information 2019, 10(11), 329; https://doi.org/10.3390/info10110329
Received: 27 August 2019 / Revised: 19 October 2019 / Accepted: 20 October 2019 / Published: 24 October 2019
(This article belongs to the Special Issue Computational Linguistics for Low-Resource Languages)
Ainu is a critically endangered language spoken by the native inhabitants of northern Japan. This paper describes our research aimed at the development of technology for automatic processing of text in Ainu. In particular, we improved the existing tools for normalizing old transcriptions, word segmentation, and part-of-speech tagging. In the experiments we applied two Ainu language dictionaries from different domains (literary and colloquial) and created a new data set by combining them. The experiments revealed that expanding the lexicon had a positive impact on the overall performance of our tools, especially with test data unrelated to any of the training sets used. View Full-Text
Keywords: Ainu language; endangered languages; normalization; word segmentation; part-of-speech tagging Ainu language; endangered languages; normalization; word segmentation; part-of-speech tagging
MDPI and ACS Style

Nowakowski, K.; Ptaszynski, M.; Masui, F.; Momouchi, Y. Improving Basic Natural Language Processing Tools for the Ainu Language. Information 2019, 10, 329.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop