Next Article in Journal
New Exact Solutions of the New Hamiltonian Amplitude-Equation and Fokas Lenells Equation
Previous Article in Journal
Proportionate Minimum Error Entropy Algorithm for Sparse System Identification
Article Menu

Export Article

Open AccessArticle
Entropy 2015, 17(9), 6007-6024; doi:10.3390/e17096007

A Gloss Composition and Context Clustering Based Distributed Word Sense Representation Model

1
Shenzhen Engineering Laboratory of Performance Robots at Digital Stage,Shenzhen Graduate School, Harbin Institute of Technology, Shenzhen 518055, China
2
School of Engineering and Applied Science, Aston University, Aston Triangle, Birmingham, B4 7ET,UK
*
Author to whom correspondence should be addressed.
Academic Editor: Raúl Alcaraz Martínez
Received: 6 May 2015 / Revised: 15 August 2015 / Accepted: 21 August 2015 / Published: 27 August 2015
(This article belongs to the Section Information Theory)
View Full-Text   |   Download PDF [386 KB, uploaded 27 August 2015]   |  

Abstract

In recent years, there has been an increasing interest in learning a distributed representation of word sense. Traditional context clustering based models usually require careful tuning of model parameters, and typically perform worse on infrequent word senses. This paper presents a novel approach which addresses these limitations by first initializing the word sense embeddings through learning sentence-level embeddings from WordNet glosses using a convolutional neural networks. The initialized word sense embeddings are used by a context clustering based model to generate the distributed representations of word senses. Our learned representations outperform the publicly available embeddings on half of the metrics in the word similarity task, 6 out of 13 sub tasks in the analogical reasoning task, and gives the best overall accuracy in the word sense effect classification task, which shows the effectiveness of our proposed distributed distribution learning model. View Full-Text
Keywords: natural language processing; lexical semantic compositionality; distributed representation; word sense disambiguation natural language processing; lexical semantic compositionality; distributed representation; word sense disambiguation
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Chen, T.; Xu, R.; He, Y.; Wang, X. A Gloss Composition and Context Clustering Based Distributed Word Sense Representation Model. Entropy 2015, 17, 6007-6024.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top