Next Article in Journal
A Memristor-Based Hyperchaotic Complex Lü System and Its Adaptive Complex Generalized Synchronization
Previous Article in Journal
An Optimization Approach of Deriving Bounds between Entropy and Error from Joint Distribution: Case Study for Binary Classifications
Previous Article in Special Issue
Information-Theoretic Neuro-Correlates Boost Evolution of Cognitive Systems
Article Menu

Export Article

Open AccessArticle
Entropy 2016, 18(2), 61; doi:10.3390/e18020061

Nonparametric Problem-Space Clustering: Learning Efficient Codes for Cognitive Control Tasks

1
Institute for High Performance Computing and Networking, National Research Council, Via Pietro Castellino 111, 80131 Naples, Italy
2
Institute of Cognitive Sciences and Technologies, National Research Council, Via S. Martino della Battaglia 44, 00185 Rome, Italy
*
Author to whom correspondence should be addressed.
Academic Editors: Christoph Salge, Georg Martius, Keyan Ghazi-Zahedi, Daniel Polani and Kevin H. Knuth
Received: 16 July 2015 / Revised: 29 January 2016 / Accepted: 14 February 2016 / Published: 19 February 2016
(This article belongs to the Special Issue Information Theoretic Incentives for Cognitive Systems)
View Full-Text   |   Download PDF [2143 KB, uploaded 19 February 2016]   |  

Abstract

We present an information-theoretic method permitting one to find structure in a problem space (here, in a spatial navigation domain) and cluster it in ways that are convenient to solve different classes of control problems, which include planning a path to a goal from a known or an unknown location, achieving multiple goals and exploring a novel environment. Our generative nonparametric approach, called the generative embedded Chinese restaurant process (geCRP), extends the family of Chinese restaurant process (CRP) models by introducing a parameterizable notion of distance (or kernel) between the states to be clustered together. By using different kernels, such as the the conditional probability or joint probability of two states, the same geCRP method clusters the environment in ways that are more sensitive to different control-related information, such as goal, sub-goal and path information. We perform a series of simulations in three scenarios—an open space, a grid world with four rooms and a maze having the same structure as the Hanoi Tower—in order to illustrate the characteristics of the different clusters (obtained using different kernels) and their relative benefits for solving planning and control problems. View Full-Text
Keywords: clustering; information theory; generative model; structure learning; goal; sub-goal; planning clustering; information theory; generative model; structure learning; goal; sub-goal; planning
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Maisto, D.; Donnarumma, F.; Pezzulo, G. Nonparametric Problem-Space Clustering: Learning Efficient Codes for Cognitive Control Tasks. Entropy 2016, 18, 61.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top