Self-Location Based on Grid-like Representations for Artificial Agents
Abstract
:1. Introduction
2. Grid-Like Vector Navigation in AI Networks
3. Encoding Scheme for Grid-Like Self-Location
3.1. The Oscillatory Interference Model and Path Integration
3.2. The Location Coding by Multiple VCOs
4. Encoding Scheme for Grid-Like Self-Location
4.1. Vector Navigation Based on Step-Wise Phase Unwrapping
Algorithm 1 Step-Wise Phase Unwrapping for 1D Path Integration |
4.2. The Proposed Scheme for Autonomous Navigation
5. Numerical Results
6. Conclusions
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- Bagnell, J.A.; Bradley, D.; Silver, D.; Sofman, B.; Stentz, A. Learning for Autonomous Navigation. Robot. Autom. Mag. IEEE 2010, 17, 74–84. [Google Scholar] [CrossRef]
- Jun, M.; Roumeliotis, S.I.; Sukhatme, G.S. State estimation of an autonomous helicopter using Kalman filtering. In Proceedings of the 1999 IEEE/RSJ Inernational Conference on Intelligent Robots and Systems, Kyongju, Republic of Korea, 17–21 October 1999; Volume 3, pp. 1346–1353. [Google Scholar]
- Bachrach, A.; Prentice, S.; He, R.; Roy, N. RANGE—Robust autonomous navigation in GPS-denied environments. J. Field Robot. 2010, 28, 1096–1097. [Google Scholar]
- Couturier, A.; Akhloufi, M.A. A review on absolute visual localization for UAV. Robot. Auton. Syst. 2021, 135, 103666. [Google Scholar] [CrossRef]
- O’keefe, J.; Nadel, L. The Hippocampus as a Cognitive Map; Clarendon Press: Oxford, UK, 1978. [Google Scholar]
- O’Keefe, J.; Dostrovsky, J. The hippocampus as a spatial map: Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 1971, 34, 171–175. [Google Scholar] [CrossRef] [PubMed]
- Hafting, T.; Fyhn, M.; Bonnevie, T.; Moser, E.I. Hippocampus-independent phase precession in entorhinal grid cells. Nature 2008, 436, 801–806. [Google Scholar] [CrossRef] [PubMed]
- Blumberg, M.S. The developmental origins of spatial navigation: Are we headed in the right direction? Trends Neurosci. 2015, 38, 67–68. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Lever, C.; Burton, S.; Jeewajee, A.; O’Keefe, J.; Burgess, N. Boundary vector cells in the subiculum of the hippocampal formation. J. Neurosci. 2009, 29, 9771–9777. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- O’Keefe, J.; Burgess, N. Dual phase and rate coding in hippocampal place cells: Theoretical significance and relationship to entorhinal grid cells. Hippocampus 2010, 15, 853–866. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Fuhs, M.C. A spin glass model of path integration in rat medial entorhinal cortex. J. Neurosci. 2006, 26, 4266–4276. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Stensola, H.; Stensola, T.; Solstad, T.; Frøland, K.; Moser, M.B.; Moser, E.I. The entorhinal grid map is discretized. Nature 2012, 492, 72–78. [Google Scholar] [CrossRef] [PubMed]
- Burgess, N.; Barry, C.; O’keefe, J. An oscillatory interference model of grid cell firing. Hippocampus 2007, 17, 801–812. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Burgess, N. Grid cells and theta as oscillatory interference: Theory and predictions. Hippocampus 2008, 18, 1157–1174. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Burgess, N. Controlling Phase Noise in Oscillatory Interference Models of Grid Cell Firing. J. Neurosci. 2014, 34, 6224–6232. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Bush, D.; Barry, C.; Manson, D.; Burgess, N. Using grid cells for navigation. Neuron 2015, 87, 507–520. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Mathis, A.; Herz, A.; Stemmler, M. Optimal population codes for space. Neural Comput. 2012, 24, 2280–2317. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Banino, A.; Barry, C.; Uria, B.; Blundell, C.; Lillicrap, T.; Mirowski, P.; Pritzel, A.; Chadwick, M.J.; Degris, T.; Modayil, J.; et al. Vector-based navigation using grid-like representations in artificial agents. Nature 2018, 557, 429–433. [Google Scholar] [CrossRef] [PubMed]
- Zeng, F.; Wang, C.; Ge, S.S. A survey on visual navigation for artificial agents with deep reinforcement learning. IEEE Access 2020, 8, 35426–135442. [Google Scholar] [CrossRef]
- Chuang, Y.; Jianye, L.; Zhi, X. Brain-inspired vector navigation method based on model of multi-scale grid cells. J. Chin. Inert. Technol. 2020, 28, 179–185. [Google Scholar]
Step 1 | Step 2 | Step 3 | Step 4 | Step 5 | Step 6 | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Case 1 | 250.5 | 7.09 | 28.4 | 0.80 | 25.5 | 0.72 | 3.4 | 0.10 | 3.0 | 0.09 | 0.5 | 0.01 |
Case 2 | 360.6 | 10.1 | 40.7 | 1.15 | 36.6 | 1.04 | 4.7 | 0.13 | 4.2 | 0.12 | 0.6 | 0.02 |
Case 3 | 1001.0 | 28.31 | 112.3 | 3.18 | 101.0 | 2.86 | 12.3 | 0.35 | 11.0 | 0.31 | 1.0 | 0.03 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Dai, C.; Xie, L. Self-Location Based on Grid-like Representations for Artificial Agents. Electronics 2023, 12, 2735. https://doi.org/10.3390/electronics12122735
Dai C, Xie L. Self-Location Based on Grid-like Representations for Artificial Agents. Electronics. 2023; 12(12):2735. https://doi.org/10.3390/electronics12122735
Chicago/Turabian StyleDai, Chuanjin, and Lijin Xie. 2023. "Self-Location Based on Grid-like Representations for Artificial Agents" Electronics 12, no. 12: 2735. https://doi.org/10.3390/electronics12122735