MemBox: Shared Memory Device for Memory-Centric Computing Applicable to Deep Learning Problems
1
Artificial Intelligence Research Laboratory, ETRI, Daejeon 34129, Korea
2
Aviation Drone Laboratory, LIG Nex1, Yongin 16961, Korea
3
Department of Computer Engineering, Chungnam National University, Daejeon 34134, Korea
*
Author to whom correspondence should be addressed.
Academic Editors: Andrea Prati, Carlos A. Iglesias, Luis Javier García Villalba and Vincent A. Cicirello
Electronics 2021, 10(21), 2720; https://doi.org/10.3390/electronics10212720
Received: 29 September 2021
/
Revised: 3 November 2021
/
Accepted: 6 November 2021
/
Published: 8 November 2021
(This article belongs to the Topic Machine and Deep Learning)
Large-scale computational problems that need to be addressed in modern computers, such as deep learning or big data analysis, cannot be solved in a single computer, but can be solved with distributed computer systems. Since most distributed computing systems, consisting of a large number of networked computers, should propagate their computational results to each other, they can suffer the problem of an increasing overhead, resulting in lower computational efficiencies. To solve these problems, we proposed an architecture of a distributed system that used a shared memory that is simultaneously accessible by multiple computers. Our architecture aimed to be implemented in FPGA or ASIC. Using an FPGA board that implemented our architecture, we configured the actual distributed system and showed the feasibility of our system. We compared the results of the deep learning application test using our architecture with that using Google Tensorflow’s parameter server mechanism. We showed improvements in our architecture beyond Google Tensorflow’s parameter server mechanism and we determined the future direction of research by deriving the expected problems.
View Full-Text
Keywords:
distributed system; shared memory; deep learning; big data; FPGA; ASIC
▼
Show Figures
Figure 1
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited
MDPI and ACS Style
Choi, Y.; Lim, E.; Shin, J.; Lee, C.-H. MemBox: Shared Memory Device for Memory-Centric Computing Applicable to Deep Learning Problems. Electronics 2021, 10, 2720. https://doi.org/10.3390/electronics10212720
AMA Style
Choi Y, Lim E, Shin J, Lee C-H. MemBox: Shared Memory Device for Memory-Centric Computing Applicable to Deep Learning Problems. Electronics. 2021; 10(21):2720. https://doi.org/10.3390/electronics10212720
Chicago/Turabian StyleChoi, Yongseok, Eunji Lim, Jaekwon Shin, and Cheol-Hoon Lee. 2021. "MemBox: Shared Memory Device for Memory-Centric Computing Applicable to Deep Learning Problems" Electronics 10, no. 21: 2720. https://doi.org/10.3390/electronics10212720
Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.
