Next Article in Journal
T-Coin: Dynamic Traffic Congestion Pricing System for the Internet of Vehicles in Smart Cities
Previous Article in Journal
Do Not Let the Robot Get too Close: Investigating the Shape and Size of Shared Interaction Space for Two People in a Conversation
Open AccessArticle

A Ranking-Based Hashing Algorithm Based on the Distributed Spark Platform

Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China
*
Author to whom correspondence should be addressed.
Information 2020, 11(3), 148; https://doi.org/10.3390/info11030148
Received: 23 January 2020 / Revised: 2 March 2020 / Accepted: 5 March 2020 / Published: 9 March 2020
With the rapid development of modern society, generated data has increased exponentially. Finding required data from this huge data pool is an urgent problem that needs to be solved. Hashing technology is widely used in similarity searches of large-scale data. Among them, the ranking-based hashing algorithm has been widely studied due to its accuracy and speed regarding the search results. At present, most ranking-based hashing algorithms construct loss functions by comparing the rank consistency of data in Euclidean and Hamming spaces. However, most of them have high time complexity and long training times, meaning they cannot meet requirements. In order to solve these problems, this paper introduces a distributed Spark framework and implements the ranking-based hashing algorithm in a parallel environment on multiple machines. The experimental results show that the Spark-RLSH (Ranking Listwise Supervision Hashing) can greatly reduce the training time and improve the training efficiency compared with other ranking-based hashing algorithms. View Full-Text
Keywords: similarity search; ranking-based hashing; distributed framework; Spark similarity search; ranking-based hashing; distributed framework; Spark
Show Figures

Figure 1

MDPI and ACS Style

Yang, A.; Qian, J.; Chen, H.; Dong, Y. A Ranking-Based Hashing Algorithm Based on the Distributed Spark Platform. Information 2020, 11, 148.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop