Next Article in Journal
ASTROLABE: A Rigorous, Geodetic-Oriented Data Model for Trajectory Determination Systems
Previous Article in Journal
Integration of GIS and Moving Objects in Surveillance Video
Article Menu
Issue 4 (April) cover image

Export Article

Open AccessArticle
ISPRS Int. J. Geo-Inf. 2017, 6(4), 96; doi:10.3390/ijgi6040096

An Effective High-Performance Multiway Spatial Join Algorithm with Spark

1
Institute of Geographic Information Science, School of Earth Sciences, Zhejiang University, Hangzhou 310027, China
2
Department of Geography, Kent State University, Kent, OH 44240, USA
*
Author to whom correspondence should be addressed.
Academic Editor: Wolfgang Kainz
Received: 29 December 2016 / Revised: 10 March 2017 / Accepted: 22 March 2017 / Published: 26 March 2017
View Full-Text   |   Download PDF [1911 KB, uploaded 26 March 2017]   |  

Abstract

Multiway spatial join plays an important role in GIS (Geographic Information Systems) and their applications. With the increase in spatial data volumes, the performance of multiway spatial join has encountered a computation bottleneck in the context of big data. Parallel or distributed computing platforms, such as MapReduce and Spark, are promising for resolving the intensive computing issue. Previous approaches have focused on developing single-threaded join algorithms as an optimizing and partition strategy for parallel computing. In this paper, we present an effective high-performance multiway spatial join algorithm with Spark (MSJS) to overcome the multiway spatial join bottleneck. MSJS handles the problem through cascaded pairwise join. Using the power of Spark, the formerly inefficient cascaded pairwise spatial join is transformed into a high-performance approach. Experiments using massive real-world data sets prove that MSJS outperforms existing parallel approaches of multiway spatial join that have been described in the literature. View Full-Text
Keywords: multiway spatial join; parallel computing; spark; geocomputation performance multiway spatial join; parallel computing; spark; geocomputation performance
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Du, Z.; Zhao, X.; Ye, X.; Zhou, J.; Zhang, F.; Liu, R. An Effective High-Performance Multiway Spatial Join Algorithm with Spark. ISPRS Int. J. Geo-Inf. 2017, 6, 96.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
ISPRS Int. J. Geo-Inf. EISSN 2220-9964 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top