CitySAC: A Query-Able CityGML Compression System
Abstract
:1. Introduction
2. Previous Studies
3. CityGML & SDI Framework
4. CitySAC Encoding System
4.1. Architecture
4.1.1. Input
4.1.2. XML Parser
4.1.3. XSD Builder
4.1.4. Entropy Module
4.1.5. Dictionary Builder
4.1.6. PCI & SGC Builder
4.1.7. Archiving Module
4.2. Data Structure
4.3. Compression & Decompression Pipeline
5. Test Results & Discussion
- The encoding process is done in one-way scan from beginning to end of the document, while maintaining its structure.
- The encoded document can be queried, while geometries can be sliced into chunk sizes to provide partial decompression.
- The encoder employs standard UTF-8 binary format and is built for dynamic representation of large geometric datasets.
- It uses entropy values to check the bit-representation and employs a scaled integer algorithm for double value.
- It is suitable for web transaction, such as Javascript readable byte-code.
- It employs state-of-the-art compressor LZMA, which produces smaller lossless outputs, and is in most cases faster than, LZMA alone.
6. Conclusions
Author Contributions
Funding
Conflicts of Interest
References
- Basanow, J.; Neis, P.; Neubauer, S.; Schilling, A.; Zipf, A. Towards 3D Spatial Data Infrastructures (3D-SDI) based on open standards—Experiences, results and future issues. In Advances in 3D Geoinformation Systems; Van Oosterom, P., Zlatanova, S., Penninga, F., Fendel, E.M., Eds.; Springer: Berlin, Germany, 2008; pp. 65–86. [Google Scholar]
- Kolbe, T.H.; Konig, G.; Nagel, C.; Stadler, A. 3D-Geo-Database Berlin Version 2.0.1a; Technical Report; Institute for Geodesy and Geoinformation Science Technische University: Berlin, Germany, 2008. [Google Scholar]
- Groger, G.; Kolbe, T.H.; Czerwinski, A.; Na-Gel, C. OpenGIS R City Geography Markup Language (CityGML) Encoding Standard; Open Geospatial Consortium: Wayland, MA, USA, 2008. [Google Scholar]
- Groger, G.; Kolbe, T.H.; Nagel, C.; Hafele, K.H. OGC City Geography Markup Language (CityGML) Encoding Standard; Open Geospatial Consortium: Wayland, MA, USA, 2012; pp. 1–344. [Google Scholar]
- Deering, M. Geometry compression. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA, 6–11 August 1995; pp. 13–20. [Google Scholar]
- Taubin, G.; Horn, W.P.; Lazarus, F.; Rossignac, J. Geometry coding and VRML. Proc. IEEE 1998, 86, 1228–1243. [Google Scholar] [CrossRef] [Green Version]
- Isenburg, M.; Snoeyink, J. Spirale Reversi: Reverse decoding of the edgebreaker coding. Comput. Geom. 2001, 20, 39–52. [Google Scholar] [CrossRef]
- Isenburg, M. LASzip: Lossless Compression of LiDAR Data; Technical Report; rapidlasso GmbH: Gilching, Germany, 2013. [Google Scholar]
- Sandoz, P.; Triglia, A.; Pericas-Geertsen, S. Fast Infoset; Technical Report; ITU: Geneva, Switzerland, 2005. [Google Scholar]
- Liefke, H.; Suciu, D. XMill: An efficient compressor for XML data. In Proceedings of the ACM SIGMOD International Conference on Management of Data, Dallas, TX, USA, 15–18 May 2000; Volume 29, pp. 153–164. [Google Scholar]
- Tolani, P.M.; Harista, J.R. XGrind: A query-friendly XML compressor. In Proceedings of the 18th International Conference on Data Engineering, San Jose, CA, USA, 26 February–1 March 2002. [Google Scholar]
- Min, J.K.; Park, M.J.; Chung, C.W. XPRESS: A queriable compression for XML data. In Proceedings of the ACM SIGMOD International Conference on Management of Data, San Diego, CA, USA, 9–12 June 2003. [Google Scholar]
- Li, W. XCOMP: An XML Compression Tool. Master’s Thesis, University of Waterloo, Waterloo, ON, Canada, 2003. [Google Scholar]
- Wang, T.J.; Gao, J.; Yang, D.Q.; Tang, S.W.; Liu, Y.F. XPath evaluation oriented XML data stream compression. J. Softw. 2005, 16, 869–877. [Google Scholar] [CrossRef]
- Ng, W.; Lam, W.Y.; Levene, M. XCQ: A queriable XML compression system. Knowl. Inf. Syst. 2006, 10, 421–452. [Google Scholar] [CrossRef]
- Li, P.; Wu, L.; Xiao, X. SDI in China: Progress and issues. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2008, 37, 2. [Google Scholar]
- Gazdzicki, J.; Linsenbarth, A. GIS in Poland: Development towards SDI. In Proceedings of the 10th EC GI & GIS Workshop, ESDI State of the Art, Warsaw, Poland, 23–25 June 2004. [Google Scholar]
- Siew, C.B.; Abdul Rahmna, A. A schema-aware encoder for Putrajaya 3D. In Urban and Regional Data Management; Laurini, R., Ellu, C., Rumor, M., Zlatanova, S., Eds.; CRC Press: Boca Raton, FL, USA, 2013; pp. 181–190. [Google Scholar]
- Stollberg, B.; Zipf, A. OGC web processing service interface for web service orchestration: Aggregating geo-processing services in a bomb threat scenario. In Proceedings of the 7th International Conference on Web and Wireless Geographical Information Systems, Cardiff, UK, 28–29 November 2007; pp. 239–251. [Google Scholar]
- Christensen, A.F.; Ostlander, N.; Lutz, M.; Bernard, L. Architectures, Designing service for distributed geoprocessing: Challenges and future directions. Trans. GIS 2008, 11, 799–818. [Google Scholar] [CrossRef]
- Walenciak, G.; Stollberg, B.; Neubauer, S.; Zipf, A. Extending spatial data infrastructures 3D by geoprocessing functionality - 3D simulations in disaster management and environmental research. In Proceedings of the International Conference on Advanced Geographic Information Systems & Web Services, Cancun, Mexico, 1–7 February 2009. [Google Scholar]
- Lanig, S.; Zipf, A. Proposal for a Web Processing Services (WPS) application profile for 3D processing analysis. In Proceedings of the 2nd International Conference on Advanced Geographic Information Systems, Applications and Services, St. Maarten, Netherlands Antilles, 10–16 February 2010. [Google Scholar]
- Shannon, C.E. Communication in the presence of noise. Proc. IRE 1949, 37, 10–21. [Google Scholar] [CrossRef]
Byte-Code | Flag Type |
---|---|
65500 | White Space |
65501 | Element |
65502 | Attribute |
65503 | Attribute Value |
65504 | Value |
65530 | Element Close |
65001⋯65499 | URI / Face-set Pair |
File Name (.XML) | Bytes | Tags | Unique Tags | Attributes | |
---|---|---|---|---|---|
Commercial Building | 856,064 | 5375 | 18 | 3224 | 2.368156 |
National Audit | 8,802,304 | 59,725 | 18 | 35,833 | 2.328374 |
Putrajaya Convention | 987,136 | 6743 | 18 | 4046 | 2.353207 |
Putrajaya Mosque | 11,190,272 | 75,749 | 13 | 45,446 | 2.32741 |
Seri Gemilang Bridge | 28,114,944 | 189,845 | 12 | 113,902 | 2.324867 |
Putrajaya All | 109,928,448 | 742,902 | 19 | 445,507 | 2.334328 |
File Name (.XML) | Bytes | Attributes | Unique Attributes | |
---|---|---|---|---|
Commercial Building | 856,064 | 3224 | 11 | 0.954407309 |
National Audit | 8,802,304 | 35,833 | 11 | 0.922468795 |
Putrajaya Convention | 987,136 | 4046 | 11 | 0.948378432 |
Putrajaya Mosque | 11,190,272 | 45,446 | 9 | 0.920554196 |
Seri Gemilang Bridge | 28,114,944 | 113,902 | 9 | 0.919246192 |
Putrajaya All | 109,928,448 | 445,507 | 11 | 0.919991184 |
File Name (.XML) | Original Size (MB) | Deflate Size (MB)/CR2 (%) | Fast InfoSize (MB)/CR2 (%) | LZMA Size (MB)/CR2 (%) | BZIP2Size (MB)/CR2 (%) | CitySAC + LZMASize (MB)/CR2 (%) |
---|---|---|---|---|---|---|
Commercial Building | 0.836 | 0.086/89.71 | 0.469/43.90 | 0.073/91.27 | 0.079/90.55 | 0.06/92.82 |
National Audit | 8.594 | 0.948/88.97 | 4.132/51.92 | 0.696/91.90 | 0.869/89.89 | 0.659/92.33 |
Putrajaya Convention | 0.962 | 0.17/82.33 | 0.43/55.30 | 0.102/89.40 | 0.106/88.98 | 0.090/90.64 |
Putrajaya Mosque | 10.928 | 1.56/85.72 | 4.81/55.98 | 0.992/90.92 | 1.226/88.78 | 0.88/91.95 |
Seri Gemilang Bridge | 27.45 | 3.612/86.84 | 12.352/55 | 2.714/90.11 | 3.519/87.18 | 2.53/90.78 |
Putrajaya All | 104.1 | 13.2/87.32 | 32.1/69.16 | 9.76/90.62 | 12.1/88.38 | 9.8/90.59 |
File Name (.XML) | Deflate (s) | Fast Info (s) | LZMA (s) | BZIP2 (s) | CitySAC + LZMA (s) |
---|---|---|---|---|---|
Commercial Building | 0.2 | 0.5 | 0.3 | 0.1 | 0.4 |
National Audit | 3.8 | 3.6 | 4.5 | 1.2 | 1.9 |
Putrajaya Convention | 1.1 | 0.9 | 1.3 | 0.3 | 0.51 |
Putrajaya Mosque | 3.5 | 4.2 | 5.8 | 2.2 | 4.1 |
Seri Gemilang Bridge | 9.8 | 11.5 | 15.2 | 4.5 | 11.2 |
Putrajaya All | 14.5 | 18.5 | 27.3 | 11.0 | 25.5 |
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Siew, C.B.; Kumar, P. CitySAC: A Query-Able CityGML Compression System. Smart Cities 2019, 2, 106-117. https://doi.org/10.3390/smartcities2010008
Siew CB, Kumar P. CitySAC: A Query-Able CityGML Compression System. Smart Cities. 2019; 2(1):106-117. https://doi.org/10.3390/smartcities2010008
Chicago/Turabian StyleSiew, Chengxi Bernad, and Pankaj Kumar. 2019. "CitySAC: A Query-Able CityGML Compression System" Smart Cities 2, no. 1: 106-117. https://doi.org/10.3390/smartcities2010008
APA StyleSiew, C. B., & Kumar, P. (2019). CitySAC: A Query-Able CityGML Compression System. Smart Cities, 2(1), 106-117. https://doi.org/10.3390/smartcities2010008