Open Access
This article is
 freely available
 reusable
Sensors 2016, 16(10), 1575; doi:10.3390/s16101575
Article
Data Analytics for Smart Parking Applications
^{1}
Centre Tecnològic de Telecomunicacions de Catalunya (CTTC), Parc Mediterrani de la Tecnologia, Av. Carl Friedrich Gauss, 7, Castelldefels, 08860 Barcelona, Spain
^{2}
Department of Information Engineering (DEI), University of Padova, Via Gradenigo 6/B, 35131 Padova, Italy
^{3}
Internet Interdisciplinary Institute (IN3), Universitat Oberta de Catalunya (UOC), Parc Mediterrani de la Tecnologia, Av. Carl Friedrich Gauss 5, Castelldefels, 08860 Barcelona, Spain
*
Correspondence: Tel.: +390498277915
Academic Editors:
Andrea Zanella
and
Toktam Mahmoodi
Received: 9 August 2016 / Accepted: 20 September 2016 / Published: 23 September 2016
Abstract
:We consider reallife smart parking systems where parking lot occupancy data are collected from field sensor devices and sent to backend servers for further processing and usage for applications. Our objective is to make these data useful to end users, such as parking managers, and, ultimately, to citizens. To this end, we concoct and validate an automated classification algorithm having two objectives: (1) outlier detection: to detect sensors with anomalous behavioral patterns, i.e., outliers; and (2) clustering: to group the parking sensors exhibiting similar patterns into distinct clusters. We first analyze the statistics of real parking data, obtaining suitable simulation models for parking traces. We then consider a simple classification algorithm based on the empirical complementary distribution function of occupancy times and show its limitations. Hence, we design a more sophisticated algorithm exploiting unsupervised learning techniques (selforganizing maps). These are tuned following a supervised approach using our trace generator and are compared against other clustering schemes, namely expectation maximization, kmeans clustering and DBSCAN, considering six months of data from a real sensor deployment. Our approach is found to be superior in terms of classification accuracy, while also being capable of identifying all of the outliers in the dataset.
Keywords:
data analytics; smart parking data; wireless sensing; SelfOrganizing Maps (SOM); data clustering; Internet of Things1. Introduction
Largescale Internet of Things (IoT) deployments are being massively installed within smart cities [1], and alongside their adoption, there is a concurrent need for advanced processing functionalities to handle the vast amount of data generated by sensor devices and, more importantly, to make these data useful for public administrations and citizens. IoT technology allows monitoring a wide range of physical objects through lowcost and possibly lowpower sensing and transmission technologies. Nevertheless, despite the evergrowing interest for IoT, to date, there have been few technical investigations employing data analytics to solve realworld problems in smart cities and especially utilizing IoT data as a basis for new applications [2,3]. A detailed literature review on smart parking applications, technologies and algorithms is provided in the next Section 2.
Our focus in this paper is on data analysis tools for smart parking systems, and for our designs, tests and considerations, we use data from a large commercial smart parking deployment installed and maintained by Worldsensing (http://www.worldsensing.com/) in a town in Northern Italy. This deployment features 370 wireless sensor nodes that are placed underneath parking spaces to provide realtime parking availability measures. Readings from this Wireless Sensor Network (WSN) were collected over a period of six full months and used for the results that we present here.
Specifically, we design processing tools to extract relevant statistical features from reallife parking data with the ultimate goal of classifying parking spaces according to their spatiotemporal patterns. Besides this, we also provide a means to automatically detect outliers, i.e., to identify those sensors whose observations do not conform to expected patterns. These outliers may for example be malfunctioning nodes, which need to be detected for inspection and maintenance, or may pinpoint anomalous parking behaviors. Note that this classification is a key feature for parking managers and also reveals interesting aspects on how people move and their habits. For example, it is possible to label neighborhoods as residential or commercial by just looking at how parking spaces are used. This knowledge may indicate preferred locations for shops or other services or may be used to infer those routes that are likely to become congested due to people commuting. Therefore, besides managing parking spaces and detecting misconduct, further smart city applications can be built on top of our classification algorithms, by fusing what we learn with other types of data.
We start our work by discussing some statistical aspects of the Worldsensing dataset. As a first step toward the classification of parking data, we use empiricallyderived distributions as a means to identify anomalous readings (outliers), adopting a naive approach. This method is however soon discarded, as it is incapable of jointly providing good classification accuracies (i.e., parking events are correctly labeled) and high detection rates (i.e., all of the events of a certain class are detected). Upon conducting this preliminary experiment, it quickly became apparent that a more sophisticated approach is required and also that parking data are rather complex as: (1) they feature different statistics across different days of the week and hours of each day and (2) multiple metrics are to be jointly tracked for a meaningful classification of parking spaces, such as the parking event duration, the vacancy duration and the frequency of parking events. As a next step, we thus jointly summarize these performance indicators into suitable feature vectors, which are then utilized in conjunction with selected clustering algorithms to classify parking signals.
As for the clustering schemes, the following algorithms from the literature are considered: (1) kmeans; see, e.g., [4]; (2) DensityBased Spatial Clustering of Applications with Noise (DBSCAN) [5], which is the de facto standard unsupervised clustering algorithm; and (3) a clustering scheme based on Expectation Maximization (EM) [6], which is taken from a recent paper on clustering for smart parking data [7] and is here adapted to our specific settings. We additionally design an original clustering technique, by utilizing SelfOrganizing Maps (SOM) [8,9], which are unsupervised neural networks possessing the ability of learning prototypes in multidimensional vector spaces. This is closely related to finding regions, one per prototype, and solving a multidimensional classification problem [10]. Our SOMbased clustering approach is presented in two flavors: (i) an SOMbased scheme requiring the number of data classes (clusters) to be known beforehand and (ii) an unsupervised SOMbased algorithm, that automatically finds the number of classes from the analysis of feature vectors.
All of the clustering algorithms are fine tuned following a supervised approach, using synthetic traces that closely resemble real signals. In this way, we obtain a ground truth dataset that is utilized to verify the correctness of the classifiers. Finally, six months of data from the Worldsensing deployment are used to comparatively assess the performance of all approaches. Overall, we found that kmeans, DBSCAN and EMclustering all show classification problems and fail to separate outliers from the other clusters, whereas our SOMbased scheme performs satisfactorily, reaching the highest classification performance when tested on syntheticallygenerated parking events and reliably detecting all outliers when applied to real data.
The remainder of this paper is organized as follows. The related work is discussed in Section 2. The system model, along with some preliminary analysis of the parking data, is presented in Section 3. The naive approach for the classification of parking spaces is explored in Section 4. The computation of features from parking data, along with the discussion of standard schemes and the presentation of our new SOMbased clustering algorithm are provided in Section 5. The considered approaches are fine tuned and numerically evaluated in Section 6, through synthetic and real datasets. Our final considerations are presented in Section 7.
2. Related Work
The usage of automated instrumentation for onstreet parking monitoring [11] has become popular in several cities around the world. In existing deployments, small sensing devices are usually placed in every parking spot to monitor large urban areas. Representative examples are Los Angeles [12], San Francisco [13] and Barcelona [14], among many others. The first layer of these complex systems is comprised of onstreet parking sensors, which are smallscale wireless devices used to monitor the presence of vehicles. Each sensor periodically wakes up to check the occupancy state of the assigned parking lot. As a car parks above it, the sensor detects its presence, and the event is wirelessly reported to a gateway within radio coverage. From the gateway, the data are then sent to backend servers for further processing, remote parking management and visualization.
The main goal of these systems is to improve the operation efficiency of public parking, which is achieved through the collection of finegrained, constant and accurate information on parking lot occupancy. With this objective in mind, the collected data are analyzed and provided to the city parking management division through suitable dashboards. On top of this, the availability of realtime parking information also enables new services, providing an improved urban user experience. As an example, Parking Guidance and Information (PGI) systems [15] help drivers find parking spaces more efficiently, thus ameliorating the problem of cruising for curb parking [16]. Onstreet parking reservation is another relevant application example [17,18].
We underline that, despite the fast growing number of realworld installations, only a few scientific papers have appeared so far on data mining and information processing for smart parking. The use of big data analytics is discussed in [19] and urban social sensing in [20], where open challenges related to the required technology to collect, store, analyze and visualize large amounts of parking data are also investigated. An architectural framework for data collection and analysis is discussed in [21]. The authors of [2] discuss some parking problems in India, elaborating on the pros and cons of parking technology, as well as on its public acceptance.
The authors of [22] put forward a swarm intelligencebased vehicle parking system employing context awareness and wireless communications. In this system, parking areas are instrumented with webbased tools and with a wireless sensor infrastructure. Parking information is collected and visualized through suitable Internetbased dashboards and is communicated to the vehicles searching for parking spaces. The route to the nearest available parking lots is computed through particle swarm optimization algorithms and is sent to the drivers. Data mining for vehicular maintenance and insurance data are investigated in [23], experimenting with Bayes and logistic regression models. A recent paper [24] employs data from onstreet parking sensors from the city of Santander, in Spain, to design and validate a framework for parking availability prediction (either by area or assessing the future state of specific parking spaces). Statistical properties of parking signals are explored in [25], where the authors propose the concept of lean sensing. Specifically, they trade some sensing accuracy at the benefit of improved operational costs: temporal and spatial correlations are then utilized to infer the systemstate from incomplete parking availability information in an attempt at reducing the power consumption associated with sensing and reporting.
The work in [7] is, to the best of our knowledge, the only one that has appeared on data analytics for smart parking spaces. There, the authors investigate farthest first and EM clustering schemes to subdivide parking traces into clusters based on their statistical features and then use Support Vector Data Description (SVDD) to identify extreme behaviors (two classes), i.e., either abnormally high or abnormally low occupancy locations. In this paper, we consider the most advanced EM approach from [7], where the number of cluster is selfassessed based on the input data. We then compare this technique with other clustering schemes and with an original SOMbased algorithm that we devise.
3. System Model
In the following sections, we discuss the dataset that was used for the results, detailing some general properties of parking data and using a simple statistical model as the basis of an eventbased simulator. This simulator is utilized for the design of the algorithms of Section 5 and their fine tuning.
3.1. Statistical Models for Parking Data
For the results in this paper, we use measurements from a WSN parking sensor deployment installed and managed by Worldsensing. The deployment is comprised of $N=370$ wireless sensors, where a node is located underneath each parking spot. Data were collected for six full months, from 1 December 2014 to 30 May 2015, counting more than one million parking events. With ${s}_{i}(t)\in \{0,1\}$, we denote the occupancy status of sensor i at the generic time t, where ${s}_{i}(t)=0$ and ${s}_{i}(t)=1$ respectively mean that the corresponding parking spot is vacant and busy at time t. In this paper, we are concerned with the statistics of parking events, namely their duration, which is modeled for sensor i through the nonnegative random variable (r.v.) ${t}_{\mathrm{ON}}^{i}$, and the duration of vacancies, modeled through the nonnegative r.v. ${t}_{\mathrm{OFF}}^{i}$. In what follows, for any parking space, we respectively refer to “ON” and “OFF” as the parking states corresponding to busy and vacant. With ${T}_{\mathrm{ON}}^{i}$ and ${T}_{\mathrm{OFF}}^{i}$, we indicate ${T}_{\mathrm{OFF}}^{i}=E[{t}_{\mathrm{OFF}}^{i}]$ and ${T}_{\mathrm{ON}}^{i}=E[{t}_{\mathrm{ON}}^{i}]$, respectively. In Figure 1, the empirical probability density function (pdf) of ${t}_{\mathrm{ON}}$ is plotted against a heavytailed Weibull distribution (similar results hold for ${t}_{\mathrm{OFF}}$). Although the empirical pdf shows an oscillatory pattern, which smooths out for increasing values of the abscissa, the Weibull nicely captures the general trend. These results are also confirmed by experimental data from the Smart Santander WSN deployment; see [24,26].
For a nonnegative r.v. Z, the Weibull pdf is defined as:
where $\kappa >0$ is the shape parameter and $\lambda >0$ is the scale parameter. In Table 1, we provide these parameters for r.v.’s ${t}_{\mathrm{ON}}$ (parking duration) and ${t}_{\mathrm{OFF}}$ (duration of vacancies). The Weibull pdf of Figure 1 was obtained considering all possible parking events and is referred to here as “average”. In the table, we also detail the pdfs of the parking sensors with the longest (“Max”) and shortest (“Min”) events.
$${p}_{Z}(z)=\frac{\kappa}{\lambda}{\left(\frac{z}{\lambda}\right)}^{\kappa 1}{e}^{{(z/\lambda )}^{\kappa}}\phantom{\rule{0.166667em}{0ex}},\phantom{\rule{0.166667em}{0ex}}z\ge 0\phantom{\rule{0.166667em}{0ex}},$$
3.2. EventBased Simulator
An eventbased simulator was built with the aim of designing the classification algorithms and performing their fine tuning. For each sensor in the Worldsensing deployment, we obtained the corresponding empirical pdfs for ${t}_{\mathrm{ON}}$ and ${t}_{\mathrm{OFF}}$, for each hour of the day (48 pdfs) and for each day of the week. Thus, parking durations and interarrival times (duration of vacancies) were simulated according to these (empirically measured) statistics for all sensor nodes. In this way, we generate onthefly synthetic traces ${s}_{i}(t)$ for all sensor nodes, which we deem reasonably well representative of real parking patterns. In Figure 2a,b, we respectively show the mean occupancy rate as a function of the hour of the day measured from the Worldsensing dataset and from the synthetic parking traces we obtained through the simulator. The occupancy rate for a certain hour of the day is defined as ${T}_{\mathrm{ON}}^{i}/({T}_{\mathrm{ON}}^{i}+{T}_{\mathrm{OFF}}^{i})$ and is averaged over all sensors $i=1,\cdots ,N$ by only considering the parking states within that hour. In these plots, the occupancy metric is shown for the real data traces and for the synthetic ones. The occupancy curves in these two plots are reasonably close and suggest that our eventbased simulator provides a fairly accurate approximation of mean occupancy figures across the entire day (both for weekends and weekdays). We further observe that higher accuracies in the simulated model can be achieved by decreasing the time granularity, e.g., by tracking the relevant statistics for each minute of the day. This however has two main drawbacks: the first is that the computational complexity substantially increases, and the second is that longer observation intervals would be required for an accurate estimation of the pdfs. Overall, an hour granularity provided a good tradeoff between complexity and accuracy.
This simulation tool is instrumental to selectively set an unusual behavior during certain days (e.g., weekends, holidays), noactivity or unusually high activity for certain nodes, time periods or geographical areas (e.g., to mimic street maintenance or node failures). This entails the addition of the number, location and occurrence time of outlier nodes in a controlled way and the assignment of different statistics to several clusters of (possibly nonadjacent) nodes. This allows for the fine tuning and the precise assessment of the considered clustering algorithms in terms of outlier detection and classification performance, as we show in Section 5.
4. A Simple Anomaly Detection Approach
Anomaly detection (also referred to as outlier detection) refers to the identification of data points, events or observations that do not conform to expected patterns.
As a first naive approach to the detection of outliers, we may use the cumulative distribution functions (cdf) of r.v.’s ${t}_{\mathrm{ON}}$ and ${t}_{\mathrm{OFF}}$, which are respectively defined as ${F}_{\mathrm{ON}}(\tau )=\mathrm{Prob}\{{t}_{\mathrm{ON}}\le \tau \}$ and ${F}_{\mathrm{OFF}}(\tau )=\mathrm{Prob}\{{t}_{\mathrm{OFF}}\le \tau \}$. In particular, we consider the tail of such distributions that, e.g., for ${t}_{\mathrm{ON}}$ is defined as $P({t}_{\mathrm{ON}}>\tau )=1{F}_{\mathrm{OFF}}(\tau )$, where τ is the duration of a parking event. Hence, we assess whether a parking event is an outlier through the following rules:
 (1)
 a threshold $\xi \in (0,1)$ is set and,
 (2)
 a parking event with duration τ is flagged as anomalous if $P({t}_{\mathrm{ON}}>\tau )<\xi $.
For each parking sensor, tail distributions are empirically evaluated for each time slot (considering an hourly granularity) and for each day of the week. They are subsequently used to flag outliers as we just explained. Note that this algorithm can be either implemented in a centralized fashion, i.e., performing the required processing in the backend servers (upon the collection of all data) or in a distributed manner, i.e., each sensor autonomously estimates the tail distributions for the monitored parking space and uses them to flag its own outliers.
Before delving into the discussion of the results, two definitions are in order.
Definition 1.
Accuracy: We define accuracy as the ratio between the number of correctlydetected outliers over the total number of detected outliers.
Definition 2.
Detection rate: We define the detection rate as the ratio between the number of correctlydetected outliers over the total number of outliers in the dataset.
We would like to reach high accuracies, meaning that most of the outliers detected by our algorithm indeed represent real deviations from the expected behavior and, as such, may flag situations requiring our attention, such as broken sensor units, high traffic conditions, street maintenance, fairs, and so forth. However, we would also like to obtain high detection rates, meaning that all of the outliers are ideally detected.
In Figure 3, we plot the accuracy vs. the detection rate for the above naive scheme, where we varied threshold ξ as a free parameter in $(0,1)$. This plot was obtained by considering sensor traces from the entire month of January 2015, where we modified the statistical behavior of 74 parking sensors (20% of the total population), increasing the parking duration of all of their events by a given percentage, as indicated in the plot (one curve for each percentage, from 10% to 70%). For $\xi \to 0$, all curves move toward the upperleft corner of the plot, providing high accuracy, but the detection rate correspondingly decreases. On the other hand, as $\xi \to 1$, we reach high detection rates, but the accuracy becomes unacceptably low. In general, this first approach has the main advantages of being simple, computationally inexpensive (once the empirical distributions are computed) and amenable to a distributed implementation. It however has the major drawback that a satisfactory tradeoff between the accuracy and detection rate is hard to achieve. Better classifiers are designed and evaluated in the following sections.
5. Advanced Classification Techniques
In this section, we describe some advanced classification techniques that will lead to an improved performance with respect to the approach of Section 4. To this end, we define the concept of outliers (see Section 5.1) and introduce a suitable set of features that are utilized by the subsequent algorithms for an effective classification of the parking sensors (see Section 5.2). After that, we describe standard classification approaches, namely kmeans, EM and DBSCAN (see Section 5.3), and a new clustering algorithm based on selforganizing maps (see Section 5.4).
5.1. Discussion on Outliers
Outliers are generally defined as data points that globally have the least degree of similarity to the dataset they belong to, and for our classification task, a data point corresponds to the time series generated by a certain sensor, which represents the behavior of the associated parking space. With the previous naive technique, we overlooked the fact that the time series in the considered parking data span a wide range of behaviors, which makes it difficult to identify outliers by looking at the dataset as a whole. Nevertheless, we recognized that there exist time series with similar characteristics, which allows splitting the data into clusters. We then found that within each cluster, parking sequences are much more homogeneous, and in turn, outliers are easier to identify. For this reason, in the remainder, instead of looking for outliers by looking at the complete dataset at once, we first split it into clusters and then perform outlier identification inside each of them.
In addition, we note that assessing whether a certain sensor is an outlier strongly depends on the definition one uses for similarity. If, for example, we were to compare parking sequences only based on the average duration of their parking events, then two sequences with the same average event duration and different event frequency would be treated as similar. Of course, this is acceptable as long as our application does not need to track event frequency. For instance, event duration is all that matters to assess whether the parking time has expired, in which case, a fine is to be issued to the car owner.
Hence, the definition of the features of interest is crucial for the correct ascertainment of outliers, and we also need to define a similarity metric over these features. In the following sections, we identify a suitable feature set for our classification problem and quantify the concept of similarity between feature vectors.
5.2. Features for Parking Analysis
In machine learning and pattern recognition [27], a feature can be defined as an individual measurable property of a phenomenon being observed. Informative, discriminating and independent features are key to the design of effective classification algorithms. For their definition, we consider, for each parking sensor i, the following statistical measures:
 (1)
 Sensor occupation (SO): accounts for the amount of time during which ${s}_{i}(t)=1$, i.e., the corresponding parking space is occupied.
 (2)
 Event frequency (EF): accounts for the number of parking events per unit time.
 (3)
 Parking event duration (PD): measures the duration of parking events.
 (4)
 Vacancy duration (VD): measures the duration of vacancies.
We computed the hourly average trend for each of the above measures, considering two classes, (cl1) weekdays and (cl2) weekends, and averaging the data points corresponding to the same hour for all of the days in the same class. For each statistical measure, this leads to 24 average values, where the value associated with hour $t\in \{1,\cdots ,24\}$ for Classes cl1/cl2 is obtained averaging the measure for hour t across all days of the same class. Thus, hourly sensor occupation functions were obtained for each hour of the day $t\in \{1,\cdots ,24\}$ for Classes cl1 and cl2, which we respectively denote by ${m}_{\mathrm{SO}}^{1}(t)$ and ${m}_{\mathrm{SO}}^{2}(t)$. Similar functions were obtained for the remaining measures, i.e., ${m}_{\mathrm{EF}}^{*}(t)$, ${m}_{\mathrm{PD}}^{*}(t)$, ${m}_{\mathrm{VD}}^{*}(t)$, where ${}^{*}$ is either one (cl1) or two (cl2). We remark that all functions ${m}_{a}^{b}(t)$ have been normalized through ${m}_{a}^{b}(t)\leftarrow ({m}_{a}^{b}(t){m}_{min})/({m}_{max}{m}_{min})$, where ${m}_{max}$ and ${m}_{min}$ respectively represent the minimum and maximum elements in the dataset for measure $a\in \{\mathrm{SO},\mathrm{EF},\mathrm{PD},\mathrm{VD}\}$ and class $b\in \{1,2\}$. Other normalizations were also evaluated, but this one led to the best classification results.
This leads to a total of $2\times 24=48$ average values for each measure (two classes and 24 h per class), which amounts to a total of $4\times 48=192$ values to represent the four statistical measures that we utilize to characterize the parking behavior of a sensor. Note that we purposely decided to separately process data from weekdays and weekends. This is because parking data from these two classes exhibits a significantly different behavior, and explicitly accounting for this fact increased the precision of our algorithms (although at the cost of a higher number of feature elements).
Thus, the eight functions (four per class) are computed for each sensor in the parking deployment, and their weighted sum is computed using suitable weights ${w}_{1},{w}_{2},{w}_{3},{w}_{4}$ with ${\sum}_{k=1}^{4}{w}_{k}=1$ and ${w}_{k}\in [0,1]$. In this way, we obtain a single feature function $f(t)$ (see Equation (2)) consisting of 96 average values: the first 48 values are representative of the average hourly measures from Class cl1, whereas the second 48 values represent the hourly measures from Class cl2. The weights determine the relative importance of each statistical measure; their correct assignment is crucial to obtain a good classification performance, as we show in Section 6.2. The feature function $f(t)$ is obtained as:
where ${t}^{\prime}=\left((t1)\phantom{\rule{3.33333pt}{0ex}}mod\phantom{\rule{0.277778em}{0ex}}24\right)+1$. We remark that $f(t)$ is sensorspecific, i.e., one such function is computed for each parking sensor. Furthermore, for each parking sensor i, this function defines a feature vector ${\mathit{x}}_{i}={[{x}_{i1},{x}_{i2},\cdots ,{x}_{iK}]}^{T}\in {\mathbb{R}}^{K}$ of $K=96$ elements that are used to train the clustering algorithms of the next sections. Specifically, for sensor i, we set ${x}_{it}\leftarrow f(t)$, $t=1,\cdots ,K$, where ${m}_{a}^{b}(t)$ in $f(t)$ is computed from measures of that sensor. A feature function example from our parking dataset is shown in Figure 4.
$$f(t)=\left\{\begin{array}{cc}{w}_{1}{m}_{\mathrm{SO}}^{1}(t)+{w}_{2}{m}_{\mathrm{PD}}^{1}(t)\hfill & t\in \{1,\cdots ,24\}\hfill \\ {w}_{3}{m}_{\mathrm{EF}}^{1}({t}^{\prime})+{w}_{4}{m}_{\mathrm{VD}}^{1}({t}^{\prime})\hfill & t\in \{25,\cdots ,48\}\hfill \\ {w}_{1}{m}_{\mathrm{SO}}^{2}({t}^{\prime})+{w}_{2}{m}_{\mathrm{PD}}^{2}({t}^{\prime})\hfill & t\in \{49,\cdots ,72\}\hfill \\ {w}_{3}{m}_{\mathrm{EF}}^{2}({t}^{\prime})+{w}_{4}{m}_{\mathrm{VD}}^{2}({t}^{\prime})\hfill & t\in \{73,\cdots ,96\}\hfill \end{array}\right.$$
5.3. Selected Clustering Techniques from the Literature
Many clustering algorithms were proposed over recent decades; see [28] for a literature survey. From this paper, an operational definition of clustering is: “given a representation of n objects, find k groups based on a measure of similarity such that the similarities between objects in the same group are high, while those between objects in different groups are low”. Note that our problem is in general more complex, as the number of clusters (data classes) is not known beforehand, but has to be inferred from the data. In this section, we review three clustering techniques from the literature, i.e., kmeans, EM and DBSCAN. These tackle the clustering problem from quite different angles and will be considered for the performance evaluation of Section 6. As will be shown, while they all detect similar clusters, none of them is entirely satisfactory, as outliers go most of the times undetected. Our SOMbased approach solves this.
kmeans: kmeans is a very popular clustering technique [4], which is successfully used in many applications. Basically, given n input data vectors ${\mathit{x}}_{i}={[{x}_{i1},{x}_{i2},\cdots ,{x}_{id}]}^{T}$, where ${\mathit{x}}_{i}\in {\mathbb{R}}^{d}$ and $i=1,\cdots ,n$, the aim is to determine a set of $k\le n$ vectors, referred to as cluster centers, that minimizes the mean squared distance from each vector in the set to its nearest center. A popular heuristic to achieve this is Lloyd’s algorithm [29]. First, kmeans is initialized by choosing k cluster centers, called centroids. Hence, it proceeds by alternating the following steps until convergence:
 (1)
 Compute the distances between each input data vector and each cluster centroid.
 (2)
 Assign each input vector to the cluster associated with the closest centroid.
 (3)
 Compute the new average of the points (data vectors) in each cluster to obtain the new cluster centroids.
The algorithm stabilizes when assignments no longer change. The clustering results provided by this technique depend on the quality of the starting points of the algorithm, i.e., the initial centroids. In this work, we consider the kmeans++algorithm [30], which augments kmeans with a low complexity and randomized seeding technique. This is found to be very effective in avoiding the poor clusters that are sometimes found by the standard kmeans algorithm. Note also that kmeans is here considered due to its popularity as a baseline clustering scheme. Nevertheless, we stress that the number of clusters k has to be known beforehand, which is not the case with real (unlabeled) parking data. Hence, techniques that discover a suitable number of clusters in an unsupervised manner are preferable, and the ones that we treat in the following do so.
EM: EM is an unsupervised classification technique, which fits a finite Gaussian Mixture Model (GMM) on the provided input vectors ${\mathit{x}}_{i}$, $i=1,\cdots ,N$ (one vector for each parking sensor), using the EM algorithm [6] to iteratively estimate the model parameters. Within the considered GMM, the number of mixtures equals the (preassigned) number of clusters, and each probability distribution models one cluster. A naive implementation of the algorithm requires to know beforehand the number of classes into which the dataset should be subdivided. Here, we implemented the procedure proposed in [6] through which the number of clusters is automatically assessed.
The steps involved in the considered EM clustering algorithm are:
 (1)
 Initial values of the normal distribution model (mean and standard deviation) are arbitrarily assigned.
 (2)
 Mean and standard deviations are iteratively refined through the expectation and maximization steps of the EM algorithm. The algorithm terminates when the distribution parameters converge or a maximum number of iterations is reached.
 (3)
 Data vectors are assigned to the cluster with the maximum membership probability.
For the automatic assessment of the number of clusters, we proceeded by crossvalidation. This starts by setting the number of clusters to one. Thus, the training set is split into a given number of folds (10 for the results in this paper). EM is then performed ten times with the ten folds. The obtained log likelihood values are averaged. If the log likelihood is increased when the number of clusters is increased by one, then the procedure is repeated. The Weka data mining software was used to this end [31].
DBSCAN: DBSCAN can be considered as the de facto standard unsupervised clustering technique [5]. A set of n points (real vectors in ${\mathbb{R}}^{d}$) is taken as the input, and the objective is to group them into a number of regions. Differently from kmeans, the number of clusters (regions) does not need to be specified a priori. Two parameters have to be set up prior to applying the algorithm, namely:
 (1)
 ε: used to define the εneighborhood of any input vector $\mathit{x}$, which corresponds to the region of space whose distance from $\mathit{x}$ is smaller than or equal to ε.
 (2)
 MinPts: representing the minimum number of points needed to form a socalled dense region.
An input vector $\mathit{x}$ is a core point if at least minPts points (including $\mathit{x}$) are within distance ε from it. The following applies: all of the points in the εneighborhood of a certain vector $\mathit{x}$ are reachable from it, whereas no points are directly reachable from a noncore point. A point $\mathit{y}$ is reachable from $\mathit{x}$ if we can locate a path of points with endpoints $\mathit{y}$ and $\mathit{x}$, and all subsequent points in the path are mutually reachable. All points that are not reachable from any other point are tagged as outliers. DBSCAN starts from an arbitrary starting point (vector). If its εneighborhood has a sufficient number of points, a cluster is initiated; otherwise, the point is considered as noise. Note that this rejection policy makes the algorithm robust to outliers, but has to be tuned through a careful adjustment of the two parameters from above, whose best setting depends on the input data distribution. If a point is found to be a dense part of the cluster, its εneighborhood is also part of the cluster. From the first point, the cluster construction process continues by visiting all of the nodes that are mutually reachable, until the densityconnected cluster is completely found. After this, a new point is processed, reiterating the procedure, which can lead to the discovery of a new cluster or noise. The main advantages of the algorithm are that the number of clusters does not have to be known, that it can discover arbitrarilyshaped regions, that is nearly insensitive to the ordering of the input points and that, if properly tuned, it is robust to outliers. Drawbacks are related to the choice of the distance measure and to the choice of the two parameters ε and MinPts, especially when clusters have large differences in densities, as a single parameter pair is unlikely to be good for all clusters.
5.4. Classification Based on SelfOrganizing Maps
Next, we present an original clustering algorithm that exploits the unsupervised learning capabilities of selforganizing maps to automatically discover clusters and to concurrently identify outliers. This algorithm is here proposed, finetuned and tested against synthetic datasets and real parking signals (see Section 6).
The SOM [8,9] is a neurocomputational algorithm that maps highdimensional data into a one or twodimensional space through a nonlinear, competitive and unsupervised learning process. The SOM differs from other artificial neural networks as it uses a neighborhood function to preserve the topological properties of the input space [32]. It is trained through input examples, and the input space is mapped into a twodimensional lattice of neurons, preserving the property that similar input patterns are mapped by nearby neurons in the map.
In this work, we consider one and twodimensional maps, which are respectively made of sequences of $M\times 1$ neurons and a lattice of $\ell =M\times M$ neurons, with $M>1$. These maps become selectively tuned to the input patterns through an unsupervised (also referred to as competitive) learning process. As learning progresses, the neuron weights tend to become ordered with respect to each other in such a way that a significant coordinate system for different input features is created over the lattice. In other words, a SOM creates a topographic map of the input data space, where the spatial locations or coordinates of the neurons in the lattice correspond to a particular domain or intrinsic statistical feature of the input data. Remarkably, this is achieved without requiring any prior knowledge on the input distribution.
With $\mathcal{X}\subset {\mathbb{R}}^{K}$, we indicate the feature (input) set, and we let ${\mathit{x}}_{i}\in \mathcal{X}$ be the input feature vector associated with parking sensor $i=1,\cdots ,N$, where ${\mathit{x}}_{i}={[{x}_{i1},{x}_{i2},\cdots ,{x}_{iK}]}^{T}$; see Section 5.2. With N, we mean the number of sensors, and $\left\mathcal{X}\right=N$. Let $\mathcal{L}$ be the lattice. Each neuron is connected to each component of the input vector, as shown in Figure 5. The links between the input vector and the neurons are weighted, such that the jth neuron is associated with a synapticweight vector ${\mathit{w}}_{j}\in {\mathbb{R}}^{K}$, where ${\mathit{w}}_{j}={[{w}_{i1},{w}_{i2},\cdots ,{w}_{iK}]}^{T}$.
SOMbased clustering: The clustering algorithm is summarized in Algorithm 1 and discussed in what follows, by identifying its main steps, i.e., training and clustering. Step 1: Training. The learning process occurs by means of showing input patters ${\mathit{x}}_{i}\in \mathcal{X}$ to the SOM. Each time a new pattern is inputted to the map, the neurons compete among themselves to be activated, with the result that only one winning neuron is elected at any one time. To determine the winning neuron, the input vector ${\mathit{x}}_{i}$ is compared with the synapticweight vectors ${\mathit{w}}_{j}$ of all neurons. Only the neuron whose synapticweight vector most closely matches the current input vector according to a given distance measure (that we choose equal to the Euclidean distance, which is commonly used) dominates. Consequently, the weights of the winning neuron and of the nodes in the lattice within its neighborhood are adjusted to more closely resemble the input vector. The algorithm steps are (see also Figure 6) as follows.
Algorithm 1 (SOM): 

A good and common choice for ${h}_{ji}(n)$ is the Gaussian function, whose span at time $n=0$ is chosen to cover all of the neurons in the lattice and is then reduced as the map is being trained. The reason for this is that a wide initial topological neighborhood, i.e., a coarse spatial resolution in the learning process, first induces a rough global order in the synapticweight vector values. Hence, during training, narrowing improves the spatial resolution of the map without destroying the acquired global order. The learning rate is also reduced as times goes by, and a sufficiently high number of iterations ${n}_{\mathrm{iter}}$ has to be chosen, so that all synaptic weights stabilize. Moreover, if the number of available input items is smaller than ${n}_{\mathrm{iter}}$, new examples can be resampled from the input data until convergence. See Chapter 9 of [32] for additional details.
Step 2: Clustering. Once the training is complete, the map has adapted to efficiently and compactly represent the feature space $\mathcal{X}$. Clustering immediately follows using the trained map, as we now explain. The feature vectors ${\mathit{x}}_{i}\in \mathcal{X}$ with $i=1,\cdots ,N$ are fed as an input to the map. For each feature vector ${\mathit{x}}_{i}$, we use Equation (3) (with the final synaptic weights) to assess the winning neuron (also referred to as the activated neuron) in the map for this vector. With ${j}^{\u2606}$, we indicate the index of the winning neuron; see Equation (3). Clusters are constructed by grouping together the feature vectors returning the same index. It is then immediate to realize that the maximum number of clusters returned by SOM equals the number of neurons in the map, ${M}^{2}$, i.e., one cluster per neuron. We underline that in some cases, a small number of neurons may never be activated, i.e., be selected as the best fitting neuron for a certain input patter (vector). As a consequence, the number of clusters may be strictly smaller than ${M}^{2}$ (in our experimental validation, this number was never smaller than ${M}^{2}2$). With this approach, the number of clusters is somewhat fixed in advance, as it strictly depends on the number of neurons in the map. Next, we propose an original algorithm that exploits SOM to selfassess the number of clusters according to a treesplitting approach.
Unsupervised SOMbased clustering: The above SOM clustering approach requires knowing in advance the number of clusters in the dataset (i.e., the number of neurons in the SOM map). Next, we devise an unsupervised clustering algorithm that does not need to know in advance the number of data classes. We do this by taking inspiration from [33,34,35]: as done in these papers, instead of clustering data through an agglomerative approach, we adopt a divisive approach, i.e., we start from a big cluster containing the entire dataset, and we iteratively partition this initial cluster into progressively smaller ones. A SOM map with only two neurons is utilized as a nonlinear classifier to split clusters into two subsets. SOM has a higher discriminant power than the lineardiscriminant functions of [33]. Furthermore, we use a localglobal adaptive clustering procedure, similar to that in [36], whose cornerstone is the selfsimilarity found in the global and local characteristics of many realworld datasets. Specifically, we assess a correlation measure among the features of the entire dataset (global metric) and those of the smaller clusters obtained at a certain step of the algorithm (local metrics). Hence, global and local metrics are compared to determine when the current clusters have to be further split. Prior to describing the algorithm, we introduce the following concepts:
 Data point: The input dataset is composed of N data points, where “data point” i is the feature column vector ${\mathit{x}}_{i}\in \mathcal{X}$ associated with the parking sensor $i=1,\cdots ,N$. These vectors are conveniently represented through the full feature matrix $\mathit{X}=[{\mathit{x}}_{1},\cdots ,{\mathit{x}}_{N}]$. With ${\mathit{X}}_{p}$, we mean a submatrix of $\mathit{X}$ obtained by collecting p columns (feature vectors), not necessarily the first p. A generic cluster $\mathcal{C}$ containing p elements is then uniquely identified by a collection of p sensors and by the corresponding feature matrix ${\mathit{X}}_{p}$.
 Cluster cohesiveness: Consider a cluster $\mathcal{C}$ with p elements, and let ${\mathit{X}}_{p}$ be the corresponding feature matrix. We use a scatter function as a measure of its cohesiveness, i.e., to gauge the distance among the cluster elements and its mean (centroid). The centroid of ${\mathit{X}}_{p}=[{\mathit{x}}_{1},\cdots ,{\mathit{x}}_{p}]$ is computed as: ${\mathit{\mu}}_{p}=({\sum}_{j=1}^{p}{\mathit{x}}_{j})/p$. The dispersion of the cluster members around ${\mathit{\mu}}_{p}$ is assessed through the sample standard deviation:$$\sigma ({\mathit{X}}_{p})=\sqrt{\frac{1}{p1}\sum _{j=1}^{p}{\parallel {\mathit{x}}_{j}{\mathit{\mu}}_{p}\parallel}^{2}}\phantom{\rule{0.166667em}{0ex}},$$
 Global vs. local clustering metrics: In our tests, we experimented with different metrics, and the best results were obtained by tracking the correlation among features, as we now detail. We proceed by computing two statistical measures: (1) a first metric, referred to as global, is obtained for the entire feature matrix $\mathit{X}$; (2) a local metric is computed for the smaller clusters (matrix ${\mathit{X}}_{p}$).
 (1)
 Global metric: Let $\mathit{X}$ be the full feature matrix. From $\mathit{X}$, we obtain the $N\times N$ correlation matrix $\mathit{C}=\{{c}_{ij}\}$, where ${c}_{ij}=\mathrm{corr}({\mathit{x}}_{i},{\mathit{x}}_{j})$. Thus, we average $\mathit{C}$ by row, obtaining the Nsized vector $\overline{\mathit{c}}={[{\overline{c}}_{1},\cdots ,{\overline{c}}_{N}]}^{T}$, with ${\overline{c}}_{i}=({\sum}_{j=1}^{N}{c}_{ij})/N$. We respectively define $\mathrm{stdev}(\overline{\mathit{c}})$ and $\mathrm{mean}(\overline{\mathit{c}})$ as the sample standard deviation and the mean of $\overline{\mathit{c}}$. We finally compute two global measures for matrix $\mathit{X}$ as:$$\begin{array}{ccc}\mathtt{meas}\mathtt{1}(\mathit{X})& =& \mathrm{stdev}(\overline{\mathit{c}})\\ \mathtt{meas}\mathtt{2}(\mathit{X})& =& \mathrm{mean}(\overline{\mathit{c}})\phantom{\rule{0.166667em}{0ex}}.\end{array}$$
 (2)
 Local metric: The local metric is computed on a subsection of the entire dataset, namely on the clusters that are obtained at runtime. Now, let us focus on one such cluster, say cluster $\mathcal{C}$ with $\left\mathcal{C}\right=p$. Hence, we build the corresponding feature matrix ${\mathit{X}}_{p}$ by selecting the p columns of $\mathit{X}$ associated with the elements in $\mathcal{C}$. Thus, we compute the correlation matrix of ${\mathit{X}}_{p}$, which we call ${\mathit{C}}_{p}$, and the psized vector ${\overline{\mathit{c}}}^{\prime}={[{\overline{c}}_{1}^{\prime},\cdots ,{\overline{c}}_{p}^{\prime}]}^{T}$, obtained averaging ${\mathit{C}}_{p}$ by row as above. The local measures associated with matrix ${\mathit{X}}_{p}$ are:$$\begin{array}{ccc}\mathtt{meas}\mathtt{1}({\mathit{X}}_{p})& =& \mathrm{stdev}({\overline{\mathit{c}}}^{\prime})\\ \mathtt{meas}\mathtt{2}({\mathit{X}}_{p})& =& min({\overline{\mathit{c}}}^{\prime})\phantom{\rule{0.166667em}{0ex}},\end{array}$$
 Global vs. local dominance: We now elaborate on the comparison of global and local metrics. Let $\mathit{X}$ and ${\mathit{X}}_{p}$ respectively be the full feature matrix and that of a cluster obtained at runtime by our algorithm. Global and local metrics are respectively computed using Equations (6) and (7) and are compared in a Pareto [37] sense as follows. We say that the global metric (matrix $\mathit{X}$) dominates the local one (matrix ${\mathit{X}}_{p}$) if the following inequalities are jointly verified:$$\begin{array}{ccc}\mathbf{dominance}& & \\ \mathtt{meas}\mathtt{1}(\mathit{X})& >& \mathtt{meas}\mathtt{1}({\mathit{X}}_{p})\\ \mathtt{meas}\mathtt{2}(\mathit{X})& <& \mathtt{meas}\mathtt{2}({\mathit{X}}_{p})\phantom{\rule{0.166667em}{0ex}}.\end{array}$$
Our unsupervised SOMbased clustering technique is detailed next.
Algorithm 2 Unsupervised SOM clustering: 

Polishing: The above cluster splitting procedure is very effective in isolating outliers, and these are usually moved onto clusters containing a single element (singletons). Nevertheless, some of the resulting nonsingleton clusters may contain data points that are very close to one another (according to, e.g., the Euclidean distance metric), and this is because separating a single outlier from a cluster may at times require multiple splitting steps, which may entail scattering a uniform cluster into multiple, but (statistically) very similar ones. To solve this, we use a final polishing procedure to rejoin (merge) similar clusters. A similar strategy was originally proposed in [38]. The merge works as follows: Let $({\mathcal{C}}_{1},{\mathcal{C}}_{2})$ be a cluster pair in $\mathcal{B}$. We first evaluate their union $\mathcal{C}={\mathcal{C}}_{1}\cup {\mathcal{C}}_{2}$, from which we obtain ${\mathit{X}}_{p}$, the feature matrix of $\mathcal{C}$, and its cohesiveness $\sigma ({\mathit{X}}_{p})$. We compute the cohesiveness for each cluster pair in $\mathcal{B}$, and we merge the two clusters with the smallest one. This is repeated until a certain stopping condition is met. Two stopping conditions can be considered: (s1) we keep merging until the number of cluster is equal to a preset number k; (s2) we keep merging until in $\mathcal{B}$ there are no cluster pairs $({\mathcal{C}}_{1},{\mathcal{C}}_{2})$ with $\sigma ({\mathit{X}}_{p})<{\sigma}_{\mathrm{th}}$.
Discussion: Algorithm 2 iteratively splits the feature set $\mathcal{X}$ into smaller subsets, based on the relation between global and local metrics and on a local target cohesiveness, ${\sigma}_{\mathrm{th}}$. SOM classifiers are utilized due to their selftuning and nonlinear characteristics, and decision (Voronoi) regions to separate the dataset into clusters are obtained in a fully unsupervised manner. We observe that splitting the data points (feature vectors) into progressively smaller subsets allows for a progressively increasing precision in the classification, i.e., at the beginning, we perform a coarse classification that is subsequently refined in the following iterations. Most importantly, the decision as to whether to split is made based on selfsimilarity considerations, using local vs. global metrics, but also on the expected cohesiveness of the clusters. For real data, we found the selfsimilarity principle to be especially important (and often the only one that was used), but for more regular (synthetic) data patterns (e.g., same statistics across days and regularly spaced in terms of average measures), the second strategy had a higher impact. The best performance was obtained through a combination of these two approaches, and it has shown a robust behavior of the clustering algorithm in all of the considered settings. The final algorithm requires one to set the single parameter ${\sigma}_{\mathrm{th}}$ (γ), which represents our clue about the target cohesiveness of the true clusters. Note that the same ${\sigma}_{\mathrm{th}}$ is used in the splitting and in the polishing phases. The DBSCAN parameters ε and MinPts play a similar role.
6. Numerical Results
In this section, we fine tune and evaluate the previouslydiscussed clustering techniques. In Section 6.1 and Section 6.2, we use synthetic parking traces of increasing complexity, by adjusting the clustering parameters so as to obtain the best possible classification performance. Note that working with synthetic data is very valuable, as it provides a ground truth to assess the quality of the clusters identified by the schemes. Specifically, in Section 6.1, we test the classification performance for an increasing number of clusters, whereas in Section 6.2, we keep the number of clusters fixed, but we use synthetic signals exhibiting complex statistics, with parameters changing hourly across a day and differing between weekdays and weekends. These signals are designed in an attempt to mimic, as accurately as possible, those in the Worldsensing deployment. Hence, in Section 6.3, the selected clustering techniques are tested with real parking data.
Performance measures: The two most widelyadopted metrics to assess the goodness of a classifier are its precision P and recall R. For our multiclass problem, their calculation entails the computation of a socalled confusion matrix $\mathit{Z}=\{{z}_{ij}\}$, as follows [39]. In general, let k be the number of classes (clusters), and let ${z}_{ij}$ be the number of data points classified of class i that actually belong to class j, with $i,j=1,\cdots ,k$. Therefore, ${z}_{ii}$ are the points that are correctly classified (the true positives), whereas ${z}_{ij}$, with $i\ne j$ are misclassified points. The confusion matrix is $\mathit{Z}$; the precision associated with class i is computed as the fraction of events that were correctly classified of class i (${z}_{ii}$) out of all instances where the clustering algorithm declared that a point belongs to class i, i.e., ${P}_{i}={z}_{ii}/{\sum}_{j=1}^{k}{z}_{ij}$; the recall is instead the ratio between the number of points that were correctly classified of type i divided by the total number of type i events, i.e., ${R}_{i}={z}_{ii}/{\sum}_{j=1}^{k}{z}_{ji}$. As is customary in the evaluation of classifiers, precision and recall are often combined into their harmonic mean [40], which is called the Fmeasure and is used as the single quality parameter. The Fmeasure associated with class i is thus:
$${F}_{i}=2{P}_{i}{R}_{i}/({P}_{i}+{R}_{i})\phantom{\rule{0.166667em}{0ex}}.$$
The weighted Fmeasure (F) is finally obtained as a weighted average of the classes’ Fmeasures, weighted by the proportion of how many points are in each class. One last consideration is in order. We deal with an unsupervised classification problem, and in turn, although the use of synthetic traces allows controlling the real number of classes k, the clustering schemes may split the data points into ${k}^{\prime}\ne k$ sets. The Fmeasure calculation has to be modified to take this into account, and we did so by computing the weighted Fmeasure (through the above procedure) on the ${k}^{\u2033}=min({k}^{\prime},k)$ clusters identified by the algorithms that most closely matched the actual k ones (specifically, precision ${P}_{i}$ and recall ${R}_{i}$ are computed for each cluster $i=1,\cdots ,{k}^{\u2033}$, where these are the clusters that most closely match the actual k clusters in the dataset, obtaining ${P}_{i}={z}_{ii}/{\sum}_{j=1}^{{k}^{\prime}}{z}_{ij}$ and ${R}_{i}={z}_{ii}/{\sum}_{j=1}^{{k}^{\prime}}{z}_{ji}$, where ${k}^{\prime}$ is the number of clusters found by the algorithm).
6.1. Synthetic Data: Classification Performance with Varying Number of Clusters
For the results in this section, we artificially created a dataset with a predefined number of clusters, each of them featuring specific distributions for parking event durations (r.v. ${t}_{\mathrm{ON}}$) and vacancies (r.v. ${t}_{\mathrm{OFF}}$). The number of clusters is k, with $k\in \{2,3,\cdots ,20\}$, and the total number of parking sensors is kept fixed and equals $N=370$ (i.e., $N/k$ sensors per cluster on average). The sensors in the first cluster have the lowest average parking time, i.e., ${T}_{ON}=10\phantom{\rule{0.166667em}{0ex}}\mathrm{min}$, and the highest ${T}_{OFF}=600\phantom{\rule{0.166667em}{0ex}}\mathrm{min}$. The last cluster contains sensors with the highest ${T}_{ON}$ and the lowest ${T}_{OFF}$. These values are inferred from the range of parking times and vacancies in the real dataset. The intermediate clusters have evenlyspaced $({T}_{ON},{T}_{OFF})$ pairs in the range (10, 600) min in a way that ${T}_{ON}$ increases from 10 to 600 min for an increasing k, whereas ${T}_{\mathrm{OFF}}$ correspondingly decreases from 600 to 10 min. The standard deviation is kept fixed at $\sigma =30$ min for all of the sensors and all values of k. For each k, the final multidimensional synthetic signal is obtained generating six months of parking events for each of the 370 sensors. While resembling real parking behaviors, this first dataset is much simpler than what we may expect in a real deployment. In fact, in real settings, parking statistics change on a hourly basis and differ from day to day. Although we consider more complex datasets in the following sections, we deem this evaluation meaningful, as it allows a preliminary assessment of the baseline performance of the selected clustering schemes.
The feature weights ${w}_{1},{w}_{2},{w}_{3},{w}_{4}$ are optimized for each clustering algorithm, so that it delivers its best possible classification performance for $k=5$ clusters. We did so because $k=5$ is the typical number of clusters that we have seen in real deployments, based on our inspection of real parking data. Hence, the weights are kept constant for all of the considered values of k, and the clustering parameters of each algorithm are optimized, by recalling that kmeans does not require any parameters to be set, but takes the actual number of clusters k as input. Note that, as k increases, the correct classification of the dataset becomes increasingly difficult, posing serious challenges to all of the clustering techniques, as: (1) the number of sensors per cluster decreases, leading to fewer examples for each class and (2) the sensors belonging to neighboring clusters become more difficult to separate out, as the differences in their patterns become less pronounced.
The weighted Fmeasure for the clustering algorithms of Section 5 is shown in Figure 7. Each point in this plot was obtained by averaging over a number of experiments so that its 95% confidence interval falls within 1% of the (plotted) average Fmeasure. As shown in this figure, although kmeans++ knows the exact number of clusters k in advance, it is not a good clustering solution. In fact, it fails to correctly classify the input data even when the number of clusters is low, i.e., smaller than five, and obtains a flawless classification only for $k=2$. EM does a better job, being able to perfectly classify the parking traces up to and including $k=5$, but it fails as k gets beyond this value, where its performance becomes comparable with that of kmeans. DBSCAN performs much better, delivering perfect classifications up to and including $k=9$ and achieving a dramatic improvement over kmeans and EM. This confirms the great ability of DBSCAN in classifying complex data, without knowing in advance the number of clusters (unsupervised clustering). What is shown in the plot is the best possible result that DBSCAN may deliver, as its parameters ε and MinPts were optimized for each k, so as to obtain the best classification performance. These parameters encode DBSCAN’s knowledge about the density and the variance of feature vectors inside the clusters. The solid curve in Figure 7 shows the weighted Fmeasure of our divisive SOM approach. The SOMbased algorithm shows superior performance, granting perfect classification up to and including $k=10$ and providing an Fmeasure improvement over DBSCAN ranging from 25% to 40% for $k=13,\cdots ,20$. SOMbased clustering has been optimized for each k, and this entails the adjustment of the sole parameter ${\sigma}_{\mathrm{th}}$.
6.2. Synthetic Data: Classification Performance with Outliers and Complex Statistics
In this section, the clustering algorithms are finetuned (finding optimal weights and parameters) considering a second synthetic dataset that has been created to very closely resemble the statistics of real parking events. Hence, the optimized solutions are used with real data in the next Section 6.3. The $N=370$ sensor nodes in the deployment are split into five clusters, as visually represented in Figure 8, and all nodes within a cluster have the same statistical behavior. For each cluster, we have considered a different pair of Weibull pdfs. Specifically, the nodes in Cluster 1 were configured to produce an average parking duration as that dictated by the “Min” pdf in Table 2, whereas those of Cluster 5 reproduce the “Max” pdf. Clusters 2 to 4 were assigned three pdf pairs so as to obtain average parking durations evenly spaced between those of “Min” and “Max”. Once the ${t}_{\mathrm{ON}}$ pdf is assigned to a sensor, its ${t}_{\mathrm{OFF}}$ statistics is picked by matching the ${T}_{\mathrm{OFF}}$ that this sensor would show in the real parking dataset. In addition, parking statistics change on a hourly basis within the same day, and we differentiate between weekdays and weekends, so as to mimic as closely as possible the statistics of real data. Finally, 10% of the sensors generate parking events using statistical distributions that are typical of outliers. This is implemented to test the outlier detection capability of the algorithms.
We simulated parking events for this setup running the kmeans, DBSCAN, EM and SOM clustering algorithms for a number of instances, setting a different fourtuple $({w}_{1},{w}_{2},{w}_{3},{w}_{4})$ for each run, where ${w}_{4}=1({w}_{1}+{w}_{2}+{w}_{3})$ and ${w}_{1},{w}_{2},{w}_{3}\in [0,1]$. At the end of each classification instance, we collected the synthetic parking traces from all nodes and checked whether the five clusters and the outlier sensors were successfully identified. We repeated this, spanning over the three weights ${w}_{1},{w}_{2}$ and ${w}_{3}$ and jointly searching for the best parameters (ε and MinPts for DBSCAN and γ for SOM). The final results of this search are shown in the heat maps of Figure 9, where we plot the Fmeasure as a function of ${w}_{2}$ and ${w}_{3}$, preassigning ${w}_{1}$ to the best weight for each scheme (we note that feasible weights are always below the main diagonal). The best classification results are obtained with the following parameters:
 kmeans: ${w}_{1}=0.06$ and ${w}_{2}={w}_{3}=0.3$.
 EM: ${w}_{1}=0.35$, ${w}_{2}=0.06$ and ${w}_{3}=0.26$.
 DBSCAN: ${w}_{1}=0.2$, ${w}_{2}=0.3$, ${w}_{3}=0.02$, $\u03f5=0.21$ and MinPts $=5$.
 SOM: ${w}_{1}=0.1$, ${w}_{2}=0.34$, ${w}_{3}=0.04$ and $\gamma =0.7$ ($\gamma ={\sigma}_{\mathrm{th}}/\sigma (\mathit{X})$).
From the results of Figure 9, we see that SOM provides better classification performance, and this is especially due to the fact that it more reliably identifies outliers. Furthermore, with respect to DBSCAN, we see that it generally provides good performance for a wider weight region. This fact is in general desirable for a clustering algorithm, as it amounts to an improved robustness against (unforeseen) changes in the statistics underpinning the data.
6.3. Classification Performance on Real Data
In this section, we apply the selected clustering techniques to the real parking data of Section 3.1. In Table 3, we show some occupancy statistics of the Worldsensing dataset over six months of data. Overall, the system is stable and well behaving: the hourly average occupancy remains mostly around 40%, and the system never reaches full capacity across all months. The maximum occupancy values are between 80% and 90%, with the highest peaks being during the winter holidays, as expected.
However, some of the sensors do exhibit unexpected patterns, as can be observed from Figure 10, where we show the average duration of parking events as a function of the sensor identifier. From this plot, we see that at least four sensors reported very long parking events, i.e., on the order of days. A more careful inspection also revealed that, generally, these sensors reported only a few events across the entire observation period. At times, other sensors exhibited parking patterns that no Weibull model could fit. Parking sensors that presented either of these two characteristics, i.e., excessively long parking events or poor agreement with a Weibull pdf, were tagged as outliers.
In Figure 11, we plot the average occupancy curves for the four clusters generated on this dataset by kmeans, EM, DBSCAN and SOM (Algorithm 2), which were configured with the weights and parameters found in Section 6.2. In these plots, the cluster identifiers have been indicated as a label on top of the corresponding curves, using the same numbering for the four schemes. We emphasize that SOM identifies an additional outlier cluster containing a total of 12 nodes, as shown in Figure 12, and that it successfully identifies all of the nodes that we manually tagged as outliers. On the other hand, we stress that kmeans, DBSCAN and EM were unable to isolate these outliers, by instead spreading them over the four clusters. As a result, the first four clusters obtained by SOM (Figure 11d) have a smaller variance (represented through a shaded area around each curve) and are sharply separated out. This does not always occur for DBSCAN; see, e.g., Clusters 3 and 4 in Figure 11c. In addition, Clusters 1 and 2 in this plot show a higher variance with respect to their SOM counterparts, especially between 00:00 and 05:00, and Clusters 3 and 4 are almost overlapping within and around the same interval. For DBSCAN, the results of Cluster 1 look particularly impacted, as the corresponding occupancy rate is considerably lower than that of all of the other schemes, and this cluster is closer to the remaining ones. The results of kmeans are clearly unsatisfactory, as Clusters 2 and 3 almost overlap. EM does a better job, delivering a good solution, with the only problem that Clusters 3 and 4 are now almost indistinguishable between 00:00 and 13:00 (weekend).
Similar considerations also hold for the remaining statistical parameters (EF, PD, VD) and also for the full feature vectors ${\mathit{x}}_{i}$, although differences in the feature space are more difficult to translate into practical considerations. Overall, the proposed SOMbased approach looks to be a promising technique, providing excellent classification results in all settings and also being quite effective in the identification of outlier nodes. A last observation is in order. In the present work, we did not explicitly measure the computational complexity of the algorithms as we target offline learning strategies. In addition, with the considered dataset, the computation time is modest: we have measured computation times that never exceed one minute for the analysis of six months of data on a standard desktop computer with a $3.2$GHz quadcore Intel Core i5 processor with 8 GB RAM, using unoptimized MATLAB code. For considerably bigger datasets (big data), the presented algorithms have to be modified, for example using parallel computing techniques [41]. We leave these questions open for future research.
7. Conclusions
In this paper, we have investigated classification schemes for smart parking applications, focusing on the detection of outliers and on the joint and automated clustering of parking sensors as a function of their readings. Real data, from a commercial deployment, were used to understand the peculiarities of realworld parking events and then assess the effectiveness of selected classification approaches, namely kmeans, expectation maximization clustering and DBSCAN. An original classification algorithm, based on selforganizing maps, was also proposed and proven to be superior to existing techniques, especially as concerns the detection of outliers. The present work is a first step toward data mining for smart parking applications, but several questions remain open to further explorations. We in fact believe that parking traces, besides being meaningful to street parking applications, also contain relevant information about how people behave, how neighborhoods are used (e.g., residential versus commercial) and may also reveal interesting facts about mobility, help implement traffic management solutions, etc. We leave these points open for future research.
Acknowledgments
The research work in this paper has been supported by Worldsensing, through a student contest that was held at the Department of Information Engineering of the University of Padova, Italy. Any opinions, findings and conclusions herein are those of the authors and do not necessarily represent those of Worldsensing.
Author Contributions
Nicola Piovesan has contributed to software for the statistical analysis of parking data, exploring relevant patterns for our subsequent designs. He has also implemented the final clustering techniques that have been presented and discussed in the paper, obtaining their results through numerical simulation. Leo Turi has performed the statistical analysis of parking data, devising the feature extraction approach presented in the paper, implementing the first version of our SOMbased clustering algorithm, and validating it through numerical simulations. He has also written the first version of the software we used to assess the performance analysis of the clustering schemes. Enrico Toigo has contributed to the software for the statistical analysis of parking data and to the initial SOMclustering algorithm. He has also implemented a number of preliminary clustering techniques, including the one presented in Section 4. Borja Martinez has provided the parking dataset, commenting the algorithms, the writeup, the results and steering the work during all its phases. He has provided important insights and directions of practical importance, to make the algorithms useful in commercial scenarios. At Worldsensing, Borja was responsible for the commissioning and calibration of the parking sensors. Michele Rossi has designed the initial SOM algorithm, has contributed to the design of the SOMbased divisive clustering scheme, interpreting the results and modifying the algorithm as needed be. He has also written the paper, conceived and supervised the work across all of its phases.
Conflicts of Interest
The authors declare no conflict of interest. The founding sponsors had collected and, upon anonymizing it, provided the dataset that was used for the results in this paper. The sponsors has likewise agreed to publish the techniques and the results herein.
Abbreviations
DBSCAN  DensityBased Spatial Clustering of Applications with Noise 
EF  Event Frequency 
EM  Expectation Maximization 
GMM  Gaussian Mixture Model 
IoT  Internet of Things 
PD  Parking Duration 
PGI  Parking Guidance and Information 
SO  Sensor Occupation 
SOM  SelfOrganizing Maps 
SVDD  Support Vector Data Description 
VD  Vacancy duration 
WSN  Wireless Sensor Networks 
References
 Zanella, A.; Bui, N.; Castellani, A.; Vangelista, L.; Zorzi, M. Internet of things for smart cities. IEEE Internet Things J. 2014, 1, 22–32. [Google Scholar] [CrossRef]
 Jog, Y.; Sajeev, A.; Vidwans, S.; Mallick, C. Understanding smart and automated parking technology. Int. J. u eServ. Sci. Technol. 2015, 8, 251–262. [Google Scholar] [CrossRef]
 Rathorea, M.M.; Ahmada, A.; Paul, A.; Rho, S. Urban planning and building smart cities based on the internet of things using big data analytics. Comput. Netw. 2016, 101, 63–80. [Google Scholar] [CrossRef]
 Jain, A.K.; Murty, M.N.; Flynn, P.J. Data clustering: A review. ACM Comput. Surv. 1999, 31, 264–323. [Google Scholar] [CrossRef]
 Sander, J.; Ester, M.; Kriegel, H.P.; Xu, X. Densitybased clustering in spatial databases: The algorithm GDBSCAN and its applications. Data Min. Knowl. Discov. 1998, 2, 169–194. [Google Scholar] [CrossRef]
 McLachlan, G.; Krishnan, T. The EM Algorithm and Extensions, 2nd ed.; WileyInterscience: Hoboken, NJ, USA, 2008. [Google Scholar]
 Yanxu, Z.; Rajasegarar, S.; Leckie, C.; Palaniswami, M. Smart car parking: Temporal clustering and anomaly detection in urban car parking. In Proceedings of the IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), Singapore, 21–24 April 2014.
 Kohonen, T. SelfOrganization and Associative Memory; Springer: Berlin, Germany, 1984. [Google Scholar]
 Kohonen, T. SelfOrganizing Maps; Springer: Berlin, Germany, 2001. [Google Scholar]
 Vesanto, J.; Alhoniemi, E. Clustering of the selforganizing map. IEEE Trans. Neural Netw. 2000, 11, 586–600. [Google Scholar] [CrossRef] [PubMed]
 Polycarpou, E.; Lambrinos, L.; Protopapadakis, E. Smart parking solutions for urban areas. In Proceedings of the IEEE International Symposium and Workshops on a World of Wireless, Mobile and Multimedia Networks (WoWMoM), Madrid, Spain, 4–7 June 2013.
 Dance, C. Lean smart parking. Park. Prof. 2014, 30, 26–29. [Google Scholar]
 Pierce, G.; Shoup, D. Getting the prices right. J. Am. Plan. Assoc. 2013, 79, 67–81. [Google Scholar] [CrossRef]
 Worldsensing. Smartprk—Making Smart Cities Happen. Available online: http://www.fastprk.com/ (accessed on 21 September 2016).
 Yang, J.; Portilla, J.; Riesgo, T. Smart parking service based on wireless sensor networks. In Proceedings of the Annual Conference on IEEE Industrial Electronics Society (IECON), Montreal, QC, Canada, 25–28 October 2012.
 Shoup, D.C. Cruising for parking. Transp. Policy 2006, 13, 479–486. [Google Scholar] [CrossRef]
 Wang, H.; He, W. A Reservationbased smart parking system. In Proceedings of the IEEE Conference on Computer Communications Workshops, Shanghai, China, 10–15 April 2011; pp. 690–695.
 Geng, Y.; Cassandras, C. New “Smart Parking” system based on resource allocation and reservations. IEEE Trans. Intell. Transp. Syst. 2013, 14, 1129–1139. [Google Scholar] [CrossRef]
 Khan, Z.; Anjum, A.; Kiani, S.L. Cloud based big data analytics for smart future cities. In Proceedings of the IEEE/ACM International Conference on Utility and Cloud Computing, Dresden, Germany, 9–12 December 2013.
 Anastasi, G.; Antonelli, M.; Bechini, A.; Brienza, S.; de Andrea, E.; de Guglielmo, D.; Ducange, P.; Lazzerini, B.; Marcelloni, F.; Segatori, A. Urban and social sensing for sustainable mobility in smart cities. In Proceedings of the 2013 Sustainable Internet and ICT for Sustainability (SustainIT), Palermo, Italy, 30–31 October 2013.
 Barone, R.E.; Giuffrè, T.; Siniscalchi, S.M.; Morgano, M.A.; Tesoriere, G. Architecture for parking management in smart cities. IET Intell. Transp. Syst. 2014, 8, 445–452. [Google Scholar] [CrossRef]
 Gupta, A.; Sharma, V.; Ruparam, N.K.; Jain, S.; Alhammad, A.; Ripon, M.A.K. Integrating pervasive computing, InfoStations and swarm intelligence to design intelligent contextaware parkingspace location mechanism. In Proceedings of the International Conference on Advances in Computing, Communications and Informatics (ICACCI), Delhi, India, 24–27 September 2014.
 He, W.; Yan, G.; Xu, L.D. Developing vehicular data cloud services in the IoT environment. IEEE Trans. Ind. Inform. 2014, 10, 1587–1595. [Google Scholar] [CrossRef]
 Vlahogiannia, E.I.; Kepaptsogloua, K.; Tsetsosa, V.; Karlaftisa, M.G. A realtime parking prediction system for smart cities. J. Intell. Transp. Syst. Technol. Plan. Oper. 2016, 20, 192–204. [Google Scholar] [CrossRef]
 Martinez, B.; Vilajosana, X.; Vilajosana, I.; Dohler, M. Lean sensing: Exploiting contextual information for most energyefficient sensing. IEEE Trans. Ind. Inform. 2016, 11, 1156–1165. [Google Scholar] [CrossRef]
 Lin, T.; Rivano, H.; Le Mouël, F. How to choose the relevant MAC protocol for wireless smart parking urban networks? In Proceedings of the ACM International Symposium on Performance Evaluation of Wireless Ad Hoc, Sensor, and Ubiquitous Networks (PEWASUN), Montreal, QC, Canada, 21–26 September 2014.
 Bishop, C. Pattern Recognition and Machine Learning; Springer: New York, NY, USA, 2007. [Google Scholar]
 Jain, A.K. Data clustering: 50 Years beyond kmeans. Pattern Recognit. Lett. 2010, 38, 651–666. [Google Scholar] [CrossRef]
 Lloyd, S. Least squares quantization in PCM. IEEE Trans. Inf. Theory 1982, 28, 129–137. [Google Scholar] [CrossRef]
 Arthur, D.; Vassilvitskii, S. kmeans++: The advantages of careful seeding. In Proceedings of the ACMSIAM Symposium on Discrete Algorithms (SODA), New Orleans, LA, USA, 7–9 January 2007.
 Hall, M.; Frank, E.; Holmes, G.; Pfahringer, B.; Reutemann, P.; Witten, I.H. The WEKA data mining software: An update. ACM SIGKDD Explor. Newsl. 2009, 11, 10–18. [Google Scholar] [CrossRef]
 Haykin, S. Neural Networks and Learning Machines, 3rd ed.; Pearson Education; Prentice Hall: Upper Saddle River, NJ, USA, 2001. [Google Scholar]
 Boley, D.L. Principal direction divisive partitioning. Data Min. Knowl. Discov. 1998, 2, 325–344. [Google Scholar] [CrossRef]
 Savaresi, S.M.; Boley, D.L.; Bittanti, S.; Gazzaniga, G. Cluster selection in divisive clustering algorithms. In Proceedings of the International Conference on Data Mining (SIAM), Arlington, VA, USA, 11–13 April 2002.
 Hofmey, D.P.; Pavlidis, N.G.; Eckley, I.A. Divisive clustering of high dimensional data streams. Stat. Comput. 2016, 26, 1101–1120. [Google Scholar] [CrossRef]
 Qu, B.; Zhang, Y.; Yang, T. Localglobal joint decision based clustering for airport recognition. In Intelligence Science and Big Data Engineering; Sun, C., Fang, F., Zhou, Z.H., Yang, W., Liu, Z.Y., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
 Pareto, V. Cours d’Economie Politique; Librairie Droz: Lausanne, Switzerland, 1896; Volume 1. [Google Scholar]
 Karypis, G.; Han, E.H.; Kumar, V. Chameleon: Hierarchical clustering using dynamic modeling. IEEE Comput. 1999, 32, 68–75. [Google Scholar] [CrossRef]
 Sokolova, M.; Lapalme, G. A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 2009, 45, 427–437. [Google Scholar] [CrossRef]
 Musicant, D.R.; Kumar, V.; Ozgur, A. Optimizing Fmeasure with support vector machines. In Proceedings of the International FLAIRS Conference, St. Augustine, FL, USA, 20–23 October 2003; pp. 356–360.
 Tsai, C.F.; Lin, W.C.; Ke, S.W. Big data mining with parallel computing: A comparison of distributed and MapReduce methodologies. J. Syst. Softw. 2016, 122, 83–92. [Google Scholar] [CrossRef]
Figure 1.
Probability distribution function of the parking duration (random variable (r.v.) ${t}_{\mathrm{ON}}$).
Figure 2.
Holiday/weekend vs. weekday occupancy rates in the month of January 2015: comparison between occupancy rates from real data and synthetic traces generated by our eventbased simulator. (a) Worldsensing dataset; (b) eventbased simulator.
Figure 3.
Anomaly detection: accuracy vs. detection rate: month of January 2015. Different curves correspond to specific increases in the parking times, from 10% to 70% for 20% of the parking nodes.
Figure 4.
Feature function $f(t)$: calculation example for a typical parking sensor. The feature vector ${\mathit{x}}_{i}={[{x}_{i1},\cdots ,{x}_{iK}]}^{T}$ for sensor i is obtained as ${x}_{it}\leftarrow f(t)$ for $t=1,\cdots ,K$.
Figure 7.
Weighted Fmeasure for the four selected clustering techniques vs. the number of clusters k.
Figure 8.
Visual representation of the five clusters considered in Section 6.2. The locations of the nodes correspond to those of the parking sensors in the considered Worldsensing deployment.
Figure 9.
Optimal weights. In (a), the weights are ${w}_{1}=0.06$, ${w}_{2},{w}_{3}\in [0,0.94]$; in (b) the weights are ${w}_{1}=0.35$, ${w}_{2},{w}_{3}\in [0,0.65]$; in (c), the weights are ${w}_{1}=0.2$, ${w}_{2},{w}_{3}\in [0,0.8]$; in (d), the weights are ${w}_{1}=0.1$, ${w}_{2},{w}_{3}\in [0,0.9]$. In the heat maps, the weighted Fmeasure is represented with a color. The weights above the main diagonal are indicated with a dark blue color and are infeasible, as their sum is greater than one. Feasible weights lie below the main diagonal, and dark red means Fmeasure $=1$.
Parking  Weekday (wd)  Weekend (we)  Mean (in Minutes) 

Average  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}45.7422$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.6039$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}58.9885$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.6313$  ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}68.2438$ (wd) ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}83.3360$ (we) 
Max  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}124.8911$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.8137$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}121.0529$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.8445$  ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}139.8266$ (wd) ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}132.2398$ (we) 
Min  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}17.8723$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.4245$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}10.1799$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.4119$  ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}50.8284$ (wd) ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}31.2628$ (we) 
Vacancies  Weekday (wd)  Weekend (we)  Mean (in Minutes) 
Average  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}112.4832$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.8448$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}101.3203$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.7480$  ${T}_{\mathrm{OFF}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}122.8511$ (wd) ${T}_{\mathrm{OFF}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}120.9045$ (we) 
Max  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}417.8844$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}2.0947$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}355.2186$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}1.8366$  ${T}_{\mathrm{OFF}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}370.1241$ (wd) ${T}_{\mathrm{OFF}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}315.6035$ (we) 
Min  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}15.2319$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.4727$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}9.5868$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.4429$  ${T}_{\mathrm{OFF}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}33.9791$ (wd) ${T}_{\mathrm{OFF}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}24.6376$ (we) 
Weibull  Weekday (wd)  Weekend (we)  Mean (in Minutes) 

Cluster 1 (Min)  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}2.8830$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}4.9033$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}4.7391$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}3.8346$  ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}2.6441$ (wd) ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}4.2853$ (we) 
Cluster 2  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}33.9250$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}1.2681$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}41.5004$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}3.8024$  ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}31.4959$ (wd) ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}37.5088$ (we) 
Cluster 3 (Average)  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}45.7422$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.6039$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}58.9885$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}0.6313$  ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}68.2438$ (wd) ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}83.3360$ (we) 
Cluster 4  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}109.0669$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}1.1866$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}102.8083$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}1.6052$  ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}102.8975$ (wd) ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}92.1482$ (we) 
Cluster 5 (Max)  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}390.601$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}4.9137$  $\lambda \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}644.1756$ $\kappa \phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}1.2876$  ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}358.2768$ (wd) ${T}_{\mathrm{ON}}\phantom{\rule{0.166667em}{0ex}}=\phantom{\rule{0.166667em}{0ex}}596.1100$ (we) 
Table 3.
Average and Max occupancy per hour for the six months in the dataset (December 2014 to May 2015).
Occupancy Stat.  December 2014  January 2015  February 2015 

Avg/Hour  $44.49$%  $40.02$%  $42.04$% 
Max/Hour  $91.22$% 24 December 2014 at time 23:00  $86.61$% 23 January 2015 at time 20:00  $87.22$% 7 February 2015 at time 19:00 
March 2015  April 2015  May 2015  
Avg/Hour  $43.41$%  $40.04$%  $39.65$% 
Max/Hour  $83.45$% 21 March 2015 at time 19:00  $88.60$% 4 April 2015 at time 19:00  $85.10$% 9 May 2015 at time 19:00 
© 2016 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CCBY) license (http://creativecommons.org/licenses/by/4.0/).