Abstract
Consideration is given to the nonstationary analogue of queueing model in which the service happens only in batches of size 2, with the arrival rate and the service rate . One proposes a new and simple method for the study of the queue-length process. The main probability characteristics of the queue-length process are computed. A numerical example is provided.
1. Introduction
Non-stationary Markovian queueing models have been the subject of extensive research for the past few decades. It is well-known that the direct computation of time-dependent characteristics for arbitrary (in)homogeneous continuous-time Markov chains, which show up in the analysis of various queueing models, is a difficult problem. Thus, usually the alternative way is taken: one resorts to different types of approximations. One can find an overview of the approaches for the performance evaluation of time-dependent queueing systems up to 2016 in [1]. The papers [2,3,4] are devoted to the construction of the main performance characteristics and papers [5,6,7,8] deal with the estimation of the convergence rate and approximations. The general framework for the study of time-dependent queueing system systems is described in detail in the recent paper [8]. It consists of several steps, among which the most important one is the estimation of the upper bounds for the rate of convergence to the limiting regime. Having such bound allows one to find (compute) the time instant, say , starting from which probabilistic properties of do not depend on the value of (assuming that the process starts at time ). Thus, for example, if the transition intensities are periodic (say, 1-time-periodic), one can truncate the process on the interval and solve the forward Kolmogorov system of differential equations on this interval with . In such a way, one may build approximations for any limiting probability characteristics of and estimate stability (perturbation) bounds. For the details regarding the stability bounds, one can refer to [9,10,11,12,13,14,15] and references therein. If the reduced intensity matrix of a Markov chain (see the next section for the definition) is essentially positive, then the approach for the computation of the upper bounds on the rate of convergence metric is available: one may use the method of logarithmic norm of a linear operator function and use the bounds for the Cauchy operator of the (reduced) forward Kolmogorov system (see [6,7]). Note that such bounds may be sharp if the difference between the two initial conditions is nonnegative.
However, the method of the logarithmic norm is not always applicable, i.e., there are Markov chains with such transition intensities, for which it does not yield upper bounds for the rate of convergence. Such a Markov chain is the topic of this paper. Specifically, one considers an inhomogeneous analogue of the classical queue, in which the service happens only in batches of size 2. For this queue, we propose the simple new method, based on the direct application of differential inequalities, for the estimation of the queue-size probability characteristics.
2. Model Description and Basic Transformations
Consideration is given to the Markov chain being the queue-length (including a customer in server) at time t in the queuing system with batch service (only). It is assumed that customers enter the system only by one and the arrival intensity does not depend on the number of customers in the system, but depends on time, and is equal to . Customers can be served only in batches of size 2 and the service intensity does not depend on the number of customers in the system, but depends on time, and is equal to . The transition diagram for is given in Figure 1.
Figure 1.
Transition diagram for the Markov chain .
Denote by , the transition probabilities and by —the probability that is in state i at time t. Let be probability distribution vector at instant t. Throughout the paper, it is assumed that
where all are and are uniformly in i for any . In addition, it is assumed that the intensity functions and are nonnegative, continuous and bounded on the interval , for any . Then, the probabilistic dynamics of the process is represented by the forward Kolmogorov system of differential equations:
where is the transposed intensity matrix of the process, having the following form:
Throughout the paper, by , we denote the -norm, i.e., , and . Let be a set all stochastic vectors, i.e., vectors with non-negative coordinates and unit norm. Hence, we have for almost all . Hence, the operator function from into itself is bounded and continuous for all and thus Label (2) is a differential equation in the space with bounded operator, which has a unique solution for any arbitrary initial condition (see [16]).
The method that is being proposed in this paper relies on the following transformation (referring to [6]) of the intensity matrix . Since due to the normalization condition, one can rewrite the system (2) as follows:
where
Note that the bounds on the rate of convergence of the solutions of the system of differential equations
correspond to the same bounds of .
Denote by T the upper triangular matrix of ones i.e., for and 0, otherwise. Then,
Put . Then, we have
where
Such transformation has been applied in a series of papers for general Markovian queueing models (see, for example, [7]). As it was mentioned above, the analysis of the rate of convergence to the limiting regime (a detailed description of this approach and its generalization can be found, for example, in [8,17,18]) was based on the logarithmic norm of an operator function from to itself, which can be computed by the simple formula:
For the considered Markov chain , the method based on the logarithmic norm no longer applied. This is due to the fact that all column sums in are equal to zero. In the next section, one outlines another approach, which is based on the direct applications of the differential inequalities. It was firstly considered for a finite Markovian queueing model in [19].
3. Bounds on the Rate of Convergence
Let be a sequence such that . Denote by the diagonal matrix. By putting from (7), one obtains
where the matrix has the following form:
Let be an arbitrary solution of (7). Consider an interval with fixed signs of coordinates of . Let now signs of the entries coincide with signs of the corresponding coordinates of . Then, for all on the time interval and hence can be considered as the corresponding norm. Put and assume that
Consider now the system (9) on the interval . Then, the following bound holds:
If one puts , where the infimum is taken over all intervals with different combinations of coordinate signs of the solution, then for any such interval one has in the own corresponding norm, the inequality .
Let firstly all coordinates of be positive. Put , , and , for , where . Then, one has:
Therefore, one can take on the corresponding interval and .
Let now and for . In this case, we put , and , for , for the same . Then, one has:
Therefore, one can take on the corresponding interval and . Moreover, it can be noted that, in any other case, a number of negative elements will be added to the column sums in (10). Hence, all values of in the other situations can only increase, and therefore the corresponding values of for the same will be even greater.
Finally, if one takes , where the infimum is taken over all intervals with different combinations of coordinate signs of the solution, then the following bounds hold:
and the corresponding ‘absolute infimum’
By applying the comparison of norms, as it was done in [7], one obtains the following theorem.
Theorem 1.
Let
for some . Then, is weakly ergodic and the following bounds on the rate of convergence hold:
for any initial conditions.
Note that the inequality holds for both sequences. It implies an existence of the limiting mean for the process and the corresponding bounds on the rate of convergence (see, for example, [6,7]).
Let the process be homogeneous i.e., let and be positive numbers. Then, (14) is equivalent to and this is equivalent to . Put . Hence,
and the following is the corollary to Theorem 1.
Corollary 1.
Let be the queue-length process in queue with service in batches of size 2. Let . Then, is ergodic and the following bounds hold:
and
for any initial condition .
Note that the inequality implies an existence of the constant limiting mean for the process and the corresponding bounds on the rate of convergence.
4. Numerical Example
There exists a number of investigations of queueing models with service in batches (or group services) (see, for example, [20,21]). Consider one example of such a queueing model with periodic arrival and service rates. We will be interested in the following quantities: the probability that the total number of customers in the system at time t is i and the mean number of customers in the system at time t, provided that initially (at instant ), there were k customers in the system.
Let and . Put . Then, and the assumptions of Theorem 1 are fulfilled. Hence, is exponentially weakly ergodic ( i.e., for any initial conditions and , where and are the solutions of (2)) and has the 1-periodic limiting mean (A Markov chain has the limiting mean , if for any k.) . Now, applying the known truncation technique (See the detailed discussion and bounds in [22]), one can compute all probability characteristics of the queue-length process . The corresponding graphs are shown in Figure 2, Figure 3, Figure 4, Figure 5, Figure 6, Figure 7, Figure 8 and Figure 9. To ensure that the truncation error is less than , one can truncate the process at the level . Then, one can compute any probability characteristic using the “extreme” initial conditions and . Inequality (16) gives the corresponding (very rough) upper bounds on the rate of convergence for the state probabilities and for the mean number of customers in the system. Therefore, one can compute all characteristics on the intervals and , and obtain the limiting state probabilities and the limiting mean with error less . In Figure 2, Figure 3, Figure 4, Figure 5, Figure 6, Figure 7, Figure 8 and Figure 9 below, it can be seen that in fact it suffices to set . Figure 2, Figure 4, Figure 6 and Figure 8 show the mean number of customers in the system and the probabilities , and converge to their limiting values. One can explicitly see how they approach the time , starting from which the characteristics do not longer depend on the initial conditions. Other figures show their approximate limiting values.
Figure 2.
Example. The mean and for , this figure shows the rate of convergence.
Figure 3.
Example. The mean and for , this figure shows approximation of the limiting mean.
Figure 4.
Example. Probability of the empty queue for and initial conditions and , this figure shows the rate of convergence.
Figure 5.
Example. Probability of the empty queue for and initial conditions and , this figure shows approximation of the limiting probability .
Figure 6.
Example. Probability for and initial conditions and , this figure shows the rate of convergence.
Figure 7.
Example. Probability for and initial conditions and , this figure shows approximation of the limiting probability .
Figure 8.
Example. Probability for and initial conditions and , this figure shows the rate of convergence.
Figure 9.
Example. Probability for and initial conditions and , this figure shows approximation of the limiting probability .
5. Conclusions
In the paper, some estimates of the rate of convergence and the corresponding approach were discussed for an inhomogeneous countable state continuous-time Markov chain. This chain is considered as the queue-length process of a simple nonstationary model of a queue with single arrivals and batch service (only in batches of size 2). The applied approach allows for studying new classes of the continuous-time Markov chain such that the corresponding reduced intensity matrix is not essentially nonnegative.
Author Contributions
Conceptualization, A.Z. and Y.S.; Methodology, A.Z., Y.S. and A.K.; Software, Y.S.; Validation, Y.S., A.Z. and A.K.; Investigation, A.Z., Y.S. and A.K.; Writing—Original Draft Preparation, Y.S., A.Z. and A.K.; Writing—Review and Editing, Y.S., A.Z. and A.K.; Supervision, A.Z.; Project Administration, A.Z.
Funding
This research was supported by Russian Science Foundation under grant 19-11-00020.
Acknowledgments
The authors thank the referees for useful comments that improved the paper and Rostislav Razumchik for some helpful discussions.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Schwarz, J.A.; Selinka, G.; Stolletz, R. Performance analysis of time-dependent queueing systems: Survey and classification. Omega 2016, 63, 170–189. [Google Scholar] [CrossRef]
- Di Crescenzo, A.; Giorno, V.; Krishna Kumar, B.; Nobile, A.G. A Time-Non-Homogeneous Double-Ended Queue with Failures and Repairs and Its Continuous Approximation. Mathematics 2018, 6, 81. [Google Scholar] [CrossRef]
- Giorno, V.; Nobile, A.G.; Spina, S. On some time non-homogeneous queueing systems with catastrophes. Appl. Math. Comp. 2014, 245, 220–234. [Google Scholar] [CrossRef]
- Ammar, S.I.; Alharbi, Y.F. Time-dependent analysis for a two-processor heterogeneous system with time-varying arrival and service rates. Appl. Math. Model. 2018, 54, 743–751. [Google Scholar] [CrossRef]
- Meyn, S.P.; Tweedie, R.L. Stability of Markovian processes III: Foster- Lyapunov criteria for continuous time processes. Adv. Appl. Probab. 1993, 25, 518–548. [Google Scholar] [CrossRef]
- Zeifman, A.; Leorato, S.; Orsingher, E.; Satin Ya Shilova, G. Some universal limits for nonhomogeneous birth and death processes. Queueing Syst. 2006, 52, 139–151. [Google Scholar] [CrossRef]
- Zeifman, A.; Razumchik, R.; Satin, Y.; Kiseleva, K.; Korotysheva, A.; Korolev, V. Bounds on the Rate of Convergence for One Class of Inhomogeneous Markovian Queueing Models with Possible Batch Arrivals and Services. Int. J. Appl. Math. Comp. Sci. 2018, 28, 141–154. [Google Scholar] [CrossRef]
- Zeifman, A.; Satin, Y.; Kiseleva, K.; Korolev, V.; Panfilova, T. On limiting characteristics for a non-stationary two-processor heterogeneous system. Appl. Math. Comput. 2019, 351, 48–65. [Google Scholar] [CrossRef]
- Kartashov, N.V. Criteria for uniform ergodicity and strong stability of Markov chains with a common phase space. Theory Probab. Appl. 1985, 30, 71–89. [Google Scholar]
- Liu, Y. Perturbation bounds for the stationary distributions of Markov chains. SIAM J. Matrix Anal. Appl. 2012, 33, 1057–1074. [Google Scholar] [CrossRef]
- Mitrophanov, A.Y. Stability and exponential convergence of continuous-time Markov chains. J. Appl. Probab. 2003, 40, 970–979. [Google Scholar] [CrossRef]
- Mitrophanov, A.Y. The spectral gap and perturbation bounds for reversible continuous-time Markov chains. J. Appl. Probab. 2004, 41, 1219–1222. [Google Scholar] [CrossRef]
- Zeifman, A.I.; Korolev, V.Y. On perturbation bounds for continuous-time Markov chains. Stat. Probab. Lett. 2014, 88, 66–72. [Google Scholar] [CrossRef]
- Mitrophanov, A.Y. Connection between the Rate of Convergence to Stationarity and Stability to Perturbations for Stochastic and Deterministic Systems. In Proceedings of the 38th International Conference Dynamics Days Europe (DDE 2018), Loughborough, UK, 3–7 September 2018; Available online: http://alexmitr.com/talk_DDE2018_Mitrophanov_FIN_post_sm.pdf (accessed on 29 June 2019).
- Rudolf, D.; Schweizer, N. Perturbation theory for Markov chains via Wasserstein distance. Bernoulli 2018, 24, 2610–2639. [Google Scholar] [CrossRef]
- Daleckij, J.L.; Krein, M.G. Stability of Solutions of Differential Equations in Banach Space; American Mathematical Society: Providence, RI, USA, 2002; Volume 43. [Google Scholar]
- Sinitcina, A.; Satin, Y.; Zeifman, A.; Shilova, G.; Sipin, A.; Kiseleva, K.; Panfilova, T.; Kryukova, A.; Gudkova, I.; Fokicheva, E. On the Bounds for a Two-Dimensional Birth-Death Process with Catastrophes. Mathematics 2018, 6, 80. [Google Scholar] [CrossRef]
- Zeifman, A.; Satin, Y.; Kiseleva, K.; Korolev, V. On the Rate of Convergence for a Characteristic of Multidimensional Birth-Death Process. Mathematics 2019, 7, 477. [Google Scholar] [CrossRef]
- Zeifman, A.; Satin, Y.; Kiseleva, K.; Kryukova, A. Applications of Differential Inequalities to Bounding the Rate of Convergence for Continuous-time Markov Chains. AIP Conf. Proc. 2019, 2116, 090009. [Google Scholar]
- Brugno, A.; D’Apice, C.; Dudin, A.; Manzo, R. Analysis of an MAP/PH/1 queue with flexible group service. Int. J. Appl. Math. Comp. Sci. 2017, 27, 119–131. [Google Scholar] [CrossRef]
- Lee, H.W.; Baek, J.W.; Jeon, J. Analysis of the MX/G/1 queue under D-policy. Stoch. Anal. Appl. 2005, 23, 785–808. [Google Scholar] [CrossRef]
- Zeifman, A.; Satin Ya Korolev, V.; Shorgin, S. On truncations for weakly ergodic inhomogeneous birth and death processes. Int. J. Appl. Math. Comp. Sci. 2014, 24, 503–518. [Google Scholar] [CrossRef]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).