Abstract
A multi-server retrial queue with a hyper-exponential service time is considered in this paper. The study is performed by the method of asymptotic diffusion analysis under the condition of long delay in orbit. On the basis of the constructed diffusion process, we obtain approximations of stationary probability distributions of the number of customers in orbit and the number of busy servers. Using simulations and numerical analysis, we estimate the accuracy and applicability area of the obtained approximations.
1. Introduction
Nowadays, retrial queues (RQ) are very popular mathematical models of various real systems. These may be call centers [1,2] where a calling customer, if he or she find all operators busy, tries to make a new call again after some (random) time. In the case of modeling of data transmission via TCP [3] if a data packet is lost or corrupted, the packet should be retransmitted after certain time. In cellular mobile networks, more complex models of retrial queues are used (see [4,5]). Furthermore, we see great opportunities in using multi-server retrial queues for modeling and design data processing systems with high-intensity data flows [6,7]. These are not only fields where retrial queues may be applied (e.g., survey [8]).
A retrial queue is a such queueing system with limited number of servers where customers that arrived and do not find a free server are not lost, but go to special ‘waiting’ state, or are moved to special buffer (orbit) for waiting. In the orbit, the customers are not organizing in a queue (e.g., first come, first served (FCFS)), but wait for a random time and then try to obtain the service again. There are a great number of RQs modifications considered by various authors—From ordinary single-server or multi-server systems to retrial queues with several orbits, priorities, collisions and so on. Detail information about retrial queue models, their analysis and applications you may find in surveys [8,9,10,11,12] and others.
Most of the authors consider single-line retrial queues and or retrial queues with exponentially distributed service time. In this paper, we consider a multi-line retrial queue with hyper-exponential service time, but we hold in mind a such model with arbitrary distributed service time as the aim for future work.
Unfortunately, exact analytical solutions for retrial queues may be derived in very rare cases. Due to this, the most authors use numerical methods, approximations or even simulation methods to study more complex retrial queues [13,14,15,16,17]. This also applies to multi-server models [16] including systems with non-exponential service time [13].
Traditionally, we study retrial queues under various asymptotic conditions such as heavy load or long delay [18,19,20,21]. In these studies we and our colleagues obtained approximations for stationary probability distributions of the number of customers in the orbit that are applicable in appropriate conditions. Unlike these previous works, in this paper, we apply a new approach—The asymptotic diffusion method [22]—To perform more detailed and accurate analysis of the model. This will give more precise approximations and wider areas of their applicability.
The rest of the paper is organized as follows. In Section 2, we describe in detail a mathematical model of the considered retrial queue and derive balance equations. In Section 3 and Section 4, we perform asymptotic analysis of obtained equations under condition of long delay in the orbit. In Section 5, we introduce the method of asymptotic diffusion analysis and construct a diffusion process which is used in Section 6 to build approximations for steady-state probability distributions of the number of busy servers and the number of customers in the orbit. Using simulations and numerical experiments, we determine the applicability area of suggested approximations in Section 7.
2. Mathematical Model
Consider a retrial queue with N servers and Poisson arrivals with intensity . Service times are independent and identically distributed as hyper-exponential variables with cumulative distribution function
where , , and .
When a customer arrives, if there is a free server the customer moves to it for service, otherwise the customer goes to the orbit and stays there during random period exponentially distributed with parameter . After this period the customer tries to get a service again according to the described algorithm.
Let us denote the number of busy servers at the moment t by , and the number of customers in the orbit by . The problem is to find steady-state probability distribution of the two-dimensional process that we denote by
for all and independently of t.
To solve the problem, let us consider the stochastic process , where and are the numbers of busy servers that realizes the service time of the first phase or the second phase respectively. The process is Markovian, hence we can write balance equations for its probability distribution
where , . So, we can write differential equations
for the case , and
for the case .
Let us introduce partial characteristic functions
where . Then we can rewrite the system of balance Equations (2)–(3) as follows:
for , and
for .
Let us use linear finite difference operators to rewrite the system Equations (4) and (5) in a compact form. Then using notation for matrix function with indexes and entries equal to for or zero otherwise, we can rewrite Equations (4) and (5) as follows:
Here
where indicator is defined as follows:
We write these operators on the right hand of matrix function affected by them similar to notations of matrix operations.
Let us denote summing operator by . Applying this operator on Equation (6) and taking into account that
and
we obtain the following scalar equation:
It will be an additional equation to the system Equation (6).
3. First Stage of the Asymptotic Analysis
System of Equations (6) and (9) can not be solved in a direct way, so, we will solve it under asymptotic condition of long delay in the orbit: .
We obtain
Let be a scalar function which determines the average number of customers in the orbit normalized by asymptotically for . Denote probabilities of the number of busy servers working at the first phase () or second phase () of given hyper-exponential distribution of service time by for and . Let be left-top triangle matrix with entries equal to for and others equal to zero.
Theorem 1.
Under asymptotic condition , probabilities are determined by expressions
where
and is a solution of the ordinary differential equation
Proof.
Let us find a solution of system Equation (16) in the form
Let us denote
Corollary 1.
Let
then function may be written in the form
4. Second Stage of the Asymptotic Analysis
Taking into account that characteristic function of process of the normalized number of customers in the orbit has form (see Equation (17)), let us make the following substitution in system Equation (9):
(here is characteristic function of centered process ). Then we obtain the system
Taking into account notation Equation (20), we can rewrite this system in the form
Denoting and making the following substitutions in Equation (24)
we obtain system of differential equations
Let us denote
We can prove the following theorem.
Theorem 2.
Function has the following form:
where non-zero entries of matrix are determined by Theorem 1, and scalar function is a solution of differential equation
Here function is determined by Equation (20), has the form
and top-left triangle matrix is determined by the following system of equations:
Proof.
Let us write only the members of the first equation of system Equation (26) that contains only zero or the first order of :
Solution of this equation we write in the form
where and are some scalar and matrix functions whose expressions we will obtain later. Substituting this expression into Equation (31), we derive
Let us rewrite this equality in the form of non-homogeneous equation
According to superposition principle, we can write a solution of this equation in the form
Notice that Equation (37) for matrix coincides with the first expression of Equation (30), therefore statement Equation (30) is true (the second expression of Equation (30) will be discussed later).
Taking into account Equation (36), we can conclude that
where .
Matrix is a particular solution to non-homogeneous system Equation (37), so it should satisfy some additional condition which we choose in the form (as was declared in Equation (30)). Then solution of system Equation (37) is uniquely determined.
Now, let us consider the second Equation of Equation (26). We substitute expansion Equation (32) in it and write the members of derived equation including up to the second order of :
Then we derive
Applying Equation (20), we obtain
Let us divide this equation by :
So, we derive
Substituting Equation (35) here, we obtain
Corollary 2.
Let , , then function from Equation (40) may be written in the form
Proof.
Let us rewrite Equation (40) in scalar form:
Applying here condition , we obtain Equation (43). □
In the next section, we will use obtained functions and as a drift and diffusion coefficients of a diffusion process which we apply to derive approximations for probability distributions under study.
5. Method of Asymptotic Diffusion Analysis
Taking into account notation and substitutions Equation (25) from the previous section, we consider stochastic process
under asymptotic condition . Here is the number of customers in the orbit and function is determined in the previous section as a solution of differential equation . We can prove the following statement.
Lemma 1.
Asymptotic stochastic process
is a solution of stochastic differential equation
that depends on continuous parameter x.
Proof.
Consider Equation (28) with and determined by Equations (22) and (40). Solution of this equation determines asymptotic characteristic function for centered and normalized stochastic process of the number of customers in the orbit under condition .
Let us make in this equation an inverse Fourier transform on argument w. Then for probability density function (p.d.f.) of process , we obtain the equation
which is the Fokker–Planck equation for p.d.f. . Hence, stochastic process is a diffusion process with drift coefficient and diffusion coefficient . Therefore, process is a solution of stochastic differential Equation (44). □
Let us consider the following stochastic process:
(here as before.)
Lemma 2.
Stochastic process is a solution to stochastic differential equation
with a precision up to an infinitesimal of order .
Proof.
Due to is a solution of differential equation and process satisfies Equation (44), the following equality is true:
It coincides with Equation (46) with a precision up to infinitesimal . □
Suppose that the system is in steady-state regime. Consider stationary p.d.f. for process :
Let us prove the following statement.
Theorem 3.
Stationary p.d.f. of stochastic process has the form
where C is a normalizing constant.
Proof.
Due to is a solution of stochastic differential Equation (46), the process is diffusion with drift coefficient and diffusion coefficient . Therefore, its p.d.f. is a solution of the Fokker–Planck equation
This equation is an ordinary differential equation of the second order. Solving it and taking into account normalization condition and boundary condition , we obtain Equation (48). The theorem is proved. □
6. Approximations of the Stationary Distributions
Consider matrix characteristic function (Theorem 2) of the joint distribution of the number of customers in the orbit and the number of servers working in the first and at the second phases. Due to Equation (27), it equals to production of characteristic function of the number of customers in the orbit and matrix that represents two-dimensional probability distribution of the number of servers working in the first and at the second phases. Therefore, we can represent stationary probability distribution under study
in the form of production
where is the joint two-dimensional stationary distribution of the number of servers working in the first and in the second phases of hyper-exponential service time Equation (1), is the stationary distribution of the number of customers in the orbit.
To construct an approximation for discrete probability distribution , consider p.d.f. of stochastic process . In the non-asymptotic case we can represent as follows:
There are various ways to construct probability distribution of discrete process on the base of p.d.f. of continuous stochastic process . We will use the following one.
Taking into account normalization condition, we can write
This probability distribution we will use as an approximation for probability distribution of the number of customers in the orbit of considered retrial queue in steady-state regime.
We can construct two different approximations for stationary probabilities of the number of busy servers. The first one can be build on the base of Formulas (13) and (14). In stationary regime, differential Equation (15) transforms to the equality
which is an equation for variable x. Let us denote its positive solution by . Substituting into Equation (13), we obtain the following expression for calculation of the first-type approximation of probabilities :
Approximation Equation (51) allows us determine another form of approximation for probability distribution of the number of servers working in the first and in the second phases:
where is calculated using Equation (13).
So, basing on these two types of approximations, we can write two types and of approximations for the stationary probability distribution of the number of busy servers as follows:
The accuracy of the constructed approximations and their applicability area will be discussed in the next section.
7. Applicability Area of Obtained Approximations
To estimate the accuracy of obtained approximations Equations (51)–(54) we perform numerical experiments with usage of simulation modeling. We use the Kolmogorov distance
as an error estimation. Here and are probability distributions of two discrete variables. For our purposes, one of them will be an approximation from , or , and another will be an empiric distribution of the same parameter constructed on the base of simulation results. Simulation model and simulation parameters (e.g., volume of collected statistical data) are chosen in a such way to error of simulation be not have a significant influence on calculation of value Equation (55) for approximations under test.
We consider values of Kolmogorov distance Equation (55) less or equal to as enough to an approximation be enough accurate. We reach for simulation experiments themselves (when both and in Equation (55) are taken from simulation results of two experiments with identical parameters).
Special developed software based on ODIS system [23,24] is used to perform simulations. Numerical calculations of probabilities Equations (51)–(54) are made using PTC Mathcad application.
For our purposes of analyzing applicability area of results Equations (51)–(54), let us consider a retrial queue with five servers () and hyper-exponential service time with parameters
Let us denote load of the system by (), and value of arrival process intensity we determine as .
In Table 1, you may find Kolmogorov distances for approximations from Equation (54) calculated for various values of load parameter and intensity of retrials . As we see, while is decreasing, the accuracy of the approximations becomes better ( is decreasing). We highlight values of Kolmogorov distance that satisfy chosen applicability condition by boldface font. We can not conclude what approximation from these is better in all cases but the first one seems more preferable in the case of and the second one is more preferable for . Furthermore, we may notice that for both of them are applicable for all cases , and the second approximation is applicable for greater values for narrower area ().
Table 1.
Values of Kolmogorov distances of approximations from Equation (54) for various values of and .
The similar results for approximation of the number of customers in the orbit Equation (51) are presented in Table 2. As in the previous case, this approximation became more accurate while is decreasing too. In addition, this approximation became more precise almost always while is growing. We can assume that it is applicable for all while (boldface is used to highlight applicable cases again).
Table 2.
Values of Kolmogorov distance of approximation for various values of and .
8. Call Center Example
Consider an example which illustrates application of obtained results in real system. Some call center has five workstations for operators that service calls from customers. Ordinary call requires time to be serviced equal to 1/m in average, where m is some measure of the average productivity of one operator and its workstation. For such calls we use exponentially distributed service time with rate = m. Some calls (about 20%) require long time to be serviced. We model them using rate m for exponential distribution. So, we can generally model service time in our system as hyper-exponential with parameters m, = m, . Let arrival process be Poisson with intensity = 2. If a customer find the system busy (there is no free operator), he or she tries to make a new call after a random time that we suppose exponentially distributed with parameter = 0.2. So, we can consider a model of the call center in the form of multi-server retrial queue with hyper-exponential service time and mentioned parameters.
Let us consider that the call center operation requires some cost and has some penalties. We suppose that we can improve a performance of the call center by increasing an average speed of calls processing m (e.g., involving more qualified personal or deploying better equipment) but we should pay a cost equals to , where is some constant. Furthermore, we have some losses due to customers that should make repeated calls. We calculate them as where is some constant and is mathematical expectation of the number of calls in the orbit. In addition, if we have too many "waiting" customers we obtain a penalty which we calculate as , where is some constant and w is some upper bound after which calls in the orbit are taken into account for the penalty calculation. Thus we can write the total cost of the call center operation K in the following form:
Using the following values of constants
and varying value of m in the interval from 0.75 to 1.2 (with step 0.05) that corresponds to values of the system load from 0.96 to 0.6 respectively, we obtain values of the total cost for the cases , and (Figure 1). As we see, in all these cases function has a minimum in the considered range of m. Therefore, when we plan work of the call center we should take into account that increasing of performance of operators and workstations does not always cause the cost be less. Moreover, value of m for the minimum point depends on value of upper bound w.
Figure 1.
Values of the total cost for various values of bound w.
9. Discussion
In this paper, we apply a new approach [22] for studying multi-server retrial queue with hyper-exponential service time. Analysis of the model is made under asymptotic condition of long delay in the orbit. Using asymptotic analysis technique [18,19], we obtain parameters of diffusion process Equation (45) which is used to build approximations for stationary probability distributions of the number of customers in the orbit Equation (51) and the number of busy servers Equations (52)–(54).
We use numerical experiments and simulations for estimation of the approximations accuracy. Using Kolmogorov distance Equation (55) as an error of approximation and criteria of approximation applicability in the form , we obtain applicability areas of proposed approximations. As it shown, these areas are wide enough. At least in the most of cases, they are wider than applicability areas of approximations obtained using basic asymptotic analysis technique as it was made in [18,19,20,21].
We suppose to use asymptotic diffusion method and obtained results in future works that will be devoted as to analysis of retrial queues with other configurations both to study of multi-server retrial queue with arbitrary distributed service time. Using hyper-exponential distribution as an approximation for distributions of other types may be the first step in this direction. Further studies may involve supplementary variables technique or using Markov chains based on departure epochs.
We thank the reviewers of this paper whose comments allow us improve the work.
Author Contributions
Conceptualization, A.N.; Formal analysis, A.M.; Investigation, A.M., A.N. and S.P.; Methodology, A.N.; Software, A.M.; Writing—original draft, S.P.; Writing—review & editing, A.M. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Aguir, S.; Karaesmen, F.; Askin, O.Z.; Chauvet, F. The impact of retrials on call center performance. OR Spektrum 2004, 26, 353–376. [Google Scholar] [CrossRef]
- Stolletz, R. Performance Analysis and Optimization of Inbound Call Centers; Springer: Berlin/Heidelberg, Germany, 2003. [Google Scholar]
- Avrachenkov, K.; Yechiali, U. Retrial networks with finite buffers and their application to internet data traffic. Probab. Eng. Inf. Sci. 2008, 22, 519–536. [Google Scholar] [CrossRef]
- Roszik, J.; Sztrik, J.; Kim, C.S. Retrial queues in the performance modelling of cellular mobile networks using MOSEL. Int. J. Simul. 2005, 6, 38–47. [Google Scholar]
- Artalejo, J.R.; Lopez-Herrero, M.J. Cellular mobile networks with repeated calls operating in random environment. Comput. Oper. Res. 2010, 37, 1158–1166. [Google Scholar] [CrossRef]
- Ke, X.; Shi, L.; Guo, W.; Chen, D. Multi-Dimensional Traffic Congestion Detection Based on Fusion of Visual Features and Convolutional Neural Network. IEEE Trans. Intell. Trans. Syst. 2019, 20, 2157–2170. [Google Scholar] [CrossRef]
- Nazarov, A.A.; Moiseev, A.N. Distributed System of Processing of Data of Physical Experiments. Rus. Phys. J. 2014, 57, 984–990. [Google Scholar] [CrossRef]
- Phung-Duc, T. Retrial Queueing Models: A Survey on Theory and Applications. arXiv 2019, arXiv:1906.09560v1. [Google Scholar]
- Falin, G.I.; Templeton, J.G.C. Retrial Queues; Chapman & Hall: London, UK, 1997. [Google Scholar]
- Falin, G.I. A survey of retrial queues. Queueing Syst. 1990, 7, 127–168. [Google Scholar] [CrossRef]
- Artalejo, J.R.; Gomez-Corral, A. Retrial Queueing Systems: A Computational Approach; Springer: Berlin/Heidelberg, Germany, 2008. [Google Scholar]
- Shekhar, C.; Raina, A.A.; Kumar, A. A brief review on retrial queue: Progress in 2010–2015. Int. J. Appl. Sci. Eng. Res. 2016, 5, 324–336. [Google Scholar]
- Kim, C.; Mushko, V.; Dudin, A. Computation of the steady state distribution for multi-server retrial queues with phase type service process. Ann. Oper. Res. 2012, 201, 307–323. [Google Scholar] [CrossRef]
- Phung-Duc, T.; Masuyama, H.; Kasahara, S.; Takahashi, Y. A matrix continued fraction approach to multiserver retrial queues. Ann. Oper. Res. 2013, 203, 161–183. [Google Scholar] [CrossRef]
- Neuts, M.; Rao, B. Numerical investigation of a multiserver retrial mode. Queueing Syst. 2002, 7, 169–189. [Google Scholar] [CrossRef]
- Artalejo, J.; Pozo, M. Numerical calculation of the stationary distribution of the main multiserver retrial queue. Ann. Oper. Res. 2002, 116, 41–56. [Google Scholar] [CrossRef]
- Ridder, A. Fast simulation of retrial queues. In Proceedings of the 3rd Workshop on Rare Event Simulation and Related Combinatorial Optimization Problems, Pisa, Italy, 5–6 October 2000. [Google Scholar]
- Moiseeva, E.; Nazarov, A. Asymptotic analysis of RQ-systems M/M/1 on heavy load condition. In Proceedings of the IV International Conference Problems of Cybernetics and Informatics, Baku, Azerbaijan, 12–14 September 2012; pp. 164–166. [Google Scholar]
- Fedorova, E. Quasi-geometric and gamma approximation for retrial queueing systems. Commun. Comput. Inf. Sci. 2014, 487, 123–136. [Google Scholar]
- Nazarov, A.; Chernikova, Y. Gaussian approximations of probabilities distribution of states of the retrial queueing system with r-persistent exclusion of alternative customers. Commun. Comput. Inf. Sci. 2015, 564, 200–209. [Google Scholar]
- Lapatin, I.; Nazarov, A. Asymptotic Analysis of the Output Process in Retrial Queue with Markov-Modulated Poisson Input Under Low Rate of Retrials Condition. Commun. Comput. Inf. Sci. 2019, 1141, 315–324. [Google Scholar]
- Nazarov, A.; Phung-Duc, T.; Paul, S.; Lizura, O. Asymptotic-Diffusion Analysis for Retrial Queue with Batch Poisson Input and Multiple Types of Outgoing Calls. Lect. Notes Comput. Sci. 2019, 11965, 207–222. [Google Scholar]
- Moiseev, A.; Demin, A.; Dorofeev, V.; Sorokin, V. Discrete-event approach to simulation of queueing networks. Key Eng. Mater. 2016, 685, 939–942. [Google Scholar] [CrossRef]
- Mesheryakov, R.; Moiseev, A.; Demin, A.; Dorofeev, V.; Sorokin, V. Using parallel computing in queueing network simulation. Key Eng. Mater. 2016, 685, 943–947. [Google Scholar] [CrossRef]
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).