1. Introduction
Queues in which primary customers find all of the servers busy and/or the waiting room occupied and either go to orbit to try again to obtain a service after a random period of time or leave the system forever are called retrial queues (RQs). RQ models have been studied in detail in a large number of works. For a comprehensive survey and a list of references in this field, see [
1,
2].
Another frequently caused phenomenon in queuing systems is feedback. Queues in which each a serviced customer joins the system either with a certain probability or leaves forever with complementary probability are called queues with feedback (QFB). If the feedback customers return to the system immediately after the completion of the service, then this system is called a queue with instantaneous feedback (QwIFB); otherwise, if feedback customers return to the system after a certain delay, then this system is called a queue with delayed feedback (QwDFB). Note that in practice, there are queues with both kinds of feedback. In other words, in some queues, some of the feedback customers join the system immediately after completion of the service and some of the other feedback customers join the system after a certain delay, i.e., after completion of the service, some customers go to virtual orbit for “thinking” before coming back to obtain additional service. Some QFBs might impose restrictions on the number of feedbacks, i.e., there are queues with single and multiple feedbacks. A QFB is often caused in computer systems with a round-robin discipline, in communication networks with retransmission of erroneous data (packets), in manufacturing with the rework of defectively produced items, etc. For state-of-the-art theory on QFB, see [
3,
4,
5,
6,
7,
8,
9,
10,
11,
12,
13] and their references.
Over the last decade, many researchers investigated models of retrial queues with delayed feedback (RQwDFB), i.e., queues in which both retrial and feedback phenomena are combined, see [
14,
15,
16,
17,
18,
19,
20]. For a detailed review of works devoted to RQwDFB, see [
21] and its reference list.
Note that feedback is also a common issue in queuing-inventory systems (QIS), as customers will return to purchase inventory after consuming items that were previously purchased. In other words, the period of time that the customer uses to consume the items might be considered as the sojourn time of the customer in orbit.
A recent detailed review of works in which models of QIS were investigated can be found in [
22]. From the indicated review, we can conclude that even though the application of a QIS with delayed feedback (QISwDFB) is very relevant, these models were considered in only a few papers.
It seems that the first time the feedback phenomenon in QIS was introduced was in [
23,
24]. In [
23], the model QISwDFR M/M/1/N/(
s, Q)/∞/M with a finite capacity for orbit by feedback customers was considered. Hereinafter, we used modified Kendall notations for symbolical representation of QIS models, which was proposed in [
25]. New components were added to the classical Kendall notations to indicate the replenishment policy (RP) in use, the type of cumulative distribution function (CDF) of the inventory’s lifetime (the symbol ∞ in the corresponding position means that items are non-perishable) and the type of CDF of the inventory delivery time (0 in the corresponding position means that the inventory delivery time is zero). The retrial rate of the feedback customers from orbit is a linear function of the number of customers in orbit. A recursive algorithm for calculating the joint probability distribution of the inventory level, the number of customers in orbit, the number of customers in the waiting room, and the status of the server was developed. The main performance measures in the steady-state were derived, and the long-run total expected cost rate was also calculated. The authors derived the Laplace–Stieljes transforms of the waiting time distribution of both the primary as well as the feedback customers. A more complex model of perishable QISwDFB MAP/M/1/N/(
s, Q)+(
s, S)/M/PH was considered in [
24]; here, the symbol “+” indicates that, depending on the state of the system, either the (
s, Q) or (
s, S) policy was used. To study this system, the MGM was employed, formulas for calculating the performance measures of the system were obtained, and the total cost (TC) minimization problem was solved. A similar model was considered in [
26]. Two main differences from the model in [
23] are that the orbit capacity is infinite and retrial rate is constant. Here, Neuts’ matrix-geometric method (MGM) [
27] was used to analyze the model and both the busy period distribution and the waiting time distribution of primary and feedback customers. In all of these models, the authors assumed that the retrial customer required only the service, and they joined the server if there were no primary customers in the system or if the inventory level was zero, or both.
An important subclass of QIS are systems with perishable inventories in which the lifetime of the items is a finite random variable. For a detailed review of works devoted to QIS with perishable inventories, see review paper [
28] and its reference list. Among recent works along this direction, References [
29,
30,
31,
32,
33,
34,
35,
36] should be noted. For brevity, we did not consider here the results obtained in the indicated papers (for this purpose, see [
25]). In a more relevant paper [
37], two models of perishable QISwDFB M/M/1/N/(
s, Q)/M/M and M/M/1/∞/(
s, Q)/M/M were considered. There are three options after the completion of service to the primary customer: (1) the customer leaves the system without purchasing an inventory item; (2) the customer purchases the item and leaves the system; (3) the customer does not purchase the item and joins the orbit for feedback. Probabilities were introduced to evaluate the three indicated options. To calculate the joint probability distribution of the inventory level, the number of customers in orbit, and the number of customers in the queue, the space merging method was developed. The authors assumed that there were several sources for executing the order with different costs and lead times. The problem of minimizing the total cost by choosing a pair of sources and the reorder level was solved.
It is worthy to note that all papers [
28,
29,
30,
31,
32,
33,
34,
35,
36,
37] assumed that inventory deteriorates after some random (positive) time. At the same time, in real life, stocks in systems can be instantly destroyed (for example, due to the negligence of warehouse workers or because of technical accidents). In addition, new customers are repeated if there are no stocks at the time of their arrival, and already serviced customers are returned to the system after spending purchased stocks. In other words, models of retrial QISwDFB (RQISwDFB) with instantly damaged items adequately describe many QIS in real life. However, to the best of our knowledge, these models have not been studied in the available literature. Based on these facts, in this paper, the first attempt was made to develop a method for calculating and optimizing the performance measures of such systems under various replenishment policies.
To be more specific, we note that the main differences between the model studied here and the models considered in the literature are as follows:
In all the known models of QISwDFB, the authors assumed that orbit for repeated customers can be formed only by feedback customers but not by primary customers. We considered a model in which some of the primary customers in some situations (for instance, when an inventory level is zero) might also be going to orbit to repeat their request in the future;
We propose a model of RQISwDFB in which items might be damaged (destroyed) instantaneously due to the fact of technical reasons;
We developed a unify method to calculate the performance measures of the proposed models under various replenishment policies.
The paper is organized as follows. In
Section 2, we describe the models and formulate the problem. In
Section 3, an analysis of the models is carried out using the matrix-geometric method, and the stability conditions under different replenishment policies are derived. Formulas for calculations of the main performance measures are presented in
Section 4. A numerical illustration, including the minimization of the total cost, is provided in
Section 5.
Section 6 concludes the study.
2. Description of Models and Formulation of the Problem
A general block diagram of the studied systems is shown in
Figure 1. The proposed model was considered under the following assumptions.
1. We considered QIS with a storage with the maximum capacity S, S < ∞;
2. The flow of primary customers (p-customers) was considered to be Poisson with the parameter λ. For simplicity of presentation, without loss of generality, it was assumed that each p-customer required an item of one size. This means that if at the moment of receipt of the p-customer the inventory level is positive, then they instantly receive the item (i.e., service time is zero) and the inventory level of the system decreases by one. If at the moment of receipt of a p-customer the inventory level is equal to zero, then this customer, according to the Bernoulli scheme, either leaves the system with probability (w.p.) α, or with a complementary probability of 1 – α, it goes to the orbit to repeat its request. The customers in the orbit are called retrial customers (r-customers). The orbit is assumed to be infinite in size;
3. A p-customer that has already received an inventory can demand additional inventory after a positive random time (delayed feedback). More specifically, each served p-customer, according to the Bernoulli scheme, either leaves the system w.p. β permanently, or with a complementary probability of 1 – β, goes to the orbit to repeat its request. Customers that require re-servicing are called feedback customers (f-customers). It is considered that the orbit for r-customers and f-customers is common, and in the orbit, these customers are considered identical. Therefore, further customers in orbit, regardless of their type, are simply called retrial customers. Customers from the orbit arrive with a constant intensity, i.e., the intensity of the arrival of r-customers does not depend on their number in the orbit. This means that only the r-customer at the head of the orbit can repeat the request to obtain the inventory. The time between arrivals of r-customers has an exponential d.f. with parameter η. It is believed that r-customers can repeat their requests many times, i.e., if at the moment of arrival of the r-customers the inventory level is equal to zero, then according to the Bernoulli scheme, they either leave the orbit w.p. γ, or with a complementary probability of 1 – γ, remain in the orbit to repeat their request;
4. A distinctive feature of the studied models is that in addition to p-customers, r-customers, and f-customers, they also contain a flow of destructive customers (d-customers). Unlike p-customers and r-customers, d-customers do not require inventory, but they destroy them, i.e., at the moment d-customers arrive, the inventory level decreases by one. It was assumed that the flow of d-customers is Poisson with the parameter κ. If at the moment of receipt of a d-customer the inventory level is equal to zero, then this customer does not affect the operation of the system;
5. Systems that use one of two replenishment policies (RPs) were studied here: (s, Q) or (s, S) policies. When using the (s, Q) policy, it was assumed that if the inventory level decreases, then an order is made to a higher-level storage to replenish the inventory, while the order volume is constant and equal to Q = S − s; in order to avoid multiple orders, it was considered that s < (S/2). When using the (s, S) policy, it was assumed that if the inventory level drops to s, 0 ≤ s < (S/2), then an order is made to a higher-level storage to replenish the inventory, while at the time of the order’s execution, the stock level of the system reaches the maximal value of S. When both policies are used, the order is completed with a random delay, i.e., the lead time is a random variable having an exponential d.f. with an average value of ν−1.
Our problem has two parts: (1) find the joint distribution of the number of r-customers in the orbit and the inventory level of the system; (2) find the following performance measures of the system: (i) average inventory level; (ii) average order size (if using the (s, S) policy); (iii) average number of r-customers in the orbit; (iv) average reorder rate; (v) average damaging rate of inventory; (vi) loss probability of p-customers; (vii) loss probability of r-customers.
3. The Proposed Method for Solving the Problem
Let us first consider a case when using the (
s,
Q) policy. Based on the above assumptions regarding the form of d.f. of random variables participating in the formation of the model, we concluded that the studied QIS is described by a two-dimensional Markov chain (2D MC). At an arbitrary moment in time, the state of this 2D MC is given by the two-dimensional vector
, where the component
indicates the number of r-customers in the orbit,
; component
determines the inventory level,
. This means that the state space of a given 2D MC is defined as follows:
where
is called the level
.
The elements of the generator of the studied 2D MC are indicated by , i.e., these values determine the transition rates from state to state . These values are determined based on the following arguments. Let the initial state of the system be .
If in the initial state the inventory level is positive (i.e., ), then when a p-customer arrives that does not require repeated servicing and also when a d-customer arrives, the transition to the state is made. In other words, there is a transition from the state to state . In this case, the total rate of such transitions is equal to ;
If in the initial state the inventory level is positive (i.e., ), then when a p-customer that requires repeated servicing arrives, a transition is made to the state ; the rate of such transitions is equal to ;
If in the initial state the inventory level is equal to zero (i.e., ), then when a p-customer w.p. arrives, a transition is made to the state ; the rate of such transitions is equal to ;
If in the initial state the inventory level is positive (i.e., ) and there is at least one r-customer in the orbit (i.e., ), then when an r-customer arrives, a transition is made to the state ; the rate of such transitions is equal to ;
If in the initial state the inventory level is equal to zero (i.e., ) and there is at least one r-customer in the orbit (i.e., ), then when an r-customer w.p. arrives, a transition is made to the state ; the rate of such transitions is equal to ;
If in the initial state the inventory level is less or equal to (i.e., ), then when the order is executed, a transition is made to the state ; the rate of such transitions is equal to .
Therefore, the positive elements of the generator of the studied 2D MC are calculated from the following relations:
Next, we renumbered the states from (1) in lexicographic order, i.e., states we renumbered according to the order
Then, from relations (2), we concluded that the studied 2D MC is a level-independent quasi-birth–death (LIQBD) process with generator:
In (3), by
we denote a null square matrix with a dimension of
, and
and
are square matrices with the same dimension. From relation (2), we concluded that the elements of the block matrices,
and
are determined by the following relations:
We denote the steady-state probabilities corresponding to the generator
by
. In other words, the vector
is a solution to the following system of equilibrium equations (SEEs):
where 0 denotes a null vector row of size
S + 1, and
e indicates the column vector of size
S + 1, all the components of which are equal to 1.
From (5)–(7), we find that the elements of the generator
are defined as follows:
Theorem 1. When using the (s, Q) policy, the system is ergodic if and only if the following condition is satisfied:
Proof. From relation (9), we conclude that SEE (8) has the following form:
For the cases
For the cases
For the cases
Hereinafter, represents the Kronecker symbols, and is the indicator function of the event A.
The SEEs (11)–(13) can be solved analytically using the recursive method. Thus, taking into account the above notation from Equation (11), we find that
On the other hand, from Equation (12), we find that
i.e.,
In Equation (13), recurrent procedures are performed starting with the equation for
, e.g., the equation for the case
is taken into account in the equation for the case
. Then, we obtain that
In other words, the desired probabilities
are expressed through
as follows:
where the unknown probability,
, is determined from the normalization condition, i.e.,
From (14), we conclude that
is determined using relation (10).
Further, according to [
27] (pp. 81–83), we conclude that the studied LIQBD is ergodic if and only if the following condition is satisfied:
Taking into account (5), (7), and (14), after certain transformations from (15), we obtain that relation (10) is true. The theorem is proved. □
Remark 1. It is important to note that the found ergodicity condition (10) has an exact probabilistic meaning. Indeed, in inequality (10), the left-hand side is the weighted rate of arrival of p-customers and f-customers into the orbit, and its right-hand side determines the weighted rate of arrival of requests from the orbit. Thus, condition (10) means the following: the weighted total intensity of p-customers and f-customers for the orbit must be less than the weighted intensity of r-customers. Note that condition (10) can be replaced by a rough but, at the same time, easy-to-check condition . The last condition is obtained by taking into account , In other words, the rough condition also has a probabilistic meaning: the left side is the reachable upper bound of the rate of arrival of p-customers and f-customers into the orbit, and the right side is the unreachable lower bound of the rate of loss of r-customers from the orbit. It is important to note that the resulting rough ergodicity condition does not depend on either the intensity of d-customers or the lead time (we will see later that this condition also does not depend on the accepted RP).
If the ergodicity condition (10) is satisfied, then the steady-state probabilities
, corresponding to the generator,
G, are calculated from the following equations:
where
R is the minimal non-negative solution to the following matrix-quadratic equation:
Boundary probabilities,
, are found from the following systems of equations with a normalizing condition:
where
I is the unit matrix of size
.
Now let us consider the system when using the (
s,
S) policy. In this model, a 2D MC with a state space (1) also describes the system under study. The generator elements of this 2D MC are defined similarly to (2), with the only difference being the sixth line on the right side of the specified formula, i.e., here the positive values of the indicated quantities are calculated from the following relations:
From (18), we conclude that this 2D MC is an LIQBD with generator:
Here, the elements of the matrices
and
are determined as follows:
Let
be the steady-state probability vector of the generator
, i.e.,
From relations (5), (7), and (21), we conclude that the elements of the generator
are determined as follows:
Theorem 2. When using the (s, S) policy, the system is ergodic if and only if condition (10) is satisfied,
where is replaced by the following value: Proof. From relation (23), we conclude that SEE (22) has the following explicit form:
For the cases
For the cases
As above (see the solution to the SEEs (11)–(13)), the obtained SEEs (25) and (26) can also be solved in a recursive manner. Thus, from Equation (25), we find that
On the other hand, from Equation (26) at
we find that
. In other words, in this case the desired probabilities
are expressed through
as follows:
where the probability
is determined from the normalization condition, i.e.,
is determined from relation (24).
As above, the studied LIQBD is ergodic if and only if condition (15) is satisfied for the vector . Then, taking into account (5), (7), and (27), after certain transformations from (15), we obtain that Theorem 2 is true. □
Further, the steady-state probabilities , corresponding to the generator are determined similarly to relations (16) and (17).
Calculating the steady-state probabilities of the constructed 2D MCs allows us to determinate the main performance measures of the system when using both replenishment policies. Next, in
Section 4, we propose formulas to calculate the indicated measures.
5. Numerical Results
Below, we demonstrate the results of numerical experiments that had two goals: one was to study the behavior of performance measures (28)–(34) with respect to changes in the values of the initial parameters, and the other goal was to solve the problem of minimizing the total cost (TC).
Regarding the first goal, we point to the results of the numerical experiments for a hypothetical model, which are shown in
Table 1,
Table 2,
Table 3,
Table 4,
Table 5,
Table 6 and
Table 7. In all experiments, it was assumed that
S = 20 and
s = 5. In the respective columns of these tables, the top row corresponds to the (
s,
S) policy and the bottom row to the (
s,
Q) policy. The values of the initial parameters are indicated after the title of each table.
As a result of the analysis of the data in these tables, it is possible to draw conclusions regarding the behavior of the performance measures (28)–(34). Note that not all of the results of the numerical experiments corresponded to theoretical expectations. Thus, the behavior of function
Sav with respect to changing parameter
η seems counterintuitive (see
Table 2). Indeed, it was theoretically expected that when using both RPs, with an increase in the intensity of r-orders, the average stock level of the system would decrease. However, from
Table 2, we conclude that these expectations did not come true; with the growth of parameter
η, the function
Sav, though at a very low rate, grew. In the same way, it was expected that when using the policy (
s,
S), the function
Vav should increase with an increasing parameter
η, but it also decreased at a very low rate. On the other hand, the function
Vav decreased because the function
Sav increased.
Other theoretically unexpected results were the behavior of function
RR with respect to the increase in parameters
ν (see
Table 4) and
γ (see
Table 7). Thus, when using both RPs, as these parameters increased, as expected, the function
Sav grew, but function
RR also grew. However, with the increase in the average inventory level, a decrease in the intensity of reorders was expected. It is important to note that the rates of change of these performance measures were very small values, since changes in their values are often observed in the third decimal place after the decimal point. In other words, these facts can be explained by the accuracy of machine calculations. At the same time, such behavior by these performance measures was observed with a wide range of changes in the initial data of the studied models. The rest of the results confirmed the theoretical expectations.
Let us now consider the second goal of our numerical experiments. Note that in real systems, often only the order point (i.e., parameter s) is the controlled parameter. Based on this fact, the problem of minimizing the TC was solved here by choosing the optimal value of the order point for fixed values of the initial parameters when using both RPs.
The TC is calculated as follows:
where
is the fixed cost of one order;
is the cost of one unit of order value;
is the storage cost per unit of inventory volume per unit of time;
is the cost of damaging one unit of stock;
are the penalties for losing one p-customer;
are the penalties for losing one r-customer;
is the cost per unit of waiting time in the orbit of one r-customer.
The optimization problem is as follows: let all parameters of the model be fixed, except for parameter s, as it is required to find such a value s in order to minimize (35). The minimization problem (35) always has a solution, since the domain of feasible solutions is a discrete finite set.
The results of solving this problem for the hypothetical model in which
S = 16 are shown in
Table 8. Here, the values of the initial parameters of the model and the coefficients in function (35) were chosen as follows:
It can be seen from
Table 8 that the values for TC when using the (
s,
Q) policy were much larger than when using the (
s,
S) policy, and the optimal value of parameter
s for the (
s,
Q) policy was equal to four, while for the (
s,
S) policy it was equal to five.