1. Introduction
Remanufacturing of used products consumes fewer natural materials and less energy than conventional manufacturing, thus reducing the generation of waste and carbon emissions [
1]. For instance, remanufacturing photocopiers can save 20–70% of the natural materials and energy needed, and reduce waste by 35–50% as compared to conventional manufacturing [
2]. It is obvious that reduced consumption of raw materials and energy is conducive to the reduction of carbon emissions. Additionally, remanufacturing can lower production cost for the manufacturer. Consequently, an increasing number of manufacturers have begun to execute remanufacturing strategies, including HP, Lenovo, Apple, and Xerox, among others [
3,
4].
The basis of a remanufacturing closed-loop supply chain (CLSC) is the collection of used products, without which the remanufacturing of new products is out of the question. Shaharudin et al. [
5] has found that the extent of product collection has a positive significant effect on the adoption of CLSC activities. However, the collection process is quite complex as a result of high uncertainty regarding the quantity, quality, and timing of returns [
6,
7,
8]. The customers’ willingness to return their used-product also contributes to the complexity of the collection problem [
9,
10]. Any manufacturer who aims to collect the used products must cope with this uncertainty and complexity.
In the study of CLSCs, most of the previous research, such as the work of Savaskan et al. [
11], and Savaskan and Van Wassenhove [
3], adopted the static return rate model. However, this model ignores the dynamic character of the activities in which manufacturers must invest in order to collect used products. For instance, manufacturers face marketing expenditures, such as advertising, designed to increase the environmental awareness of customers and improve their knowledge about the used product return policies. Manufacturers also must invest in operational activities such as creating and maintaining recycling facilities, collection arrangements, reverse logistics, reprocessing strategies, and so on. The marketing activities and operational activities both have dynamic and long term effects, which means that the return rate reflects the whole investment history [
12]. In this way, the investment and return characteristics for a CLSC are similar to those presented in the dynamic advertising problem [
13]. To study the dynamic return problem, we developed a stochastic differential game model similar to the one presented by De Giovanni and Zaccour [
12]. The model simultaneously considered the dynamic effect of the collection process and the stochastic factors during the collection activities. We then applied the optimal control method to solve the model.
In the field of marketing, optimal control models are used widely to cope with the dynamic nature of advertising as well as with dynamic pricing problems. Examples include the advertising goodwill model [
13], advertising sales volume model [
14], and market growth model [
15] along with its extensions [
16,
17,
18,
19]. However, to the best of our knowledge, there has been little research that utilizes the dynamic control model to investigate the return problem in the CLSC area. De Giovanni and Zaccour [
12] and Huang and Nie [
19] were two of the few attempts made in this direction.
In order to investigate the optimal control strategy for the manufacturer and retailer in a CLSC, the stochastic differential game model that we developed takes into account stochastic disturbance during the collection process. The used products are collected by the manufacturer, the remanufactured products do not differ in any way from the new products manufactured from raw materials, and both types of products are sold at the same price in the same markets. The manufacturer facing the stochastic disturbance in the collection process is the leader in the CLSC approach; thus, the supply chain members are playing the Stackelberg differential game with the manufacturer as channel leader. The manufacturer simultaneously determines the wholesale price as well as the level of the effort for collecting the used products, and then the retailer determines the retail price. The differential game is solved by the Hamilton–Jacobi–Bellman (HJB) equation method.
The main contribution of this work seeks to implement a differential game model to investigate the optimal control strategies for the CLSC members in a stochastic dynamic scenario, and study how the stochastic factors in the collection process would affect the return rate of the CLSC system. Furthermore, the paper proposes a coordination contract to boost the efficiency of the decentralized CLSC.
As the importance of remanufacturing has increased, so has the amount of research dealing with the operation of a CLSC, such as the work of Savaskan et al. [
11], and Savaskan and Van Wassenhove [
3]. We refer the reader to Atasu et al. [
20], Govindan et al. [
21] and Govindan and Soleimani [
22] for comprehensive reviews of CLSC operations. Since we focused on the product collection problem in a CLSC with a dynamic and stochastic setting, our research is related to two streams of the available literature.
The first stream includes papers that concentrated on the reverse channel management problem in various CLSC scenarios. Savaskan et al. [
11] modeled three common reverse channel options for CLSCs: the manufacturer’s collection channel, the retailer’s collection channel, and a third-party collection channel. Comparing the three types of channels, they found that the retailer’s collection process might be the optimal reverse channel for the CLSC. Savaskan and Van Wassenhove [
3] studied the reverse channel design problem further by extending the model into the scenario of competing retailers. Huang et al. [
23] considered a CLSC with a dual recycle channel in which the manufacturer sells products via the retailer in the forward chain, while the retailer and the third party simultaneously collect used products in the reverse chain. They found that the dual recycling channel dominated the single recycling channel when the reverse channel competition is not very strong. Zhang et al. [
24] considered the CLSC problem in a dual channel supply chain with the manufacturer selling products via direct Internet channels as well as indirect retailer channels. De Giovanni and Zaccour [
25] studied the collection outsourcing choice of the manufacturer in a CLSC, where the retailer or the third-party firm can undertake the outsourcing task. These papers mainly discussed the reverse channel design problem with a single member in the supply chain to undertake the collection task [
26,
27,
28,
29,
30].
Subramanian et al. [
31] considered the effect of extended producer responsibility (EPR) on a remanufacturing supply chain. Jacobs and Subramanian [
32] also considered the EPR programs, and they attempted to share the EPR responsibility within the supply chain. Jena and Sarmah [
33] studied the co-operation and competition issues in a CLSC that consisted of two manufacturers who compete for selling as well as collecting the used products. Ma et al. [
34] investigated various cooperative models among the different parties in a CLSC consisting of a single manufacturer, a single retailer, and two recyclers, with the main focus on how the cooperative strategies might affect the CLSC system. These papers mainly looked at ways to allocate the collection activity in the supply chain to improve the collection efficiency. Our paper contributes to this stream by utilizing the differential game model to study the collecting strategies in a decentralized CLSC.
The second stream of research related to our model is the investigation of used product acquisition in a centralized or decentralized system. Guide and Wassenhove [
35] considered the used product collection problem in the face of uncertain quality. Nakashima et al. [
36] studied the optimal control problem in remanufacturing systems. Fallah et al. [
37] studied the competition between two CLSCs in an uncertain environment, with the competition including retail prices in the forward channel, and incentives paid to consumers in the reverse channel. Their major focus was on closed-loop network design decisions, using fuzzy set theory to handle the uncertainties. This area of research focused mainly on the issues of product collection in terms of quality or timing uncertainty, but the collection activities had their dynamic nature as well [
12,
38,
39].
De Giovanni and Zaccour [
12] proposed a dynamic collection model that utilized a differential game method to characterize the feedback equilibrium of a CLSC with one manufacturer and one retailer. A cost and revenue-sharing contract was proposed. They found that the retailer who acts as the leader always prefers the contract, while the manufacturer only prefers the contract under particular conditions. Huang and Nie [
19] also proposed a dynamic collection model that captured the dynamic characteristics of the collection process. They derived the open-loop control strategies of both manufacturer and retailer in a manufacturer-led Stackelberg game. These two papers are most closely related to our research. However, we took the stochastic disturbance into consideration and focused on the effect of stochastic factors on the control strategies of the manufacturer and retailer. Further, we studied the coordination problem of the CLSC, and the results showed that the stochastic supply chain can be coordinated by the proposed contract.
The remainder of this paper is organized as follows.
Section 2 presents our modeling framework.
Section 3 and
Section 4 show how we derived the feedback control strategies for the integrated channel and the decentralized channel, respectively.
Section 5 explores the coordination problem in the decentralized CLSC.
Section 6 concludes the paper.
2. The Model
The product return model we adopted is similar to the ones used by Huang and Nie [
19] and De Giovanni and Zaccour [
12], which supposed that the real time return rate has a cumulative effect. The return rate in our model is formulated as a continuous and weighted average of past return activities, with a decaying weighting function. Defining return rate
as the state variable, and the return effort
as the control variable, the dynamic return process is captured by the following formula:
where
is the decaying factor, and
is the extent of the impact of return activities on the return rate.
Equation (1) captures the dynamics of the product return process, but it does not consider random disturbance in the process. Actually, there are many factors that can disturb the return rate, such as the wide geographic spread of used products to be returned, and the complexity of reverse transportation [
40]. Considering stochastic disturbance, we model the return rate
by the Itô equation as shown:
where
is a variance term,
is a standard Wiener process,
is the initial return rate, and
. The model in Equation (2) is intuitive insofar as the term
represents the net influence of return effort on the return rate, which is deterministic, and the term
represents the stochastic disturbance of the random factors on the return rate, which is indeterminate.
It should be noted that the return rate must satisfy
. As a result,
and
should be continuous functions, and they should satisfy the Lipschitz conditions on each closed subinterval of
. In addition,
when
, and
With this condition, the drift at
is positive as long as
, which can be met easily when
is small enough. Since we consider the return rate is not able to reach 1, we ignore the case that
. Similar to the work of Prasad and Sethi [
41], we let
to simplify the complexity in the study, which satisfies the condition when
is a positive constant.
The cost function of return activities for the manufacturer is assumed by , where is the return cost coefficient. In reality, the used products could be distributed widely across the market, which could cause a comparatively high return cost coefficient for the manufacturer.
The per unit cost of manufacturing a new product unit from raw materials or from used materials is represented by and , respectively. We assume , which indicates that remanufacturing is profitable to the manufacturer. Let to denote the cost savings from remanufacturing.
Utilizing
to denote the retail price, which is controlled by the retailer, the demand rate for the product at time
is calculated as follows:
where
represents the market potential capacity, and
represents the price sensitivity coefficient.
The supply chain consists of one manufacturer, the Stackelberg leader, and one retailer, the Stackelberg follower. The time preference rate of supply chain members is denoted by
and the planning period is
. Controlling the wholesale price
and the collection effort
, the objective function of the manufacturer is formulated as follows:
Controlling the retail price
, the objective function of the retailer is formulated as shown:
The supply chain members seek to maximize their expected discounted profit stream subject to the system dynamics in Equation (2). We adopted the Hamilton–Jacobi–Bellman (HJB) equation method to resolve the stochastic differential game presented above.
3. Benchmark Model: The Integrated Channel
In this section, we consider the integrated channel scenario in which the retailer is not involved in the decision making process, and the manufacturer behaves as the central decision maker who makes the pricing and collecting decisions. This provides the benchmark results for our analysis.
The stochastic return rate is given by Equation (2), and the demand rate is given by Equation (3). In the integrated channel scenario, there is no wholesale price, and the objective of the central decision maker is formulated as shown:
The central decision maker simultaneously decides both the retail price
as well as the level of collection effort
. The Hamilton–Jacobi–Bellman (HJB) equation is formulated as follows:
in which
, and
.
Applying the first-order condition to Equation (7) provides the feedback strategies of the central decision maker:
Taking Equation (8) back into Equation (7), we then have the following equation:
Similar to the approach used by Erickson [
42], we conjecture the value function is
, in which
are coefficients that need to be determined. We obtain
and
directly. Inserting the conjectured value function and its derivations into Equation (9), we get the following result:
Based on the equal coefficient principle, we have the following equations:
The coefficients are solved as shown:
Assume that
to ensure that
is real. Now we have
. To assure the solution is meaningful in practice,
should be positive, or else the collection effort level might be negative when the return rate
is small. To make
, we have the following:
and
Obviously,
, and
. In other words, when
then
,
, and
. In addition, when
we have
and
. Thus, when the return rate is small, the collection effort level
may be positive. As a result, we abandon the solution concerning
.
Utilizing the superscript C to denote the scenario of integrated channels, the equilibrium strategies are summarized in the following proposition.
Proposition 1. For the integrated channel, assuming that , we can show:
- (1)
The optimal retail price control strategy of the central decision maker is given by: - (2)
The optimal collection effort level control strategy is given by: - (3)
The value function of the integrated channel is calculated by
Proposition 1 indicates the optimal feedback strategies as well as the profit level of the integrated channel. The assumption , which can be rewritten as , means the collection cost coefficient could not be too small in the model, otherwise the central decision maker would collect all the used products. However, this cannot be true in practice because the used products may be spread widely across geographic areas. There is a similar result for the decentralized channel.
6. Conclusions
For a remanufacturing CLSC, the basic procedure is to collect used products to be recycled into the production of new products. In this paper, we considered the impact of stochastic disturbance on the dynamic collection process in a CLSC consisting of a manufacturer and a retailer, where the manufacturer is responsible for collecting the used products. We also investigated the coordination problem faced by a decentralized CLSC.
First, we proposed a dynamic collection equation that considered the stochastic disturbance. We used a stochastic collection model based on the Itô equation, and then we derived the optimal feedback control strategies for both the manufacturer and retailer in centralized and decentralized system settings, respectively. The evolutionary path and probability distribution of the stochastic return rate were analyzed. Finally, we proposed a contract to coordinate the decentralized supply chain.
The optimal control strategy was derived using the HJB equation method. The results of comparative statistics for the equilibrium strategies showed that increasing cost savings from remanufacturing would result in increasing the return effort by the manufacturer. Furthermore, increasing cost savings from remanufacturing would result in decreasing retailer pricing of the product. In contrast, when the cost of production is increasing, the manufacturer and the retailer would increase the wholesale price and retail price, and the manufacturer would lower the level of return effort. We demonstrated that in either case, when the stochastic disturbance intensity is increasing, the manufacturer would improve the level of return effort. However, neither manufacturer nor retailer pricing would be affected by the stochastic disturbance. All of the above changes are beneficial to both the supply chain members and the customers.
As a result of stochastic disturbance, the return rate always hovered around the expected return rate. However, the expectation and variance of the return rate proved to be stable from a long-term perspective. The expected value of the return rate and the variance might decrease or increase with time, depending on the value of the initial return rate of the system.
The proposed contract could coordinate the stochastic supply chain as the manufacturer utilizes the marginal cost pricing under the coordination model. The actual production cost equals the unit cost minus the cost savings brought by the collection of used products.
It is interesting from the comparative statics results in
Table 1 that the stochastic disturbance would not affect the strategies of forward channel. However, the table demonstrates that the cost savings as well as the production cost would affect both the forward decision and the reverse decision. This means even if the stochastic disturbance is intensive, it would not transmit to the forward channel.
It should be noticed that the stable return rate is solved by taking the time limit as
; however, for a real CLSC system, it is unrealistic that the time would go for infinity. As a result, we should keep in mind that the real return rate would not be stable as the disturbance of the stochastic factors in the collection process, which is shown in
Figure 1.
The equilibrium of both integrated channel as well as the decentralized channel exist only when the collection cost coefficient could not be too small. It is interesting that there is similar assumption in the static model [
11]. It can be interpreted as the when the collection cost coefficient is too small, the manufacturer would have motivation to collect all the product while this cannot be true in practice. As a result of the wide and disordered distribution of used products as well as the special preference of some customers, the manufacturer cannot collect all used products. Consequently, the assumption is reliable from the perspective of reality.
To develop a more general understanding of the impact of stochastic disturbance on CLSCs, future efforts could extend our model to consider cases in which either the retailer or a third party collects the used products. The reverse channel design problem could be researched in the stochastic model as well. Furthermore, the competitive environment is also worth investigating, which would increase the mathematical difficulties.