1. Introduction
Prostate cancer (PCa) is the second most common type of cancer in men, with over 160,000 men diagnosed during 2017 in the US alone, of which over 26,000 succumb [
1]. The majority of patients that die of the disease do so because of distant metastases—90% of which are to the bone. For this reason, a better understanding of tumor–bone interactions is key if we are to improve how bone metastatic prostate cancer patients are treated.
Improvements in our understanding of the molecular mechanisms involved in this disease have led to the discovery of new therapeutic targets; however, the disease remains lethal with tumor resistance to treatments emerging in virtually every patient. Thus, understanding the impact of treatments in a complex heterogeneous tumor requires approaches that can incorporate several scales of biological insights. A successful approach needs to recapitulate the emergent process of metastatic prostate cancer establishment and the emergence of resistance to treatment. In the past, we demonstrated how a sophisticated agent-based computational model could help us understand the role of PCa–host interactions, as well as the impact of existing and novel treatments [
2,
3]. While agent-based models can accurately and quantitatively recapitulate cell dynamics in a specific area of a tumor, capturing the relevant intra-tumor heterogeneity and sensitivity to treatments can be a challenging and time-consuming process [
4]. Alternatively, non-spatial population models that capture intra-tumor heterogeneity can be used to represent the entire metastatic burden of the disease and thus could be used as proxies for the patient in optimization algorithms [
5]. Furthermore, non-spatial models lend themselves to easier measurement and use [
6] and avoids the confusion of population-level intuitions for reductive ground truth [
7].
Simple qualitative models can be useful in providing an understanding of how certain interactions shape evolution and resistance in cancer. Previously, Ryser et al. used a simple ordinary differential equation (ODE) model to understand bone remodeling [
8,
9] and to illustrate how tumor cell interactions with bone remodeling cells can shape cancer progression [
10]. Evolutionary game theory (EGT) is a particularly powerful, yet simple and qualitative, approach to focusing on the role of interactions in cancer. It originated in looking at the effects of heterogeneity [
11,
12], and we have used it to look at a wide number of dynamics in cancer such as go-vs-grow [
13,
14], the Warburg effect [
15], tumor–stroma interactions [
16], and interactions of multiple public goods [
17]. In the process, we have built EGT models for many cancers, including prostate cancer [
15,
16]—as have several other groups. Dingli et al. [
18] focused on a type of bone cancer, multiple myeloma, using an EGT approach that incorporated both tumor cells as well as bone stromal cells. More recently, West et al. [
19] studied the impact of novel treatments like adaptive therapies in the context of bone metastatic prostate cancer but without including the cellular species that characterize the bone ecosystem.
In this work, we aim to model not only cancerous growth in the bone but also capture key aspects of normal bone homeostasis and its co-option. We built an EGT model where PCa cells can co-opt cells from the bone modeling unit (BMU). In brief, every part of the bone is remodeled every 3–5 years. The BMU is an area of trabecular bone that is remodeled via osteoclasts (OCs) and osteoblasts (OBs). Although other cell types are involved, including mesenchymal stem cells, macrophages, and myeloid-derived cells, both OCs and OBs are the key cell types involved in the resorption and deposition of bone tissue, respectively. The process of remodeling is orchestrated through signaling molecules such as receptor activator of nuclear factor kappa-B ligand (RANKL), which is generated by osteoblasts and promotes osteoclast differentiation and survival, and TGF-
, which is released when bone tissue is removed by OCs. These cellular species make the bone a very dynamic organ [
20]. Furthermore, studies have shown that metastatic cancer cells can co-opt this process for their own benefit [
21]. For this reason, OCs and OBs constitute the key cellular strategies of any mathematical model of bone remodeling. In our model, these two cell populations will be described as the bone stroma.
Capturing the regulation and dis-regulation of bone homeostasis allows us to better understand the selection that drives metastatic cancer evolutionary dynamics and the impact of treatments on the bone microenvironment—a topic of clinical significance. Furthermore, our approach also incorporates ecological aspects by modeling the role of the bone in regulating the fitness of the different cell types [
22]. Our results suggest that we could optimize the combination of on and off periods of treatment to limit tumor growth and control bone growth.
2. Model
The interactions between OCs and OBs orchestrate bone (B) remodeling and homeostasis. As such, bone volume is determined by the balance between the density of OBs (
) and the density of OCs (
) on the existing bone, where OBs increase the bone volume and OCs decrease the bone volume according to the following discrete time dynamics:
where OBs and OCs are in the range such that
. The values of
B are dimensionless and can be understood as a lack of bone if
, bone homesostasis if
, and excessive bone if
. The constant
K determines time-scales.
Note that the above dynamics are physical and not evolutionary. The dynamics of densities for OBs, OCs, and the sensitive and resistant parts of the tumor (
,
), however, are ecological and given by logistic growth:
where
and
is the total density (thus
is the amount of remaining space in the niche),
is the selection strength,
is the death rate, and
represents the fitness functions.
The fitness function for OBs is given by
where the first summand of
corresponds to the benefit conferred to OBs by OCs. This benefit can be attributed to the secretion of TGF-
by OCs that recruits OBs to the remodeling site. This is dependent on the proportion of OC among healthy cells (
) and the dearth of bone with respect to its standard equilibrium
. In the second summand,
is the benefit that an OB receives from interacting with any PCa cell due to their natural secretion of TGF-
.
The fitness function for OCs is given by
which captures the benefit conferred to OCs by OBs that can be attributed to the secretion of RANKL as a result of bone resorption. This is dependent on the proportion of OBs among healthy cells (
) and the overabundance of bone with respect to its standard equilibrium
. Since both
and
are functions of the proportions of OCs and OBs, we could rewrite the equations for
and
as a replicator dynamic model (for a similar model, see Kaznatcheev [
23]).
Finally, the fitness functions for chemotherapy-sensitive and -resistant tumors are
where
is the benefit a PCa cell receives from interacting with OCs. The OC-led resorption of the bone allows the neighboring PCa cells to access nutrients and growth factors previously embedded in the bone;
is the benefit that a PCa cell receives from interacting with other PCa cells derived from the secretion of TGF-
. The cost of resistance to treatment is
r, and the efficacy of the treatment is
s. Resistance to chemotherapy is common and results from the treatment providing strong selection for PCa cells that can avoid its cyto-toxicity. This resistance often comes through the upregulation of drug exporter pumps on the surface of PCa cells [
24,
25,
26]. Producing and maintaining these pumps is energetically costly to the PCa cells but allows those that have a sufficient number of them to deal with cytotoxic drugs.
Chemotherapy
For all the fitness functions above, chemotherapy is implemented by the introduction of a cost
s, which corresponds to the strength of the chemotherapy regiment. Chemotherapy is widely used in treating hormone-sensitive and -insensitive metastatic prostate cancer [
27]. As chemotherapy options like docetaxel become more widely used, so does the importance of understanding how to better administer them in order to minimize the possibility that resistant phenotypes emerge. As a simple caricature, the variable
s can be described microdynamically: when a cell tries to undergo mitosis, it will be killed with probability
s. This means that, at
s = 0.5, there will be no growth in the affected population, since half the time that a cell tries to divide, it succeeds and becomes two cells and half the time it dies and becomes zero cells. For
, the growth rate is slowed; for
, the growth rate flips its sign, i.e., the growth rate becomes a “shrink” rate. This is implemented in all fitness functions (except for chemo-resistant
) by multiplying the fitness function by
. Note that chemotherapy only impacts the bone via interfering with the cells that control bone perturbation, i.e., OBs and OCs.
3. Results
We will illustrate our results with simulations of particular parameter settings as follows: a death rate of , a selection strength of , a bone adjustment rate of , and tumor–environment ecological interactions of , , and . Due to the qualitative nature of this model, the dimensionless parameters were chosen to recapitulate dynamics that are accepted throughout the literature instead of to correspond with experimental measurements. The sensitivity of these parameters was investigated informally, and confirmed our belief that these parameters are not the only values in the space that can generate these results.
With the model described, we can recapitulate bone homeostasis when there are no PCa cells. Initial densities of the different population are as follows:
,
,
, and
. The plots shown in
Figure 1 show how the bone is initially resorbed, and then deposited as OCs and OBs work to restore the balance of bone to homeostatic levels after a simulated microfracture.
3.1. Tumor Introduction
We now assume that a metastatic PCa cell has extravasated into an area of the bone that will undergo remodeling. In this case, we assume that the initial conditions are
,
,
,
, and
. In this case, the results can be seen in
Figure 2, which shows how the growth of the PCa population leads to an increase of pathological bone and a dominance of the PCa cells over the OBs and the OCs.
3.2. Standard Chemotherapy
Trying to asses the impact of chemotherapy, we assumed the following initial conditions:
,
,
,
, and
. Additionally, a simple chemotherapy regiment of
is initiated from timesteps 200–350. The results can be seen in
Figure 3 and show that, while bone continues to grow even under treatment, the tumor population takes a sharp decline highlighting the impact of chemotherapy.
3.3. Fractionated Treatment
To understand the effect of varying treatment regimens, the model was used to simulate a wide number of combinations of treatment and treatment holidays. Each regiment is characterized by dividing the treatment into periods, each period representing the same amount of time. Each slot can have a value of either (1) to signify that treatment is being applied or (0) to indicate that it is not. Thus, assuming a treatment with n different treatment periods, we can consider different treatment regimens based on combinations of treatments and breaks.
The full treatment space also contains regimens that produce favorable results at the cost of eradicating the stromal population—which would be presumably cytotoxic to the patient. Thus, we removed all treatments that reduced the stromal population below a threshold. This approach allows us to contrast continuous and a spectrum of fractionated regimens. From the space of 16 windows, where each window is 40 timesteps,
Table 1 lists the top 5 treatment schedules that yielded the best results in terms of average bone size, as well as the treatment’s average tumor burden.
Table 1 also lists two other treatment regimens: (1) a continuous treatment regiment and (2) a periodic treatment regiment for comparison. Although the model is qualitative and these results therefore might not translate into differences in bone and burden that are equivalent to the measurements it provides, we expect that the qualitative differences between treatment schedules would apply in vivo.
Moreover,
Figure 4 shows all the potential treatments plotted with respect to average bone size and average tumor burden with three representative treatments shown to the side: a periodic treatment, a continuous treatment, and a fractionated treatment.
4. Discussion
Intra-tumor heterogeneity is increasingly recognized as the key driver of evolution in cancer. This heterogeneity also explains the emergence of resistance to both standard-of-care and targeted treatments. We presented an EGT model that captures this heterogeneity and the role of dynamic homeostasis of bone remodeling orchestrating the interactions between bone-producing cells (OBs) and bone-resorbing cells (OCs). This homeostasis can be disrupted by tumor cells, whose growth, in turn, can be prevented by the application of cytotoxic drugs such as docetaxel. Our results recapitulate not only the “vicious cycle” of the disruption and co-option of homeostatic mechanisms but also the pathological bone formation that characterizes bone metastatic prostate cancer [
28]. Knowing that certain tumor phenotypes can be relatively immune to the effects of chemotherapy, our model also captures the emergence of therapy-resistant tumors.
The conventional clinical application of chemotherapy in most cancers involves the use of the drug until either the tumor enters remission, resistance renders further application of the drug ineffective, or the patient can no longer tolerate it. This approach is called maximum tolerable dosage (MTD) and has been recently contrasted with alternative approaches where the aim is to transform the disease into one that could be managed as a chronic condition. In support of this, intermittent docetaxel has been proven to be useful in metastatic prostate cancer [
29,
30].
Our results show that the efficacy of the treatment depends on the heterogeneity of the tumor. MTD works best if the metastases are homogeneous. Assuming heterogeneity with regard to chemotherapy resistance, a realistic scenario in metastatic prostate cancer, our model allows us to explore how different treatment durations and intervals between drug application impact tumor heterogeneity, fitness, and bone mass (see
Figure 4). Unsurprisingly, the model shows that alternative treatment strategies are likely to yield better results if the metastasis contains both susceptible and resistant phenotypes.
Novel therapies where conventional drugs are used while taking into account the tumor’s evolutionary dynamics have been proposed and mathematically explored by Orlando et al. [
31] under the constraint that the microenvironment of the tumor plays a reduced role and that tumor populations do not interact with each other. Our results extend beyond these constraints and show that neither conventional nor fractionated strategies are always the best solution. While our systematic search has not shown optimal treatments resembling the evolutionarily enlightened therapies proposed by Zhang et al. [
22], there is some evidence that they could work in the context of metastatic prostate cancer. Our main result supports a variant: the application of fractionated therapies where full dosage is first applied for a period of time, followed by an alternation between on and off cycles.
While this finding will not have an immediate impact on how fractionated treatments are delivered, it shows that the model captures the basic biological principles of bone metastatic prostate cancer, allowing us to explore treatment strategies in a meaningful way. Models, like the one we have presented here, can be used to better understand evolutionarily enlightened treatments. EGT is a well known mathematical tool in which to frame evolutionary questions, and our EGT model allows us to include the microenvironmental selection as well as cell–cell interactions in the game dynamics. We are aware that, by its own nature, mathematical models constitute a simplification of the reality being modeled. For example, our model does not take into consideration the spatial interplay that is known to impact EGT dynamics of cancer [
14,
32] and has been recently shown to play a key role in the efficacy of some innovative applications of conventional treatments in cancer [
33]. We expect that our results could be quantitatively different, as we assume different costs of resistance, treatment impact, or spatial structure. However, the principle of a period of continuous application followed by periods of on and off cycles is expected to hold when the parameters change to reflect different tumors and treatment efficacies.
We measured the impact of these different treatment schemes by looking at their effect on the two tumor populations; however, in bone metastatic prostate cancer, there are other metrics that need to be considered: total dosage and microenvironmental impact. As shown in
Figure 2, tumor growth leads to an increase in bone, growth that can, in some cases, be curtailed by chemotherapy (see
Figure 3).
Figure 4 shows that the scheduling of chemotherapy can have a substantial impact on the amount of pathological bone formed, a consideration that is clinically important yet rarely included in mathematical models of bone metastases. The examples offer the interesting possibility that a sustained application of chemotherapy followed by treatment holidays and subsequent applications of fractionated therapy could lead to control not only of tumor growth but also of bone growth (
Figure 4D; although, see Kaznatcheev [
34] for a perspective on the limits of tumor burden control in models like ours).
While the total dosage is slightly different, the purely continuous and the (approximately) periodic treatments shown in
Figure 4A,B demonstrate bone increases over time.
Our EGT model, by combining tumor, stroma, and bone microenvironment, constitutes a platform in which various standard-of-care treatment strategies for metastatic prostate cancer patients that can minimize dosage and bone disease—including, but are not limited to, bisphosphonates, anti-RANKL, and hormonal therapies—can be investigated. We have investigated some of those treatment options before [
2] using agent-based approaches. However, the combination of agent-based and EGT approaches to tackle questions regarding the evolutionary dynamics of bone metastatic prostate cancer and of resistance to standard-of-care treatments presents several benefits. This includes confidence in the results obtained by any single model (assuming consistency between the two models) as well as the ability to understand and describe both local and systemic disease dynamics.