Next Article in Journal
Estimation of Nitrite—Nitric Oxide Derivative—In Horses with Intestinal Colic by ESR Spectroscopy
Previous Article in Journal
A Century of Swine Influenza: Is It Really Just about the Pigs?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predicting Diagnosis of Australian Canine and Feline Urinary Bladder Disease Based on Histologic Features

1
School of Veterinary Science, The University of Queensland, Gatton, QLD 4343, Australia
2
Good Clinical Practice Research Group, School of Veterinary Science, The University of Queensland, Gatton, QLD 4343, Australia
3
School of Veterinary Medicine, College of Science, Health, Engineering and Education, Murdoch University, Murdoch, WA 6150, Australia
*
Author to whom correspondence should be addressed.
Vet. Sci. 2020, 7(4), 190; https://doi.org/10.3390/vetsci7040190
Submission received: 29 October 2020 / Revised: 20 November 2020 / Accepted: 25 November 2020 / Published: 27 November 2020
(This article belongs to the Section Anatomy, Histology and Pathology)

Abstract

:
Anatomic pathology is a vital component of veterinary medicine but as a primarily subjective qualitative or semiquantitative discipline, it is at risk of cognitive biases. Logistic regression is a statistical technique used to explain relationships between data categories and outcomes and is increasingly being applied in medicine for predicting disease probability based on medical and patient variables. Our aims were to evaluate histologic features of canine and feline bladder diseases and explore the utility of logistic regression modeling in identifying associations in veterinary histopathology, then formulate a predictive disease model using urinary bladder as a pilot tissue. The histologic features of 267 canine and 71 feline bladder samples were evaluated, and a logistic regression model was developed to identify associations between the bladder disease diagnosed, and both patient and histologic variables. There were 102 cases of cystitis, 84 neoplasia, 42 urolithiasis and 63 normal bladders. Logistic regression modeling identified six variables that were significantly associated with disease outcome: species, urothelial ulceration, urothelial inflammation, submucosal lymphoid aggregates, neutrophilic submucosal inflammation, and moderate submucosal hemorrhage. This study demonstrated that logistic regression modeling could provide a more objective approach to veterinary histopathology and has opened the door toward predictive disease modeling based on histologic variables.

1. Introduction

Anatomic pathologists are highly trained in the use of light microscopy, and increasingly digital whole-slide images, for analysis of tissue specimens at 20 to 600 times magnification to evaluate the cellular components and characteristics of a disease or physiologic process. Pathologists make a diagnosis through the recognition of one or more histologic findings, ideally combined with the clinical history of the patient [1]. However, it is well known that pathologists are influenced by cognitive bias [2,3]—a facet of the discipline that has both benefits and limitations [4]. Examples of cognitive bias include (a) confirmation bias—looking for evidence of a favored hypothesis; (b) diagnostic drift—slight variations in scoring values over the course of a study; (c) tunnel vision or anchoring—the tendency to rely too heavily on the first information presented; (d) avoidance of extreme scoring ranges; and (e) availability bias—referring to what most easily comes to mind, which means less familiar diseases are not considered [3,5].
Manual histopathology is generally qualitative or semi-quantitative as opposed to quantitative, and at times has low agreement between individual pathologists [6,7] which has prompted recent advances in computer learning and computer-based image analysis [3]. Mathematical models for pathologists’ diagnostic processes do exist. However, very few have been validated [8]. When a pathologist looks at a tissue microscopically, they incorporate the observed changes with their knowledge obtained via extensive training and experience to formulate an ordered differential list [9]. The diagnosis with the highest probability is then reported as the final diagnosis. In summary, pathologists incorporate a wide range of knowledge and experience to provide the most likely diagnosis based on the microscopic changes they observe.
Logistic regression is a statistical method used to explain the relationship between data categories and outcomes [10]. The output of logistic regression is an odds ratio which reflects the likelihood that an event/disease occurs as depending on dichotomous explanatory variables (for example, what is the odds of a patient developing diabetes if they are overweight or not overweight) [11]. In a stepwise procedure, logistic regression is used to build the best possible model that explains the relationship between the outcome/s of interest and the explanatory variables in the dataset [10,11]. To do this, the model uses logit (log-odds) transformation to predict the probability of the outcome/s occurring in every possible combination of explanatory variables, thus acts as a simulation [10,11]. Logistic regression modeling was chosen for this study because it allows prediction of outcome probability from a combination of continuous and discrete independent variables [12].
Disorders of the urinary bladder are common in dogs and cats; therefore, bladder tissue is relatively easy to acquire. Bladder diseases account for 7% of cats hospitalized in veterinary clinics in the United States [13]. An estimated 14% of North American dogs are affected by a urinary tract infection at some point during their lifetime [14] and 1.5–3% of dogs admitted into veterinary care are diagnosed with urolithiasis (bladder stones) [15]. Urinary bladder neoplasms (primarily urothelial carcinoma, UC, previously termed transitional cell carcinoma, TCC) account for 1.5–2% of all canine neoplasms, while the prevalence of bladder neoplasia in cats is much lower [16]. Urinary bladder disorders can be grouped into four broad categories—neoplastic disease, urinary tract infection, non-infectious cystitis (namely feline idiopathic cystitis) and urolithiasis [17].
Statistical models have potential to predict disease risk in both the human and veterinary medical fields by providing an objective probability of the disease occurring given the combination of variables [18] In the veterinary field, statistical models have been used in genetics [19], ultrasonography [20,21], surgery and surgical prognosis development [22,23] as well as predicting disease outbreaks [24]. However, the use of statistical models in veterinary histopathology has been limited [25]. The aims of this study were to evaluate the microscopic changes of urinary bladder diseases in a retrospective collection of canine and feline urinary bladder tissue and to quantify the association, if any, between the microscopic changes and disease diagnosis. This work demonstrates the clinical utility of quantitative statistical techniques in veterinary diagnostics to provide an evidence-based approach for decision making in veterinary histopathology.

2. Materials and Methods

2.1. Study Population and Data Collection

Records of dogs and cats with bladder histology submitted to The University of Queensland Veterinary Laboratory Service (UQVLS) between January 1994 and March 2016 were obtained via a search enquiry on the histopathology database for canine and feline pathology reports containing at least one of the following terms: bladder, cystitis, transitional cell, urinary, urothelial. The database search process is outlined in Figure 1. Pathology records were excluded if they only mentioned gallbladder (not urinary bladder, n = 747), if the record contained cytology but not histology (n = 24) or if the animal was less than six months of age (n = 46), as immature bladder wall can have umbilical artery or urachal remnants [26]. Records were excluded when urinary bladder had been discussed in the gross section of the necropsy report, but no histology had been taken (n = 68), and when no diagnosis could be made due to poor sample size or quality (n = 5). Tissue blocks were retrieved (where available, 83 could not be located or the sample was not of diagnostic quality), and slides recut at 4 µm thickness and stained with hematoxylin and eosin (H&E) (Leica ST5020 autostainer).
In addition, bladder pathology records were obtained from the School of Veterinary Medicine, College of Science, Health, Engineering and Education, Murdoch University (MUSVM). The search function on the MUSVM database prevented an identical database search being performed, thus the primary disease category was selected, followed by a search for keywords (cystitis, urin*, transit*, uroth*, urolith*, TCC and UCC) within each year of archived records. Seventy-one blocks were identified, and slides recut and stained with H&E using a manual staining method.
A selection of Brisbane veterinary clinics was recruited for involvement in the project based on their geographical location, and a small number of prospective bladder biopsies were obtained from dogs and cats undergoing cystotomy at those clinics as part of disease diagnosis or treatment (n = 19). Finally, eleven slides containing canine or feline urinary bladder specimens were donated by a local veterinary diagnostic pathology company. The UQVLS pathology database search for biopsy and necropsy samples and the prospective collection of biopsy and necropsy samples was performed under the University of Queensland animal ethics ANRFA/SVS/259/16.

2.2. Histopathology

A wide range of histologic features were scored for each slide, outlined in Supplementary Table S1. Many variables were scored based on presence or absence, such as urothelial inflammation or neoplastic urothelium. Some variables had multilevel scoring, such as primary submucosal inflammatory type (lymphocytic, neutrophilic, lymphoplasmacytic or granulomatous) and submucosal hemorrhage (none, hemorrhage present in up to 25%, 26–50% and >50% of the submucosa) (Supplementary Table S1). These histologic features were selected based on a literature review of microscopic changes in urinary bladder diseases in people [27,28,29,30,31]. Retrieved cases were interrogated by EJ (pathology trainee) and RA (Diplomate of the American College of Veterinary Pathologists), and after microscopic slide review, cases were categorized ranked in this order—neoplasia, urolithiasis (bladder stones), cystitis (inflammation in the bladder wall which may be due to infectious or non-infectious causes), normal bladder wall, or other diagnoses.
Based on the human literature [32,33] and a review of 56 normal and diseased bladder specimens at the beginning of this project, we agreed that up to 20 scattered lymphocytes per 100× magnification field of the mucosa and submucosa were considered normal, with greater than 20 leading to classification as cystitis, particularly if there was concurrent hemorrhage and/or edema. Normal bladders could have occasional lymphocytes scattered throughout the urothelium and lamina propria, but no neutrophils.
Urolithiasis is not a histologic diagnosis per se. However, these cases were identified and separated based on clinical imaging and/or cystoscopy, or gross postmortem findings. Records were assigned to the urolithiasis category if uroliths were mentioned in the submitted history regarding the current clinical presentation for biopsy cases, or if they were reported in the necropsy report.
Where neoplasia of any type had been identified in the bladder wall, records were placed into the ‘neoplasia’ category, even if there was concurrent inflammation or urolithiasis, as neoplasia was considered to be the predominant pathologic process. Tissue was categorized as normal if the bladder wall had no abnormalities or had up to 20 scattered submucosal lymphocytes without hemorrhage and edema.
All other diagnoses were grouped together in the ‘other’ category, including hemorrhage only, edema only, autolysis only, peritonitis (inflammation of the bladder serosa), traumatic bladder rupture, and healed scar tissue (Supplementary Table S2). Cases with normal bladder tissue and other diagnoses combined were considered as the base category to which the other three categories of diagnostic outcomes were compared in the statistical modeling. The ‘other’ diagnosis group was combined with normal bladders for two reasons. First, to simulate the array of histologic features that may be observed in absence of one of our main three diagnoses; second, to increase the power of this group as the normal bladder cases alone were a relatively small group. Data was managed using Microsoft Excel (Microsoft Corporation, Redmond, WA, USA).

2.3. Statistical Analysis

Multinomial logistic regression analysis was utilized to analyze univariable associations between risk factor variables—histologic variables and species; and the dependent variable, the diagnoses—cystitis, neoplasia or urolithiasis, compared to normal and other diagnoses combined. Stata 15.0 (StataCorp., College Station, TX, USA) was used for all statistical analyses. The urothelial inflammation category was changed from a multilevel grading to the dichotomous ‘presence or absence’ of urothelial inflammation for the multivariate model, due to low case numbers in the higher categories. Likewise, for submucosal hemorrhage—categories 3 (26–50%) and 4 (>50% submucosa containing hemorrhage) were combined due to a low number of cases in category 4. A multiple Wald test was used to evaluate the statistical significance of all categories together for any histologic variable [10]. Variables for which Wald’s p < 0.10 were considered for multivariate analysis.
For the multivariable model, forward stepwise model building procedure was performed and the overall p values and odds ratios (OR) with 95% confidence intervals (CI) for explanatory variables were recorded. The stepwise selection process was stopped once all covariates were significantly (p ≤ 0.05) contributing to the model in any of the four outcome categories (cystitis, neoplasia, urolithiasis, baseline of normal/other). First order interactions between explanatory variables were also explored. Variables not selected for the original multivariate model were added back one at a time, with significant variables (p ≤ 0.05) retained. Using this approach, we were able to identify variables that by themselves were not significantly related to the outcome, but made an important significant contribution in the presence of other variables [34]. The Hausman–McFadden Test was used to test the assumption that the model odds ratios for each level of the histologic variable were independent of the other levels [35].
Several approaches were used to conduct regression diagnostics. First, three binary logistic regression models were created from the final multivariate model (baseline/cystitis, baseline/neoplasia, baseline/urolithiasis) and regression diagnostics were carried out on each model as described [10]. Thus, covariate patterns with outlying standardized Pearson residual and delta–beta values were identified, and the models were then rerun excluding cases from within these patterns and the changes in the resulting coefficients were examined. Model fit was then assessed using the Hosmer–Lemeshow goodness-of-fit test. Secondly, a recently developed overall goodness-of-fit-test for multinomial logistic regression models [36] was applied using the—logitgof—command in Stata (StataCorp., College Station, TX, USA). Predicted probabilities were calculated from the multinomial model using the—margins—command in Stata, where the predicted probability of each diagnostic outcome was calculated at each level of the individual variable and variable combinations, while all other variables in the model were at their means.

3. Results

The dataset consisted of 338 cases (Table 1) including 102 cystitis (30% of all samples), 84 neoplasia (25%, 71% of these UC, Supplementary Table S3), 42 urolithiasis (12%), 63 normal bladders (19%) and 47 other diagnoses (14%). During the slide review process, 23 cases had their diagnosis changed. The most common reason for a changed diagnosis was reclassifying a cystitis diagnosis as normal due to paucity of inflammatory infiltrates (n = 7).
Stepwise construction of the multinomial logistic regression model revealed six variables that were significantly associated with disease diagnosis, compared to the normal/other disease baseline category (herein referred to as ‘baseline’), when other variables were accounted for: species, urothelial ulceration, urothelial inflammation, submucosal lymphoid aggregates, neutrophilic submucosal inflammation, and having a moderate amount of submucosal hemorrhage (Table 2).
Species was significant for the urolithiasis outcome, with dogs having at least five times higher odds of having urolithiasis than cats (p = 0.04). Slides with urothelial ulceration were 13 times more likely to be diagnosed with urolithiasis (p < 0.01) compared to slides without urothelial ulceration. The presence of inflammatory cells infiltrating the urothelial cell layer was significantly associated with all disease groups, particularly urolithiasis (p < 0.01). Urothelial inflammation was also associated with neoplasia (p < 0.01) and cystitis (p = 0.02) compared to cases that did not have urothelial inflammation (Table 2).
The presence of submucosal lymphoid aggregates was significantly associated with cystitis (p = 0.01) and neoplasia (p = 0.03). Neutrophilic submucosal inflammation was significantly associated with all disease groups compared to the baseline category, particularly urolithiasis where slides with neutrophilic submucosal inflammation were 17 times more likely to belong to the urolithiasis group (p = 0.01). Neutrophilic submucosal inflammation was also strongly associated with cystitis (p < 0.01), and moderately associated with the neoplasia category (p = 0.02). A ‘moderate to severe’ amount of hemorrhage (>26% of the submucosa contains extravasated erythrocytes) was significantly associated with cystitis (p = 0.01). Predicted probabilities for the significant variables (p ≤ 0.05) are displayed in Supplementary Tables S4 and S5 and are shown graphically in Figure 2. Each data entry (vertical line) depicts a disease diagnosis (cystitis, neoplasia, urolithiasis and normal/other) without and with the significant histologic variable.

4. Discussion

Five histologic variables and one animal variable were found to be significantly associated with one or more disease group using logistic regression modeling—urothelial inflammation, urothelial ulceration, type of submucosal inflammation, amount of submucosal hemorrhage, presence of submucosal lymphoid aggregates and species. Our result of dogs having five times higher odds of being diagnosed with urolithiasis compared to cats is not surprising as urolithiasis is reported more commonly in dogs than cats [37]. Urolithiasis is thought to be present in up to 1.5% of cats seen at veterinary practices and up to 3% of dogs [15], which is reflected in our findings.
Urothelial ulceration was significantly associated with urolithiasis, which makes sense pathophysiologically as this disease is characterized by the presence of a urolith in the bladder lumen. The bladder stones cause physical trauma to urothelial cells, sometimes to the point of complete urothelial loss [15,38]. It is important to note that urothelial loss may also occur as a postmortem change or as part of tissue handling during biopsy. However, we endeavored to prevent overlap here by using separate variables for urothelial loss (denudation) and ulceration. Postmortem or tissue handling-induced urothelial loss showed minimal tissue reaction, suggesting that it was artefactual, as opposed to pathologic ulceration which includes one or more of the following cellular changes in addition to the urothelial loss—urothelial cell flattening and sliding, submucosal or urothelial inflammation, submucosal hemorrhage or submucosal edema in the remaining urothelial layer and/or submucosa [39].
The presence of urothelial inflammation was strongly associated with all disease groups but could not be used to differentiate between them. It is normal to have low numbers of resident lymphocytes within the urothelium [33]. However, it makes biological sense that numbers would increase in response to physical trauma such as uroliths, the presence of microorganisms, or in response to ‘foreign’ neoplastic cells (most neoplasms in this dataset were urothelial carcinomas which arise from urothelial cells). In addition, neoplasms weaken tissue architecture and can make the tissue more sensitive to trauma or infection, further increasing leukocyte numbers. Finally, neoplasms are known to recruit specific intra-tumoral lymphocytes, which may be what we observed in our UC samples [40].
Neutrophilic submucosal inflammation was increased in association with all disease outcomes while non-neutrophilic inflammation (mononuclear; primarily lymphocytic or lymphoplasmacytic infiltrates) was not significantly associated with any disease group compared to baseline. As mentioned, the presence of scattered lymphocytes in the urothelium and submucosa can be normal [32,33]. However, neutrophils are not part of the resident leukocyte population and are only present when stimulated by inflammation, which is consistent with our results. Therefore, the submucosa of a normal bladder wall should not contain any neutrophils.
The most severe categories of hemorrhage observed in the histologic analysis (a moderate to marked amount of hemorrhage—extravasated erythrocytes occupying >26% of the submucosal area) were significantly associated with the cystitis outcome when compared to baseline. Submucosal hemorrhage was observed in all disease groups, but it was highest in the cystitis group. This is likely attributable to the vasoactive cytokines released during acute inflammation, causing increased vascular permeability and leakage [41]. We observed a high level of neutrophilic inflammation in the cystitis group; submucosal neutrophils are likely to be associated with hemorrhage because one of the enzymes released, elastase, can contribute to the breakdown of arteriolar walls [42]. In addition, bacteria can induce endothelial damage, which may result in submucosal hemorrhage in some bacterial cystitis cases [39]. Submucosal hemorrhage may occur as a sequela to tissue handling during biopsy. However, tissue handling does not result in extravascular inflammatory cell infiltrates.
Finally, the presence of submucosal lymphoid aggregates was associated with cystitis and neoplasia, but not with urolithiasis. Aggregates of lymphocytes (often with germinal centers) are a part of normal immune surveillance in many tissues [43,44], but in the human urinary bladder are thought to represent chronic inflammation [45]. There are no published standards for the role of lymphoid aggregates in canine or feline bladders. However, the chronic inflammation theory is plausible for these species as well. Chronic inflammation is frequent in cases of recurrent cystitis [46,47], while tumor-infiltrating leukocytes are commonly observed alongside neoplasia [48]. Animals with recurrent bacterial cystitis may have predisposing breed, anatomical or metabolic factors that have caused them to have bladder inflammation more frequently throughout their life prior to histologic sampling [46,47,49,50], thus resulting in the presence of lymphoid aggregates. Uroliths may take a more acute clinical course, with animals showing clinical signs more acutely than those with low-grade cystitis or with neoplasia; this could theoretically lead to earlier detection of disease and therefore tissue samples being obtained earlier in the disease process before lymphoid aggregates developed. Lastly, there is likely to be little antigenic drive in urolithiasis to provoke an acquired immune response, which typically occurs in lymphoid tissue. Conversely, infection and neoplasia are associated with abnormal self or non-self-antigens, and therefore would be more likely to trigger an acquired, lymphocytic immune response [51,52] and thus develop lymphoid aggregates.
When bladder stones were present, the histologic diagnosis made by the initial pathologist was often ‘cystitis’, because bladder wall inflammation frequently occurs in these cases. Urolithiasis is not a histologic diagnosis. However we chose to separate these records into a different group for the modeling process, ‘urolithiasis,’ and not include them in the ‘cystitis’ category as the inflammation can be attributed to the physical trauma of the stone in addition to potential bacterial infection. It was recognized that bacterial cystitis may lead to urolithiasis, namely struvite stone formation secondary to urease-producing bacteria [53,54]. Conversely, uroliths can impair bladder defenses, facilitating the development of bacterial cystitis [53]. Up to 50% of canine bladder stones are thought to be infection related [55], a phenomenon that is much more common in dogs than in cats [56]. The small number of cases in this study with confirmed concurrent bacterial cystitis and urolithiasis were categorized with other urolithiasis cases instead of other bacterial cystitis cases for several reasons. Firstly, urine culture for bacterial detection may not be performed routinely on every urolith case, and therefore the urolithiasis category in this dataset is likely to already contain some cases with both urolithiasis and bacterial urinary tract infection. Secondly, the cystitis disease group is already a heterogenous combination of (a) cases with bacterial or fungal infection confirmed by urine culture, (b) cases with suspected bacterial infection without bacterial culture, and (c) cases of suspected feline idiopathic cystitis (no infectious organism involved). Thirdly, we hypothesized that the mechanical damage caused by uroliths may lead to a different inflammation profile to bacterial cystitis alone, and therefore cases with uroliths and bacterial infection were deemed more similar to the urolithiasis cases than cases of cystitis without bladder stones. The authors realize that there is likely to be overlap between the cystitis and urolithiasis groups in this study and it would be ideal to have urine culture results for each of these cases to enable more accurate stratification of these diseases. However, this was not possible due to the retrospective nature of this study.
One limitation of this work is that cases of chronic cystitis are more likely to undergo clinical biopsy than acute cystitis patients, so there is likely to be some skewing of our dataset to contain a higher proportion of chronic cystitis cases than would occur in the general pet population. For the cystitis outcome, it is important to note that our definition of cystitis (histologic evidence of inflammation in the bladder wall) is different from the commonly used clinical definition of cystitis (patients with lower urinary tract clinical signs and often with positive bacterial culture indicating urinary tract infection). Due to the histologic and primarily retrospective nature of this study, many cases were lacking urine culture results, making it impossible to definitively categorize those cases as having or not having bacterial cystitis. Further, the combination of normal and other diagnoses is likely to have had some impact on the results. The two groups were combined to increase case numbers in the baseline category and to replicate the range of other diseases that may be compared to our disease groups. In future it would be prudent to recruit a larger sample size to enable the comparison of disease categories to a group of normal bladders without any other disease combined with it. The small sample size for cats in our study is thought to be a sampling bias as a result of a combination of factors; fewer cats undergoing postmortem examination at our institution, the difficulty of obtaining bladder biopsies from cats, particularly males [57], as well as a lower proportion of owned cats compared to dogs in Australia; 27% of households have a pet cat, 40% of households have a pet dog [58].
The primary limitation of this study is its retrospective nature. A retrospective study design was chosen for two reasons. Firstly, despite bladder disease occurring commonly in dogs and cats, bladder biopsy is not frequently performed and therefore a suitable sample size of bladder histologic specimens would be very difficult to attain via a prospective study. This particularly applies to the rarely biopsied but highly clinically significant syndrome of feline idiopathic cystitis. Secondly, evaluating 20 years of archived pathology records provides a detailed insight into the historical nature of bladder disease samples—an analysis that has not previously been performed. A limitation of this approach is that ideally, mathematical models should be developed from prospective data to minimize missing data and tighten the definition of subject groups [18]. However, financial and ethical constraints prohibited a prospective study in this instance. Some limitations for using logistic regression modeling are that odds ratios are the only output, the sequence of entering variables into the model is based purely on the statistical criteria, and it can be difficult to interpret interactions between variables [59]. In addition, the use of logistic regression means that our probabilities for disease outcome based on histologic variables were calculated by keeping all other variables in the model at their mean value.

5. Conclusions

In summary, we applied logistic regression modeling to a histology dataset of canine and feline urinary bladders from Eastern and Western Australia which identified six significant variables that were associated with disease outcome compared to baseline; urothelial ulceration, urothelial inflammation, neutrophilic submucosal inflammation, submucosal lymphoid aggregates, amount of submucosal hemorrhage, and species. The next step in this work will be the creation of a predictive probability tool for bladder disease diagnosis and validation of the tool in a prospective controlled setting, to evaluate its potential use for diagnostic veterinary pathology applications. Going forward, a prospective study evaluating both histologic features of canine and feline urinary bladder disease, and patient outcome information would be required to refine the accuracy and clinical applicability of this model and predictive tool.

Supplementary Materials

The following are available online at https://www.mdpi.com/2306-7381/7/4/190/s1, Table S1: All animal, sampling and diagnostic histologic variables measured on each bladder slide and used in the logistic regression modeling process. Table S2: Breakdown of pathology records where the diagnosis for the bladder tissue was assigned to the ‘other’ category (n = 47). Table S3: Neoplasia types. Table S4: Canine predicted probabilities for each diagnosis by the five significant histologic variables. Table S5: Feline predicted probabilities for each diagnosis by the five significant histologic variables.

Author Contributions

Conceptualization, E.J., J.A. and R.A.; methodology, J.A. and R.A.; formal analysis, E.J. and J.A.; data curation, E.J.; writing—original draft preparation, E.J.; writing—review and editing, E.J., R.A., M.T., C.P. and K.J.; supervision, R.A.; funding acquisition, E.J. All authors have read and agreed to the published version of the manuscript.

Funding

The authors would like to acknowledge the John and Mary Kibble bequest for companion animal research, Companion animal research funds for the University of Queensland School of Veterinary Science, and the David Galbraith Postgraduate Research Scholarship in Companion Animal Health.

Acknowledgments

We acknowledge the support of the UQVLS and MUSVM team for their help in acquiring the case records.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Raab, S.S.; Oweity, T.; Hughes, J.H.; Salomao, D.R.; Kelley, C.M.; Flynn, C.M.; D’Antonio, J.A.; Cohen, M.B. Effect of clinical history on diagnostic accuracy in the cytologic interpretation of bronchial brush border specimens. Am. J. Clin. Pathol. 2000, 114, 78–83. [Google Scholar] [CrossRef] [PubMed]
  2. Fandel, T.M.; Pfnur, M.; Schafer, S.C.; Bacchetti, P.; Mast, F.W.; Corinth, C.; Ansorge, M.; Melchior, S.W.; Thuroff, J.W.; Kirkpatrick, C.J.; et al. Do we truly see what we think we see? The role of cognitive bias in pathological interpretation. J. Pathol. 2008, 216, 193–200. [Google Scholar] [CrossRef] [PubMed]
  3. Aeffner, F.; Wilson, K.; Martin, N.; Black, J.; Hendriks, C.; Bolon, B.; Rudmann, D.; Gianani, R.; Koegler, S.; Krueger, J.; et al. The Gold Standard Paradox in Digital Image Analysis: Manual Versus Automated Scoring as Ground Truth. Arch. Pathol. Lab. Med. 2017, 141, 1267–1275. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Hamilton, P.W.; van Diest, P.J.; Williams, R.; Gallagher, A.G. Do we see what we think we see? The complexities of morphological assessment. J. Pathol. 2009, 218, 285–291. [Google Scholar] [CrossRef] [PubMed]
  5. Mamede, S.; van Gog, T.; van den Berge, K.; Rikers, R.M.; van Saase, J.L.; van Guldener, C.; Schmidt, H.G. Effect of availability bias and reflective reasoning on diagnostic accuracy among internal medicine residents. J. Am. Med. Assoc. 2010, 304, 1198–1203. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Van Ginneken, A.M.; van der Lei, J. Understanding differential diagnostic disagreement in pathology. Proc. Annu. Symp. Comput. Appl. Med. Care 1991, 99–103. [Google Scholar]
  7. Day, M.J.; Bilzer, T.; Mansell, J.; Wilcock, B.; Hall, E.J.; Jergens, A.; Minami, T.; Willard, M.; Washabau, R. Histopathological standards for the diagnosis of gastrointestinal inflammation in endoscopic biopsy samples from the dog and cat: A report from the World Small Animal Veterinary Association Gastrointestinal Standardization Group. J. Comp. Path. 2008, 138 (Suppl. 1), S1–S43. [Google Scholar]
  8. Crowley, R.S.; Naus, G.J.; Stewart, J.; Friedman, C.P. Development of visual diagnostic expertise in pathology—An information-processing study. J. Am. Med. Inform. Assoc. 2003, 10, 39–51. [Google Scholar] [CrossRef]
  9. Bartels, P.H. The diagnostic pattern in histopathology. Am. J. Clin. Pathol. 1989, 91, S7–S13. [Google Scholar]
  10. Dohoo, I.; Martin, W.; Stryhn, H. Veterinary Epidemiologic Research; VER Inc.: Charlottetown, PE, Canada, 2009; ISBN 978-091-901-360-5. [Google Scholar]
  11. Sperandei, S. Understanding logistic regression analysis. Biochem. Med. 2014, 24, 12–18. [Google Scholar] [CrossRef]
  12. Bhatti, I.P.; Lohano, H.D.; Pirzado, Z.A.; Jafri, I.A. A Logistic Regression Analysis of the Ischemic Heart Disease Risk. J. Appl. Sci. 2006, 6, 785–788. [Google Scholar] [CrossRef]
  13. Osborne, C.A.; Kruger, J.M.; Lulich, J.P.; Polzin, D.J. Disorders of the feline lower urinary tract. In Canine and Feline Nephrology and Urology, 1st ed.; Osborne, C.A., Finco, D., Eds.; Lippincott Williams and Wilkins: Philadelphia, PA, USA, 1995; ISBN 978-068-306-666-1. [Google Scholar]
  14. Ling, G.V. Therapeutic strategies involving antimicrobial treatment of the canine urinary tract. J. Am. Vet. Med. Assoc. 1984, 185, 1162–1164. [Google Scholar] [PubMed]
  15. Osborne, C.A.; Lulich, J.P.; Bartges, J.W.; Unger, L.K.; Thumchai, R.; Koehler, L.A.; Bird, K.A.; Felice, L.J. Canine and feline urolithiasis: Relationship of etiopathogenesis to treatment and prevention. In Canine and Feline Nephrology and Urology; Osborne, C.A., Finco, D., Eds.; Lea & Febiger: Philadelphia, PA, USA, 1995; ISBN 978-068-306-666-1. [Google Scholar]
  16. Chew, D.J.; DiBartola, S.P.; Schenck, P.A. Tumors of the urinary system. In Canine and Feline Nephrology and Urology, 2nd ed.; Saunders: St. Louis, MO, USA, 2011; ISBN 978-0-7216-8178-8. [Google Scholar]
  17. Chew, D.J.; DiBartola, S.P.; Schenck, P.A. Canine and Feline Nephrology and Urology; Saunders: St. Louis, MO, USA, 2011; ISBN 978-0-7216-8178-8. [Google Scholar]
  18. Harrell, F.E. Regression Modeling Strategies; Springer Science & Business Media: New York, NY, USA, 2015; ISBN 978-038-795-232-1. [Google Scholar]
  19. Bartolomé, N.; Segarra, S.; Artieda, M.; Francino, O.; Sánchez, E.; Szczypiorska, M.; Casellas, J.; Tejedor, D.; Cerdeira, J.; Martínez, A.; et al. A Genetic Predictive Model for Canine Hip Dysplasia: Integration of Genome Wide Association Study (GWAS) and Candidate Gene Approaches. PLoS ONE 2015, 10, e0122558. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Murakami, T.; Feeney, D.A.; Bahr, K.L. Analysis of clinical and ultrasonographic data by use of logistic regression models for prediction of malignant versus benign causes of ultrasonographically detected focal liver lesions in dogs. Am. J. Vet. Res. 2012, 73, 821–829. [Google Scholar] [CrossRef]
  21. Nakamura, K.; Kawamoto, S.; Osuga, T.; Morita, T.; Sasaki, N.; Morishita, K.; Ohta, H.; Takiguchi, M. Left Atrial Strain at Different Stages of Myxomatous Mitral Valve Disease in Dogs. J. Vet. Intern. Med. 2017, 31, 316–325. [Google Scholar] [CrossRef] [Green Version]
  22. Grohn, Y.T.; Fubini, S.L.; Smith, D.F. Use of a multiple logistic regression model to determine prognosis of dairy cows with right displacement of the abomasum or abomasal volvulus. Am. J. Vet. Res. 1990, 51, 1895–1899. [Google Scholar]
  23. Reeves, M.J.; Curtis, C.R.; Salman, M.D.; Stashak, T.S.; Reif, J.S. Validation of logistic regression models used in the assessment of prognosis and the need for surgery in equine colic patients. Prev. Vet. Med. 1992, 13, 155–172. [Google Scholar] [CrossRef]
  24. Selvaraju, G.; Balasubramaniam, A.; Rajendran, D.; Kannon, D.; Geetha, M. Multiple linear regression model for forecasting Bluetongue disease outbreak in sheep of North-west agroclimatic zone of Tamil Nadu, India. Vet. World 2013, 6, 321–324. [Google Scholar] [CrossRef]
  25. Glueckert, E.; Clifford, D.L.; Brenn-White, M.; Ochoa, J.; Gabriel, M.; Wengert, G.; Foley, J. Endemic Skunk amdoparvovirus in free-ranging striped skunks (Mephitis mephitis) in California. Trans. Emerg. Dis. 2019, 66, 2252–2263. [Google Scholar] [CrossRef]
  26. Mata, J.A.; Livne, P.M.; Gibbons, M.D. Urinary ascites: Complication of umbilical artery catheterization. Urology 1987, 30, 375–377. [Google Scholar] [CrossRef]
  27. Tomaszewski, J.E.; Landis, J.R.; Russack, V.; Williams, T.M.; Wang, L.; Hardy, C.; Brensinger, C.; Matthews, Y.L.; Abele, S.T.; Kusek, J.W.; et al. Biopsy features are associated with primary symptoms in interstitial cystitis: Results from the interstitial cystitis database study. Urology 2001, 57, 67–81. [Google Scholar] [CrossRef]
  28. Lynes, W.; Flynn, S.; Shortliffe, L.; Stamey, T. The histology of interstitial cystitis. Am. J. Surg. Pathol. 1990, 14, 969–976. [Google Scholar] [CrossRef] [PubMed]
  29. van de Merwe, J.P.; Nordling, J.; Bouchelouche, P.; Bouchelouche, K.; Cervigni, M.; Daha, L.K.; Elneil, S.; Fall, M.; Hohlbrugger, G.; Irwin, P.; et al. Diagnostic criteria, classification, and nomenclature for painful bladder syndrome/interstitial cystitis: An ESSIC proposal. Eur. Urol. 2008, 53, 60–67. [Google Scholar] [CrossRef] [PubMed]
  30. Srikousthubha, S.; Raghuveer, C.V.; Hingle, S. Profile of lesions in cystoscopic bladder biopsies: A histopathological study. J. Clin. Diagn. Res. 2013, 7, 1609–1612. [Google Scholar]
  31. Cheng, L.; MacLennan, G.T.; Lopez-Beltran, A. Histologic grading of urothelial carcinoma: A reappraisal. Hum. Pathol. 2012, 43, 2097–2108. [Google Scholar] [CrossRef]
  32. Christmas, T.J. Lymphocyte sub-populations in the bladder wall in normal bladder, bacterial cystitis and interstitial cystitis. Br. J. Urol. 1994, 73, 508–515. [Google Scholar] [CrossRef]
  33. Gardiner, R.A.; Seymore, G.J.; Lavin, M.F.; Strutton, G.M.; Gemmell, E.; Hazan, G. Immunohistochemical Analysis of the Human Bladder. Br. J. Urol. 1986, 58, 19–25. [Google Scholar] [CrossRef]
  34. Bursac, Z.; Gauss, C.H.; Williams, D.K.; Hosmer, D.W. Purposeful selection of variables in logistic regression. Source Code Biol. Med. 2008, 3, 17. [Google Scholar] [CrossRef] [Green Version]
  35. Hausman, J.; McFadden, D. Specification Tests for the Multinomial Logit Model. Econometrica 1984, 52, 1219–1240. [Google Scholar] [CrossRef] [Green Version]
  36. Fagerland, M.W.; Hosmer, D.W.; Bofin, A.M. Multinomial goodness-of-fit tests for logistic regression models. Stat. Med. 2008, 27, 4238–4253. [Google Scholar] [CrossRef]
  37. Tion, M.; Dvorska, J.; Saganuwan, S. A review on urolithiasis in dogs and cats. Bulg. J. Vet. Med. 2015, 18, 1–18. [Google Scholar] [CrossRef]
  38. Jokinen, M.P.; Seely, J.C. Urinary bladder, ureter and urethra. In Boorman’s Pathology of the Rat, Reference and Atlas, 2nd ed.; Suttie, A.W., Leininger, J.R., Bradley, A.E., Eds.; Academic Press: Cambridge, MA, USA, 2018; ISBN 978-012-391-489-7. [Google Scholar]
  39. Zachary, J.; McGavin, M. Pathologic Basis of Veterinary Disease; Mosby: Missouri, MO, USA, 2016; ISBN 978-032-335-775-3. [Google Scholar]
  40. Horn, T.; Laus, J.; Seitz, A.K.; Maurer, T.; Schmid, S.C.; Wolf, P.; Haller, B.; Winkler, M.; Retz, M.; Nawroth, R.; et al. The prognostic effect of tumour-infiltrating lymphocytic subpopulations in bladder cancer. World J. Urol. 2016, 34, 181–187. [Google Scholar] [CrossRef] [PubMed]
  41. Grover, S.; Srivastava, A.; Lee, R.; Tewari, A.K.; Te, A.E. Role of inflammation in bladder function and interstitial cystitis. Ther. Adv. Urol. 2011, 3, 19–33. [Google Scholar] [CrossRef] [PubMed]
  42. Kuromitsu, S.; Yokota, H.; Hiramoto, M.; Morita, S.; Mita, H.; Yamada, T. Increased concentration of neutrophil elastase in urine from patients with interstitial cystitis. Scand. J. Urol. Nephrol. 2008, 42, 455–461. [Google Scholar] [CrossRef]
  43. Kolbjornsen, O.; Press, C.M.; Moore, P.F.; Landsverk, T. Lymphoid follicles in the gastric mucosa of dogs. Distribution and lymphocyte phenotypes. Vet. Immunol. Immunopathol. 1994, 40, 299–312. [Google Scholar] [CrossRef]
  44. Roccabianca, P.; Woo, J.C.; Moore, P.F. Characterization of the diffuse mucosal associated lymphoid tissue of feline small intestine. Vet. Immunol. Immunopathol. 2000, 75, 27–42. [Google Scholar] [CrossRef]
  45. Cheng, L.; Lopez-Beltran, A.; Bostwick, D.G. Inflammatory and infectious conditions. In Bladder Pathology, 1st ed.; Cheng, L., Lopez-Beltran, A., Bostwick, D.G., Eds.; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2012; ISBN 978-111-827-541-2. [Google Scholar]
  46. Norris, C.R.; Williams, B.J.; Ling, G.V.; Franti, C.E.; Johnson, D.L.; Ruby, A.L. Recurrent and persistent urinary tract infections in dogs: 383 cases. J. Am. Anim. Hosp. Assoc. 2000, 36, 484–492. [Google Scholar] [CrossRef]
  47. Seguin, M.A.; Vaden, S.L.; Altier, C.; Stone, E.; Levine, J.F. Persistent urinary tract infections and reinfections in 100 dogs (1989–1999). J. Vet. Intern. Med. 2003, 17, 622–631. [Google Scholar]
  48. Knapp, D.W.; Ramos-Vara, J.A.; Moore, G.E.; Dhawan, D.; Bonney, P.L.; Young, K.E. Urinary bladder cancer in dogs, a naturally occurring model for cancer biology and drug development. Inst. Lab. Anim. Res. J. 2014, 55, 100–118. [Google Scholar] [CrossRef]
  49. Montalbetti, N.; Rued, A.C.; Clayton, D.R.; Ruiz, W.G.; Bastacky, S.I.; Prakasam, H.S.; Eaton, A.F.; Kullmann, F.A.; Apodaca, G.; Carattino, M.D. Increased urothelial paracellular transport promotes cystitis. Am. J. Physiol. Ren. Physiol. 2015, 309, F1070–F1081. [Google Scholar] [CrossRef] [Green Version]
  50. Martinez-Ruzafa, I.; Kruger, J.M.; Miller, R.; Swenson, C.L.; Bolin, C.A.; Kaneene, J.B. Clinical features and risk factors for development of urinary tract infections in cats. J. Feline Med. Surg. 2012, 14, 729–740. [Google Scholar] [CrossRef] [PubMed]
  51. Joseph, M.; Enting, D. Immune Responses in Bladder Cancer-Role of Immune Cell Populations, Prognostic Factors and Therapeutic Implications. Front. Oncol. 2019, 9, 1270. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Abraham, S.N.; Miao, Y. The nature of immune responses to urinary tract infections. Nat. Rev. Immunol. 2015, 15, 655–663. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Osborne, C.; Lees, G. Bacterial infections of the canine and feline urinary tract. In Canine and Feline Nephrology and Urology, 1st ed.; Osborne, C., Finco, R., Eds.; Williams & Wilkins: Philadelphia, PA, USA, 1995; ISBN 978-068-306-666-1. [Google Scholar]
  54. Seaman, R.; Bartges, J. Canine struvite urolithiasis. Compend. Contin. Educ. Pr. Vet. 2001, 23, 407–420. [Google Scholar]
  55. Syme, H.M. Stones in cats and dogs: What can be learnt from them? Arab. J. Urol. 2012, 10, 230–239. [Google Scholar] [CrossRef]
  56. Houston, D.M.; Vanstone, N.P.; Moore, A.E.P.; Weese, H.E.; Weese, J.S. Evaluation of 21 426 feline bladder urolith submissions to the Canadian Veterinary Urolith Centre (1998–2014). Can. Vet. J. 2016, 57, 196–201. [Google Scholar]
  57. Chew, D.J.; Buffington, T.; Kendall, M.S.; Osborn, S.D.; Woodsworth, B.E. Urethroscopy, Cystoscopy, and Biopsy of the Feline Lower Urinary Tract. Vet. Clin. North. Am. Small Anim. Pract. 1996, 26, 441–462. [Google Scholar] [CrossRef]
  58. Animal Medicines Australia. Pets in Australia: A National Survey of Pets and People; Animal Medicines Australia: Barton, Australia, 2019. [Google Scholar]
  59. Knottnerus, J.A. Application of Logistic Regression to the Analysis of Diagnostic Data: Exact Modeling of a Probability Tree of Multiple Binary Variables. Med. Decis. Mak. 1992, 12, 93–108. [Google Scholar] [CrossRef]
Figure 1. Flow chart for the selection of canine and feline urinary bladder histology slides submitted to the University of Queensland Veterinary Laboratory Service (UQVLS) between January 1994 and March 2016, selected slides from the School of Veterinary Medicine College of Science, Health, Engineering and Education (MUSVM), Murdoch University pathology archives, and prospective samples obtained from local veterinary clinics and a veterinary pathology company in the Brisbane region.
Figure 1. Flow chart for the selection of canine and feline urinary bladder histology slides submitted to the University of Queensland Veterinary Laboratory Service (UQVLS) between January 1994 and March 2016, selected slides from the School of Veterinary Medicine College of Science, Health, Engineering and Education (MUSVM), Murdoch University pathology archives, and prospective samples obtained from local veterinary clinics and a veterinary pathology company in the Brisbane region.
Vetsci 07 00190 g001
Figure 2. Graphical representations of the six significant variables from the logistic regression modeling, all with 95% CI, displaying probability (diamond) with the low (square) and high (triangle) ends of the CI. (A): Probability for bladder diagnosis by species; cystitis (CYS), neoplasia (NEO), urolithiasis (URO), normal/other (N/O), feline (_F), canine (_C). (B): Probability for bladder diagnosis by type of submucosal inflammation; primarily mononuclear (non-neutrophilic) inflammation (_MON), primarily neutrophilic inflammation (_NEU). (C): Probability for bladder diagnosis by presence or absence of urothelial ulceration; No urothelial ulceration (_N), yes, urothelial ulceration present (_Y). (D): Probability for bladder diagnosis by presence of urothelial inflammatory infiltrate; No urothelial inflammation (_N), Urothelial inflammation was present (_Y). (E): Probability for bladder diagnosis by amount of submucosal hemorrhage; No submucosal hemorrhage (_N), Mild amount of submucosal hemorrhage (_mild), Moderate to severe amount of submucosal hemorrhage (_mod). (F): Probability for bladder diagnosis by presence or absence of submucosal lymphoid aggregates; No submucosal lymphoid aggregates (_N), Yes, submucosal lymphoid aggregates were present (_Y).
Figure 2. Graphical representations of the six significant variables from the logistic regression modeling, all with 95% CI, displaying probability (diamond) with the low (square) and high (triangle) ends of the CI. (A): Probability for bladder diagnosis by species; cystitis (CYS), neoplasia (NEO), urolithiasis (URO), normal/other (N/O), feline (_F), canine (_C). (B): Probability for bladder diagnosis by type of submucosal inflammation; primarily mononuclear (non-neutrophilic) inflammation (_MON), primarily neutrophilic inflammation (_NEU). (C): Probability for bladder diagnosis by presence or absence of urothelial ulceration; No urothelial ulceration (_N), yes, urothelial ulceration present (_Y). (D): Probability for bladder diagnosis by presence of urothelial inflammatory infiltrate; No urothelial inflammation (_N), Urothelial inflammation was present (_Y). (E): Probability for bladder diagnosis by amount of submucosal hemorrhage; No submucosal hemorrhage (_N), Mild amount of submucosal hemorrhage (_mild), Moderate to severe amount of submucosal hemorrhage (_mod). (F): Probability for bladder diagnosis by presence or absence of submucosal lymphoid aggregates; No submucosal lymphoid aggregates (_N), Yes, submucosal lymphoid aggregates were present (_Y).
Vetsci 07 00190 g002
Table 1. Count data of all reviewed histology slides by species, following slide review.
Table 1. Count data of all reviewed histology slides by species, following slide review.
DiagnosisCanine (%)Feline (%)Total (%)
Cystitis81 (30)21 (30)102 (30)
Neoplasia74 (28)10 (14)84 (25)
Other34 (13)13 (18)47 (14)
Normal40 (15)23 (32)63 (19)
Urolithiasis38 (14)4 (6)42 (12)
26771338
Table 2. Results of the final multivariate multinomial logistic regression model showing animal or histologic factors associated with diagnoses (cystitis, neoplasia and urolithiasis) compared with the reference category of normal/other diagnoses combined.
Table 2. Results of the final multivariate multinomial logistic regression model showing animal or histologic factors associated with diagnoses (cystitis, neoplasia and urolithiasis) compared with the reference category of normal/other diagnoses combined.
Diagnosis
VariableCystitisNeoplasiaUrolithiasis
OR (95%CI)pOR (95%CI)pOR (95%CI)p
Species
FelineReference Reference Reference
Canine1.95 (0.71, 5.31)0.192.03 (0.75, 5.52)0.175.41 (1.07, 27.46)0.04
Urothelial ulceration
NoReference Reference Reference
Yes1.12 (0.43, 2.89)0.820.90 (0.33, 2.43)0.8313.45 (3.73, 48.56)<0.01
Lymphoid aggregates
NoReference Reference Reference
Yes6.16 (1.59, 23.87)0.014.59 (1.20, 17.61)0.031.71 (0.32, 9.12)0.53
Neutrophilic submucosal inflammation
NoReference Reference Reference
Yes6.47 (2.81, 14.88)<0.012.82 (1.23, 6.49)0.0217.05 (5.26, 55.23)0.01
Amount of submucosal hemorrhage
1Reference Reference Reference
21.98 (0.81, 4.82)0.131.12 (0.48, 2.57)0.801.01 (0.3, 3.39)0.99
34.46 (1.43, 13.93)0.010.39 (0.09, 1.76)0.221.7 (0.40, 7.30)0.47
Urothelial inflammation
NoReference Reference Reference
Yes4.56 (1.35, 15.42)0.025.45 (1.7, 17.52)<0.0110.23 (2.49, 42.06)<0.01
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Jones, E.; Alawneh, J.; Thompson, M.; Palmieri, C.; Jackson, K.; Allavena, R. Predicting Diagnosis of Australian Canine and Feline Urinary Bladder Disease Based on Histologic Features. Vet. Sci. 2020, 7, 190. https://doi.org/10.3390/vetsci7040190

AMA Style

Jones E, Alawneh J, Thompson M, Palmieri C, Jackson K, Allavena R. Predicting Diagnosis of Australian Canine and Feline Urinary Bladder Disease Based on Histologic Features. Veterinary Sciences. 2020; 7(4):190. https://doi.org/10.3390/vetsci7040190

Chicago/Turabian Style

Jones, Emily, John Alawneh, Mary Thompson, Chiara Palmieri, Karen Jackson, and Rachel Allavena. 2020. "Predicting Diagnosis of Australian Canine and Feline Urinary Bladder Disease Based on Histologic Features" Veterinary Sciences 7, no. 4: 190. https://doi.org/10.3390/vetsci7040190

APA Style

Jones, E., Alawneh, J., Thompson, M., Palmieri, C., Jackson, K., & Allavena, R. (2020). Predicting Diagnosis of Australian Canine and Feline Urinary Bladder Disease Based on Histologic Features. Veterinary Sciences, 7(4), 190. https://doi.org/10.3390/vetsci7040190

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop