Search Results (21)

Objective: Reliable reading and annotation of chest X-ray (CXR) images are essential for both clinical decision-making and AI model development. While most of the literature emphasizes pulmonary findings, this study evaluates the consistency and reliability of annotations for extrapulmonary findings, using a labelling scheme. Methods: Six clinicians with varying experience levels (novice, intermediate, and experienced) annotated 100 CXR images using a diagnostic labelling scheme, in two rounds, separated by a three-week washout period. Annotation consistency was assessed using Randolph’s free-marginal kappa (RK), prevalence- and bias-adjusted kappa (PABAK), proportion positive agreement (PPA), and proportion negative agreement (PNA). Pairwise comparisons and the McNemar’s test were conducted to assess inter-reader and intra-reader agreement. Results: PABAK values indicated high overall grouped labelling agreement (novice: 0.86, intermediate: 0.90, experienced: 0.91). PNA values demonstrated strong agreement on negative findings, while PPA values showed moderate-to-low consistency in positive findings. Significant differences in specific agreement emerged between novice and experienced clinicians for eight labels, but there were no significant variations in RK across experience levels. The McNemar’s test confirmed annotation stability between rounds. Conclusions: This study demonstrates that clinician annotations of extrapulmonary findings in CXR are consistent and reliable across different experience levels using a pre-defined diagnostic labelling scheme. These insights aid in optimizing training strategies for both clinicians and AI models. Full article

Background/Objectives: Posture is a significant indicator of health status in older adults. This study aimed to develop an automatic posture assessment tool based on sagittal photographs by validating recognition models using convolutional neural networks. Methods: A total of 9140 images were collected with data augmentation, and each image was labeled as either Ideal or Non-Ideal posture by physical therapists. The hidden and output layers of the models remained unchanged, while the loss function and optimizer were varied to construct four different model configurations: mean squared error and Adam (MSE & Adam), mean squared error and stochastic gradient descent (MSE & SGD), binary cross-entropy and Adam (BCE & Adam), and binary cross-entropy and stochastic gradient descent (BCE & SGD). Results: All four models demonstrated an improved accuracy in both the training and validation phases. However, the two BCE models exhibited divergence in validation loss, suggesting overfitting. Conversely, the two MSE models showed stability during learning. Therefore, we focused on the MSE models and evaluated their reliability using sensitivity, specificity, and Prevalence-Adjusted Bias-Adjusted Kappa (PABAK) based on the model’s output and correct label. Sensitivity and specificity were 85% and 84% for MSE & Adam and 67% and 77% for MSE & SGD, respectively. Moreover, PABAK values for agreement with the correct label were 0.69 and 0.43 for MSE & Adam and MSE & SGD, respectively. Conclusions: Our findings indicate that the MSE & Adam model, in particular, can serve as a useful tool for screening inspections. Full article

Background/Objectives: Patients with rheumatic immune-mediated diseases (rheumatic-IMID) and latent tuberculosis (LTBI) are at an increased risk of developing active tuberculosis (TB); therefore, screening is recommended before starting biological treatment. The aims of this study were as follows: (i) to assess the prevalence of LTBI, (ii) to determine the importance of using a booster test in TST-negative patients, (iii) to compare the tuberculin skin test (TST) with the interferon-gamma release assay (IGRA), (iv) to perform a review of the prevalence of LTBI. Methods: A cross-sectional hospital study was performed, including patients diagnosed with rheumatic-IMID who underwent a TST and/or IGRA during the period 2016–2020. If the first TST was negative, a new TST (booster) was performed. Results: A total of 1117 patients were included. The overall prevalence of LTBI was estimated to be 31.7% (95% confidence interval, 29.74–33.66). The LTBI prevalence ranged from 38.5% for vasculitis to 14% for sarcoidosis. The booster test was positive in 22.9% of 817 patients with a negative or indeterminate IGRA. The IGRA was positive in 3.8% of 793 patients with a negative booster.The adjusted Cohen’s kappa coefficient between TST (+booster) and IGRA was 0.62. Conclusions: LTBI is frequent in patients with rheumatic-IMID. IGRA and TST (+booster) show a moderate, fair grade of agreement. Therefore, performing both tests before biological therapy should be highly recommended. Full article

Background: A minority of studies using the GLIM criteria for malnutrition diagnosis have performed formal empirical validation. Objectives: To evaluate the concurrent and predictive validity of GLIM criteria with and without prior screening among community-dwelling older adults in Singapore. Method: In the Singapore Longitudinal Aging Study (SLAS-2, n = 2477), malnutrition was diagnosed using single-step and two-step GLIM procedures using the Mini Nutritional Assessment Short Form (MNA-SF) and Elderly Nutritional Index for Geriatric Malnutrition Assessment (ENIGMA) for initial screening. Criterion validity was evaluated using MNA-Full Form (MNA-FF) as reference malnutrition diagnosis. Prognostic validity was evaluated using logistic and Cox regression analyses with respect to impaired quality of life (QoL) and 10-year mortality. Results: GLIM malnutrition with and without MNA-SF or ENIGMA screening showed significant associations with known clinical correlates; single-step GLIM malnutrition: sensitivity = 80%, specificity = 83%; two-step MNA-SF-GLIM malnutrition: sensitivity = 80%, specificity = 85%; two-step ENIGMA-GLIM malnutrition: sensitivity = 74%, specificity = 88%; positive predictive values of around 20% and negative predictive values above 98%. Cohen’s kappa values of agreement were uniformly low (0.26 to 0.32). All showed significant associations with about 50% increased odds of impaired QoL and 10-year mortality, adjusted for age, sex, ethnicity, education levels, and housing type, with the ENIGMA-GLIM malnutrition showing the highest risk estimates. Compared to MNA-FF malnutrition prevalence of 4.1%, GLIM-based malnutrition increased prevalence (14.6% to 19.7%) estimates. Conclusions: The GLIM criteria showed good construct and criterion validity. It increased the number of individuals diagnosed with malnutrition. The agreement between diagnoses of malnutrition was low. Diagnostic and prognostic accuracy vary with the screening instrument used. Early identification of malnutrition using appropriate tools can provide opportunities to delay or prevent the risk of important adverse outcomes such as impaired QoL and mortality. Full article

Postural assessment is one of the indicators of health status in older adults. Since the number of older adults is on the rise, it is essential to assess simpler methods and automated ones in the future. Therefore, we focused on a visual method (imaging method). The purpose of this study is to determine the degree of agreement between the imaging method and the palpation and visual methods (clinical method). In addition, the influence of differences in the information content of the sagittal plane images on the assessment was also investigated. In this experiment, 28 sagittal photographs of older adults whose posture had already been assessed using the clinical method were used. Furthermore, based on these photographs, 28 gray and silhouette images (G and S images) were generated, respectively. The G and S images were assessed by 28 physical therapists (PTs) using the imaging method. The assessment was based on the Kendall classification, with one of four categories selected for each image: ideal, kyphosis lordosis, sway back, and flat back. Cross-tabulation matrices of the assessments using the clinical method and imaging method were created. In this table, four categories and two categories of ideal and non-ideal (KL, SB, and FB) were created. The agreement was evaluated using the prevalence-adjusted bias-adjusted kappa (PABAK). In addition, sensitivity and specificity were calculated to confirm the reliability. When comparing the clinical and imaging methods in the four posture categories, the PABAK values were −0.14 and −0.29 for the S and G images, respectively. In the case of the two categories, the PABAK values were 0.57 and 0.5 for the S and G images, respectively. The sensitivity and specificity were 86% and 57% for the S images and 76% and 71% for the G images, respectively. The four categories show that the imaging method is difficult to assess regardless of the image processing. However, in the case of the two categories, the same assessment of the clinical method applied to the imaging method for both the S and G images. Therefore, no differences in image processing were observed, suggesting that PTs can identify posture using the visual method. Full article

Background: Endoscopic ultrasound-guided puncture aspiration biopsy (EUS-FNA) of pancreatic ductal adenocarcinoma (PDAC) is highly diagnostic, but it is difficult to distinguish from benign disease. Our objective was to determine the usefulness of maspin staining, in addition to conventional p53 staining, in the diagnosis of PDAC by EUS-FNA. Methods: Of the patients who underwent EUS-FNA and were diagnosed with PDAC, we retrospectively identified 90 cases in which both maspin and p53 staining were performed. In addition, we identified 28 cases of benign pancreatic disease diagnosed using EUS-FNA and these were selected as a control group. For analysis of EUS-FNA specimens, Cohen’s Kappa (κ) coefficient and the prevalence and bias adjusted Kappa statistic (PABAK) were applied to assess the significance of sensitivity and specificity, comparing p53, maspin, p53+maspin. Results: The sensitivity and specificity of p53 staining were 48.9% and 100%. The κ coefficient was 0.31 (95%CI 0.18–0.44) (p < 0.01) and the PABAK coefficient was 0.22 (95%CI 0.03–0.40). The results for maspin staining were 88.9% and 92.9%. The κ coefficient was 0.72 (95%CI 0.54–0.90) (p < 0.01) and the PABAK coefficient was 0.78 (95%CI 0.64–0.88). The results for the combination of maspin and p53 staining were 94.4% and 92.2%. The κ coefficient was 0.82 (95%CI 0.64–1.00) (p < 0.01) and the PABAK coefficient was 0.86 (95%CI 0.74–0.94). Conclusion: Adding maspin staining to p53 staining showed high sensitivity and specificity. Our results demonstrated the usefulness of their combined use that might contribute to the improvement of tissue diagnostic performance of PDAC by EUS-FNA. Full article

Breast cancer recurrence is an important outcome for patients and healthcare systems, but it is not routinely reported in cancer registries. We developed an algorithm to identify patients who experienced recurrence or a second case of primary breast cancer (combined as a “second breast cancer event”) using administrative data from the population of Ontario, Canada. A retrospective cohort study design was used including patients diagnosed with stage 0-III breast cancer in the Ontario Cancer Registry between 1 January 2009 and 31 December 2012 and alive six months post-diagnosis. We applied the algorithm to healthcare utilization data from six months post-diagnosis until death or 31 December 2013, whichever came first. We validated the algorithm’s diagnostic accuracy against a manual patient record review (n = 2245 patients). The algorithm had a sensitivity of 85%, a specificity of 94%, a positive predictive value of 67%, a negative predictive value of 98%, an accuracy of 93%, a kappa value of 71%, and a prevalence-adjusted bias-adjusted kappa value of 85%. The second breast cancer event rate was 16.5% according to the algorithm and 13.0% according to manual review. Our algorithm’s performance was comparable to previously published algorithms and is sufficient for healthcare system monitoring. Administrative data from a population can, therefore, be interpreted using new methods to identify new outcome measures. Full article

Due to superior sensitivity compared to traditional microscopy, real-time PCR has been well established for the diagnosis of Giardia duodenalis in human stool samples. In this study, screening real-time PCRs for different target genes of G. duodenalis, i.e., the 18S rRNA gene, the gdh (glutamate dehydrogenase) gene and the bg (beta-giardin) gene, were comparatively assessed next to various real-time PCR assays for the discrimination of the assemblages A and B of G. duodenalis targeting the bg gene with and without locked nucleic acid–containing probes as well as the tpi (triose phosphate isomerase) gene. The screening PCRs were assessed by including 872 non-preselected samples with a high pre-test probability for G. duodenalis in the statistical analysis, while 53 G. duodenalis-positive samples as indicated by at least two screening PCRs were finally included in the assessment of the assemblage-specific PCRs. For the screening PCRs, sensitivity estimated with latent class analysis (LCA) ranged from 17.5% to 100%, specificity from 92.3% to 100% with an accuracy-adjusted prevalence of 7.2% for G. duodenalis within the non-preselected sample collection. In detail, sensitivity and specificity were 100% and 100% for the 18S rRNA gene-specific assay, 17.5% and 92.3% for the gdh gene-specific assay, and 31.7% and 100% for the bg gene-specific assay, respectively. Agreement kappa was slight with only 15.5%. For the assemblage-specific PCRs, estimated sensitivity ranged from 82.1% to 100%, specificity from 84.0% to 100% with nearly perfect agreement kappa of 90.1% for assemblage A and yet substantial agreement of 74.8% for assemblage B. In detail for assemblage A, sensitivity and specificity were 100% and 100% for the bg gene-specific assay without locked nucleic acids (LNA) as well as 100% and 97.8% for both the bg gene-specific assay with LNA and the tri gene-specific assay, respectively. For assemblage B, sensitivity and specificity were 100% and 100% for the bg gene-specific assay without LNA, 96.4% and 84.0% for the bg gene-specific assay with LNA, and 82.1% and 100% for the tri gene-specific assay, respectively. Within the assessed sample collection, the observed proportion comprised 15.1% G. duodenalis assemblage A, 52.8% G. duodenalis assemblage B and 32.1% non-resolved assemblages. Only little differences were observed regarding the cycle threshold (Ct) values when comparing the assays. In conclusion, best diagnostic accuracy was shown for an 18S rRNA gene-specific screening assay for G. duodenalis and for a differentiation assay discriminating the G. duodenalis assemblages A and B by targeting the bg gene with probes not containing locked nucleic acids. By adding additional highly specific competitor assays for confirmation testing, diagnostic specificity can be further increased on the cost of sensitivity if optimized specificity is desired. Full article

Metabolic syndrome (MetS) is a cluster of medical conditions associated with several health disorders. MetS and frailty can be related to prolonged physical deconditioning. There is a need to know whether there is concordance between the different ways of diagnosing it and to know their prevalence in Spanish older adults. Thus, the aims of this study were to describe the prevalence of MetS; to analyse the concordance between different definitions to diagnose MetS; and to study the associations between MetS, frailty status, and physical activity (PA) in older adults with decreased functional capacity. This report is a cross-sectional study involving 110 Spanish older adults of ages ≥65 years with decreased functional capacity. Clinical criteria to diagnose MetS was defined by different expert groups. Anthropometric measurements, blood biochemical analysis, frailty status, functional capacity, and PA were assessed. The Kappa statistic was used to determine the agreement between the five MetS definitions used. Student’s t-test and the Pearson chi-square test were used to examine differences between sex, frailty, and PA groups. The sex-adjusted prevalence of MetS assessed by the National Cholesterol Education Program—Third Adult Treatment Panel was 39.4% in men and 32.5% in women. The International Diabetes Federation and the Harmonized definitions had the best agreement (k = 1.000). The highest odds ratios (ORs) of cardiometabolic risk factors to develop MetS were elevated triglycerides (37.5) and reduced high-density lipoprotein cholesterol (27.3). Central obesity and hypertension prevalence were significantly higher in the non-active group (70.7% and 26.8%, respectively), compared to the active group (50.0% and 7.7%, respectively). Moreover, the active group (OR = 0.85, 95% CI = 0.35, 2.04) and active women group (OR = 0.77, 95% CI = 0.27, 2.20) appeared to show a lower risk of developing this syndrome. MetS is highly prevalent in this sample and changes according to the definition used. It seems that sex and frailty do not influence the development of MetS. However, PA appears to decrease central obesity, hypertension, and the risk of developing MetS. Full article

The visibility of anterior hyaloid membrane (AHM) and Berger’s space in phakic eyes was investigated. In 624 eyes of 624 patients, the retrolental space was scanned with the deep-range anterior segment optical coherence tomography (AS-OCT, CASIA2, Tomey). Subgroup analysis was conducted in 223 eyes undergoing cataract surgery. The logistic regression analysis using the backward-elimination method was performed to evaluate the influence of various factors on the visibility of AHM (dependent variable). Explanatory variables included age, gender, axial length, corneal power, corneal cylinder, and the Co III gradings. Intrarater repeatability for AHM visibility was excellent with the prevalence-adjusted bias-adjusted kappa (κ coefficient) of 0.90. AHM was observed in 43 eyes (6.9%). The patients with visible AHM (68.1 ± 8.8 years) were significantly older than those without visible AHM (52.6 ± 25.6 years) (p < 0.001). The logistic regression analysis in the cataract surgery subgroup revealed that axial length (p = 0.030) and corneal power (p = 0.043) were significantly associated with AHM visibility. The mean absolute refractive error from target was significantly larger in eyes with visible AHM (0.670 ± 0.384 D) than with invisible AHM (0.494 ± 0.412 D) (p = 0.037). The postoperative refractive prediction was less accurate in eyes with visible AHM, but no significant tendency existed in terms of myopic or hyperopic shifts. Full article

Perinatal anxiety affects an estimated 15% of women globally and is associated with poor maternal and infant outcomes. Identifying women with anxiety is essential to prevent these adverse associations, but there are a number of challenges around measurement. We used data from England’s 2020 National Maternity Survey to compare the prevalence of anxiety symptoms at six months postpartum using three different measures: the two-item Generalised Anxiety Disorders Scale (GAD-2), the anxiety subscales of the Edinburgh Postnatal Depression Scale (EPDS-3A) and a direct question. The concordance between each pair of measures was calculated using two-by-two tables. Survey weights were applied to increase the representativeness of the sample and reduce the risk of non-response bias. The prevalence of postnatal anxiety among a total of 4611 women was 15.0% on the GAD-2, 28.8% on the EPDS-3A and 17.1% on the direct question. Concordance between measures ranged between 78.6% (95% CI 77.4–79.8; Kappa 0.40) and 85.2% (95% CI 84.1–86.2; Kappa 0.44). Antenatal anxiety was the strongest predictor of postnatal anxiety across all three measures. Women of Black, Asian or other minority ethnicity were less likely to report self-identified anxiety compared with women of White ethnicity (adjusted odds ratio 0.44; 95% CI 0.30–0.64). Despite some overlap, different anxiety measures identify different groups of women. Certain population characteristics such as women’s ethnicity may determine which type of measure is most likely to identify women experiencing anxiety. Full article

The Sleep Number smart bed uses embedded ballistocardiography, together with network connectivity, signal processing, and machine learning, to detect heart rate (HR), breathing rate (BR), and sleep vs. wake states. This study evaluated the performance of the smart bed relative to polysomnography (PSG) in estimating epoch-by-epoch HR, BR, sleep vs. wake, mean overnight HR and BR, and summary sleep variables. Forty-five participants (aged 22–64 years; 55% women) slept one night on the smart bed with standard PSG. Smart bed data were compared to PSG by Bland–Altman analysis and Pearson correlation for epoch-by-epoch HR and epoch-by-epoch BR. Agreement in sleep vs. wake classification was quantified using Cohen’s kappa, ROC analysis, sensitivity, specificity, accuracy, and precision. Epoch-by-epoch HR and BR were highly correlated with PSG (HR: r = 0.81, |bias| = 0.23 beats/min; BR: r = 0.71, |bias| = 0.08 breaths/min), as were estimations of mean overnight HR and BR (HR: r = 0.94, |bias| = 0.15 beats/min; BR: r = 0.96, |bias| = 0.09 breaths/min). Calculated agreement for sleep vs. wake detection included kappa (prevalence and bias-adjusted) = 0.74 ± 0.11, AUC = 0.86, sensitivity = 0.94 ± 0.05, specificity = 0.48 ± 0.18, accuracy = 0.86 ± 0.11, and precision = 0.90 ± 0.06. For all-night summary variables, agreement was moderate to strong. Overall, the findings suggest that the Sleep Number smart bed may provide reliable metrics to unobtrusively characterize human sleep under real life-conditions. Full article

A proxy-assessment of health-related quality of life (HRQL) may be an alternative for burn patients who are medically unable to self-report shortly after being admitted to the hospital. This study examined the patient–partner agreement on the recalled pre-injury HRQL of burn patients. In a multi-centre study of 117 patient–partner pairs, the recalled pre-burn HRQL was assessed with the EQ-5D-3L + Cognition during the acute phase following the burns. Agreement was evaluated with Kappa and ICC statistics. Burn severity and PTSD symptoms were assessed as potential predictors of disagreement. The results showed that pre-burn EQ-Index scores were similar to population norms, whereas the EQ Visual Analog Scale (EQ-VAS) scores of patients were significantly higher. Agreement varied across EQ-5D domains and, after adjusting for prevalence, was substantial to almost perfect. Average agreement on the EQ-Index and EQ-VAS was, respectively, substantial and moderate, but differences between partners were larger at lower levels of HRQL, and specifically in the pain/discomfort domain. Patient–partner differences could not be explained by the patient’s age or gender, number of surgeries, partner’s presence at the burn event, or post-traumatic stress disorder (PTSD) symptoms of either the patient or partner. In conclusion, patient–partner agreement is substantial and partner–proxy reports of pre-burn EQ-5D domains and EQ-Index scores may be used to complement or serve as a substitute for the patient’s assessment. Given the moderate agreement on the EQ-VAS, it may be less suited for proxy assessment. Full article

As qualified microscopy of enteric parasitoses as defined by high diagnostic accuracy is difficult to maintain in non-endemic areas due to scarce opportunities for practicing with positive sample materials, molecular diagnostic options provide less investigator-dependent alternatives. Here, we compared three molecular targets for the real-time PCR-based detection of Cryptosporidium spp. From a population of 1000 individuals comprising both Ghanaian HIV (human immunodeficiency virus) patients and military returnees after deployment in the tropics, stool samples were assessed for Cryptosporidium spp. by real-time PCR targeting the small subunit ribosomal RNA (SSU rRNA) gene, the Cryptosporidium oocyst wall (COWP) gene, and the DnaJ-like protein gene (DnaJ), respectively. In declining order, sensitivity of 100% for the SSU rRNA gene PCR, 90.0% for the COWP PCR and 88.8% for the DnaJ PCR, respectively, as well as specificity of 99.6% for the COWP PCR and 96.9% for both the SSU rRNA gene PCR and the DnaJ PCR, respectively, were recorded. Substantial agreement (kappa value 0.663) between the three assays was observed. Further, an accuracy-adjusted Cryptosporidium spp. prevalence of 6.0% was calculated for the study population. In conclusion, none of the assessed real-time PCR assays were associated with perfect test accuracy. However, a combination of highly sensitive SSU rRNA gene PCR for screening purposes and more specific COWP PCR for confirmatory testing should allow reliable diagnosis of Cryptosporidium spp. in stool samples even in low prevalence settings. Full article

Cystoisospora (C.) belli is a coccidian parasite associated with acute or chronic gastroenteritis in immunocompromised patients. Dissatisfactory sensitivity of microscopy as the diagnostic standard approach has been described. Here, we comparatively evaluated two real-time PCRs targeting ribosomal RNA gene sequences of C. belli in stool in a test comparison without a reference standard applying latent class analysis. Therefore, 1000 stool samples from Ghanaian HIV (human immunodeficiency virus) patients (n = 905) as well as military returnees from the tropics (n = 95) were assessed by both assays in parallel. After the exclusion of 33 samples showing PCR inhibition, 29 and 33 positive results were recorded with the 5.8S rRNA gene/ITS-2 sequence PCR and the ITS-2 sequence PCR, respectively, resulting in an accuracy-adjusted prevalence of 3.2%. Nearly perfect agreement between both assays was indicated by Fleiss’ kappa of 0.933 with sensitivity and specificity of 92.8% and 100% as well as 100% and 99.8% for the 5.8S rRNA gene/ITS-2 sequence PCR and the ITS-2 sequence PCR, respectively. Both assays proved to be suitable for the diagnosis of C. belli in human stool samples with slightly better sensitivity of the ITS-2 sequence assay, while the 5.8S rRNA gene/ITS-2 sequence PCR may be considered for confirmatory testing. Full article