Next Article in Journal
Sequential Irreversible Electroporation for Locally Advanced Pancreatic Cancer
Next Article in Special Issue
Stratifying Disease Severity in Pediatric COVID-19: A Correlative Study of Serum Biomarkers and Lung Ultrasound—A Retrospective Observational Dual-Center Study
Previous Article in Journal
HCV RNA Quantification by a Domestic Commercial Assay: A Case Study among People Who Inject Drugs in Vietnam
Previous Article in Special Issue
Sonographic Aeration Scoring Indicates Disease Severity in Critically Ill Patients with COVID-19
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Accuracy of Thoracic Ultrasonography for the Diagnosis of Pediatric Pneumonia: A Systematic Review and Meta-Analysis

1
Department of Thoracic Surgery, West China Hospital, Sichuan University, Chengdu 610041, China
2
Department of Radiation Oncology, The First Affiliated Hospital of Dalian Medical University, Dalian 116011, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Diagnostics 2023, 13(22), 3457; https://doi.org/10.3390/diagnostics13223457
Submission received: 5 October 2023 / Revised: 5 November 2023 / Accepted: 13 November 2023 / Published: 16 November 2023

Abstract

:
As an emerging imaging technique, thoracic ultrasonography (TUS) is increasingly utilized in the diagnosis of lung diseases in children and newborns, especially in emergency and critical settings. This systematic review aimed to estimate the diagnostic accuracy of TUS in childhood pneumonia. We searched Embase, PubMed, and Web of Science for studies until July 2023 using both TUS and chest radiography (CR) for the diagnosis of pediatric pneumonia. Two researchers independently screened the literature based on the inclusion and exclusion criteria, collected the results, and assessed the risk of bias using the Diagnostic Accuracy Study Quality Assessment (QUADAS) tool. A total of 26 articles met our inclusion criteria and were included in the final analysis, including 22 prospective studies and four retrospective studies. The StataMP 14.0 software was used for the analysis of the study. The overall pooled sensitivity was 0.95 [95% confidence intervals (CI), 0.92–0.97] and the specificity was 0.94 [95% CI, 0.88–0.97], depicting a good diagnostic accuracy. Our results indicated that TUS was an effective imaging modality for detecting pediatric pneumonia. It is a potential alternative to CXR and a follow-up for pediatric pneumonia due to its simplicity, versatility, low cost, and lack of radiation hazards.

1. Introduction

As a common lower respiratory tract infection, pneumonia is one of the important causes of morbidity and mortality in children. According to statistics, around 150 million children under the age of five are afflicted with pneumonia annually, and pneumonia-related mortality accounts for approximately 15% of the overall mortality in this age cohort [1,2]. Accurate and sensitive diagnoses of pediatric pneumonia can help clinicians implement more effective therapies to prevent further progression of the condition. The symptoms and signs of pneumonia in children, however, lack specificity and often exhibit variations based on the patient’s age, pathogen type, and infection severity. Therefore, more rapid and efficient ways to diagnose pediatric pneumonia still need to be further explored [3].
Currently, CXR is considered the primary diagnostic tool for suspected pneumonia in children, while chest computed tomography (CT) is frequently employed as the definitive diagnostic method for patients with inconclusive CXR findings [4,5]. However, despite their high diagnostic accuracy for identifying the etiology of chest opacity, these aforementioned imaging modalities are not recommended as the first-line choice for pediatric pneumonia evaluation due to their high cost, demanding operator and equipment requirements, prolonged patient waiting times, and potential exposure to hazardous levels of radiation for children [6,7,8].
In recent years, there has been increasing interest in exploring thoracic ultrasonography (TUS) as a potential alternative option for the diagnosis of pediatric pneumonia, owing to the continuous advancements in ultrasound technology. Compared to CT and CXR, TUS offers no ionizing radiation exposure, low cost, and ease of operation. Additionally, TUS can be performed at the point of care, making it a more practical diagnostic tool in diverse clinical settings.
We conducted a systematic review and meta-analysis of the relevant studies on the use of TUS for diagnosing pneumonia in children, aiming to evaluate its diagnostic accuracy as an alternative method.

2. Methods

2.1. Search Strategy

The systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement [9]. The protocol was registered in the international prospective register for systematic reviews, PROSPERO (CRD42023470677). We searched in Embase, PubMed, and Web of Science databases to identify studies that investigated the accuracy and role of TUS for diagnosing pneumonia in children up until July 2023 (see Supplementary Material S1 for the details of the search strategy). The authors (Z.D. and C.S.) systematically searched all the titles and abstracts published in English that were relevant to our study and downloaded the full texts for further evaluation. At the same time, we also manually retrieved the reference lists of the relevant systematic reviews to include other relevant articles that were not captured in the systematic search to ensure the comprehensiveness of the literature search.

2.2. Selection Criteria

The articles included in the meta-analysis had to satisfy the following criteria: (1) patients aged below 16 years, (2) presenting symptoms and signs suggestive of pneumonia (including but not limited to fever, tachypnea or dyspnea, cough, diminished breath sounds, and rales), (3) exhibiting positive findings on thoracic ultrasound (such as lung consolidation, air bronchogram sign, pleural effusion, abnormal pleural line, and B-lines etc. The details can be found in Table 1), and (4) clinical diagnoses along with laboratory and chest imaging examinations were used as reference.
The following exclusion criteria were applied: (1) patients with severe respiratory diseases other than pneumonia, (2) patients with congenital anomalies or chronic lung diseases (their chest radiography or ultrasound findings may have other signs that interfere with the diagnosis of TUS and CXR due to the impact of the congenital anomalies or chronic diseases.), (3) patients over 16 years of age, (4) patients who had not undertaken TUS as a diagnostic tool, (5) case reports and studies without original data (such as reviews, comments, etc.), and (6) studies with incomplete data (did not report the sensitivity and specificity as the results or did not provide enough information to calculate the sensitivity and specificity) or where statistical effect size pooling was not feasible.

2.3. Data Extraction and Quality Assessment

Two authors (Z.D. and J.T.) independently extracted the following data from each included article: (1) the first author’s name, (2) the year and region of publication, (3) the study design and blinding, (4) the patient characteristics and sources, (5) the experience of the TUS operators, (6) the type of TUS probe, (7) the TUS diagnostic criteria for pneumonia along with the reference test and (8) the quantitative data required for statistical analysis. The data extracted by the above two authors was then compared by another author (C.S.), and disagreements were resolved by voting after a dialogue between the two members of the research team (C.S., and B.W.).
All the included studies were independently assessed for methodological quality by two reviewers (Z.D. and J.T.) using the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2), a tool that evaluates the risk of bias and applicability across four domains of the included studies [10]. Any discrepancies between the two reviewers were discussed, and if a consensus could not be reached, they were resolved by involving the third author (C.S.).

2.4. Data Analysis

The Stata MP 14.0 software (National Center for Supercomputer Applications, Urbana, IL, USA) was used to analyze the diagnostic accuracy. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), and 95% confidence intervals (95% CI) were calculated based on the collected data for the sensitivity, specificity, true positive (TP), false positive (FP), false negative (FN), and true negative (TN). Forest plots and summary receiver operating characteristic curves (sROC) were generated. The Cochran Q-statistic and inconsistency (I2) were utilized to assess the heterogeneity while a meta-regression analysis was employed to explore the potential sources of heterogeneity. Random effects models were used for all the quantitative analyses.

3. Results

3.1. Study Selection

The database search, encompassing articles published up to July 2023, revealed a total of 252 articles that satisfied the study topic and selected keywords. Among these, 61 full-text articles were identified for further assessment and screening. Following the predefined inclusion and exclusion criteria, a final selection of 26 [11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36] observational studies (22 prospective and four retrospective) were included for the meta-analysis (Figure 1).

3.2. Study Characteristics

A total of 26 studies involving 4436 participants (2402 males and 2034 females; 54.1% vs. 45.9%) were included in the analysis. Among them, 2866 patients were diagnosed with pneumonia, and the remaining 1570 participants were not diagnosed with pneumonia. The diagnostic criteria for pneumonia included clinically relevant symptoms and evidence of imaging and/or laboratory tests. The specific details of the diagnostic reference tests for each study are presented in Table 2. The detailed characteristics of these studies are also presented in Table 2. Two studies were conducted in North America [14,29], sixteen in Europe [11,12,13,15,16,18,19,20,21,22,23,24,26,27,28,35], seven in Asia [17,25,30,32,33,34,36], and one in Africa [31]. The study subjects were mainly infants, children, and adolescents, except for two studies that included newborns [17,32]. A total of 23 studies involved pediatric patients admitted to either the wards or emergency departments, while three studies [15,17,32] involved patients in ICU (two studies in NICU and one in PICU). To avoid significant changes in the consolidation process due to the time passed between the two imaging tests, nearly all the patients included in our study (except Zhan et al. [22]) performed chest imaging and TUS consecutively within 24 h of hospitalization. Table 3 illustrates the details of the chest ultrasound used to diagnose pneumonia, including the operator, type of probe, blinding, and the diagnostic criteria of TUS. In addition, Table 4 describes the original data required for meta-analysis, including the TP, FP, TN, FN as well as the sensitivity and specificity.

3.3. Quality Assessment

QUADAS-2 was used to evaluate the quality of the included literature, and in general, most of the articles included in this study were of high quality, as elaborated Table 5. The potential for bias and limitations in terms of the applicability was negligible in the following domains: a precise definition of the target population and explicit inclusion and exclusion criteria for the study enrollment, a meticulous description of how the index and reference tests were employed to diagnose pneumonia, as well as a comprehensive presentation of the study design and methodology.
On the whole, the majority of the findings used in our study were deemed to be of good quality. A total of 24 trials (92.3%) included patients who underwent a CXR as part of their standard clinical procedure, while only two studies (7.7%) did not mention the utilization of CXRs as the controls. The included studies all incorporated specific criteria for inclusion and exclusion, along with details regarding the diagnosis of TUS. However, some studies involved patients from the ICU or neonates [15,17,32], and may not have objectively reflected the disease characteristics of the majority of the pediatric patients, thus inducing a potential risk of selection bias. There were two studies that did not mention whether the interpreters were blinded to the results of TUS [11,20], thus posing a risk of bias. In addition, the sex ratio of the included subjects was 54.1% to 45.9% (2402 males and 2034 females), which may cause bias due to the difference in the number of genders.

3.4. Details of TUS for Diagnosing Pediatric Pneumonia

In the analyzed articles, the level of experience among the ultrasound operators and interpreters varied greatly, ranging from novice radiologists or even pediatric residents who received only brief training in TUS for diagnostic purposes [15,22] to senior sonographers with extensive imaging expertise [24,28,33,34]. At present, most of the commonly used ultrasonic probes are 5–10 MHz high-frequency linear transducers and micro-convex transducers. The method of TUS examination proposed by Copetti and Cattarossi is currently the most widely referenced, enhanced, and applied approach in clinical research [11]. The TUS examination was employed to systematically scan the bilateral lung fields, dividing each hemi-thorax into three distinct regions to cover the entire lung: the anterior region delimited by the parasternal line and the anterior axillary line, the lateral region delimited by the axillary line, and finally, the posterior region delimited by the paravertebral line and the posterior axillary line. Within each of these regions, it was recommended to perform scans along the anatomical lines, including the parasternal, mid-clavicle, anterior axilla, central axilla, posterior axilla, central scapular, and paravertebral areas [11,15]. The probe was typically positioned vertically, diagonally, and parallel to the ribs of the anterior, lateral, and posterior thoraxes, respectively, for a comprehensive examination of each intercostal space [37,38].

3.5. Meta-Analysis

A total of 26 studies were included to assess the diagnostic accuracy of TUS in pediatric pneumonia. The statistical software was utilized to calculate the pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), and their corresponding 95% CI. Additionally, the forest plot was generated. A cutoff value of p < 0.05 was used to determine inconsistency.
For the diagnosis of pneumonia in children, TUS demonstrated a pooled sensitivity and specificity of 0.95 (95% CI, 0.92–0.97) and 0.94 (95% CI, 0.88–0.97), respectively (Figure 2). However, the I2 was 96.17% and 92.35%, respectively, showing significant heterogeneity. The PLR and NLR were 14.88 (95% CI, 7.92–27.95; Cochran Q-statistic = 417.52; p = 0.00) and 0.05 (95% CI, 0.03–0.09; Cochran Q-statistic = 772.79; p = 0.00), which also indicated significant heterogeneity in the data analysis (Figure 3). The area under the sROC curve (AUC) was determined to be 0.98 (95% CI, 0.97–0.99), indicating an excellent diagnostic accuracy with a slope towards the upper left, as depicted in Figure 4.

3.6. Publication Bias

Deek’s funnel plot asymmetry test was conducted to investigate potential publication bias, and the results indicated no significant evidence of publication bias among the included studies (p = 0.13). Therefore, we did not perform the trim and fill analysis.

3.7. Subgroup Analysis

We conducted a subgroup analysis from the following aspects in an attempt to provide a more detailed reflection of the reliability of TUS for diagnosing pneumonia in children. The findings are presented in Table 6.

3.7.1. Patients Setting

Among the 26 studies, 15 studies conducted TUS in pediatric emergency departments. Of the remaining 11 studies, eight were conducted in the pediatric ward, two in the NICU, and one in the PICU. The subgroup analysis revealed that the sensitivity and specificity of the pediatric emergency departments were 0.93 (95% CI, 0.88–0.97) and 0.91 (95% CI, 0.84–0.95), respectively. The PLR was calculated as 10.05 (95% CI, 5.53–18.27), with a NLR of 0.07 (95% CI, 0.04–0.14). The AUC was determined to be 0.97 (95% CI, 0.95–0.98). On the other hand, for TUS performed in pediatric wards were found to be at a higher level of accuracy with sensitivity and specificity values of 0.95 (95% CI, 0.91–0.97) and 0.96 (95% CI, 0.82–0.99), respectively. The PLR was 22.81 (95% CI, 4.84–107.45), the NLR was 0.06 (95% CI, 0.03–0.09), and the AUC remained high at a value of 0.98 (95% Cl, 0.96–0.99). Due to the limited number of studies conducted in the NICU and PICU, the subgroup analysis was not available.

3.7.2. Operator Experience

In six studies, the operators performing TUS had limited experience or received only a brief training (less than 1 month of ultrasound training or experience). The subgroup analyses revealed the following results. The sensitivity was 0.83 (95% CI, 0.67–0.93), with a specificity of 0.91 (95% CI, 0.88–0.94). The PLR was 9.78 (95% CI, 6.69–14.30), and the NLR was 0.18 (95% CI, 0.08–0.39). The AUC was calculated as 0.93 (95% CI, 0.90–0.95). TUS for the remaining 20 studies were performed and interpreted by experienced sonographers (more than 3 years experience in ultrasonic clinical diagnosis) or highly trained radiologists and pediatricians (more than 5 years of clinical experience and more than 1 year of ultrasonic diagnosis training). The subgroup analysis yielded the following results: a sensitivity of 0.96 (95% CI, 0.94–0.97), a specificity of 0.94 (95% CI, 0.87–0.98), a PLR of 16.87 (95% CI, 7.06–40.29), an NLR of 0.04, (95% CI, 0.03–0.06), and an AUC of 0.98 (95% CI, 0.97–0.99).

3.7.3. Probe Selection

Out of all the 26 studies, 13 selected linear and convex probes for the TUS diagnosis, 11 selected linear probes, and the remaining two studies used convex probes. The subgroup analysis revealed that the sensitivity and specificity of the diagnoses using the linear combined convex probes were 0.95 (95% CI, 0.92–0.97) and 0.95 (95% CI, 0.87–0.98), respectively. The PLR was calculated as 18.23 (95% CI, 6.89–48.19), with a NLR of 0.05 (95% CI, 0.03–0.09). The AUC was determined to be 0.99 (95% CI, 0.97–0.99). The results for the subgroups of the studies using only the linear probe were as follows: sensitivity, 0.94 (95% CI, 0.87–0.97); specificity, 0.94 (95% CI, 0.85–0.98); PLR, 14.77 (95% CI, 5.85–37.28); NLR, 0.06 (95% CI, 0.03–0.15); AUC, 0.98 (95% CI, 0.96–0.99).
According to the results of the subgroup analysis, the setting of the patients and probe selection did not significantly affect the diagnostic accuracy of TUS in pediatric pneumonia. However, whether the operators had a good experience in performing TUS had a certain effect on the diagnostic accuracy. The performance of the experienced sonographers in the diagnosis of pneumonia in children was better than that of the inexperienced sonographers.

4. Discussion

4.1. Pediatric Pneumonia and Its Current Status of Diagnosis

Pneumonia is the single leading infectious cause of pediatric hospitalization and death worldwide. Pneumonia caused an estimated 740,000 children’s death under the age of 5 years in 2019 alone, accounting for 14% of all infant deaths under the age of five and 22% of all deaths among children aged 1–5 years globally [39,40]. With the improvement of medical services and living standards, and the global attention to the prevention and treatment of pneumonia in children, the morbidity and mortality of pneumonia in children have presented a downward trend [41]. Although the number of pneumonia cases and mortality in children have decreased significantly, the number of hospital visits and hospitalization rates of pneumonia patients have increased in developing countries and some developed countries [41]. In addition, the COVID-19 pandemic has had a significant impact on the epidemiology of related respiratory diseases in recent years, showing a different epidemiology of pneumonia from that before the pandemic [42,43]. Therefore, in the current situation, the early detection, diagnosis, and treatment of pneumonia in children has become essential.
Currently, the diagnosis of childhood pneumonia still poses many problems, particularly in resource-limited settings. The difficulties in its diagnosis can be attributed to several factors. Firstly, the symptoms and signs of pneumonia are often inconspicuous in infected children due to their age, physical conditions, complications, and etiology of infection, thus lacking specificity and complicating the diagnostic process [44,45]. Secondly, due to the inherent characteristics of pediatric patients, such as their limited ability to articulate their medical history and symptoms accurately, as well as their reduced tolerance towards illness, clinicians face challenges in making informed judgments. Currently, the prevailing approach for diagnosing pneumonia in children relies on CXR. In cases where CXR fails to provide a definitive diagnosis for pneumonia, further evaluation with CT is warranted [46]. However, these imaging modalities are not suitable for pediatric patients. First of all, CXR, which is commonly used as the initial diagnostic tool, has limited sensitivity (86.2%, refer to the data in Balk et al.) when used alone and requires children to be exposed to radiation. Additionally, there is some inter-observer variability in its interpretation [47]. Secondly, although CT offers a high diagnostic accuracy, it involves excessive radiation exposure, high costs, and sometimes necessitates the sedation of children [48]. Consequently, their application in the diagnosis of common pediatric pneumonia is restricted.

4.2. The Feasibility and Performance of TUS in the Diagnosis of Children

In the past decade, significant advancements in clinical diagnostic technology have propelled ultrasound technology to achieve remarkable progress. The resolution of ultrasonic instruments has undergone substantial improvements, thereby significantly enhancing the detection rate of abnormal disease signs. The convenience of ultrasound equipment has also been enhanced. From larger instruments that were initially fixed only in the consulting room, we now have portable bedside ultrasound machines and even pocket (hand-held) ultrasound devices that can be easily carried around. With the continuous development of modern science and technology, ultrasound diagnosis has transcended conventional boundaries and is no longer confined solely to diagnosing lesions in parenchymatous organs. Nowadays, the application of ultrasound has progressively expanded in the diagnosis of thoracic, gastrointestinal, and other hollow organ diseases.
In recent years, an increasing number of researchers have turned their attention to the application of thoracic ultrasound for the diagnosis of chest diseases. Previous studies have confirmed that TUS exhibits a high sensitivity and specificity for detecting various pleural diseases in adults [49]. A meta-analysis investigating TUS for diagnosing community-acquired pneumonia (CAP) in adults revealed that TUS demonstrated a higher sensitivity and specificity, resulting in a superior diagnostic accuracy than CXR [50]. TUS can assist clinicians in diagnosing CAP among adult patients. However, the role of TUS in pediatric pneumonia diagnosis remains uncertain.
The feasibility of TUS for the diagnosis of pneumonia is mainly based on the anatomical relationship between the thorax and lung. The superficial layer of the thoracic cavity is composed of subcutaneous tissue and muscle, and the deep layer is composed of pleural tissue attached to the inner surface of the thoracic cavity and the surface of the lungs, which are air-filled organs. Thus, the large variation in acoustic impedance at the pleura and lung junction results in the generation of horizontal artifacts, which are seen as a series of equidistant and parallel echo lines under the pleura, known by sonographers as A-lines. The vertical comet tail-like artifacts produced by the pleural line are called B-lines, which are not present in the normal lung. The B line originates from the pleural line, exhibits a clear demarcation, extends posteriorly to replace the A-line at the margin, and demonstrates movement corresponding to lung sliding [51,52]. Chest ultrasonography commonly relies on the aforementioned artifact analysis. The ultrasound findings for pneumonia primarily manifest as hypoechoic consolidation areas with varying sizes and shapes, characterized by irregular borders [33]. The echotexture may exhibit homogeneity or heterogeneity [53], while lung sliding may be diminished or even absent [7].
The chest wall structure in children is characterized by its thinness, smaller thoracic width, and anteroposterior diameter, which renders it more conducive for obtaining high-quality images using TUS imaging. Furthermore, the greatest advantage of ultrasound diagnosis in pediatric cases lies in its ability to eliminate radiation exposure, thereby significantly reducing the potential medical risks associated with medical treatment. Moreover, due to the convenience of imaging equipment and the low requirements for usage conditions, ultrasound examinations can be conveniently performed at the point of care without transportation, which is especially beneficial for bedside diagnoses in ICU and emergency department settings or for pediatric pneumonia screening in remote areas. In conclusion, TUS exhibits numerous advantages and holds great potential for diagnosing pneumonia in children.
Various ultrasound transducers are used for conducting chest ultrasound examinations. Contemporary ultrasound devices typically incorporate three standard probes: linear, curvilinear, and phased arrays, each of which plays a crucial role in TUS. Some providers might possess a micro-convex transducer that is specifically designed for TUS, but this is less common. A high-frequency (8–12 MHz) linear probe is advantageous for delineating the anterior pleural line with precision, despite its limited depth penetration. Conversely, a low-frequency curvilinear probe is instrumental for visualizing the dependent lung regions. The phased array probe (2.5–5 MHz), with its reduced footprint and intermediate frequency, offers an optimal balance. However, it poses challenges in accurately delineating the pleural line with this transducer in patients [51]. The operator typically selects probes of different types based on the specific location of the lesion and the physical characteristics of the patient. Most of the studies included in this meta-analysis selected linear and convex probes with different frequencies. A subgroup analysis of the probe selection revealed a minimal variation in the diagnostic performance of TUS when different probes were used, which was potentially attributed to the limited number of included studies and predominantly involved pediatric patients with pneumonia, where the lesion was typically localized in a relatively fixed position. Further research is needed in the future to explore the possible impact of the use of different probes for TUS diagnosis.
After a rigorous and systematic literature review and screening, a total of 26 original studies were included in this meta-analysis to evaluate the performance of TUS in the diagnosis of pneumonia in children. After the statistical analysis, our findings revealed that TUS exhibited a high sensitivity and specificity, with a pooled sensitivity of 0.95 (95% CI, 0.92–0.97) and a pooled specificity of 0.94 (95% CI, 0.88–0.97), surpassing the previous meta-analysis conducted by Lu et al. [54]. On the other hand, the combined PLR and NLR were 14.88 (95% CI, 7.92–27.95) and 0.05 (95% CI, 0.03–0.09), respectively, and the AUC was 0.98 (95% CI, 0.97 = 0.99), both indicating the exceptional diagnostic performance of TUS in pediatric pneumonia detection. Of all the 26 included studies, one (Zhan et al.) showed a poor sensitivity (40.0%, 95% CI, 30.0–51.0%) to TUS, and we analyzed the potential confounders that could have contributed to this result. First, to eliminate any bias, the operator (a pediatric resident with minimal practical ultrasound experience) in this study was blinded to all the information regarding the patient, including the physical examination, results of the blood tests and chest radiography fundings, while other studies were only blinded to the chest radiography fundings. Second, because of unforeseen events, they were forced to change ultrasound equipment after the first 24 patients. This made it difficult to assess whether the observed significant difference in the sensitivity was caused by the equipment change or for other reasons. Finally, due to practical challenges, the LUS and CR were not always performed consecutively in this study, which may have potentially exerted a great impact on the diagnostic accuracy of TUS.
However, there was considerable heterogeneity in the sensitivity and specificity among the 26 studies (I2 > 90%). We hypothesized that the covariates of the “ultrasound operator experience”, “different ultrasound equipment”, “type of wards”, and “choice of reference tests” might have been potential factors contributing to the heterogeneity. The discussion of the diagnostic heterogeneity of TUS in the current literature was replicated and corroborated in this analysis, which was similar to the results of the analysis by Balk et al. [55]. The results of the subgroup analysis showed that experienced operators used TUS to diagnose pneumonia with higher accuracy, which was consistent with the results predicted in advance. Nevertheless, the non-imaging clinicians with systematic training also had a better sensitivity and specificity in the diagnosis of TUS. For instance, in a study conducted by Esposito et al. [15], pediatric residents who received only 7 h of training demonstrated remarkable sensitivity (98%) and specificity (95%) when utilizing TUS for the diagnosis of pediatric pneumonia. The International Liaison Committee on Lung Ultrasound also indicated that TUS is a fundamental ultrasound examination method that is easily acquired and applied [56]. It can be seen that the learning cost of TUS is relatively low, making it accessible even for beginners. Moreover, TUS exhibits a consistent diagnostic accuracy, rendering it suitable for widespread implementation and adoption in clinical settings.

4.3. Limitations and Future Prospects

Some limitations of our study should be acknowledged. Firstly, there was a dearth of standardized procedures for testing the research validity and assessing the quality requirements. Consequently, we did not conduct an analysis on the internal consistency of each sample or investigate its impact on the overall success rate of the TUS diagnosis. Secondly, due to the absence of corresponding data in some of the included literature, our meta-analysis lacked controls. We solely collected and analyzed the data pertaining to the pneumonia diagnosis by TUS without examining and comparing the accuracy of CXR or other diagnostic methods. Thus, we were unable to quantitatively demonstrate the improvement in the TUS accuracy compared to the other diagnostic approaches. In addition, due to ethical constraints, our included studies were unable to employ traditional CT as the diagnostic reference standard. Instead, we utilized CXR alone or in combination with clinical diagnosis and laboratory tests as the reference criteria. However, given the limited number of included studies, we were unable to establish this combined test as a criterion. Therefore, it was important to interpret our findings by taking that into account. Finally, the majority of the studies we included were single-center and small in scale. Therefore, it is our expectation that future researchers will conduct more rigorous evaluations using larger sample sizes and multicenter clinical studies.
Currently, the differentiation of pneumonia pathology is limited to clinical manifestations and laboratory tests. Although there is increasing evidence suggesting that TUS is more accurate than CXR for diagnosing pneumonia in children [47], the literature on the differential etiology of pneumonia remains scarce. This requires further analysis of current ultrasound findings in the gray zone, encompassing abnormalities in the pleural line, sub-centimeter solid nodules, and focal confluent B-lines. Additionally, there is a lack of corresponding research to substantiate the optimal timing for TUS diagnosis. Previous studies have conducted follow-ups on patients undergoing TUS and observed that as clinical interventions are implemented and the condition improves, the lung consolidation shadow gradually diminishes in the ultrasound images. This phenomenon may potentially result in a decline in the diagnostic sensitivity of TUS. Therefore, future studies are needed to further explore the optimal window time of TUS for the diagnosis of pneumonia to achieve more standardized protocols for clinical application. The results of this subgroup analysis revealed the influence of varying levels of TUS expertise on the accuracy of pneumonia diagnosis, highlighting the need to develop a standardized TUS training curriculum and quantify the duration required for beginners to attain proficiency in performing TUS and interpreting the imaging results accurately. Therefore, TUS can be more effectively promoted and popularized as a routine diagnostic technique in the workflow of clinicians [57].
Recently, significant advancements in the application of artificial intelligence (AI) across various medical domains have catalyzed the development and innovation of novel AI-based diagnostic technologies [58]. Deep learning is an advanced stage of artificial intelligence, which uses multilayer neuronal cascade learning to hierarchically extract raw data, thus simulating human neural networks [59,60]. Previous studies have reported the application of deep learning methods in the diagnosis of pneumonia in children [61,62]. It can be seen that AI technology has great prospects in the promotion of TUS, especially in economically underdeveloped areas or primary medical institutions. By employing an automated intelligent diagnosis system for TUS, the detection rate of pneumonia in children can be enhanced while simultaneously improving the efficiency of clinicians.

5. Conclusions

In conclusion, TUS is a highly promising imaging diagnostic technique that can serve as a valuable adjunct to CXR and physical examination. The most notable advantage of this approach for pediatric patients lies in its ability to avoid ionizing radiation exposure. Our meta-analysis results demonstrated that TUS exhibits excellent sensitivity and specificity for diagnosing pneumonia among children, with the added benefit of being suitable even for novices inexperienced with ultrasound interpretation. Therefore, actively promoting the widespread adoption of this convenient diagnostic technology among general pediatricians can yield significant benefits for both medical practitioners and patients across diverse clinical settings. However, it is important to acknowledge that this conclusion was solely based on the clinical studies that met our specific inclusion criteria, necessitating future large-scale, multicenter trials that are well designed to validate and evaluate the conclusions.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/diagnostics13223457/s1.

Author Contributions

Conceptualization: Z.D., C.S. and H.L.; methodology: Z.D.; project administration: Z.D. and C.S.; formal analysis: Z.D. and C.S.; data curation: Z.D., B.W. and J.T.; writing—original draft preparation: Z.D. and J.T.; writing—review and editing: Z.D., C.S. and H.L.; visualization: Z.D.; supervision: C.S. and H.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

No new data were created or analyzed in this study. Data sharing is not applicable to this article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Rudan, I.; Tomaskovic, L.; Boschi-Pinto, C.; Campbell, H.; WHO Child Health Epidemiology Reference Group. Global Estimate of the Incidence of Clinical Pneumonia among Children under Five Years of Age. Bull. World Health Organ. 2004, 82, 895–903. [Google Scholar] [PubMed]
  2. Bezerra, P.G.M.; Britto, M.C.A.; Correia, J.B.; Duarte, M.d.C.M.B.; Fonceca, A.M.; Rose, K.; Hopkins, M.J.; Cuevas, L.E.; McNamara, P.S. Viral and Atypical Bacterial Detection in Acute Respiratory Infection in Children under Five Years. PLoS ONE 2011, 6, e18928. [Google Scholar] [CrossRef] [PubMed]
  3. Wunderink, R.G.; Waterer, G.W. Clinical Practice. Community-Acquired Pneumonia. N. Engl. J. Med. 2014, 370, 543–551. [Google Scholar] [CrossRef] [PubMed]
  4. Kim, O.H.; Kim, W.S.; Kim, M.J.; Jung, J.Y.; Suh, J.H. US in the Diagnosis of Pediatric Chest Diseases. Radiographics 2000, 20, 653–671. [Google Scholar] [CrossRef] [PubMed]
  5. Metlay, J.P.; Fine, M.J. Testing Strategies in the Initial Management of Patients with Community-Acquired Pneumonia. Ann. Intern. Med. 2003, 138, 109–118. [Google Scholar] [CrossRef] [PubMed]
  6. Frush, D.P.; Donnelly, L.F.; Rosen, N.S. Computed Tomography and Radiation Risks: What Pediatric Health Care Providers Should Know. Pediatrics 2003, 112, 951–957. [Google Scholar] [CrossRef]
  7. Riccabona, M. Ultrasound of the Chest in Children (Mediastinum Excluded). Eur. Radiol. 2008, 18, 390–399. [Google Scholar] [CrossRef]
  8. Nievelstein, R.A.J.; van Dam, I.M.; van der Molen, A.J. Multidetector CT in Children: Current Concepts and Dose Reduction Strategies. Pediatr. Radiol. 2010, 40, 1324–1344. [Google Scholar] [CrossRef]
  9. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. BMJ 2009, 339, b2535. [Google Scholar] [CrossRef]
  10. Whiting, P.F.; Rutjes, A.W.S.; Westwood, M.E.; Mallett, S.; Deeks, J.J.; Reitsma, J.B.; Leeflang, M.M.G.; Sterne, J.A.C.; Bossuyt, P.M.M.; QUADAS-2 Group. QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies. Ann. Intern. Med. 2011, 155, 529–536. [Google Scholar] [CrossRef]
  11. Copetti, R.; Cattarossi, L. Ultrasound Diagnosis of Pneumonia in Children. Radiol. Med. 2008, 113, 190–198. [Google Scholar] [CrossRef] [PubMed]
  12. Iuri, D.; De Candia, A.; Bazzocchi, M. Evaluation of the Lung in Children with Suspected Pneumonia: Usefulness of Ultrasonography. Radiol. Med. 2009, 114, 321–330. [Google Scholar] [CrossRef] [PubMed]
  13. Caiulo, V.A.; Gargani, L.; Caiulo, S.; Fisicaro, A.; Moramarco, F.; Latini, G.; Picano, E.; Mele, G. Lung Ultrasound Characteristics of Community-Acquired Pneumonia in Hospitalized Children. Pediatr. Pulmonol. 2013, 48, 280–287. [Google Scholar] [CrossRef]
  14. Shah, V.P.; Tunik, M.G.; Tsung, J.W. Prospective Evaluation of Point-of-Care Ultrasonography for the Diagnosis of Pneumonia in Children and Young Adults. JAMA Pediatr. 2013, 167, 119–125. [Google Scholar] [CrossRef]
  15. Esposito, S.; Papa, S.S.; Borzani, I.; Pinzani, R.; Giannitto, C.; Consonni, D.; Principi, N. Performance of Lung Ultrasonography in Children with Community-Acquired Pneumonia. Ital. J. Pediatr. 2014, 40, 37. [Google Scholar] [CrossRef]
  16. Reali, F.; Sferrazza Papa, G.F.; Carlucci, P.; Fracasso, P.; Di Marco, F.; Mandelli, M.; Soldi, S.; Riva, E.; Centanni, S. Can Lung Ultrasound Replace Chest Radiography for the Diagnosis of Pneumonia in Hospitalized Children? Respiration 2014, 88, 112–115. [Google Scholar] [CrossRef] [PubMed]
  17. Liu, J.; Liu, F.; Liu, Y.; Wang, H.-W.; Feng, Z.-C. Lung Ultrasonography for the Diagnosis of Severe Neonatal Pneumonia. Chest 2014, 146, 383–388. [Google Scholar] [CrossRef]
  18. Iorio, G.; Capasso, M.; De Luca, G.; Prisco, S.; Mancusi, C.; Laganà, B.; Comune, V. Lung Ultrasound in the Diagnosis of Pneumonia in Children: Proposal for a New Diagnostic Algorithm. PeerJ 2015, 3, e1374. [Google Scholar] [CrossRef]
  19. Urbankowska, E.; Krenke, K.; Drobczyński, Ł.; Korczyński, P.; Urbankowski, T.; Krawiec, M.; Kraj, G.; Brzewski, M.; Kulus, M. Lung Ultrasound in the Diagnosis and Monitoring of Community Acquired Pneumonia in Children. Respir. Med. 2015, 109, 1207–1212. [Google Scholar] [CrossRef]
  20. Ianniello, S.; Piccolo, C.L.; Buquicchio, G.L.; Trinci, M.; Miele, V. First-Line Diagnosis of Paediatric Pneumonia in Emergency: Lung Ultrasound (LUS) in Addition to Chest-X-Ray (CXR) and Its Role in Follow-Up. Br. J. Radiol. 2016, 89, 20150998. [Google Scholar] [CrossRef]
  21. Guerra, M.; Crichiutti, G.; Pecile, P.; Romanello, C.; Busolini, E.; Valent, F.; Rosolen, A. Ultrasound Detection of Pneumonia in Febrile Children with Respiratory Distress: A Prospective Study. Eur. J. Pediatr. 2016, 175, 163–170. [Google Scholar] [CrossRef] [PubMed]
  22. Zhan, C.; Grundtvig, N.; Klug, B.H. Performance of Bedside Lung Ultrasound by a Pediatric Resident: A Useful Diagnostic Tool in Children With Suspected Pneumonia. Pediatr. Emerg. Care 2018, 34, 618–622. [Google Scholar] [CrossRef] [PubMed]
  23. Samson, F.; Gorostiza, I.; González, A.; Landa, M.; Ruiz, L.; Grau, M. Prospective Evaluation of Clinical Lung Ultrasonography in the Diagnosis of Community-Acquired Pneumonia in a Pediatric Emergency Department. Eur. J. Emerg. Med. 2018, 25, 65–70. [Google Scholar] [CrossRef]
  24. Boursiani, C.; Tsolia, M.; Koumanidou, C.; Malagari, A.; Vakaki, M.; Karapostolakis, G.; Mazioti, A.; Alexopoulou, E. Lung Ultrasound as First-Line Examination for the Diagnosis of Community-Acquired Pneumonia in Children. Pediatr. Emerg. Care 2017, 33, 62–66. [Google Scholar] [CrossRef] [PubMed]
  25. Yadav, K.K.; Awasthi, S.; Parihar, A. Lung Ultrasound is Comparable with Chest Roentgenogram for Diagnosis of Community-Acquired Pneumonia in Hospitalised Children. Indian J. Pediatr. 2017, 84, 499–504. [Google Scholar] [CrossRef] [PubMed]
  26. Yilmaz, H.L.; Özkaya, A.K.; Sarı Gökay, S.; Tolu Kendir, Ö.; Şenol, H. Point-of-Care Lung Ultrasound in Children with Community Acquired Pneumonia. Am. J. Emerg. Med. 2017, 35, 964–969. [Google Scholar] [CrossRef] [PubMed]
  27. Claes, A.-S.; Clapuyt, P.; Menten, R.; Michoux, N.; Dumitriu, D. Performance of Chest Ultrasound in Pediatric Pneumonia. Eur. J. Radiol. 2017, 88, 82–87. [Google Scholar] [CrossRef]
  28. Man, S.C.; Fufezan, O.; Sas, V.; Schnell, C. Performance of Lung Ultrasonography for the Diagnosis of Communityacquired Pneumonia in Hospitalized Children. Med. Ultrason. 2017, 19, 276–281. [Google Scholar] [CrossRef]
  29. Ellington, L.E.; Gilman, R.H.; Chavez, M.A.; Pervaiz, F.; Marin-Concha, J.; Compen-Chang, P.; Riedel, S.; Rodriguez, S.J.; Gaydos, C.; Hardick, J.; et al. Lung Ultrasound as a Diagnostic Tool for Radiographically-Confirmed Pneumonia in Low Resource Settings. Respir. Med. 2017, 128, 57–64. [Google Scholar] [CrossRef]
  30. Yan, C.; Hui, R.; Lijuan, Z.; Zhou, Y. Lung Ultrasound vs. Chest X-ray in Children with Suspected Pneumonia Confirmed by Chest Computed Tomography: A Retrospective Cohort Study. Exp. Ther. Med. 2020, 19, 1363–1369. [Google Scholar] [CrossRef]
  31. Osman, A.M.; Sarhan, A.A.; Abd-Elrahman, A.M.; Abo-Salha, M.A. Lung Ultrasound for the Diagnosis of Community-Acquired Pneumonia in Infants and Children. Egypt. J. Chest Dis. Tuberc. 2020, 69, 227. [Google Scholar] [CrossRef]
  32. Jiang, P.; Wei, J. The Application of Pulmonary Ultrasound in Neonatal Ventilator-Associated Pneumonia. Front. Pediatr. 2022, 10, 882056. [Google Scholar] [CrossRef] [PubMed]
  33. Thareeb, M.K.; Zghair, M.A.A.; Hassan, Q.A. Diagnostic Ability of Chest Ultrasound in Selective Paediatric Pneumonia Alternative to CT Scan: A Single-Center Comparative Observational Study. J. Nepal Paediatr. Soc. 2022, 42, 17–23. [Google Scholar] [CrossRef]
  34. Talwar, N.; Manik, L.; Chugh, K. Pediatric Lung Ultrasound (PLUS) in the Diagnosis of Community-Acquired Pneumonia (CAP) Requiring Hospitalization. Lung India 2022, 39, 267–273. [Google Scholar] [CrossRef] [PubMed]
  35. Gürbüz, N.; Zengin, N.; Karaburun, N.C.; Düzgün, F.; Bal, A. A Comparison Study in Children with Lower Respiratory Tract Infections: Chest X-ray and Lung Ultrasound. J. Pediatr. Res. 2023, 10, 102–106. [Google Scholar] [CrossRef]
  36. Amatya, Y.; Russell, F.M.; Rijal, S.; Adhikari, S.; Nti, B.; House, D.R. Bedside Lung Ultrasound for the Diagnosis of Pneumonia in Children Presenting to an Emergency Department in a Resource-Limited Setting. Int. J. Emerg. Med. 2023, 16, 2. [Google Scholar] [CrossRef]
  37. Lichtenstein, D.A.; Mezière, G.A. Relevance of Lung Ultrasound in the Diagnosis of Acute Respiratory Failure: The BLUE Protocol. Chest 2008, 134, 117–125. [Google Scholar] [CrossRef]
  38. Ho, M.-C.; Ker, C.-R.; Hsu, J.-H.; Wu, J.-R.; Dai, Z.-K.; Chen, I.-C. Usefulness of Lung Ultrasound in the Diagnosis of Community-Acquired Pneumonia in Children. Pediatr. Neonatol. 2015, 56, 40–45. [Google Scholar] [CrossRef]
  39. Roh, E.J.; Shim, J.Y.; Chung, E.H. Epidemiology and Surveillance Implications of Community-Acquired Pneumonia in Children. Clin. Exp. Pediatr. 2022, 65, 563–573. [Google Scholar] [CrossRef]
  40. Yun, K.W. Community-Acquired Pneumonia in Children: An Updated Perspectives on Its Etiology, Diagnosis, and Treatment. Clin. Exp. Pediatr. 2023; Online ahead of print. [Google Scholar] [CrossRef]
  41. McAllister, D.A.; Liu, L.; Shi, T.; Chu, Y.; Reed, C.; Burrows, J.; Adeloye, D.; Rudan, I.; Black, R.E.; Campbell, H.; et al. Global, Regional, and National Estimates of Pneumonia Morbidity and Mortality in Children Younger than 5 Years between 2000 and 2015: A Systematic Analysis. Lancet Glob. Health 2019, 7, e47–e57. [Google Scholar] [CrossRef]
  42. Jia, Z.; Yan, X.; Gao, L.; Ding, S.; Bai, Y.; Zheng, Y.; Cui, Y.; Wang, X.; Li, J.; Lu, G.; et al. Comparison of Clinical Characteristics Among COVID-19 and Non-COVID-19 Pediatric Pneumonias: A Multicenter Cross-Sectional Study. Front. Cell Infect. Microbiol. 2021, 11, 663884. [Google Scholar] [CrossRef] [PubMed]
  43. Moscovich, D.P.; Averbuch, D.; Kerem, E.; Cohen-Cymberknoh, M.; Berkun, Y.; Brooks, R.; Reiff, S.; Meir, M.B.; Wolf, D.; Breuer, O. Pediatric Respiratory Admissions and Related Viral Infections during the COVID-19 Pandemic. Pediatr. Pulmonol. 2023, 58, 2076–2084. [Google Scholar] [CrossRef] [PubMed]
  44. Kevat, P.M.; Morpeth, M.; Graham, H.; Gray, A.Z. A Systematic Review of the Clinical Features of Pneumonia in Children Aged 5–9 Years: Implications for Guidelines and Research. J. Glob. Health 2022, 12, 10002. [Google Scholar] [CrossRef] [PubMed]
  45. Rueda, Z.V.; Aguilar, Y.; Maya, M.A.; López, L.; Restrepo, A.; Garcés, C.; Morales, O.; Roya-Pabón, C.; Trujillo, M.; Arango, C.; et al. Etiology and the Challenge of Diagnostic Testing of Community-Acquired Pneumonia in Children and Adolescents. BMC Pediatr. 2022, 22, 169. [Google Scholar] [CrossRef] [PubMed]
  46. Leung, A.K.C.; Wong, A.H.C.; Hon, K.L. Community-Acquired Pneumonia in Children. Recent Pat. Inflamm. Allergy Drug Discov. 2018, 12, 136–144. [Google Scholar] [CrossRef]
  47. Buz Yaşar, A.; Tarhan, M.; Atalay, B.; Kabaalioğlu, A.; Girit, S. Investigation of Childhood Pneumonia With Thoracic Ultrasound: A Comparison Between X-ray and Ultrasound. Ultrasound Q. 2023. [Google Scholar] [CrossRef]
  48. Miglioretti, D.L.; Johnson, E.; Williams, A.; Greenlee, R.T.; Weinmann, S.; Solberg, L.I.; Feigelson, H.S.; Roblin, D.; Flynn, M.J.; Vanneman, N.; et al. The Use of Computed Tomography in Pediatrics and the Associated Radiation Exposure and Estimated Cancer Risk. JAMA Pediatr. 2013, 167, 700–707. [Google Scholar] [CrossRef]
  49. Najgrodzka, P.; Buda, N.; Zamojska, A.; Marciniewicz, E.; Lewandowicz-Uszyńska, A. Lung Ultrasonography in the Diagnosis of Pneumonia in Children-A Metaanalysis and a Review of Pediatric Lung Imaging. Ultrasound Q. 2019, 35, 157–163. [Google Scholar] [CrossRef]
  50. Ye, X.; Xiao, H.; Chen, B.; Zhang, S. Accuracy of Lung Ultrasonography versus Chest Radiography for the Diagnosis of Adult Community-Acquired Pneumonia: Review of the Literature and Meta-Analysis. PLoS ONE 2015, 10, e0130066. [Google Scholar] [CrossRef]
  51. Hendin, A.; Koenig, S.; Millington, S.J. Better with Ultrasound: Thoracic Ultrasound. Chest 2020, 158, 2082–2089. [Google Scholar] [CrossRef]
  52. Hansell, L.; Milross, M.; Delaney, A.; Tian, D.H.; Ntoumenopoulos, G. Lung Ultrasound Has Greater Accuracy than Conventional Respiratory Assessment Tools for the Diagnosis of Pleural Effusion, Lung Consolidation and Collapse: A Systematic Review. J. Physiother. 2021, 67, 41–48. [Google Scholar] [CrossRef] [PubMed]
  53. Alrajab, S.; Youssef, A.M.; Akkus, N.I.; Caldito, G. Pleural Ultrasonography versus Chest Radiography for the Diagnosis of Pneumothorax: Review of the Literature and Meta-Analysis. Crit. Care 2013, 17, R208. [Google Scholar] [CrossRef] [PubMed]
  54. Lu, X.; Jin, Y.; Li, Y.; Weng, L.; Li, H. Diagnostic Accuracy of Lung Ultrasonography in Childhood Pneumonia: A Meta-Analysis. Eur. J. Emerg. Med. 2022, 29, 105–117. [Google Scholar] [CrossRef] [PubMed]
  55. Balk, D.S.; Lee, C.; Schafer, J.; Welwarth, J.; Hardin, J.; Novack, V.; Yarza, S.; Hoffmann, B. Lung Ultrasound Compared to Chest X-ray for Diagnosis of Pediatric Pneumonia: A Meta-Analysis. Pediatr. Pulmonol. 2018, 53, 1130–1139. [Google Scholar] [CrossRef]
  56. Volpicelli, G.; Elbarbary, M.; Blaivas, M.; Lichtenstein, D.A.; Mathis, G.; Kirkpatrick, A.W.; Melniker, L.; Gargani, L.; Noble, V.E.; Via, G.; et al. International Evidence-Based Recommendations for Point-of-Care Lung Ultrasound. Intensive Care Med. 2012, 38, 577–591. [Google Scholar] [CrossRef]
  57. Tsou, P.-Y.; Chen, K.P.; Wang, Y.-H.; Fishe, J.; Gillon, J.; Lee, C.-C.; Deanehan, J.K.; Kuo, P.-L.; Yu, D.T.Y. Diagnostic Accuracy of Lung Ultrasound Performed by Novice Versus Advanced Sonographers for Pneumonia in Children: A Systematic Review and Meta-Analysis. Acad. Emerg. Med. 2019, 26, 1074–1088. [Google Scholar] [CrossRef]
  58. Liu, P.-R.; Lu, L.; Zhang, J.-Y.; Huo, T.-T.; Liu, S.-X.; Ye, Z.-W. Application of Artificial Intelligence in Medicine: An Overview. Curr. Med. Sci. 2021, 41, 1105–1115. [Google Scholar] [CrossRef]
  59. Van der Velden, B.H.M.; Kuijf, H.J.; Gilhuijs, K.G.A.; Viergever, M.A. Explainable Artificial Intelligence (XAI) in Deep Learning-Based Medical Image Analysis. Med. Image Anal. 2022, 79, 102470. [Google Scholar] [CrossRef]
  60. Zhou, T.; Cheng, Q.; Lu, H.; Li, Q.; Zhang, X.; Qiu, S. Deep Learning Methods for Medical Image Fusion: A Review. Comput. Biol. Med. 2023, 160, 106959. [Google Scholar] [CrossRef]
  61. Liang, G.; Zheng, L. A Transfer Learning Method with Deep Residual Network for Pediatric Pneumonia Diagnosis. Comput. Methods Programs Biomed. 2020, 187, 104964. [Google Scholar] [CrossRef]
  62. Fang, X.; Li, W.; Huang, J.; Li, W.; Feng, Q.; Han, Y.; Ding, X.; Zhang, J. Ultrasound Image Intelligent Diagnosis in Community-Acquired Pneumonia of Children Using Convolutional Neural Network-Based Transfer Learning. Front. Pediatr. 2022, 10, 1063587. [Google Scholar] [CrossRef] [PubMed]
Figure 1. PRISMA flowchart of the literature search process.
Figure 1. PRISMA flowchart of the literature search process.
Diagnostics 13 03457 g001
Figure 2. Forest plot depicting the sensitivity and specificity [11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36].
Figure 2. Forest plot depicting the sensitivity and specificity [11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36].
Diagnostics 13 03457 g002
Figure 3. Forest plot depicting the PLR and NLR [11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36].
Figure 3. Forest plot depicting the PLR and NLR [11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36].
Diagnostics 13 03457 g003
Figure 4. sROC graph of the TUS diagnostic performance. (The numbers in the figure were represented the 26 included studies.)
Figure 4. sROC graph of the TUS diagnostic performance. (The numbers in the figure were represented the 26 included studies.)
Diagnostics 13 03457 g004
Table 1. Definition and meaning of the TUS fundings.
Table 1. Definition and meaning of the TUS fundings.
TUS fundingsDefinition/Meaning
Lung slidingRhythmic movement of the pleural line with respiration (a normal funding).
Lung consolidationHypoechogenic area with irregular margins and adjacent comet tail artifacts along a non-homogeneous echo texture.
Liver-like (“hepatized”) area with fluid and air bronchograms (static or dynamic).
Pleural effusionAnechoic space between the visceral and parietal pleura.
Air bronchogramPunctate or branching hyperechoic images reflecting the airways made visible by the surrounding fluid/inflammation.
Fluid bronchogramIdentified as anechoic tublar structures, with hyperechoic walls. It may indicate obstructive pneumonia.
A-linesHorizontal lines equally spaced from the pleural line, representing artifacts generated by subpleural air (a normal finding).
B-linesHyperechoic artifact images erasing the A-line, extending from the pleural line to the end of the screen, emerging with lung movements and extending in a vertical manner, and classified as focal, multiple, or confluent.
The presence of these artifacts can be attributed to fluid-rich subpleural interlobular septae, which are surrounded by air and associated with various pathological findings.
Table 2. Characteristics of the involved studies.
Table 2. Characteristics of the involved studies.
AuthorsYearCountryStudy Type
(Observational)
Patients SettingReference StandardSample SizeSex
(Male/Female)
Ages
Copetti and Cattarossi [11]2008ItalyProspectivePediatric EDClinical diagnosis + CXR7937/425.1 ± 5.0 years
Iuri et al. [12]2009ItalyProspectivePediatric EDCXR2817/114.5 ± 4.9 years
Caiulo et al. [13]2013ItalyProspectivePediatric wardClinical diagnosis + CXR + blood results10253/495.0 ± 3.0 years
Shah et al. [14]2013USAProspectivePediatric EDCXR200112/882.6 ± 6.2 years
Esposito et al. [15]2014ItalyProspectivePICUCXR10356/475.6 ± 4.6 years
Reali et al. [16]2014ItalyProspectivePediatric wardClinical diagnosis + CXR + blood results10761/464.0 ± 3.0 years
Liu et al. [17]2014ChinaProspectiveNICUClinical diagnosis + CXR + blood results8043/37NR
Iorio et al. [18]2015ItalyRetrospectivePediatric wardClinical diagnosis + CXR + laboratory findings5227/253.5 ± 3.1 years
Urbankowska et al. [19]2015PolandProspectivePediatric wardClinical diagnosis + CXR + laboratory findings10669/37Median = 52.5 months
Ianniello et al. [20]2016ItalyRetropectivePediatric EDClinical diagnosis + CXR 8444/40Mean = 6.0 years
Guerra et al. [21]2016ItalyProspectivePediatric EDClinical diagnosis + CXR + blood results222108/1143 months–16 years
Zhan et al. [22]2016DenmarkProspectivePediatric EDCXR + blood results + microbiological testing16493/71Median = 1.5 years
Samson et al. [23]2016SpainProspectivePediatric EDClinical diagnosis + CXR200116/84Median = 29.5 months
Boursiani et al. [24]2017GreeceProspectivePediatric EDClinical diagnosis + CXR6927/42Median = 4.5 years
Yadav et al. [25]2017IndiaProspectivePediatric EDClinical diagnosis + CXR11865/5326.2 ± 19.6 months
Yilmaz et al. [26]2017TurkeyProspectivePediatric EDClinical diagnosis + CXR16088/723.3 ± 4.0 years
Claes et al. [27]2017BelgiumProspectivePediatric EDClinical diagnosis + CXR14377/66Mean = 3.4 years
Man et al. [28]2017RomaniaRetrospectivePediatric EDClinical diagnosis + laboratory findings8142/396.5 ± 4.7 years
Ellington et al. [29]2017USAProspectivePediatric ED/wardClinical diagnosis + CXR + laboratory findings421258/16320.0 ± 14.6 months
Yan et al. [30]2020ChinaRetrospectivePediatric wardClinical diagnosis + CXR + CT925435/49012.5 ± 3.1 years
Osman et al. [31]2020EgyptProspectivePediatric wardClinical diagnosis + CXR9036/54Median = 2.2 years
Jiang and Wei [32]2022ChinaProspectiveNICUClinical diagnosis + CXR + laboratory findings12264/58NR
Thareeb et al. [33]2022IraqProspectivePediatric wardClinical diagnosis + CT10670/366.5 ± 4.1 years
Talwar et al. [34]2022IndiaProspectivePediatric wardClinical diagnosis261168/934.3 ± 4.4 years
Gürbüz et al. [35]2023TurkeyProspectivePediatric EDClinical diagnosis + CXR4827/215.4 ± 5.3 years
Amatya et al. [36]2023NepalProspectivePediatric EDClinical diagnosis + CXR365209/156Median = 16.5 months
ED, emergency department; PICU, pediatric intensive care unit; NICU, neonatal intensive care unit; CXR, chest X-ray; CT, computed tomography, NR: not reported.
Table 3. Ultrasound details of the enrolled studies.
Table 3. Ultrasound details of the enrolled studies.
StudyBlinding *OperatorLUS ProbeDiagnostic Criteria
Copetti and Cattarossi (2008) [11]NMEmergency physician3.5–5 MHz convex probe and high-resolution 7.5–10 MHz linear probeLung consolidation, bronchograms, and pleural effusion
Iuri et al. (2009) [12]YesRadiologistBroadband (2–5 MHz) convex probe and high-frequency broadband (5–12 MHz) linear probeLung consolidation and pleural effusion
Caiulo et al. (2013) [13]YesPediatrician with ultrasound experienceHigh-resolution linear probe with frequencies ranging from 6–12 MHzB-lines, consolidation, air pleural line abnormalities, and pleural effusion
Shah et al. (2013) [14]YesEmergency physician with ultrasound experienceLinear array transducer at 7.5–10 MHzLung consolidation, air bronchogram, and B-lines
Esposito et al. (2014) [15]YesPediatric resident with limited ultrasound experienceConvex 2.5–6.6 MHz probe and linear 7.5–12 MHz probeB-lines, interruption of pleural line, Consolidation, and pleural effusion
Reali et al. (2014) [16]YesPulmonologistLinear probe (7.5–10 MHz)B-lines, consolidation, air pleural line abnormalities, and pleural effusion
Liu et al. (2014) [17]YesExperienced physicianHigh-frequency linear 9–12 MHz probePleural line abnormalities, lung consolidation, disappearance of lung sliding, and lung pulse
Iorio et al. (2015) [18]YesPediatrician with ultrasound experience5–10 MHz linear probeLung consolidation, bronchograms, superficial fluid alveologram, and pleural effusion
Urbankowska et al. (2015) [19]YesPediatric sonographerConvex 3–7 MHz probe and linear 5–9 MHz probeLung consolidation, bronchograms, pleural effusion, and pleural line abnormalities
Ianniello et al. (2016) [20]NMRadiologistCurved array 4 MHz multifrequency probe and linear 7.5–10 MHz probeLung consolidation, B-lines, air bronchogram, pleural line abnormalities, and pleural effusion
Guerra et al. (2016) [21]YesPediatrician with ultrasound experienceHigh-resolution 7.5–10-MHz linear probe ± 3.5–5-MHz convex probeLung consolidation, air and fluid bronchogram, pleural effusion, and B-lines
Zhan et al. (2016) [22]YesPediatric resident with limited ultrasound experienceTwo linear probes (5–10 MHz and 5–13 MHz)Subpleural consolidation, air bronchogram, and pleural effusion
Samson et al. (2016) [23]YesPediatricians and pediatrics with varying ultrasound experience6–15 MHz linear probeLung consolidation, air bronchogram, and pleural effusion
Boursiani et al. (2017) [24]YesExperienced pediatric radiologist5–8 MHz micro-convex, 5–12 MHz linear array, and 3–5 MHz convex transducers)B-lines, lung consolidation, air or fluid bronchogram, and pleural effusion
Yadav et al. (2017) [25]YesTrained radiologisthigh-resolution micro-convex transducer with the depth of 8 cmLung consolidation, air bronchogram, fluid alveologram, B-lines, and pleural effusion
Yilmaz et al. (2017) [26]YesExperienced pediatric emergency physician6–13 MHz linear probeConsolidation, air and fluid bronchograms, B-lines, and pleural effusion
Claes et al. (2017) [27]YesPediatric radiologistLinear 5–12 MHz probe ± convex 4–9 MHz probeLung consolidation
Man et al. (2017) [28]YesSenior radiologistConvex (7–11 MHz) and linear (3.5–5 MHz) probesConsolidation, air bronchogram, and pleural effusion
Ellington et al. (2017) [29]YesTrained general pracitionerHFL38/13–6 MHz linear transducer.Consolidation with a pleural effusion
Yan et al. (2020) [30]YesExperienced sonographer7.5 MHz linear probesB-lines, consolidation, air bronchogram, and pleural effusion
Osman et al. (2020) [31]YesRadiologist3–5 MHz convex transducer and high-frequency 5–12-MHz linear array probeB-lines, consolidation, air bronchogram, and pleural effusion
Jiang and Wei (2022) [32]YesSenior radiologist with professional trainingHigh-frequency linear array probe (frequency 10–12 MHz)Lung consolidation, air bronchogram, pleural effusion, B-lines, and pleural line abnormalities
Thareeb et al. (2022) [33]YesSenior radiologist with more than five years of experience6–9 MHz linear probe and 3–5 MHz convex probeLung consolidation, B-lines, air or liquid bronchogram, and pleural effusion
Talwar et al. (2022) [34]YesExpert clinicosonologistMicro-convex transducer with curvilinear (3.5–5 MHz) and linear (7.5–10 MHz) probesB-lines, consolidation, air bronchogram, fluid bronchogram, and pleural effusion
Gürbüz et al. (2023) [35]YesPediatric resident with ultrasound trainingLinear 3–13 MHz and convex 2–6 MHz probesLung consolidation, subpleural consolidation, pleural effusion, and B-lines
Amatya et al. (2023) [36]YesExpert sonographerCurvilinear probeB-lines and subpleural consolidation
NM, not mentioned. *: means the TUS operators had no contact with the radiologists and were blinded to the chest radiography findings.
Table 4. Individual and cumulative statistics for the included studies.
Table 4. Individual and cumulative statistics for the included studies.
StudyParticipantsTrue
Positives
False
Positives
True
Negatives
False
Negatives
Sensitivity
(95% CI, %)
Specificity
(95% CI, %)
Positive PV (%)Negative PV (%)
Copetti and Cattarossi [11]79 60 0 19 0 100% (94.0–100)100% (82.4–100)100%100%
Iuri et al. [12]28 22 0 4 2 91.7% (NA)100% (NA)100%66.70%
Caiulo et al. [13]102 88 0 13 1 98.9% (93.9–100)100% (75.3–100)100%92.90%
Shah et al. [14]200 31 18 146 5 86.1% (71.0–94.0)89% (83.0–93.0)63.3%96.70%
Esposito et al. [15]103 47 3 52 1 97.9% (88.9–99.9)94.5% (84.9–98.9)94.00%98.10%
Reali et al. [16]107 76 1 25 5 93.8% (86.2–98.0)96.2% (80.4–99.9)98.70%83.30%
Liu et al. [17]80 40 0 40 0 100% (NA)100% (NA)100%100%
Iorio et al. [18]52 28 1 22 1 96.6% (82.2–99.9)95.7% (78.1–99.9)96.60%95.70%
Urbankowska et al. [19]106 71 0 30 5 93.4% (NA)100% (NA)100%85.70%
Ianniello et al. [20]84 60 0 23 1 98.4% (91.2–100)100% (85.2–100)100%95.80%
Guerra et al. [21]222 207 0 8 7 96.7% (93.4–98.7)100% (63.1–100)100%53.30%
Zhan et al. [22]164 33 7 75 49 40.0% (30.0–51.0)91% (83.0–96.0)82.50%60.50%
Samson et al. [23]200 74 6 109 11 87.1% (78.0–93.4)94.8% (89.0–98.1)92.50%90.80%
Boursiani et al. [24]69 62 0 3 4 93.9% (NA)100% (NA)100%42.90%
Yadav et al. [25]118 99 6 11 2 98.0% (93.0–99.8)64.7% (38.3–85.8)94.30%84.60%
Yilmaz et al. [26]160 142 4 7 7 95.3% (90.6–98.1)63.6% (30.8–89.1)97.30%50.00%
Claes et al. [27]143 44 8 90 1 98% (88.0–100)92% (84.0–96.0)84.60%98.90%
Man et al. [28]81 57 5 4 15 79.2 (68.0–87.8)44.4 (13.7–78.8)91.90%21.10%
Ellington et al. [29]421 176 11 219 15 92.2% (NA)95.2% (NA)94.10%93.60%
Yan et al. [30]925 745 65 84 31 96.0% (NA)56.4% (NA)92.00%73.00%
Osman et al. [31]90 82 1 5 2 97.6% (91.7–99.7)83.3% (35.9–99.6)98.80%71.40%
Jiang and Wei [32]122 111 0 7 4 96.5% (NA)100% (NA)100%63.60%
Thareeb et al. [33]106 74 0 16 16 82.2% (NA)100% (NA)100%50.00%
Talwar et al. [34]261 141 8 105 7 95.3% (90.5–98.1)92.9% (86.5–96.9)94.60%93.75%
Gürbüz et al. [35]48 19 4 24 1 95% (75.1–99.9)85.7% (67.3–95.8)82.60%96.00%
Amatya et al. [36]365 75 39 242 9 89.3% (81.0–95.0)86.1% (82.0–90.0)65.80%96.41%
PV, predictive value; NA, not available.
Table 5. Risk of bias and applicability judgments in QUADAS-2.
Table 5. Risk of bias and applicability judgments in QUADAS-2.
StudyPatient SelectionApplicabilityIndex TestApplicabilityReference StandardApplicabilityFlow and Timing
Copetti and Cattarossi [11]ULULULU
Iuri et al. [12]LLLLULL
Caiulo et al. [13]UULLLLL
Shah et al. [14]HLLLLLL
Esposito et al. [15]HLLLLLL
Reali et al. [16]LLLLLLL
Liu et al. [17]HLLLLLL
Iorio et al. [18]HLLLLLU
Urbankowska et al. [19]LLLLLLL
Ianniello et al. [20]HLLLULL
Guerra et al. [21]LLLLLLL
Zhan et al. [22]LLLLLLH
Samson et al. [23]LLLLLLL
Boursiani et al. [24]LLLLLLL
Yadav et al. [25]LLLLLLU
Yilmaz et al. [26]ULULLLU
Claes et al. [27]LLLLLLL
Man et al. [28]LLLLLLL
Ellington et al. [29]LLLLLLL
Yan et al. [30]LLLLLLU
Osman et al. [31]LLLLHLL
Jiang and Wei [32]HLULLLU
Thareeb et al. [33]LLULULL
Talwar et al. [34]LLLLLLL
Gürbüz et al. [35]ULLLLLU
Amatya et al. [36]LLULLLL
H, high; L, low; U, unclear.
Table 6. Subgroup analysis of the included studies by the different study characteristics.
Table 6. Subgroup analysis of the included studies by the different study characteristics.
VariableNSensitivity (95% CI)Specifcity (95% CI)Positive LR Negative LRAUC
Patients settings
    ED150.93 (0.88–0.97)0.91 (0.84–0.95)10.05 (5.53–18.27)0.07 (0.04–0.14)0.97 (0.95–0.98)
    Ward 80.95 (0.91–0.97)0.96 (0.82–0.99)22.81 (4.84–107.45)0.06 (0.03–0.09)0.98 (0.96–0.99)
    NICU *2NANANANANA
    PICU *1NANANANANA
Operator experience
    Limited60.83 (0.67–0.93)0.91 (0.88–0.94)9.78 (6.69–14.30)0.18 (0.08–0.39)0.93 (0.90–0.95)
    Experienced200.96 (0.94–0.97)0.94 (0.87–0.98)16.87 (7.06–40.29)0.04 (0.03–0.06)0.98 (0.97–0.99)
Probe selection
    Linear110.94 (0.87–0.97)0.94 (0.85–0.98)14.77 (5.85–37.28)0.06 (0.03–0.15)0.98 (0.96–0.99)
    Convex *2NANANANANA
    Linear + convex130.95 (0.92–0.97)0.95 (0.87–0.98)18.23 (6.89–48.19)0.05 (0.03–0.09)0.99 (0.97–0.99)
N, number of studies; LR, likelihood ratio; AUC, area under the sROC curve; NA, not available. *: The subgroup analysis was not available due to quantitative limitations.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Dong, Z.; Shen, C.; Tang, J.; Wang, B.; Liao, H. Accuracy of Thoracic Ultrasonography for the Diagnosis of Pediatric Pneumonia: A Systematic Review and Meta-Analysis. Diagnostics 2023, 13, 3457. https://doi.org/10.3390/diagnostics13223457

AMA Style

Dong Z, Shen C, Tang J, Wang B, Liao H. Accuracy of Thoracic Ultrasonography for the Diagnosis of Pediatric Pneumonia: A Systematic Review and Meta-Analysis. Diagnostics. 2023; 13(22):3457. https://doi.org/10.3390/diagnostics13223457

Chicago/Turabian Style

Dong, Zhenghao, Cheng Shen, Jinhai Tang, Beinuo Wang, and Hu Liao. 2023. "Accuracy of Thoracic Ultrasonography for the Diagnosis of Pediatric Pneumonia: A Systematic Review and Meta-Analysis" Diagnostics 13, no. 22: 3457. https://doi.org/10.3390/diagnostics13223457

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop