Next Article in Journal
Architectural Allostatic Overloading: Exploring a Connection between Architectural Form and Allostatic Overloading
Next Article in Special Issue
Differential Factors Are Associated with Physical Activity in Older Adults in Brazil with and without Non-Communicable Chronic Diseases: A Cross-Sectional Analysis of the 2019 National Health Survey
Previous Article in Journal
Perspectives on the Person-Centered Practice of Healthcare Professionals at an Inpatient Hospital Department: A Descriptive Study
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 20
Issue 9
10.3390/ijerph20095636
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Inter-Examiner and Intra-Examiner Reliability of Quantitative and Qualitative Ultrasonography Assessment of Peripheral and Respiratory Muscles in Critically Ill Patients

by
Felipe Douglas Silva Barbosa
1,2,*,
José Lucas Dos Santos
3,
Maria Emilia Dantas Alves
4,
Juliana de Ávila Barreto Alves
3,
Telma Cristina Fontes Cerqueira
5 and
Valter Joviniano De Santana Filho
1,6
1
Graduate Program in Health Sciences, Federal University of Sergipe, Aracaju 49060-100, Brazil
2
Family Health and Occupational Therapy Department, Faculty of Medicine, Federal University of Bahia, Salvador 40026-010, Brazil
3
University Hospital of Lagarto, Federal University of Sergipe, Lagarto 49400-000, Brazil
4
Multiprofessional Integrated Residency Program in Hospital Care, University Hospital of Lagarto, Federal University of Sergipe, Lagarto 49400-000, Brazil
5
Department of Physiotherapy of Lagarto, Federal University of Sergipe, Lagarto 49400-000, Brazil
6
Department of Physiotherapy, Federal University of Sergipe, São Cristovão 49100-000, Brazil
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(9), 5636; https://doi.org/10.3390/ijerph20095636
Submission received: 15 March 2023 / Revised: 13 April 2023 / Accepted: 20 April 2023 / Published: 25 April 2023
(This article belongs to the Special Issue Aging Strong: Promoting Exercise and Nutrition to Combat Frailty in Older Adults)
Browse Figures
Versions Notes

Abstract

:
ICU patients are exposed to several factors that can lead to muscle structural and functional changes, and ultrasonography can identify them. Although several studies have analyzed the reliability of muscle ultrasonography assessment, a protocol with more muscle assessments becomes a challenge. The aim of this study was to analyze the inter and intra-examiner reliability of peripheral and respiratory muscle ultrasonography assessment in critically ill patients. The sample size was 10 individuals aged ≥ 18 years who were admitted to the ICU. Practical training of four health professionals from different backgrounds was performed. After training, each examiner acquired three images to assess the thickness and echogenicity of the muscle groups: biceps brachii, forearm flexor group, quadriceps femoris, tibialis anterior and diaphragm. For the reliability analysis, an intraclass correlation coefficient was performed. Six hundred US images were analyzed for muscle thickness and 150 for echogenicity. Excellent intra-examiner reliability for echogenicity (ICC: 0.867–0.973) and inter-examiner reliability for thickness were found in all muscle groups (ICC: 0.778–0.942). For muscle thickness intra-examiner reliability, excellent results were found (ICC: 0.798–0.988), with a “good” correlation in one diaphragm assessment (ICC: 0.718). Excellent inter- and intra-examiner reliability of the thickness assessment and intra-examiner echogenicity of all muscles analyzed were found.

1. Introduction

Individuals hospitalized in Intensive Care Units (ICU) are exposed to several factors that can lead to structural and functional changes in the muscles, which may be related to important clinical outcomes, such as functional disability and mortality [1]. These patients can lose about 2% of muscle mass per day, with a higher loss during the first 7–10 days of immobility [2]. Moreover, immobility in bed for more than 72 h can cause damage up to 5 years after hospital discharge [3]. Furthermore, the deleterious effects suffered by the musculoskeletal system are generalized during ICU stay, affecting both peripheral and respiratory muscles [4].
According to Tillquist et al. [5], a good evaluation in the ICU is important for the early identification of impairments and to guide the treatment accordingly. Among these methods, ultrasonography (US) has been identified by The European Working Group on Sarcopenia as a useful method for evaluating skeletal muscle, being able to identify structural, quantitative and qualitative changes in peripheral and respiratory muscles, in addition to considering its characteristics of being an accessible tool at the bedside, non-invasive and portable [6], although accepting that further research is required [7,8].
The US diagnostic accuracy to verify muscle changes in the ICU has been analyzed in several studies, proving that this evaluation method is capable of verifying changes in muscle thickness, cross-sectional area and echogenicity [9,10,11]. Studies have shown that changes in muscle mass and quality may be associated with changes in strength and functional capacity. These studies diversely report the reduction in muscle thickness and cross-sectional area and increased echogenicity are associated with a decrease of muscle strength and functional capacity during the awakening of critically ill patients, mainly analyzing the quadriceps femoris and diaphragm and, less frequently, the upper limb muscles [12,13,14,15,16]. Considering this, ultrasonographic assessment of the muscle changes is suggested as a prognostic marker, while the patient cannot cooperate with volitional functional tests [11].
Furthermore, considering the different methodologies and results found, in addition to the fact that US is evaluator-dependent, in other words, dependent on the evaluator’s interpretation, inter- and intra-examiner reliability studies were performed. US has shown excellent inter-examiner and intra-examiner reliability, considering different levels of experience, settings, examiners' level of training and established protocols [5,17,18].
Even taking into consideration all the US potential and the results of the available studies, their interpretation and implementation are tough because of significant methodological weaknesses and lack of standardization of the ultrasonography methodology [19,20]. There are some concerns in regard to blinding assessment, appropriate training, reliability of landmarks, participant positioning, muscle assessment and so on [20]. Moreover, even though several studies have done the evaluation and analysis of different muscle groups, a huge amount of research has been focused on large muscle groups (e.g., quadriceps femoris), but it suggested that smaller muscles can also be interesting due to their specific function. Moreover, it is unclear if analyses of a muscle group, such as the quadriceps femoris, may represent the impairments related to the whole body, such as sarcopenia [7,8,21].
As studies have been conducted mainly considering usually one or two muscles per study, there is a lack of knowledge in regards to the reliability of the muscle assessment of the higher amount of muscles/muscles groups and a need for standardization of a protocol with a greater number of muscle assessments aiming to improve the ability to evaluate the global effects of muscle changes. As a first step, the analysis of the inter- and intra-examiner reliability of a protocol in this context is necessary, considering the complexity of the evaluation procedure. Thus, this research aims to analyze the inter-examiner and intra-examiner reliability of peripheral and respiratory muscle assessment through ultrasonography in critically ill patients. It was hypothesized that, after the training, examiners would have excellent inter and intra-examiner reliability in US muscle assessment.

2. Material and Methods

2.1. Study Design, Setting, and Ethical Considerations

This is an investigation of the inter- and intra-examiner reliability of muscle assessment through ultrasonography, which was conducted in a general ICU (medical and surgical) of a university hospital. This study followed the guidelines for reporting reliability and agreement studies (GRRAS) [22]. All subjects, or their guardians/family members/caregivers, who participated in this research were informed about the study conditions and signed the “informed consent form”. This study was approved by the Research Ethics Committee of the Federal University of Sergipe (approval number: 5.531.925).

2.2. Population, Sample, Inclusion, and Exclusion Criteria

The population of this study corresponds to individuals aged ≥ 18 years and who were admitted to the ICU. Participants were recruited by convenience, including participants who met the inclusion and exclusion criteria and were already admitted to the ICU, as well as participants who were admitted later until the required sample was reached.
The sample size was 10 participants. This value was determined from the recommendations of Walter et al. [23]. It included the acceptable reliability values (ICC = 0.70), the predicted reliability coefficient (ICC = 0.93, based on a previous study) [17], three repetitions of the task and levels of error type I (α = 0.05) and type II (β = 0.20). The result of the sample of nine individuals was obtained, but we recruited ten individuals to reduce losses.
Participants were included if they were ≥18 years old and were admitted to the ICU. Subjects were excluded if 1. they remained hospitalized for less than 48 h; 2. they had a pre-admission diagnosis of dementia; 3. they received home mechanical ventilation before admission; 4. they were diagnosed with terminal cancer or were in palliative care; 6. they had a second or subsequent admission to the ICU during the study period; or 7. they did not have family members or caregivers who could give information or sign the “informed consent form”.

2.3. Data Collection

Following the protocol described by Mayer et al. [18] approach, four health professionals (one nurse, two physiotherapists, and one occupational therapist) were trained by an expert Physiotherapist, Ph.D. and university lecturer, who had training and experience in muscle assessment through ultrasonography prior to implementation. Three of the examiners were well-trained and experienced, with more than 5 years of experience working in ICUs, with the exception of one physiotherapist who was ending her two-year residency program. All of them were from the research group and had experience with research projects. In regard to US muscle assessment, examiners had little to no prior experience with US muscle assessment, with one examiner (OT) with informal training and experience during the last year. During the data collection, they did not receive any other training.
Regarding the training program, face-to-face meetings were held, with a duration of about eight hours. Guidance was given regarding the ultrasonography handling, equipment regulation for the image acquisition (frequency, depth and gain), transducer positioning and the protocol to be used for participants' positioning, location of points of interest, identification of anatomical structures (subcutaneous tissue, fascia, muscle and bone) and acquisition of images, in addition to their storage. Moreover, it was provided training to acquire images and measure the thickness of all muscles/muscle groups analyzed in this research. A “guiding document” was available during the image acquisition, including the step-by-step to be performed and the points of interest.
After the training program, each of the 4 evaluators acquired three images to allow inter- and intra-examiner reliability analyses [12], which were obtained based on the structured protocol for subject positioning, determination of appropriate reference points and handling of the transducer, as reported.
To recruit participants, one of the four examiners contacted the prospective participants or their legal guardians in cases where the participant was unable to verify the inclusion and exclusion criteria and sign the informed consent form. The participants’ clinical information was collected after the completion of the US muscle assessment of all participants.

2.4. Ultrasonography Assessment Protocol

For image acquisition, a MindRay M30 portable ultrasound device (Shenzhen Mindray Bio-Medical Electronics Co., Ltd., Shenzhen, China) was used, with a model 75L38P linear transducer. The settings for image acquisition (frequency, depth and gain) were kept constant between examiners (MSK pre-set, frequency of 8.5 MHz, depth of 7.4 cm and gain of 64 db).
In regard to participants positioning in bed, all of them were examined in the supine position, in a semi-recumbent position with patient’s head of bed placed at 30-degree angle, with arms and legs extended and muscles in a relaxed state. All US images were obtained on the participant’s right side, independently and with alternation of evaluators for each image acquisition of all muscles, within 24 h after the first examiner’s evaluation to reduce fluctuations in measurement and analysis of muscle parameters.
After each image acquisition attempt, the subject was returned to its initial position, and the skin was cleaned to remove any gel or marks, ensuring the independent performance of image acquisition procedures. Independent positioning, landmark capture, and transducer handling techniques were emphasized to reduce the risk of measurement bias, such as anchoring. After each assessment, the ultrasonography device was reset to the home screen, with the new evaluator instructed to create a new file for subsequent image storage. This approach was used to minimize the risks of an examiner accessing images of the previous examiner. All images obtained by the examiners were stored on an unidentified hard drive [18].

2.4.1. Diaphragmatic Assessment

Ultrasonography is an instrument that allows the evaluation of diaphragmatic thickness and mobility. For this study, the diaphragmatic thickness was evaluated. A high-frequency linear array transducer was used to measure the thickness of the diaphragm using B-mode. The transducer was positioned in the 8th or 9th intercostal space between the middle and anterior axillary lines in the zone of apposition. The diaphragm was visualized as the intermediate space between the pleural and peritoneal lines at the end of expiration [24]. Even though it is known that there are some influences of the mechanical ventilator’s parameters on the diaphragm thickness, participants with mechanical ventilation were assessed by all examiners under the same circumstances and parameters.

2.4.2. Peripheral Muscles Assessment

Peripheral muscles (biceps brachii, forearm flexors, quadriceps femoris and tibialis anterior) were assessed through the protocol described by Arts et al. [25] and Gruther et al. [26]. All participants were examined in the supine position, with arms and legs extended and muscles in a relaxed state. The evaluation was performed in the transverse plane, in the largest diameter of the analyzed muscle, and with the amount of contact gel necessary to minimize the pressure of the transducer on the skin [25,26].
To obtain images of the biceps brachii, it was positioned the transducer perpendicularly along the axis of the arm on its anterior surface at the point located between the lower third and the upper two-thirds of the distance between the acromion and the cubital fossa. For the forearm flexor group, the transducer was positioned between the upper two-fifths and the lower three-fifths of the distance from the antecubital crease to the distal end of the radius. For the quadriceps femoris, the transducer was positioned perpendicularly to the muscle at the point located two-thirds of the distance between the anterior superior iliac spine and the superior surface of the patella on the anterior thigh. For the tibialis anterior muscle, the transducer was positioned perpendicularly to the long axis of the muscle at the point between the upper quarter and lower three-quarters of the distance from the lower border of the patella to the tip of the lateral malleolus [25,26]. Approximate transducer position can be seen in Figure 1.

2.4.3. Muscle Thickness

The thickness of the biceps brachii muscle was assessed between the upper part of the humerus and the superficial fascia of the biceps (including the brachialis muscle); on the forearm flexor group, it was evaluated between the interosseous membrane located close to the radius and the superficial fascia of the flexors; on the quadriceps femoris it was evaluated between the upper part of the femur and the superficial fascia of the rectus femoris (includes the rectus femoris and vastus intermedius); finally, on the tibialis anterior it was evaluated between the interosseous membrane located close to the tibia and the superficial fascia of the tibialis anterior [25]. Measurements were performed in centimeters and can be seen in Figure 2.

2.4.4. Muscle Echogenicity

Muscle echogenicity was quantified using the grayscale analysis histogram through the square trace method using the ImageJ software in a region of interest with an area of 2 cm × 2 cm for the peripheral muscles and 1 cm × 1 cm for the diaphragm. In muscles where the square was not allowed in the indicated measurements, the largest possible square area was examined within the anatomical limits established for the evaluated muscles. This area was used to reduce the risk of using structures other than the muscle of interest, such as fascia and bone. In grayscale analysis, black is assigned 0, and white is assigned 255, with shades of gray in between and each pixel is assigned a value. This allows the mean and standard deviation of grayscale values to be calculated, which was repeated 3 times for each muscle [27]. Images used for echogenicity analyses were selected from those used for the assessment of muscle thickness, using only the images of one examiner, which was randomly chosen. Measurements can be seen in Figure 1. As the training did not include the echogenicity assessment, only the examiner who had experience with the assessment and use of ImageJ carried out the analysis, so only the intra-examiner reliability was performed.

2.5. Statistical Analysis

For descriptive analyses, categorical variables were expressed in frequency (percentage), and continuous variables were submitted to Shapiro–Wilk test to determine the normality of the distribution. The variables met the normality criteria and were presented as mean and standard deviation. For the inter and intraobserver reliability analyses, the values of the Intraclass Correlation Coefficient (ICC) were performed, considering a two-way mixed-effects method with absolute agreement. Regarding thickness, the mean thickness measurement of the three images captured was performed for the inter-examiner reliability analysis for each muscle. For intra-examiner reliability, the analysis was performed based on the measurements of the three images of each evaluator for each muscle. In regards to echogenicity, only one evaluator carried out the analyses, so only the intraobserver reliability was performed, using the average value of echogenicity obtained in ImageJ, as previously reported. A weak correlation was considered when a value lower than 0.4 was found; satisfactory correlation with a value greater than or equal to 0.4 and less than 0.60; a value equal to or greater than 0.60 and less than 0.75 the correlation was considered good; a value greater than or equal to 0.75 the correlation was considered excellent [28]. All analyzes were performed using SPSS (v.20.0, IBM), considering a significance level of p ≤ 0.05 and a 95% confidence interval (CI).

3. Results

The study sample was 10 participants, which resulted in the acquisition and analysis of 600 US images for inter and intra-examiner muscle thickness reliability and 150 US images for intra-examiner muscle echogenicity reliability. The sample presented a mean age of 62 years old, most of whom were male (60%), with a mean stay of 9.1 days in the ICU on the day of the US assessment. In regards to health status, the majority had a clinical condition upon admission to the ICU (70%), used mechanical ventilation during their ICU stay (90%), and had SAPSII with a mean of 68.4. Participants’ sociodemographics information can be seen in Table 1.
The values of muscle thickness and echogenicity were presented as means and standard deviations, shown in Table 2 and Table 3, respectively. In regards to muscle thickness, the averages of the three assessments performed on each muscle group per examiner were presented. For muscle echogenicity, the averages of three assessments performed for each muscle group by the single examiner were arranged.
In regards to muscle echogenicity, only intra-examiner reliability was performed. Excellent results were found in all analyses performed (ICC: 0.867–0.973). The results can be seen in Table 3.
In regards to muscle thickness, inter-rater and intra-rater reliability analyses were performed. For inter-examiner reliability, excellent results were found for all muscle groups (ICC: 0.778–0.942). As for the intra-examiner reliability, excellent results were found in the vast majority of analyses performed (ICC: 0.718–0.988), with only a “good” correlation in the intra-examiner reliability of examiner 1 of the diaphragm muscle (ICC: 0.718). The results can be seen in Table 4.

4. Discussion

Considering that this study aimed to analyze the inter-examiner and intra-examiner reliability of the ultrasonography assessment of muscle thickness and echogenicity of peripheral and respiratory muscles, the results demonstrated excellent inter- and intra-examiner reliability of muscle thickness assessment and intra-examiner echogenicity assessment of biceps brachii, forearm flexors groups, quadriceps femoris, tibialis anterior and diaphragm of critically ill patients.
Firstly, it is important to highlight that this study makes an important advance in scientific knowledge with the implementation of a training/qualification program for health professionals with different backgrounds. Studies have requested that training programs should be structured to enhance the reliability of US muscle assessment, as there is still no training program or standardized protocols for training health professionals and students [8,19,20,29,30]. In addition, it is also suggested that studies should report data regarding reliability and training, not considering that these are already established in the literature [20].
The sample of this study corresponds, for the most part, to males and older adults, with a high risk of mortality who used MV during hospitalization and with a long period of hospitalization, which may have influenced the results found. These factors may explain the reduced muscle thickness and the poorer muscle quality evidenced by echogenicity when compared to healthy individuals and critically ill subjects from other studies. These conditions make these assessments even more challenging, increasing the importance of the results presented in this study.
The assessment, as well as the reliability, of muscle thickness, is the most widespread US muscle analysis technique in the literature. As expected, it is clear that small variations of muscle measurements can occur due to various reasons, as shown in Table 2. For this reason, it is suggested to use the mean value of three measurements, as was done [7]. However, when ICC was performed, the excellent correlation between examiners was demonstrated, which took into consideration the absolute agreement between examiners; in other words, it considered both the agreements and systematic differences between measurements [31]. This study corroborates those studies carried out in ICUs, demonstrating excellent inter- and intra-examiner reliability of examiners with little or no experience in muscle assessment via US [17,18,32].
Considering the muscles evaluated in this study, the quadriceps femoris is the muscle most analyzed in studies [5,17,18,33], probably because it has large dimensions and well-defined anatomical conditions, a fact that can make its assessment easier [17]. This study corroborates previous studies that demonstrated excellent inter- and intra-examiner reliability in assessing the quadriceps femoris in the ICU and with examiners with different levels of experience [5,17,18,33].
In association with the quadriceps femoris, some studies also analyzed the inter- and intra-examiner reliability of the Tibialis anterior thickness assessment [18,33]. Comparing the results between experienced and inexperienced examiners with different professional backgrounds, Mayer et al. [18] found excellent inter-examiner (ICC: 0.886) and intra-examiner (ICC: 0.761–0.857) reliability for Tibialis anterior thickness assessment, as well as quadriceps femoris (ICC: 0.915 and 0.884–0.901) and biceps brachii (ICC: 0.958 and 0.924–0.962) [18].
In addition, the inter- and intra-examiner reliability of the diaphragm thickness assessment is also highly evaluated [17,34,35]. Corroborating with the findings of Sarwal et al. [17], results showed less agreement between the evaluators, despite the result being considered “excellent”, with only one intra-examiner reliability considered “good” for one of the examiners. This result can be explained by the difficulty in identifying and analyzing this muscle. The diaphragm is a thin muscle with an average of 0.33 cm in healthy individuals [36]. In the study by Sarwal et al. [17], diaphragmatic thickness averaged between 0.22 cm and 0.26 cm, and in our study, 0.20 cm and 0.22 cm, varying between examiners.
Finally, the muscles of the upper limb are less analyzed in relation to the quadriceps femoris. Our results corroborate the findings in the literature for the biceps brachii [18,32,33] and forearm flexors group [37]. There was less agreement, despite the excellent result, for interobserver reliability in the forearm flexor group. This result can be explained by the need for greater positioning adjustments due to range of motion limitations for forearm supination found in the participants, which are due to muscle atrophy and edema in the assessed region.
Regarding echogenicity, reliability studies are scarce in the literature, which does not reflect its importance for the diagnosis of acquired muscle weakness and reduced functional capacity during hospitalization and discharge from the ICU [11,12,13]. This study results demonstrated excellent intra-examiner reliability for all analyzed muscle groups, corroborating previously published results in relation to the quadriceps femoris [17,18,38,39], tibialis anterior [18], biceps brachii [18] and diaphragm [17]. There were not found studies analyzing the reliability of echogenicity in the forearm flexors group in critically ill patients.
Our study had as strengths the presentation of a training program for health professionals from different areas of training, which allows the expansion of the use of US for muscle assessment. As stated in many prior studies, minimal training is required to perform US muscle assessment, with a study giving a 20 min training for that [40]. This study established an 8 h practical training, and a “guiding document” was available during the image acquisition, including the step-by-step to be performed to acquire and analyze the US images. So, it should be clear that, after the training, these professionals were able to perform image acquisition and analysis with an excellent analysis correlation. Furthermore, this study expanded the possibilities of using a higher number and less common muscle groups through US assessment of muscle thickness and echogenicity.
As limitations, there was no inclusion of radiologists in the team, which may facilitate the handling and training for US muscle assessment. However, studies have shown excellent reliability in examiners with different levels of experience and professional training [17,18,32]. Moreover, as this research was performed in a single center as well as included small sample size, it may be difficult to generalize the results to other populations.

5. Conclusions

Considering all the aspects presented, it was possible to demonstrate excellent inter- and intra-examiner reliability in the US assessment of muscle thickness and intra-examiner muscle echogenicity of the biceps brachii, forearm flexors, quadriceps femoris, tibialis anterior and diaphragm of individuals admitted to the ICU, through a training program for inexperienced professionals with different professional backgrounds.
The protocol presented in this study, as well as its results, might support the clinical practice of ICU professionals, in addition to favoring the development of scientific studies with the application of ultrasonography in the quantitative and qualitative assessment of the peripheral and respiratory muscles. However, it is recommended that future studies should include an expert in US muscle assessment in the data collection team as a standard of comparison, as well as larger sample sizes to improve the results generalization.

Author Contributions

Conceptualization, F.D.S.B., T.C.F.C. and V.J.D.S.F.; investigation, F.D.S.B., J.L.D.S., M.E.D.A. and J.d.Á.B.A.; methodology, F.D.S.B., J.L.D.S., M.E.D.A., J.d.Á.B.A., T.C.F.C. and V.J.D.S.F.; project administration, F.D.S.B., T.C.F.C. and V.J.D.S.F.; supervision, T.C.F.C. and V.J.D.S.F.; validation, T.C.F.C. and V.J.D.S.F.; writing—original draft, F.D.S.B., J.L.D.S., M.E.D.A., J.d.Á.B.A., T.C.F.C. and V.J.D.S.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Research Ethics Committee of the Federal University of Sergipe (approval number: 5.531.925, approved on July 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available upon reasonable request from the corresponding author.

Acknowledgments

We would like to thank all participants and families who accepted to participate on our study as well as the University Hospital of Lagarto and its ICU coordinator and staff.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Martinez, B.; Alves, G.A. Muscle Assessment in Intensive Care Unit. PROFISIO 2017, 3, 51–79. [Google Scholar]
  2. Wischmeyer, P.E.; San-Millan, I. Winning the War against ICU-Acquired Weakness: New Innovations in Nutrition and Exercise Physiology. Crit. Care 2015, 19, S6. [Google Scholar] [CrossRef] [PubMed]
  3. Hodgson, C.L.; Stiller, K.; Needham, D.M.; Tipping, C.J.; Harrold, M.; Baldwin, C.E.; Bradley, S.; Berney, S.; Caruana, L.R.; Elliott, D.; et al. Expert Consensus and Recommendations on Safety Criteria for Active Mobilization of Mechanically Ventilated Critically Ill Adults. Crit. Care 2014, 18, 1–9. [Google Scholar] [CrossRef] [PubMed]
  4. Moisey, L.L.; Mourtzakis, M.; Cotton, B.A.; Premji, T.; Heyland, D.K.; Wade, C.E.; Bulger, E.; Kozar, R.A. Skeletal Muscle Predicts Ventilator-Free Days, ICU-Free Days, and Mortality in Elderly ICU Patients. Crit. Care 2013, 17, 1. [Google Scholar] [CrossRef]
  5. Tillquist, M.; Kutsogiannis, D.J.; Wischmeyer, P.E.; Kummerlen, C.; Leung, R.; Stollery, D.; Karvellas, C.J.; Preiser, J.C.; Bird, N.; Kozar, R.; et al. Bedside Ultrasound Is a Practical and Reliable Measurement Tool for Assessing Quadriceps Muscle Layer Thickness. J. Parenter. Enter. Nutr. 2014, 38, 886–890. [Google Scholar] [CrossRef]
  6. Paris, M.T.; Mourtzakis, M.; Day, A.; Leung, R.; Watharkar, S.; Kozar, R.; Earthman, C.; Kuchnia, A.; Dhaliwal, R.; Moisey, L.; et al. Validation of Bedside Ultrasound of Muscle Layer Thickness of the Quadriceps in the Critically Ill Patient (VALIDUM Study). J. Parenter. Enter. Nutr. 2017, 41, 171–180. [Google Scholar] [CrossRef]
  7. Perkisas, S.; Bastijns, S.; Baudry, S.; Bauer, J.; Beaudart, C.; Beckwée, D.; Cruz-Jentoft, A.; Gasowski, J.; Hobbelen, H.; Jager-Wittenaar, H.; et al. Application of Ultrasound for Muscle Assessment in Sarcopenia: 2020 SARCUS Update. Eur. Geriatr. Med. 2021, 12, 45–59. [Google Scholar] [CrossRef]
  8. Cruz-Jentoft, A.J.; Bahat, G.; Bauer, J.; Boirie, Y.; Bruyère, O.; Cederholm, T.; Cooper, C.; Landi, F.; Rolland, Y.; Sayer, A.A.; et al. Sarcopenia: Revised European Consensus on Definition and Diagnosis. Age Ageing 2019, 48, 16–31. [Google Scholar] [CrossRef]
  9. Zhang, W.; Wu, J.; Gu, Q.; Gu, Y.; Zhao, Y.; Ge, X.; Sun, X.; Lian, J.; Zeng, Q. Changes in Muscle Ultrasound for the Diagnosis of Intensive Care Unit Acquired Weakness in Critically Ill Patients. Sci. Rep. 2021, 11, 1–11. [Google Scholar] [CrossRef]
  10. Puthucheary, Z.A.; Phadke, R.; Rawal, J.; McPhail, M.J.W.; Sidhu, P.S.; Rowlerson, A.; Moxham, J.; Harridge, S.; Hart, N.; Montgomery, H.E. Qualitative Ultrasound in Acute Critical Illness Muscle Wasting. Crit. Care Med. 2015, 43, 1603–1611. [Google Scholar] [CrossRef]
  11. Parry, S.M.; El-Ansary, D.; Cartwright, M.S.; Sarwal, A.; Berney, S.; Koopman, R.; Annoni, R.; Puthucheary, Z.; Gordon, I.R.; Morris, P.E.; et al. Ultrasonography in the Intensive Care Setting Can Be Used to Detect Changes in the Quality and Quantity of Muscle and Is Related to Muscle Strength and Function. J. Crit. Care 2015, 30, 1151.e9–1151.e14. [Google Scholar] [CrossRef]
  12. Hayes, K.; Holland, A.E.; Pellegrino, V.A.; Mathur, S.; Hodgson, C.L. Acute Skeletal Muscle Wasting and Relation to Physical Function in Patients Requiring Extracorporeal Membrane Oxygenation (ECMO). J. Crit. Care 2018, 48, 1–8. [Google Scholar] [CrossRef]
  13. Mayer, K.P.; Thompson Bastin, M.L.; Montgomery-Yates, A.A.; Pastva, A.M.; Dupont-Versteegden, E.E.; Parry, S.M.; Morris, P.E. Acute Skeletal Muscle Wasting and Dysfunction Predict Physical Disability at Hospital Discharge in Patients with Critical Illness. Crit. Care 2020, 24, 1–12. [Google Scholar] [CrossRef]
  14. Palakshappa, J.A.; Reilly, J.P.; Schweickert, W.D.; Anderson, B.J.; Khoury, V.; Shashaty, M.G.; Fitzgerald, D.; Forker, C.; Butler, K.; Ittner, C.A.; et al. Quantitative Peripheral Muscle Ultrasound in Sepsis: Muscle Area Superior to Thickness. J. Crit. Care 2018, 47, 324–330. [Google Scholar] [CrossRef]
  15. Jaber, S.; Petrof, B.J.; Jung, B.; Chanques, G.; Berthet, J.P.; Rabuel, C.; Bouyabrine, H.; Courouble, P.; Koechlin-Ramonatxo, C.; Sebbane, M.; et al. Rapidly Progressive Diaphragmatic Weakness and Injury during Mechanical Ventilation in Humans. Am. J. Respir. Crit. Care Med. 2011, 183, 364–371. [Google Scholar] [CrossRef]
  16. Mateos-angulo, A.; Galán-mercant, A.; Cuesta-vargas, A.I. Muscle Thickness and Echo Intensity by Ultrasonography and Cognitive and Physical Dimensions in Older Adults. Diagnostics 2021, 11, 1471. [Google Scholar] [CrossRef]
  17. Sarwal, A.; Parry, S.M.; Berry, M.J.; Hsu, F.C.; Lewis, M.T.; Justus, N.W.; Morris, P.E.; Denehy, L.; Berney, S.; Dhar, S.; et al. Interobserver Reliability of Quantitative Muscle Sonographic Analysis in the Critically Ill Population. J. Ultrasound Med. 2015, 34, 1191–1200. [Google Scholar] [CrossRef]
  18. Mayer, K.P.; Dhar, S.; Cassity, E.; Denham, A.; England, J.; Morris, P.E.; Dupont-versteegden, E.E. Interrater Reliability of Muscle Ultrasonography Image Acquisition by Physical Therapists in Patients Who Have or Who Survived Critical Illness. Phys. Ther. 2020, 100, 1701–1711. [Google Scholar] [CrossRef] [PubMed]
  19. Formenti, P.; Umbrello, M.; Coppola, S.; Froio, S.; Chiumello, D. Clinical Review: Peripheral Muscular Ultrasound in the ICU. Ann. Intensive Care 2019, 9. [Google Scholar] [CrossRef]
  20. Mourtzakis, M.; Parry, S.; Connolly, B.; Puthucheary, Z. Skeletal Muscle Ultrasound in Critical Care: A Tool in Need of Translation. Ann. Am. Thorac. Soc. 2017, 14, 1495–1503. [Google Scholar] [CrossRef]
  21. Casey, P.; Alasmar, M.; McLaughlin, J.; Ang, Y.; McPhee, J.; Heire, P.; Sultan, J. The Current Use of Ultrasound to Measure Skeletal Muscle and Its Ability to Predict Clinical Outcomes: A Systematic Review. J. Cachexia. Sarcopenia Muscle 2022, 13, 2298–2309. [Google Scholar] [CrossRef] [PubMed]
  22. Kottner, J.; Audigé, L.; Brorson, S.; Donner, A.; Gajewski, B.J.; Hróbjartsson, A.; Roberts, C.; Shoukri, M.; Streiner, D.L. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Were Proposed. J. Clin. Epidemiol. 2011, 64, 96–106. [Google Scholar] [CrossRef] [PubMed]
  23. Walter, S.D.; Eliasziw, M.; Donner, A. Sample Size and Optimal Designs for Reliability Studies. Stat. Med. 1998, 17, 101–110. [Google Scholar] [CrossRef]
  24. Schepens, T.; Goligher, E.C. Using Ultrasound to Prevent Diaphragm Dysfunction. ICU Manag. Pract. 2018, 18. [Google Scholar]
  25. Arts, I.M.P.; Pillen, S.; Schelhaas, H.J.; Overeem, S.; Zwarts, M.J. Normal Values for Quantitative Muscle Ultrasonography in Adults. Muscle Nerve 2010, 41, 32–41. [Google Scholar] [CrossRef]
  26. Gruther, W.; Benesch, T.; Zorn, C.; Paternostro-Sluga, T.; Quittan, M.; Fialka-Moser, V.; Spiss, C.; Kainberger, F.; Crevenna, R. Muscle Wasting in Intensive Care Patients: Ultrasound Observation of the M. Quadriceps Femoris Muscle Layer. J. Rehabil. Med. 2008, 40, 185–189. [Google Scholar] [CrossRef]
  27. Cartwright, M.S.; Kwayisi, G.; Griffin, L.P.; Sarwal, A.; Walker, F.O.; Harris, J.M.; Berry, M.J.; Chahal, P.S.; Morris, P.E. Quantitative Neuromuscular Ultrasound in the Intensive Care Unit. Muscle Nerve 2013, 47, 255–259. [Google Scholar] [CrossRef]
  28. Cicchetti, D.V. Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. Psychol. Assess. 1994, 6, 284–290. [Google Scholar] [CrossRef]
  29. Nagae, M.; Umegaki, H.; Yoshiko, A.; Fujita, K. Muscle Ultrasound and Its Application to Point-of-Care Ultrasonography: A Narrative Review. Ann. Med. 2023, 55, 190–197. [Google Scholar] [CrossRef]
  30. Zhao, R.; Li, X.; Jiang, Y.; Su, N.; Li, J.; Kang, L.; Zhang, Y.; Yang, M. Evaluation of Appendicular Muscle Mass in Sarcopenia in Older Adults Using Ultrasonography: A Systematic Review and Meta-Analysis. Gerontology 2022, 68, 1174–1198. [Google Scholar] [CrossRef]
  31. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed]
  32. Hadda, V.; Kumar, R.; Hussain, T.; Khan, M.A.; Madan, K.; Mohan, A.; Khilnani, G.C.; Guleria, R. Reliability of Ultrasonographic Arm Muscle Thickness Measurement by Various Levels of Health Care Providers in ICU. Clin. Nutr. ESPEN 2018, 24, 78–81. [Google Scholar] [CrossRef] [PubMed]
  33. Baston, C.M.; Gellhorn, A.C.; Hough, C.L.; Bunnell, A.E. Interrater Reliability of Quantitative Ultrasound Measures of Muscle in Critically Ill Patients. PMR 2022, 14, 183–189. [Google Scholar] [CrossRef] [PubMed]
  34. Dhungana, A.; Khilnani, G.; Hadda, V.; Guleria, R. Reproducibility of Diaphragm Thickness Measurements by Ultrasonography in Patients on Mechanical Ventilation. World J. Crit. Care Med. 2017, 6, 185–189. [Google Scholar] [CrossRef]
  35. Hadda, V.; Kumar, R.; Madan, K.; Khan, M.; Mohan, A.; Khilnani, G.; Guleria, R. Intraobserver Variability and Reliability of Diaphragm Thickness Measurement on Ultrasonography by Critical Care Physician Among Patients with Sepsis. J. Assoc. Chest Physicians 2019, 7, 18. [Google Scholar] [CrossRef]
  36. Boon, A.J.; Harper, C.J.; Ghahfarokhi, L.S.; Strommen, J.A.; Watson, J.C.; Sorenson, E.J. Two-Dimensional Ultrasound Imaging of the Diaphragm: Quantitative Values in Normal Subjects. Muscle Nerve 2013, 47, 884–889. [Google Scholar] [CrossRef]
  37. Baldwin, C.E.; Paratz, J.D.; Bersten, A.D. Diaphragm and Peripheral Muscle Thickness on Ultrasound: Intra-Rater Reliability and Variability of a Methodology Using Non-Standard Recumbent Positions. Respirology 2011, 16, 1136–1143. [Google Scholar] [CrossRef]
  38. Vieira, L.; Rocha, L.P.B.; Mathur, S.; Santana, L.; de Melo, P.F.; da Silva, V.Z.M.; Durigan, J.L.Q.; Cipriano, G. Reliability of Skeletal Muscle Ultrasound in Critically Ill Trauma Patients. Rev. Bras. Ter. Intensiv. 2019, 31, 464–473. [Google Scholar] [CrossRef]
  39. Abiko, T.; Ohmae, K.; Murata, S.; Shiraiwa, K.; Horie, J. Reliability of Muscle Thickness and Echo Intensity Measurements of the Quadriceps: A Novice Examiner. J. Bodyw. Mov. Ther. 2022, 31, 164–168. [Google Scholar] [CrossRef]
  40. Zaidman, C.M.; Wu, J.S.; Wilder, S.; Darras, B.T.; Rutkove, S.B. Minimal Training Is Required to Reliably Perform Quantitative Ultrasound of Muscle. Muscle Nerve 2014, 50, 124. [Google Scholar] [CrossRef]
Ijerph 20 05636 g001 550
Figure 1. US transducer positioning during assessment. Source: authors. (A): Biceps Brachii; (B): Tibialis anterior; (C): Quadriceps femoris; (D): Forearm flexor groups; (E): Diaphragm.
Figure 1. US transducer positioning during assessment. Source: authors. (A): Biceps Brachii; (B): Tibialis anterior; (C): Quadriceps femoris; (D): Forearm flexor groups; (E): Diaphragm.
Ijerph 20 05636 g001
Ijerph 20 05636 g002 550
Figure 2. US image demonstrating various measurements of muscle thickness and echogenicity. Source: authors. (A) Quadriceps femoris US image with thickness measurement and histogram; (B) Tibialis anterior US image with thickness measurement; (C) Biceps Brachii US image with thickness measurement; (D) Forearm flexor groups US image with thickness measurement; (E) Diaphragm US image with thickness measurement.
Figure 2. US image demonstrating various measurements of muscle thickness and echogenicity. Source: authors. (A) Quadriceps femoris US image with thickness measurement and histogram; (B) Tibialis anterior US image with thickness measurement; (C) Biceps Brachii US image with thickness measurement; (D) Forearm flexor groups US image with thickness measurement; (E) Diaphragm US image with thickness measurement.
Ijerph 20 05636 g002
Table
Table 1. Participants’ Sociodemographic and clinical characteristics.
Table 1. Participants’ Sociodemographic and clinical characteristics.
CharacteristicsResults
Age in years (Mean ± SD)62 (±18.92)
Sex
Male (%)60%
Female (%)40%
Condition for admission to the ICU
Clinical (%)70%
Surgical (%)30%
Days of ICU stay at the time of assessment (Mean ± SD)9.10 (±6.14)
Use of mechanical ventilation during ICU stay
Yes (%)90%
No (%)10%
SAPSII (Mean ± SD)68.40 (±16.10)
Table
Table 2. Mean and standard deviation of muscle thickness per examiner.
Table 2. Mean and standard deviation of muscle thickness per examiner.
ExaminersMean (±SD) in cm
Biceps brachiiExaminer 12.47 (±0.70)
Examiner 21.98 (±0.52)
Examiner 32.46 (±0.52)
Examiner 42.59 (±0.61)
Forearm flexor groupExaminer 12.46 (±0.47)
Examiner 22.01 (±0.34)
Examiner 32.53 (±0.52)
Examiner 42.32 (±0.40)
Quadriceps femorisExaminer 12.64 (±0.64)
Examiner 22.68 (±0.83)
Examiner 33.06 (±0.87)
Examiner 42.73 (±0.70)
Tibialis anteriorExaminer 11.95 (±0.29)
Examiner 21.92 (±0.28)
Examiner 32.02 (±0.28)
Examiner 41.96 (±0.24)
DiaphragmExaminer 10.20 (±0.06)
Examiner 20.21 (±0.08)
Examiner 30.22 (±0.07)
Examiner 40.21 (±0.04)
Table
Table 3. Mean, standard deviation and intra-examiner reliability of muscle echogenicity.
Table 3. Mean, standard deviation and intra-examiner reliability of muscle echogenicity.
Biceps BrachiiForearm Flexor GroupQuadriceps
Femoris		Tibialis AnteriorDiaphragm
Mean (±SD) in cm119.23 (±27.15)131.30 (±27.56)124.65 (±28.37)137.17 (±22.71)124.43 (±24.83)
ICC0.9520.9730.9700.9540.867
CorrelationExcellentExcellentExcellentExcellentExcellent
Table
Table 4. Intra-examiner and inter-examiner reliability of muscle thickness according to muscle group.
Table 4. Intra-examiner and inter-examiner reliability of muscle thickness according to muscle group.
MusclesIntra-Examiner ReliabilityInter-Examiner Reliability
ExaminersResultsCorrelationResultsCorrelation
Biceps brachiiExaminer 10.982Excellent0.894Excellent
Examiner 20.951Excellent
Examiner 30.977Excellent
Examiner 40.988Excellent
Forearm flexor group Examiner 10.972Excellent0.789Excellent
Examiner 20.918Excellent
Examiner 30.942Excellent
Examiner 40.922Excellent
Quadriceps femorisExaminer 10.950Excellent0.917Excellent
Examiner 20.984Excellent
Examiner 30.972Excellent
Examiner 40.960Excellent
Tibialis anteriorExaminer 10.924Excellent0.942Excellent
Examiner 20.913Excellent
Examiner 30.930Excellent
Examiner 40.902Excellent
DiaphragmExaminer 10.718Good0.778Excellent
Examiner 20.972Excellent
Examiner 30.931Excellent
Examiner 40.798Excellent
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Barbosa, F.D.S.; Dos Santos, J.L.; Alves, M.E.D.; Alves, J.d.Á.B.; Cerqueira, T.C.F.; De Santana Filho, V.J. Inter-Examiner and Intra-Examiner Reliability of Quantitative and Qualitative Ultrasonography Assessment of Peripheral and Respiratory Muscles in Critically Ill Patients. Int. J. Environ. Res. Public Health 2023, 20, 5636. https://doi.org/10.3390/ijerph20095636

AMA Style

Barbosa FDS, Dos Santos JL, Alves MED, Alves JdÁB, Cerqueira TCF, De Santana Filho VJ. Inter-Examiner and Intra-Examiner Reliability of Quantitative and Qualitative Ultrasonography Assessment of Peripheral and Respiratory Muscles in Critically Ill Patients. International Journal of Environmental Research and Public Health. 2023; 20(9):5636. https://doi.org/10.3390/ijerph20095636

Chicago/Turabian Style

Barbosa, Felipe Douglas Silva, José Lucas Dos Santos, Maria Emilia Dantas Alves, Juliana de Ávila Barreto Alves, Telma Cristina Fontes Cerqueira, and Valter Joviniano De Santana Filho. 2023. "Inter-Examiner and Intra-Examiner Reliability of Quantitative and Qualitative Ultrasonography Assessment of Peripheral and Respiratory Muscles in Critically Ill Patients" International Journal of Environmental Research and Public Health 20, no. 9: 5636. https://doi.org/10.3390/ijerph20095636

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop