Next Article in Journal
A Randomized Controlled Trial of Vertebral Body Decompression Procedure Versus Conservative Treatment for Painful Vertebral Compression Fracture
Previous Article in Journal
Prevalence Rates of Arterial Hypertension According to the Threshold Criteria of 140/90 or 130/80 mmHg and Associated Cardiometabolic and Renal Factors: SIMETAP-HTN Study
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Medicina
Volume 59
Issue 10
10.3390/medicina59101847
medicina-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Mechanical Restraint in Inpatient Psychiatric Unit: Prevalence and Associated Clinical Variables

by
Andrea Aguglia
1,2,
Giovanni Pietro Corsini
2,
Isabella Berardelli
3,
Andrea Berti
1,
Benedetta Conio
2,
Nicolò Garbarino
1,
Giovanni Battista Gnecco
1,
Caterina Magni
1,
Enrico Venturini
1,
Alessandra Costanza
4,5,6,*,
Andrea Amerio
1,2,
Mario Amore
1 and
Gianluca Serafini
1,2
1
Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, Section of Psychiatry, University of Genoa, 16132 Genoa, Italy
2
Istituto di Ricovero e Cura a Carattere Scientifico (IRCCS), Ospedale Policlinico San Martino, 16132 Genoa, Italy
3
Department of Neurosciences, Mental Health and Sensory Organs, Faculty of Medicine and Psychology, Suicide Prevention Centre, Sant’Andrea Hospital, Sapienza University of Rome, 00189 Rome, Italy
4
Department of Psychiatry, Adult Psychiatry Service, University Hospitals of Geneva (HUG), 1207 Geneva, Switzerland
5
Department of Psychiatry, Faculty of Biomedical Sciences, University of Italian Switzerland (USI), 6900 Lugano, Switzerland
6
Department of Psychiatry, Faculty of Medicine, University of Geneva (UNIGE), 1211 Geneva, Switzerland
*
Author to whom correspondence should be addressed.
Medicina 2023, 59(10), 1847; https://doi.org/10.3390/medicina59101847
Submission received: 30 August 2023 / Revised: 9 October 2023 / Accepted: 11 October 2023 / Published: 17 October 2023
(This article belongs to the Section Psychiatry)
Versions Notes

Abstract

:
Background and Objectives: mechanical restraint (MR) is a controversial issue in emergency psychiatry and should be better studied to implement other alternative therapeutic interventions. The aim of this study was to estimate the prevalence of MR in an Italian psychiatric unit and identify the sociodemographic and clinical characteristics as well as the pharmacological pattern associated with MR. Materials and Methods: all subjects (N = 799) consecutively admitted to an Italian psychiatric inpatient unit were recruited. Several sociodemographic and clinical characteristics were recorded. Results: The prevalence of MR was 14.1%. Males, a younger age, and a single and migrant status were associated with the MR phenomenon. MR was more prevalent in patients affected by other diagnoses and comorbid illicit substance use, in patients with aggressive behaviors, and those that were involuntary admitted, leading significantly to hospitalization over 21 days. Furthermore, the patients that underwent MR were taking a lower number of psychiatric medications. Conclusions: Unfortunately, MR is still used in emergency psychiatry. Future research should focus on the dynamics of MR development in psychiatry, specifically considering ward- and staff-related factors that could help identify a more precise prevention and alternative intervention strategies.

1. Introduction

Restraint is a controversial theme of worldwide relevance in psychiatry. It is defined as a limitation in an individual’s freedom of movement, being referred more precisely as a coercive act. The Italian National Bioethics Committee has described restraint as a “mechanical or pharmacological limitation of an individual’s possibility of autonomous movement” [1].
Several types of restraint can be identified, including environmental restraint, defined as a practice or intervention that restricts a patient’s free movement into the psychiatric ward [2]; chemical restraint, consisting in the administration of medication to manage patients’ behavior [3]; and psychological restraint, defined as any decision or program designed to retain a patient’s privileges and participation in activities [4]. Moreover, physical restraint is divided into manual, mechanical, and physical-psychological (e.g., healthcare personnel psychologically oblige the patient to take the pharmacological treatment) [5]. Mechanical restraint (MR) includes any mechanical device (e.g., the historical straightjacket, the belt with wrist-cuffs, wrist and ankle cuffs tied to the bed, bed-side bars) which, either directly applied to the patient’s body or adjacent to him/her, is hardly removable and aims to prevent, limit, or control his/her body movements. In psychiatry, MR is considered complementary and dependent from manual restraint; the latter is usually employed to implement the former, although it may be used alone as in the case of the forced administration of any medication [6].
Unfortunately, MR still represents one of the greatest concerns in psychiatric clinical practice for each clinician, being considered an obsolete, potentially dangerous, and non-therapeutic approach to treat agitated, aggressive, or violent patients. Restraint, in particular MR, should be used only in cases of severe, not otherwise manageable, emergency situations, when all de-escalation strategies have failed. In Italy, according to the judgment of the Court of Cassation nº 50497, MR has been legitimized to prevent harm to the patient or to others, identifying extreme situations, so called a “state of necessity”, that requires a statement of guardianship from professionals (art.54 and 40 of the Criminal Code, respectively) [7]. Moreover, restraint must be used when unavoidable, as safely as possible, and in a manner that respects the patient’s dignity [8]. The prolonged and inappropriate use of MR, due to its coercive nature, could lead to negative consequences, such as potential permanent damages or death [9]. A dramatic example offered from contemporary chronicle concerns the “Mastrogiovanni’s case”, a patient who died following 84 h of MR [10]. This traumatic event is a very rare phenomenon; however, permanent lesions (of the wrist, legs, nerves), respiratory distress, venous thromboembolism, deep vein thrombosis, especially if the MR is prolonged, could frequently occur. Furthermore, patients report decreased self-esteem and empowerment, strong feelings of humiliation, as well as loss of trust in healthcare personnel [11,12].
The prevalence of MR could vary greatly across different countries, ranging from 0.031 restraint events per day per 1 million in New Zealand to 62.3 restraint events per day per 1 million people in Japan (ages 20–64) [13,14]. Also in Europe, the pattern of coercive psychiatric treatment varies widely between countries with regard to its frequency, type, and legal regulations as well as the rates, duration, and methods of restraint [4,15]. The prevalence of MR in Italy ranges from 3.8% to 20% [16,17,18,19].
Patients with acute symptoms are at the highest risk of being secluded and restrained [20]. Violent behavior or threatening violence is a common indication for the use of seclusion/restraint [21]. Furthermore, above the various psychiatric diagnosis, psychotic symptoms are frequently associated with MR [22].
No-restraint psychiatric wards, called “Club SPDC no-restraint”, deserves mention in Italy, where the use of restraint is strictly forbidden and clinicians use noncoercive methods. Nowadays, only 5% of Italian psychiatric wards are members of the aforementioned type of psychiatric unit [23], while in restraint-using psychiatric wards the common goal is the decrease in mechanical restraint use [17]. This low percentage could be explained as follows: several patients with secondary psychiatric manifestations due to a medical condition, such as major neurocognitive disorders or substances use disorders or delirium, are often admitted to psychiatric units. Another potential explanation is the absence of seclusion in the Italian legislation. Lastly, other related factors involved in the MR phenomenon, including the mental health care system, structure of the psychiatric ward and staff are still undervalued.
Based on the hypothesis that even if restrictive measures in psychiatric clinical practice could be necessary, the prolonged and inappropriate use of MR could lead to negative consequences for the patient and patients’ experiences of restraint could be negative, harmful, or traumatic [24,25], the aim of this study was to estimate the prevalence of MR in an Italian psychiatric unit. Furthermore, a second aim of the present study was to identify the main sociodemographic and clinical characteristics and pharmacological pattern associated with this phenomenon in daily clinical practice to better understand how to minimize the use of MR and organize other specific interventions. The null hypothesis should be the absence of MR in the inpatient psychiatric setting.

2. Materials and Methods

2.1. Sample

A cross-sectional study has been conducted including all subjects (N = 799) consecutively admitted to the Section of Psychiatry, Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DiNOGMI), University of Genoa (Italy) over three years (2019–2021).
A detailed explanation of the study design was provided and all participants provided a written informed consent for collecting sociodemographic and clinical information, used for research purposes in aggregate mode, anonymously. The study was conducted according to the guidelines of the Declaration of Helsinki [26] and the study design was reviewed and approved by the local ethics committee.

2.2. Clinical Assessment

A semi-structured interview, used in a previous published paper [27], was administered to all subjects to collect basic data, as follows: sociodemographic variables (age, gender, marital and occupational status, educational level, living situation, type of discharge, and migrant status), clinical characteristics (primary psychiatric diagnosis, age at onset, duration of illness, non-suicidal self-injuries, first hospitalization, length of current hospitalization in days, long hospitalization (defined as a time over 21 days), type of admission (voluntary or involuntary), need of mechanical restraint, presence of psychiatric and/or medical comorbidity, positive family history of psychiatric disorders). All patients were diagnosed according to the Diagnostic and Statistical Manual for Mental Disorders, fifth edition (DSM-5) [28]. The diagnoses at discharge were divided into the following subgroups: schizophrenia and related disorders, bipolar and related disorders, depressive disorders, personality disorders, and others (including the remaining psychiatric and non-psychiatric disorders such as social admission, mental retardation, or major neurocognitive disorders) [27].
Also, suicidal behaviors (including suicidal ideation, current and lifetime suicide attempt) were considered. Trained psychiatrists assessed suicidal ideation and behavior, according to the definition adopted by Posner et al. [29,30,31] in the Columbia-Suicide Severity Rating Scale (C-SSRS); thus, suicidal ideation included thoughts about a wish to be dead up to active suicide ideation with a specific plan and intent. Furthermore, a suicide attempt was defined as a nonfatal, self-directed, potentially injurious behavior with an intent to die that may or may not have resulted in injury [32,33]. Furthermore, aggressive and violent behaviors were investigated. Direct aggressive behavior is characterized by (a) physical or verbal behavior, often harmful, usually with the intention of inflicting damage or other unpleasantness toward an individual or object, occurring either reactively or without provocation; (b) violent behaviors such as the use of physical force to injure, abuse, damage, or destroy. The World Health Organization (WHO) provides a less conventional definition of violence as follows: “the intentional use of physical force or power, threatened or actual, against oneself, another person, or against a group or community, which either results in or has a high likelihood of resulting in injury, death, psychological harm, maldevelopment, or deprivation”. Lastly, presence of at least one illicit substance (e.g., alcohol, cannabis, cocaine, amphetamines, and heroin) and pharmacological treatment at discharge (e.g., number of medications, antipsychotics, oral or long-acting injection antipsychotics, first or second generation antipsychotics, antidepressants, mood stabilizers, benzodiazepines) were assessed.

2.3. Statistical Analysis

The statistical analysis was carried out with the IBM Statistical Package for Social Sciences (SPSS) version 25.0 (SPSS Inc., Chicago, IL, USA) and the value of statistical significance was set at p < 0.05. All patients’ characteristics were reported as mean and standard deviation (SD) or frequency and percentage for continuous and categorical variables, respectively. The sample was divided into two subgroups, according to the presence of at least one episode of MR during the index hospitalization in the psychiatric unit. The Kolmogorov–Smirnov test was used to confirm whether all variables in the sample followed a normal distribution. Therefore, the following statistical analyses were performed for the bivariate comparisons: continuous variables were compared using the unpaired Student’s t-test for two-class comparisons, categorical variables using the Pearson’s chi-square in contingency tables. Cohen’s d, Cramer’s v, and phi coefficients were reported as measures of effect sizes. Small effect sizes were indicated by d ≥ 0.2 or v|phi ≥ 0.1, medium effect sizes by d ≥ 0.5 or v|phi ≥ 0.3, and large effect sizes by d ≥ 0.8 or v|phi ≥ 0.5.
Finally, a logistic regression analysis was performed using as the dependent variable the MR and including sequentially sociodemographic, clinical, and other characteristics potentially associated with “MR subgroup”.

3. Results

The whole sample included 799 patients, of which 14.1% (N = 113) were physically restrained during hospitalization. The mean (±SD) current age was 44.35 (±16.55) and just over half were males (N = 453, 56.7%). About two thirds of patients (N = 523, 65.5%) were single and one out of four (N = 199, 24.9%) were working. One hundred and five (13%) were migrants.
When the two subgroups were compared, the patients who underwent MR were more likely to be male (65.5% vs. 55.2% p = 0.042), younger (41.11 ± 17.24 vs. 44.88 ± 16.38, p = 0.024), and single (76.1% vs. 63.7%, p = 0.020) than patients who did not undergo MR. Finally, MR was more associated with migrant status (22.1% vs. 11.7%, p = 0.002). See Table 1 for all characteristics and statistical comparisons.
Mechanical restraint was more prevalent in the patients with other diagnoses (29.2% vs. 17.6%, p = 0.006), in patients with aggressive behaviors (83.2% vs. 17.2%, p < 0.001), and in patients admitted involuntary (79.6% vs. 20.8%, p < 0.001), considering the clinical variables. Furthermore, the status of MR was significantly associated with hospitalization over 21 days (15.9% vs. 9.8%, p = 0.049). All statistical comparisons are summarized in Table 2.
Furthermore, the presence of at least one illicit substance was more prevalent among the mechanically restrained patients (53.1% vs. 39.5%, p = 0.007), particularly alcohol (38.9% vs. 28.6%, p = 0.026) and cannabis (28.3% vs. 15.7%, p = 0.001). The other statistical comparisons are summarized in Table 3.
Regarding pharmacological treatment at discharge, patients that underwent MR were taking a lower number of medications (2.66 ± 1.39 vs. 3.21 ± 1.48, p < 0.001). Furthermore, a significantly higher prescription of antidepressants (26.7% vs. 8.8%, p < 0.001) and lithium (24.1% vs. 14.1%, p = 0.020) was in the non-mechanical restrained patients. The other statistical comparisons are displayed in Table 4.
When the logistic regression was performed, aggressive behaviors (OR: 15.124, 95% CI 8.277–27.635, p < 0.001), involuntary admissions (OR: 8.662, 95% CI 4.845–15.485, p < 0.001), long hospitalization (OR: 3.319, CI 95% 1.498–7.353, p = 0.003) and lower number of medications at discharge (OR: 0.800, 95% CI 0.659–0.971, p = 0.024) remained significantly associated with the presence of at least one episode of MR in the patients admitted in an emergency psychiatric unit (R2 Nagelkerke = 0.523), as shown in Table 5.

4. Discussion

Our study aimed to estimate the prevalence of MR in an emergency psychiatric unit and identify the potential sociodemographic and clinical variables empirically associated with the increased use of MR. Nowadays, especially in Italy, it is an extremely debated topic that should be discussed broadly to implement knowledge and understand how limit the use of MR, adopting other operational and clinical strategies or structural environmental changes in the inpatient psychiatric setting [34].
In our sample, the prevalence of MR was 14.1%, in accordance with other Italian studies on this topic [17,18,19].
Being male, younger, single, and a migrant resulted in being significantly associated with at least one episode of MR during the index episode (hospitalization in a psychiatric unit), although these sociodemographic characteristics have been not confirmed with the regression analysis. Our findings are in accordance with data in the literature [35,36,37,38], especially in the Italian context [16,39]. Regarding the association with migrant status, MR could be more used for several reasons including, for example, not only the language barrier, cultural and ethnic differences leading to difficulties in communication (i.e., frequent misunderstandings) between migrants and staff but also different and more severe clinical psychiatric manifestations with poorer insight and pharmacological adherence that needs to be treated [18,40,41].
From the regression analysis, four variables appeared to be independently associated with MR; the strongest variable associated was aggressive behaviors, followed by involuntary admission, long hospitalization, and a lower number of medicaments at discharge.
Aggressive behaviors are quite frequent in the inpatient psychiatric setting and, recently, the number of aggressions has increased. In a systematic review, the weighted mean prevalence of aggressive behaviors was 54% (ranging from 7.5% to 75.9% between studies) [42]. It could be explained by a combination of several factors, differentiated and grouped, as follows: (a) mental health care system factors (regional and hospital policy, ward rules, attitude towards patients, cultural factors); (b) ward factors, including a higher bed occupancy, busy places, overcrowding, day and evening shifts, unsafe and restrictive environment with a lack of structure and inconsistent execution of policy, smoking, a lack of privacy for patients, personal space and freedom to move around, overstimulation, a feeling of physical confinement, inconsistent following of the rules, locked doors without any social interaction; (c) staff factors, including male health care workers, unqualified or more temporary staff, overwork or perceived high workload, job strain or dissatisfaction with leadership, tiredness, lack of good introduction of the nurse, poor collaboration between nurses, burn-out, low grade of communication and de-escalation skills, poor attitudes towards aggression, higher clinician stress level [5,43,44]; (d) patient factors, including a primary diagnosis of a psychotic or bipolar disorder (especially a manic episode) with hostility and impulsivity, involuntary admission due to a lack of insight and the presence of more severe symptomatology but also the loss autonomy and freedom which urges the patient to resist, leading to an aggressive behavior, current illicit substance use, the presence of lifetime aggressive behaviors, younger age, interaction with patients or staff characterized by poor communication, lack of empathy or respect, lack of shared decision making. Also, external stressors are to be considered, including financial worries, having been in foster care as a child, having interpersonal problems, divorced parents or positive first-degree familial psychiatric history, being a migrant [42]. Unfortunately, MR could be the most frequent response to manage an aggressive behavior in psychiatric and non-psychiatric wards, suggesting a lack of skills in managing violence and dangerous situations without any cross-national harmonization in terms of development of best practice recommendations in the field of coercive measures in psychiatry [10]. As a matter of fact, as reported by the EUNOMIA study, the frequency of coercive measures used (i.e., MR) in individual sites showed a high variation across sites [4]. Therefore, it is time for national and international guidelines on MR in psychiatric patients [10].
Recently, de-escalation techniques to manage aggressive behaviors have been provided: always respect the personal space of the patient while maintaining a protected position with the possibility to escape, do not be provoking or offensive, create verbal contact and do not often make eye contact, be concise and communicate clearly, recognize patients’ needs and feelings, pay attention to what the patient is saying without lying to them, agree or agree to disagree with the patient’s thoughts and sensations, lay down the law and set clear and definite confines, propose sincerely the patient’s choices and try to gain their trust, debrief the subject and the staff after the de-escalation [12]. Furthermore, in terms of diagnosis and severe psychopathological conditions, aggressive behaviors are often detectable and MR could be limited and prevented with the use of adequate pharmacological treatment, especially because the first three days are related to the highest prevalence rates of aggressive behaviors [45].
It is also necessary that patients with specific clinical conditions, including substance intoxication or withdrawal, major neurocognitive disorders, social situations, and altered behaviors in neurodevelopment disorders should not be hospitalized in the psychiatric setting. As a matter of fact, in our sample, the “other diagnoses” and presence of at least one illicit substance use (especially alcohol and cannabinoid), were significantly associated with MR contrary to data from the literature [16,37,39,43]. Furthermore, a recent systematic review reported specifically more MR in psychotic disorders (ranging from 26.8% to 82.3%), affective disorders, in particular during a manic episode (varying from 12% to 53.6%), substance use (ranging from 4.9% to 32%), and personality disorders (varying from 1.9% to 11%) [22]. Lastly, a history of aggressive behaviors is considered the most significant risk factor of repeating aggressiveness and, consequently, be treated with MR [46]. It is well-known that these factors are often associated with involuntary admissions that, in our study, resulted in being significantly associated with MR. This could be explained by some predisposing characteristics such as a more severe symptomatology, poor insight, more probability to show specific clinical dimensions such as hostility, impulsivity, aggressiveness, and violence [16,17,39,46,47,48,49], and the association between MR and long hospitalization is quite intuitive. To conclude, health care workers should keep in mind that the several mentioned risk factors are dynamic and interactive in the current inpatient psychiatric setting whereas others are stable and unchangeable, such as previous aggressive behaviors or hospitalization. Therefore, limiting the use of MR is strongly recommended not only for the restriction of freedom and human rights but also for the negative potential consequences, including physical injuries, symptom worsening, a feeling of humiliation, loss of trust in staff, reduced adherence to treatment, decreased self-esteem, permanent lesions, and death due to venous thromboembolism, pulmonary embolism, stress cardiomyopathy, or drug-induced liver injury. It is also necessary to underline that there are situations in which it cannot be avoided [8].
Finally, patients with at least one episode of MR during psychiatric hospitalization were discharged with a lower number of medications. To the best of our knowledge, no studies investigated this significant pharmacological aspect related to MR. This finding could be explained by the fact that the management of aggressive behaviors or severe agitation involves only sedative drugs with a faster action, avoiding the prescription of different overlapping pharmacological classes that induce a polypharmacological effect not only with a higher probability of pharmacological interactions and side effects but also a negative impact on the clinical course of illness [50,51]. It could also depend on the primary psychiatric diagnosis: for example, patients with alcohol intoxication show psychomotor agitation, oppositive behavior and, after de-escalation techniques, MR remains the only potential intervention. Other possibilities are patients affected by psychotic dementia or a major neurocognitive disorder.
The present study has the following limitations. First, the study’s cross-sectional design does not allow for the testing of cause and effect, only providing measures of association. Second, this study was limited to patients admitted to one Italian university hospital (located in the northwestern region of Italy) and the findings could not be generalizable to non-Italian patients, other healthcare systems, or different geopolitical socioeconomic regions. Third, several contributing factors such as those that are staff- and ward-related, that could affect the decision of whether to use MR, have not been considered. Finally, no assessment with structured and validated psychometric tools was made to investigate the potential implicated clinical dimension, such as impulsivity, hostility, and aggressiveness, in the MR phenomenon.

5. Conclusions

In our sample, MR is associated with aggressive behaviors, involuntary admissions, long hospitalization, and a lower number of medications at discharge. An early recognition of the patient’s features could improve the clinical handling of the aforementioned conditions and, consequently, decrease the use of MR. It is necessary to work together to limit this phenomenon in the inpatient psychiatric setting, focusing not only on the patient’s characteristics but also on ward- (more green and structured space, privacy and rehabilitation activities, never exceeding the number of beds, no crowding) and staff- (good leadership, training in communication skills, shared decision making) related factors, due to the multifactorial genesis of MR. Future research should focus on longitudinal studies to gain more insight into the dynamics of MR development in the inpatient psychiatric setting, specifically considering these other aforementioned factors that could help identify more precise prevention and intervention strategies.

Author Contributions

Conceptualization, A.A. (Andrea Aguglia) and G.P.C.; methodology, A.A. (Andrea Aguglia), G.P.C. and B.C.; formal analysis, A.B. and N.G.; investigation, G.B.G., C.M. and E.V.; data curation, G.B.G., C.M. and E.V.; writing—original draft preparation, A.A. (Andrea Aguglia) and B.C.; writing—review and editing, I.B., A.C. and A.A. (Andrea Amerio); supervision, M.A. and G.S.; project administration, M.A. and G.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study design was approved by the “IRCCS Ospedale Policlinico San Martino” Ethical Review Board (366/2019), 20 April 2020.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy/ethical restrictions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Comitato Nazionale per la Bioetica. Bioetica e Diritti degli Anziani; Presidenza del Consiglio dei Ministri: Roma, Italy, 2006; p. 7. [Google Scholar]
  2. Meyer, G.; Köpke, S.; Haastert, B.; Mühlhauser, I. Restraint use among nursing home residents: Cross-sectional study and prospective cohort study. J. Clin. Nurs. 2009, 18, 981–990. [Google Scholar] [CrossRef]
  3. Coburn, V.A.; Mycyk, M.B. Physical and Chemical Restraints. Emerg. Med. Clin. N. Am. 2009, 27, 655–667. [Google Scholar] [CrossRef]
  4. Raboch, J.; Kalisová, L.; Nawka, A.; Kitzlerová, E.; Onchev, G.; Karastergiou, A.; Magliano, L.; Dembinskas, A.; Kiejna, A.; Torres-Gonzales, F.; et al. Use of coercive measures during involuntary hospitalization: Findings from ten European countries. Psychiatr. Serv. 2010, 61, 1012–1017. [Google Scholar] [CrossRef] [PubMed]
  5. Lee, T.K.; Välimäki, M.; Lantta, T. The Knowledge, Practice and Attitudes of Nurses Regarding Physical Restraint: Survey Results from Psychiatric Inpatient Settings. Int. J. Environ. Res. Public Health 2021, 18, 6747. [Google Scholar] [CrossRef] [PubMed]
  6. Negroni, A. On the concept of restraint in psychiatry. Eur. J. Psychiatry 2017, 31, 99–104. [Google Scholar] [CrossRef]
  7. Bowblis, J.R.; Crystal, S.; Intrator, O.; Lucas, J.A. Response to regulatory stringency: The case of antipsychotic medication use in nursing homes. Health Econ. 2012, 21, 977–993. [Google Scholar] [CrossRef]
  8. Petrini, C. Ethical considerations for evaluating the issue of physical restraint in psychiatry. Ann. Ist. Super. Sanita 2013, 49, 281–285. [Google Scholar] [CrossRef] [PubMed]
  9. Barnett, R.; Stirling, C.; Pandyan, A.D. A review of the scientific literature related to the adverse impact of physical restraint: Gaining a clearer understanding of the physiological factors involved in cases of restraint-related death. Med. Sci. Law 2012, 52, 137–142. [Google Scholar] [CrossRef]
  10. Maiese, A.; dell’Aquila, M.; Romano, S.; Santurro, A.; De Matteis, A.; Scopetti, M.; Arcangeli, M.; La Russa, R. Is it time for international guidelines on physical restraint in psychiatric patients? Clin. Ter. 2019, 170, e68–e70. [Google Scholar] [CrossRef]
  11. Wilson, C.; Rouse, L.; Rae, S.; Ray, M.K. Is restraint a ‘necessary evil’ in mental health care? Mental health inpatients’ and staff members’ experience of physical restraint. Int. J. Ment. Health Nurs. 2017, 26, 500–512. [Google Scholar] [CrossRef] [PubMed]
  12. De Berardis, D.; Ventriglio, A.; Fornaro, M.; Vellante, F.; Martinotti, G.; Fraticelli, S.; Di Giannantonio, M. Overcoming the Use of Mechanical Restraints in Psychiatry: A New Challenge in the Everyday Clinical Practice at the Time of COVID-19. J. Clin. Med. 2020, 9, 3774. [Google Scholar] [CrossRef] [PubMed]
  13. Newton-Howes, G.; Savage, M.K.; Arnold, R.; Hasegawa, T.; Staggs, V.; Kisely, S. The use of mechanical restraint in Pacific Rim countries: An international epidemiological study. Epidemiol. Psychiatr. Sci. 2020, 29, e190. [Google Scholar] [CrossRef]
  14. Lee, D.C.A.; Robins, L.M.; Bell, J.S.; Srikanth, V.; Möhler, R.; Hill, K.D.; Griffiths, D.; Haines, T.P. Prevalence and variability in use of physical and chemical restraints in residential aged care facilities: A systematic review and meta-analysis. Int. J. Nurs. Stud. 2021, 117, 103856. [Google Scholar] [CrossRef] [PubMed]
  15. Steinert, T.; Lepping, P.; Bernhardsgrütter, R.; Conca, A.; Hatling, T.; Janssen, W.; Keski-Valkama, A.; Mayoral, F.; Whittington, R. Incidence of seclusion and restraint in psychiatric hospitals: A literature review and survey of international trends. Soc. Psychiatry Psychiatr. Epidemiol. 2010, 45, 889–897. [Google Scholar] [CrossRef] [PubMed]
  16. Beghi, M.; Peroni, F.; Gabola, P.; Rossetti, A.; Cornaggia, C.M. Prevalence and risk factors for the use of restraint in psychiatry: A systematic review. Riv. Psichiatr. 2013, 48, 10–22. [Google Scholar] [CrossRef]
  17. Di Lorenzo, R.; Baraldi, S.; Ferrara, M.; Mimmi, S.; Rigatelli, M. Physical restraints in an Italian psychiatric ward: Clinical reasons and staff organization problems. Perspect. Psychiatr. Care 2012, 48, 95–107. [Google Scholar] [CrossRef] [PubMed]
  18. Tarsitani, L.; Pasquini, M.; Maraone, A.; Zerella, M.P.; Berardelli, I.; Giordani, R.; Polselli, G.M.; Biondi, M. Acute psychiatric treatment and the use of physical restraint in first-generation immigrants in Italy: A prospective concurrent study. Int. J. Soc. Psychiatry 2013, 59, 613–618. [Google Scholar] [CrossRef]
  19. Aguglia, A.; Moncalvo, M.; Solia, F.; Maina, G. Involuntary admissions in Italy: The impact of seasonality. Int. J. Psychiatry Clin. Pract. 2016, 20, 232–238. [Google Scholar] [CrossRef]
  20. Happell, B.; Koehn, S. From numbers to understanding: The impact of demographic factors on seclusion rates. Int. J. Ment. Health Nurs. 2010, 19, 169–176. [Google Scholar] [CrossRef]
  21. Whittington, R.; Bowers, L.; Nolan, P.; Simpson, A.; Neil, L. Approval ratings of inpatient coercive interventions in a national sample of mental health service users and staff in England. Psychiatr. Serv. 2009, 60, 792–798. [Google Scholar] [CrossRef]
  22. Chieze, M.; Hurst, S.; Kaiser, S.; Sentissi, O. Effects of Seclusion and Restraint in Adult Psychiatry: A Systematic Review. Front. Psychiatry 2019, 10, 491. [Google Scholar] [CrossRef]
  23. Nichini, C.; Alecci, E. Nuovi Orientamenti Contenzione Fisica nei Servizi Psichiatrici Italiani. Psichiatria Oggi 2021, 1 (Gennaio-Giugno): 80–90. Available online: https://www.psichiatriaoggi.it/wp-content/uploads/2021/07/11-Nichini-nuovi-orientamenti-contenzione-fisica.pdf (accessed on 2 May 2023).
  24. Holmes, D.; Kennedy, S.L.; Perron, A. The mentally ill and social exclusion: A critical examination of the use of seclusion from the patient’s perspective. Issues Ment. Health Nurs. 2004, 25, 559–578. [Google Scholar] [CrossRef]
  25. Frueh, B.C.; Knapp, R.G.; Cusack, K.J.; Grubaugh, A.L.; Sauvageot, J.A.; Cousins, V.C.; Yim, E.; Robins, C.S.; Monnier, J.; Hiers, T.G. Patients’ reports of traumatic or harmful experiences within the psychiatric setting. Psychiatr. Serv. 2005, 56, 1123–1133. [Google Scholar] [CrossRef] [PubMed]
  26. World Medical Association. World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects. JAMA 2013, 310, 2191–2194. [Google Scholar] [CrossRef]
  27. Aguglia, A.; Corsini, G.P.; Costanza, A.; Berti, A.; Bruno, E.; Escelsior, A.; Sanvi, J.; Trabucco, A.; Vai, E.; Amerio, A.; et al. Sociodemographic and Clinical Correlates Associated with the Frequent Service Users in an Italian Psychiatric Emergency Department. Diagnostics 2023, 13, 430. [Google Scholar] [CrossRef] [PubMed]
  28. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 5th ed.; American Psychiatric Association: Washington, DC, USA, 2013. [Google Scholar]
  29. Posner, K.; Oquendo, M.A.; Gould, M.; Stanley, B.; Davies, M. Columbia Classification Algorithm of Suicide Assessment (C-CASA): Classification of suicidal events in the FDA’s pediatric suicidal risk analysis of antidepressants. Am. J. Psychiatry 2007, 164, 1035–1043. [Google Scholar] [CrossRef]
  30. Posner, K.; Brent, D.; Lucas, C.; Gould, M.; Stanley, B.; Brown, G.; Fisher, P.; Zelazny, J.; Burke, A.; Oquendo, M.J.N.Y.; et al. Columbia-Suicide Severity Rating Scale (C-SSRS); Columbia University Medical Center: New York, NY, USA, 2008. [Google Scholar]
  31. Posner, K.; Brown, G.K.; Stanley, B.; Brent, D.A.; Yershova, K.V.; Oquendo, M.A.; Currier, G.W.; Melvin, G.A.; Greenhill, L.; Shen, S.; et al. The Columbia-Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am. J. Psychiatry 2011, 168, 1266–1277. [Google Scholar] [CrossRef] [PubMed]
  32. Silverman, M.M.; Berman, A.L.; Sanddal, N.D.; O’Carroll, P.W.; Joiner, T.E. Rebuilding the tower of Babel: A revised nomenclature for the study of suicide and suicidal behaviors. Part 1: Background, rationale, and methodology. Suicide Life-Threat. Behav. 2007, 37, 248–263. [Google Scholar] [CrossRef]
  33. Silverman, M.M.; Berman, A.L.; Sanddal, N.D.; O’Carroll, P.W.; Joiner, T.E. Rebuilding the tower of Babel: A revised nomenclature for the study of suicide and suicidal behaviors. Part 2: Suicide-related ideations, communications, and behaviors. Suicide Life-Threat. Behav. 2007, 37, 264–277. [Google Scholar] [CrossRef]
  34. Fernández-Costa, D.; Gómez-Salgado, J.; Fagundo-Rivera, J.; Martín-Pereira, J.; Prieto-Callejero, B.; García-Iglesias, J.J. Alternatives to the Use of Mechanical Restraints in the Management of Agitation or Aggressions of Psychiatric Patients: A Scoping Review. J. Clin. Med. 2020, 9, 2791. [Google Scholar] [CrossRef]
  35. Reitan, S.K.; Helvik, A.S.; Iversen, V. Use of mechanical and pharmacological restraint over an eight-year period and its relation to clinical factors. Nord. J. Psychiatry 2018, 72, 24–30. [Google Scholar] [CrossRef] [PubMed]
  36. Lykke, J.; Hjorthøj, C.; Thomsen, C.T.; Austin, S.F. Prevalence, predictors, and patterns of mechanical restraint use for inpatients with dual diagnosis. Perspect. Psychiatr. Care 2020, 56, 20–27. [Google Scholar] [CrossRef]
  37. El-Abidi, K.; Moreno-Poyato, A.R.; Privat, A.T.; Martinez, D.C.; Aceña-Domínguez, R.; Pérez-Solà, V.; Mané, A. Determinants of mechanical restraint in an acute psychiatric care unit. World J. Psychiatry 2021, 11, 854–863. [Google Scholar] [CrossRef]
  38. Ketelsen, R.; Fernando, S.; Driessen, M. Gender-Related Differences Regarding Aggressive Behaviour and Coercive Measures in Psychiatric Inpatients. Psychiatr. Prax. 2022, 49, 121–127. [Google Scholar] [CrossRef] [PubMed]
  39. Caruso, R.; Antenora, F.; Riba, M.; Belvederi Murri, M.; Biancosino, B.; Zerbinati, L.; Grassi, L. Aggressive Behavior and Psychiatric Inpatients: A Narrative Review of the Literature with a Focus on the European Experience. Curr. Psychiatry Rep. 2021, 23, 29. [Google Scholar] [CrossRef] [PubMed]
  40. Cole, C.; Klotz, E.; Junghanss, J.; Oster, A.; Bermpohl, F.; Vandamme, A.; Mahler, L. Patient communication ability as predictor of involuntary admission and coercive measures in psychiatric inpatient treatment. J. Psychiatr. Res. 2022, 153, 11–17. [Google Scholar] [CrossRef] [PubMed]
  41. Pedersen, M.L.; Gildberg, F.; Baker, J.; Damsgaard, J.B.; Tingleff, E.B. Ethnic disparities in the use of restrictive practices in adult mental health inpatient settings: A scoping review. Soc. Psychiatry Psychiatr. Epidemiol. 2023, 58, 505–522. [Google Scholar] [CrossRef]
  42. Weltens, I.; Bak, M.; Verhagen, S.; Vandenberk, E.; Domen, P.; van Amelsvoort, T.; Drukker, M. Aggression on the psychiatric ward: Prevalence and risk factors. A systematic review of the literature. PLoS ONE 2021, 16, e0258346. [Google Scholar] [CrossRef]
  43. Kodal, J.S.; Kjær, J.N.; Larsen, E.R. Mechanical restraint and characteristics of patient, staff and shifts in a psychiatric ward. Nord. J. Psychiatry 2018, 72, 103–108. [Google Scholar] [CrossRef]
  44. Galbert, I.; Azab, A.N.; Kaplan, Z.; Nusbaum, L. Staff attitudes and perceptions towards the use of coercive measures in psychiatric patients. Int. J. Ment. Health Nurs. 2023, 32, 106–116. [Google Scholar] [CrossRef]
  45. Woods, P.; Ashley, C. Violence and aggression: A literature review. J. Psychiatr. Ment. Health Nurs. 2007, 14, 652–660. [Google Scholar] [CrossRef]
  46. Grassi, L.; Biancosino, B.; Marmai, L.; Kotrotsiou, V.; Zanchi, P.; Peron, L.; Marangoni, C.; Vanni, A.; Barbui, C. Violence in psychiatric units: A 7-year Italian study of persistently assaultive patients. Soc. Psychiatry Psychiatr. Epidemiol. 2006, 41, 698–703. [Google Scholar] [CrossRef] [PubMed]
  47. Laukkanen, E.; Kuosmanen, L.; Selander, T.; Vehviläinen-Julkunen, K. Seclusion, restraint, and involuntary medication in Finnish psychiatric care: A register study with root-level data. Nord. J. Psychiatry 2020, 74, 439–443. [Google Scholar] [CrossRef]
  48. Pérez-Revuelta, J.I.; Torrecilla-Olavarrieta, R.; García-Spínola, E.; López-Martín, A.; Guerrero-Vida, R.; Mongil-San Juan, J.M.; Rodríguez-Gómez, C.; Pascual-Paño, J.M.; González-Sáiz, F.; Villagrán-Moreno, J.M. Factors associated with the use of mechanical restraint in a mental health hospitalization unit: 8-year retrospective analysis. J. Psychiatr. Ment. Health Nurs. 2021, 28, 1052–1064. [Google Scholar] [CrossRef]
  49. O’Callaghan, A.K.; Plunkett, R.; Kelly, B.D. Seclusion, Restraint, Therapeutic Alliance, and Legal Admission Status: What Really Matters? J. Psychiatr. Pract. 2022, 28, 454–464. [Google Scholar] [CrossRef] [PubMed]
  50. Kim, A.M.; Salstein, L.; Goldberg, J.F. A systematic review of complex polypharmacy in bipolar disorder: Prevalence, clinical features, adherence, and preliminary recommendations for practitioners. J. Clin. Psychiatry 2021, 82, 20r13263. [Google Scholar] [CrossRef] [PubMed]
  51. Aguglia, A.; Natale, A.; Fusar-Poli, L.; Amerio, A.; Costanza, A.; Fesce, F.; Gnecco, G.B.; Marino, M.; Placenti, V.; Serafini, G.; et al. Complex polypharmacy in bipolar disorder: Results from a real-world inpatient psychiatric unit. Psychiatry Res. 2022, 318, 114927. [Google Scholar] [CrossRef]
Table 1. Sociodemographic characteristics of the whole sample and the mechanical and non-mechanical restraint subgroups.
Table 1. Sociodemographic characteristics of the whole sample and the mechanical and non-mechanical restraint subgroups.
N (%) or Mean ± SDTotal
Sample
(N = 799)		Mechanical
Restraint
(N = 113)		Non-Mechanical Restraint
(N = 686)		Chi2/t-TestpEffect Size
Male gender453 (56.7)74 (65.5)379 (55.2)4.1430.0420.072
Current age (years)44.35 ± 16.5541.11 ± 17.2444.88 ± 16.382.2550.0240.224
Marital status 9.8850.0200.111
Single523 (65.5)86 (76.1)437 (63.7)
Married132 (16.5)16 (14.2)116 (16.9)
Separated/divorced121 (15.2)7 (6.2)114 (16.6)
Widowed19 (2.8)4 (3.5)19 (2.8)
Educational level (years)11.07 ± 3.6010.48 ± 3.5811.17 ± 3.591.9050.057 *0.192
Occupational status (Yes)199 (24.9)24 (21.2)175 (25.5)0.9460.3310.034
Migrant status105 (13.1)25 (22.1)80 (11.7)9.3030.0020.108
Living situation 0.6960.7060.030
Alone245 (30.7)31 (27.4)214 (31.2)
With parents464 (58.1)68 (60.2)396 (57.7)
In public residence90 (11.3)14 (12.4)76 (11.1)
Discharge 0.8560.6520.033
Private home324 (59.0)64 (56.6)411 (59.9)
Transferred to other ward119 (21.7)30 (26.5)155 (22.6)
Public residence106 (19.3)19 (16.9)120 (17.5)
* = trend of significance.
Table 2. Clinical characteristics of the whole sample and the mechanical and non-mechanical restraint subgroups.
Table 2. Clinical characteristics of the whole sample and the mechanical and non-mechanical restraint subgroups.
N (%) or Mean ± SDTotal
Sample
(N = 799)		Mechanical
Restraint
(N = 113)		Non-Mechanical Restraint
(N = 686)		Chi2/t-TestpEffect Size
Psychiatric diagnosis
Schizophrenia and related disorders
Bipolar and related disorder
Depressive disorders
Personality disorders
Others
227 (28.4)
222 (27.8)
80 (10.0)
116 (14.5)
154 (19.3)
35 (31.0)
24 (21.2)
4 (3.5)
17 (15.0)
33 (29.2)
192 (28.0)
198 (28.9)
76 (11.1)
99 (14.4)
121 (17.6)		14.5990.0060.135
Age at onset (years)28.17 ± 14.7427.16 ± 13.4828.34 ± 14.940.7890.4310.082
Duration of illness (years)16.17 ± 13.4013.86 ± 12.7316.56 ± 13.471.3870.1980.206
Suicidal Ideation248 (31.0)32 (28.3)216 (31.5)0.4550.5000.024
Current suicide attempt92 (11.5)7 (6.2)85 (12.4)3.6560.056 *0.068
Lifetime suicide attempts136 (17.0)10 (8.8)126 (18.4)6.2230.0130.088
Non suicidal self-harm73 (9.1)7 (6.2)66 (9.6)1.3160.2510.041
Aggressive behavior212 (26.6)94 (83.2)118 (17.2)216.319<0.0010.521
Length of hospitalization (days)10.05 ± 9.5811.63 ± 12.089.79 ± 9.09−1.8980.058 *0.172
Involuntary admission158 (28.8)90 (79.6)143 (20.8)162.383<0.0010.451
First hospitalization310 (38.8)51 (45.1)259 (37.8)2.2240.1360.053
Long hospitalization85 (10.6)18 (15.9)67 (9.8)3.8760.0490.070
Psychiatric comorbidity379 (47.4)56 (49.6)323 (47.1)0.2380.6260.017
Medical comorbidity313 (39.2)35 (31.0)278 (40.5)3.7140.054 *0.068
Family history of psychiatric disorders326 (40.8)50 (44.2)276 (40.2)0.6470.4210.028
* = trend of significance.
Table 3. Presence of illicit substances in the whole sample and the mechanical and non-mechanical restraint subgroups.
Table 3. Presence of illicit substances in the whole sample and the mechanical and non-mechanical restraint subgroups.
N (%)Total Sample
(N = 799)		Mechanical
Restraint
(N = 113)		Non-Mechanical
Restraint
(N = 686)		Chi2/t-TestpEffect Size
At least one substance331 (41.4)60 (53.1)271 (39.5)7.3880.0070.096
Alcohol240 (30.0)44 (38.9)196 (28.6)4.9610.0260.079
Cannabis140 (17.5)32 (28.3)108 (15.7)10.6160.0010.115
Cocaine96 (12.0)16 (14.2)80 (11.7)0.5720.4490.027
Amphetamines10 (1.3)1 (0.9)9 (1.3)0.1430.7050.013
Heroin47 (5.9)6 (5.3)41 (6.0)0.0800.7770.010
Table 4. Pharmacological treatment at discharge for the whole sample and the mechanical and non-mechanical restraint subgroups.
Table 4. Pharmacological treatment at discharge for the whole sample and the mechanical and non-mechanical restraint subgroups.
N (%) or Mean ± SDTotal
Sample
(N = 799)		Mechanical
Restraint
(N = 113)		Non-Mechanical Restraint
(N = 686)		Chi2/t-TestpEffect Size
Number of medications3.14 ± 1.482.66 ± 1.393.21 ± 1.483.684<0.0010.383
Antipsychotics637 (79.7)88 (77.9)549 (80.0)0.2780.5980.019
Oral593 (74.2)76 (67.3)517 (75.4)3.3330.0680.065
Long-acting injection104 (13.0)20 (17.7)84 (12.2)2.5490.1100.056
First-generation201 (25.2)33 (29.2)168 (24.5)1.1450.2850.038
Second-generation547 (68.5)70 (61.9)477 (69.5)2.5860.1080.057
Antidepressants193 (24.2)10 (8.8)183 (26.7)16.829<0.0010.145
Mood stabilizers426 (53.3)55 (48.7)371 (54.1)1.1400.2860.038
Lithium 181 (22.7)16 (14.2)165 (24.1)5.4190.0200.082
Benzodiazepines563 (70.5)75 (66.4)488 (71.1)1.0590.3040.036
Table 5. Logistic regression analysis considering sociodemographic and clinical characteristics associated with physical restraint.
Table 5. Logistic regression analysis considering sociodemographic and clinical characteristics associated with physical restraint.
BS.E.WaldpExp(B)95% CI for EXP
Male Gender0.0250.2940.0070.9311.0260.576–1.826
Current Age0.0080.0110.5810.4461.0080.987–1.030
Single status0.4170.3881.1550.2821.5170.710–3.243
Migrant status0.3820.3850.9850.3211.4660.689–3.119
Other diagnoses0.2690.3420.6190.4321.3090.669–2.562
Lifetime suicide attempt0.5770.4551.6140.2041.7820.731–4.343
Aggressive behaviors2.7160.30878.006<0.00115.1248.277–27.635
Involuntary admission2.1590.29653.047<0.0018.6624.845–15.485
Long hospitalization1.2000.4068.7360.0033.3191.498–7.353
Presence of illicit drugs0.2120.4410.2300.6321.2360.520–2.935
Alcohol−0.1560.4170.1400.7080.8550.377–1.938
Cannabinoid0.2870.4040.5050.4771.3320.604–2.938
Number of medications−0.2230.0995.0740.0240.8000.659–0.971
Ongoing Lithium treatment−0.0330.4060.0070.9350.9670.436–2.145
Ongoing Antidepressant treatment−0.2080.4520.2380.6250.8020.331–1.944
Constant−4.7890.98923.464<0.0010.008
R2 Nagelkerke = 0.523.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Aguglia, A.; Corsini, G.P.; Berardelli, I.; Berti, A.; Conio, B.; Garbarino, N.; Gnecco, G.B.; Magni, C.; Venturini, E.; Costanza, A.; et al. Mechanical Restraint in Inpatient Psychiatric Unit: Prevalence and Associated Clinical Variables. Medicina 2023, 59, 1847. https://doi.org/10.3390/medicina59101847

AMA Style

Aguglia A, Corsini GP, Berardelli I, Berti A, Conio B, Garbarino N, Gnecco GB, Magni C, Venturini E, Costanza A, et al. Mechanical Restraint in Inpatient Psychiatric Unit: Prevalence and Associated Clinical Variables. Medicina. 2023; 59(10):1847. https://doi.org/10.3390/medicina59101847

Chicago/Turabian Style

Aguglia, Andrea, Giovanni Pietro Corsini, Isabella Berardelli, Andrea Berti, Benedetta Conio, Nicolò Garbarino, Giovanni Battista Gnecco, Caterina Magni, Enrico Venturini, Alessandra Costanza, and et al. 2023. "Mechanical Restraint in Inpatient Psychiatric Unit: Prevalence and Associated Clinical Variables" Medicina 59, no. 10: 1847. https://doi.org/10.3390/medicina59101847

Article Metrics

Back to TopTop