Next Article in Journal
Emodin, an Emerging Mycotoxin, Induces Endoplasmic Reticulum Stress-Related Hepatotoxicity through IRE1α–XBP1 Axis in HepG2 Cells
Next Article in Special Issue
Addressing the Real-World Challenges of Immunoresistance to Botulinum Neurotoxin A in Aesthetic Practice: Insights and Recommendations from a Panel Discussion in Hong Kong
Previous Article in Journal
Ciguatera Fish Poisoning in the Caribbean Sea and Atlantic Ocean: Reconciling the Multiplicity of Ciguatoxins and Analytical Chemistry Approach for Public Health Safety
Previous Article in Special Issue
Lessons about Botulinum Toxin A Therapy from Cervical Dystonia Patients Drawing the Course of Disease: A Pilot Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

No Secondary Treatment Failure during Incobotulinumtoxin—A Long-Term Treatment Demonstrated by the Drawing of Disease Severity

1
Department of Neurology, Moorenstrasse 5, 40225 Düsseldorf, Germany
2
Department of Neurology, Maria Hilf Clinics, 41063, Moenchengladbach, Germany
3
Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Experimental and Clinical Research Center, 13125 Berlin, Germany
4
Department of Regional Health Research and Molecular Medicine, University of Southern Denmark, 5230 Odense, Denmark
5
Department of Neurology, Slagelse Hospital, 4200 Slagelse, Denmark
*
Author to whom correspondence should be addressed.
Toxins 2023, 15(7), 454; https://doi.org/10.3390/toxins15070454
Submission received: 25 April 2023 / Revised: 4 July 2023 / Accepted: 10 July 2023 / Published: 12 July 2023
(This article belongs to the Special Issue Immunogenicity of Botulinum Toxin)

Abstract

:
The aim of this study was to detect clinical hints regarding the development of secondary treatment failure (STF) in patients with focal dystonia who were exclusively treated with incobotulinumtoxin/A (incoBoNT/A). In total, 33 outpatients (26 with idiopathic cervical dystonia, 4 with Meige syndrome and 3 with other cranial dystonia) who were treated with repeated injections of incoBoNT/A for a mean period of 6.4 years without interruptions were recruited to draw the course of their disease severity (CoD) from the onset of symptoms to the onset of BoNT therapy (CoDB graph) and from the onset of BoNT therapy to recruitment (CoDA graph). At the time of recruitment, the patients assessed the change in severity as a percentage of the severity at the onset of BoNT therapy. Blood samples were taken to test the presence of neutralizing antibodies (NABs) using the mouse hemidiaphragm assay (MHDA). Patients reported an improvement of about 70% with respect to the mean. None of the patients tested positive for MHDA. Three different types of CoDB and three different types of CoDA graphs could be distinguished. The patients with different CoDB graphs reported different long-term outcomes, but there was no significant difference in long-term outcomes between patients with different CoDA graphs. None of the patients produced a CoDA graph with an initial improvement and a secondary worsening as a hint for the development of STF. A primary non-response was not observed in any of the patients. During long-term treatment with BoNT/A, NABs and/or STF may develop. However, in the present study on patients with incoBoNT/A long-term monotherapy, no hints for the development of NABs or STF could be detected, underlining the low antigenicity of incoBoNT/A.
Key Contribution: IncoBoNT/A long-term monotherapy showed no secondary treatment failure or neutralizing antibodies, indicating low antigenicity.

1. Introduction

Botulinum neurotoxins (BoNTs) are clostridial products produced as single chains [1] that have to be cleaved into a light and heavy chain coupled by a disulfide bond to become biologically active, and they are embedded in much larger protein complexes [1,2]. These complex proteins are necessary to protect BoNTs after oral uptake during their passage through the gastrointestinal tract against the acidic milieu of the stomach [2] and for the penetration of BoNTs through the gastrointestinal wall [3]. However, when BoNT preparations are injected, the complex proteins immediately start to diffuse from the neurotoxins after dilution [4,5] and may act as adjuvants [6,7,8,9] when dendritic cells are stimulated by transdermal applications [10].
In most long-term BoNT-treated patients, T-cells have recognized the presence of BoNT [11] and triggered the production of antibodies that may reduce the biological activity of BoNT (neutralizing antibodies (NABs)). NABs target the antigens of the heavy and the light chain [12,13] and reduce the intracellular uptake of BoNTs or the intracellular cleavage of SNARE-proteins [14,15]. This leads to the development of secondary treatment failure (STF).
Clinically, the development of NAB-induced STF may be difficult to detect. It has been hypothesized that NAB-induced STF occurs early in the course of treatment [16]. For several indications, the development of STF after the first three injections has been reported [17,18]. First, the duration of the clinical effect is reduced [19]. During this phase of the development of NAB-induced STF, the reduction in efficacy can be overcome by an increase in the dose (partial STF (pSTF)). With the continuation of BoNT applications, NAB titers usually increase until a complete STF (cSTF) develops with a large reduction in the clinical effect, including the peak effect around week 4 [17,19]. Treating physicians and patients often realize that BoNT injections have become less effective compared to the effect at the onset of BoNT therapy only after years of treatment [16].
When STF (pSTF or cSTF) is suspected and NABs are determined, some patients may have a negative NAB test but develop a clear STF [20,21]. On the other hand, the cross-sectional testing of NABs in still-responding patients may detect patients with excellent clinical outcomes but positive NAB testing [22,23]. This raises the question of the sensitivity and specificity of positive NAB tests for STF. It may very well be that careful clinical observation and documentation are at least as sensitive as the performance of a mouse lethality assay (MLA) or the mouse hemidiaphragm test (MHDA).
We, therefore, developed a method of drawing the course of disease severity (CoD). This method has the advantage of using the patient’s assessment of the clinical efficacy of BoNT therapy, which may add information to the treating physician’s assessment [24,25,26]. Furthermore, this drawing test is much cheaper and easier to perform than a laboratory NAB test. In a cohort of 66 consecutively recruited patients with cervical dystonia, 17 patients (=25.8%) produced a CoD graph from the onset of BoNT/A therapy to recruitment (CoDA graph) that showed a good initial response followed by secondary worsening. This secondary worsening was also observed by the treating physician who previously increased the BoNT/A dose and optimized the injection technique. In ten of these seventeen patients (=58.8%), a positive MHDA test was detected [25,26]. This may indicate that the clinical situation (especially the CoD drawing) is at least as sensitive to detecting STF as MHDA testing is to detecting NAB-induced STF.
To present more evidence that CoD drawing is a useful clinical tool in detecting STF and does not produce false-positive cases with regard to STF, CoD drawing was compared to MHDA testing in 33 patients with focal cranial dystonia who were treated long-term with incoBoNT/A exclusively and for whom no NAB induction was expected [27].

2. Results

2.1. Demographical, Treatment-Related Data and Outcome Measures of All Patients

The final analysis, which is presented in detail in Table 1, was based on 33 patients (17 females and 16 males). The mean age (AGE) was 58.7 years (SD: 13.1), and the mean age at onset of symptoms (AOS) was 47.6 years (SD: 15.0). The time to therapy (DURS) was 5.2 years (SD: 8.1), and the duration of treatment (DURT) 6.4 years (SD: 2.2).
The initial dose (IDOSE) was 164 U incoBoNT/A (SD: 85). The dose was increased (INDOSE) during DURT by 96 U incoBoNT/A with respect to the mean (SD: 80). The dose at recruitment (ADOSE) was therefore 260 U (SD: 111).
The improvement assessed by the patients as a percentage of the initial severity of their disease (IMPQ) was 69.4% (SD: 19). When patients had to use the right edge of the CoDA graph as a VAS scale (IMPD) to assess the actual severity of the disease (ASD) before drawing the CoDA graph (for details, see methods), the improvement (IMPD) was 69.6% (SD: 18.2), which was nearly identical to the IMPQ.
In the patients with CD (n = 26), the initial TSUI score varied between 4 and 16 and was 7.6 with respect to the mean (SD: 3.0). At recruitment, the mean TSUI score (ATSUI) was 4.0 (SD: 3.0). Thus, the mean improvement in the TSUI score (IMPTSUI) was 3.6 = 47.6% (SD: 3.5).

2.2. Three Types of CoDB Graphs and Corresponding Treatment-Related Data

Three different types of CoDB graphs could be distinguished. Seven patients experienced a rapid onset of their disease with little further progression thereafter. These patients produced CoDB graphs with more than 75% of the data points lying above the line (OS/OT-line) from the left lower corner (onset of symptoms) to the right upper corner (onset of therapy) (for further details, see methods). This type of CoDB graph was called the rapid onset (RO) type. Eleven patients experienced a slow, mild progression of their disease for a longer period of time before their disease started to worsen more rapidly. These patients produced CoDB graphs with more than 75% of the data points lying below the OS/OT-line. This type of CoDB graph was called the delayed onset (DO) type. Fifteen patients experienced a continuous worsening of disease severity from the onset of symptoms to the onset of incoBoNT/A therapy. Their CoDB graphs varied around the OS/OT line. This type of CoDB graph was called the continuous onset type (CO-type).
The outcome assessed by the patients (IMPQ) was significantly different across the three RO, CO and DO subgroups. The best outcome at recruitment (IMPQ: MV = 77.9% (SD: 8.1)) was reported by the RO group, and the lowest (MV = 57.0%; SD: 23.2%) was reported by the DO group (see Table 1). The initial dose (ITSUI; p < 0.009) and actual dose per session (ATSUI; p < 0.01)) were also significantly different across the three patient subgroups. The lowest IDOSE (MV = 105; SD = 72) and ADOSE (MV = 199; SD = 108) by far were used in the CO group (see Table 1 and Figure 1).
In CD patients (n = 26), TSUI scores were also determined by the treating physician. The best outcome (ATSUI: MV = 3.0; SD = 1.6) was observed in the RO group, and the worst outcome was observed in the DO group (MV = 5.0; SD = 4.4). This explains the significant difference in the patient assessment of improvement (IMPQ: see Table 1).
In the RO group, the TSUI score decreased from a high initial TSUI (MV = 9.7) to the best TSUI (BTSUI) of 1.9. Thereafter, the TSUI score increased again to the actual TSUI (difference: 3.0 − 1.9 = 1.1). This worsening was compensated for by an increase in dose (INDOSE) of 40 U (ADOSE − BDOSE = 314 − 274). In the CO group, the TSUI score worsened from the best TSUI of 0.9 to 3.8 (difference: 2.9), which was only partially compensated for by an increase in the dose of 14 U (ADOSE − BDOSE = 199 − 185). In the DO group, the TSUI score worsened from 1.8 to 5.0 (difference: 3.2), which was not compensated for by an increase in the dose (ADOSE − BDOSE = 310 − 302 = 8). Patient assessment (IMPQ) correlates with the quality of the compensation strategy being performed by the treating physician.

2.3. Three Different Types of CoDA Graphs and Corresponding Treatment-Related Data

Three different types of CoDA graphs could be distinguished. To classify the CoDA graphs, a line (OT/ASD line) between the left upper corner (onset of therapy) and the mark for the actual severity of the disease (ASD mark on the right edge of the CoDA graph) was drawn. Nine patients drew CoDA graphs with more than 75% of the data points lying above the OT/ASD line (for further details see methods). This type of CoDA graph was called the rapid response (RR) type. Six patients experienced a slow initial improvement of their disease for a longer period of time before their disease started to improve more rapidly. These patients produced CoDA graphs with more than 75% of the data points lying below the OT/ASD line. This type of CoDA graph was called the delayed response (DR) type. Eighteen patients experienced a continuous improvement in disease severity from incoBoNT/A therapy to recruitment. Their CoDA graphs varied around the OT/ASD line. This type of CoDA graph was called the continuous response (CR) type.
When the entire cohort was split up into three subgroups according to response type, the female/male ratio in the different subgroups was different (p = 0.05; chi2-testing). The three-group ANOVA did not reveal any significant differences between the RR, CR or DR subgroups. AGE (MV = 67.2; SD = 9.8) was the highest in the DR group, as was AOS (MV = 52.5; SD: 8.4). This group also had the longest duration of treatment (MV = 7.8 years; SD = 3.0 years). Although the initial TSUI score was the highest (MV = 10.0; SD = 6.0) in the DR group, the actual TSUI score (ATSUI) was the lowest (MV = 2.7; SD = 1.2). This was achieved using the highest increase in dose (INDOSE) from 132 to 249 (difference = 117) (see Figure 2).

2.4. No NAB Induction and No Primary or Secondary Treatment Failure

In all 33 patients, the time to paralysis (TTP) of the MHDA test was well below 60 min (see Table 2). Thus, all patients had a negative MHDA test. All patients experienced an improvement of at least 40%. No CoDA graph yielded a hint that a patient was a primary non-responder. Furthermore, no patient produced a graph with an initial improvement of more than 20% followed by secondary worsening. No CoDA graph yielded a hint that a patient had developed a partial or complete secondary treatment failure (STF).

3. Discussion

3.1. No NAB Induction during Long-Term Monotherapy with incoBoNT/A

The cross-sectional testing of the present cohort for the presence of NABs by means of the sensitive MHDA did not yield any positive results as hypothesized in the Introduction. In all patients, the time to paralysis (TTP) did not exceed 55 min and was well below the lower cut-off value for an MHDA-positive test result of 60 min. This is in line with previous reports on NABs in patients exclusively treated with incoBoNT/A [27]. So far, no patient has been detected who developed NABs after incoBoNT/A monotherapy. However, a few preceding injections with a complex protein containing BoNT/A preparation before long-term incoBoNT/A therapy may themselves induce NAB formation, so the risk of developing NABs is not always zero [28].
In patients being exclusively treated with a complex protein containing BoNT/A preparation, the incidence of becoming MHDA positive was about 1.1% [27]. After a mean duration of therapy of 6.4 years (as in the present cohort), a prevalence of at least 7.2% of NAB-positive patients must be expected if the antigenicity of incoBoNT/A was equal to that of abo- or onaBoNT/A. This implies that at least two MHDA-positive patients were expected in the present cohort. However, no patient was MHDA-positive. This is consistent with the observation in a much larger study [27] that the antigenicity of incoBoNT/A is significantly lower than that of abo- or onaBoNT/A.

3.2. No Hints for the Development of a Secondary Treatment Failure in the CoDA Graphs

NAB testing was compared to the CoD graph drawing. No patient (with CD or with another cranial dystonia) produced a CoDA graph with an initial improvement followed by a secondary worsening (STF-type) as a hint for an STF.
In a previous study on a patient drawing of the course of CD severity after the onset of botulinum toxin therapy (CoDA graph), 17 (=25.8%) out of 66 patients (who were consecutively recruited and mainly treated with abobotulinumtoxinA (aboBoNT/A; Dysport®) or onabotulinumtoxinA (onaBoNT/A; Botox®)) produced CoDA graphs of an STF type. In five of these patients, STF was complete (cSTF: 5/66 = 7.6%), which is slightly more than the 5.9% reported by Walter et al. [17]. This may be a hint that the risk to develop a partial or complete secondary treatment failure under incoBoNT/A therapy is lower than under abo- or onaBoNT/A therapy, as was reported for the risk of NAB induction [27].
The incidence of the development of a pSTF appears to be at least twice as high as the incidence of NAB induction (incidence of NAB induction = 1.1%; incidence of STF development = 2.6%) [20,25]. This indicates that the careful clinical assessment of the efficacy of BoNT/A therapy may be superior to laboratory tests in detecting the development of STF. In the present study, neither the patient assessment of the clinical effect by means of a CoD graph drawing nor physician clinical scoring detected STF, underlining the low antigenicity of incoBoNT/A. This supports the notion that CoD graph drawing may be a useful clinical tool for detecting STF.
It has to be kept in mind that “secondary treatment failure” is not exactly defined. It has repeatedly been reported that in some patients with an STF change in injection guidance, the modification of the injection scheme and increase in dose led to improved response behavior. We think that all these cases of STF that can be improved by the modification of the BoNT/A injection technique or dose should be classified under insufficiently treated patients instead of patient treatment failures.
This insufficiency of treatment may result from a further progression of the underlying neurological disease despite improvements under ongoing BoNT/A therapy [29]. In patients with focal dystonia, a focal type may worsen to a multifocal or segmental type, affording the adaptation of the injection scheme and dose. In the present study, a worsening in disease severity is documented in patients with CD. After the best outcome (BTSUI) was reached under ongoing incoBoNT/A treatment, the TSUI score slightly worsened again. The treating physician reacted to this development of the TSUI score by adapting the dose. In the case of too-low compensation, the patients reported a reduced efficacy of incoBoNT/A therapy, as in the DO group (see Results). This underlines the necessity to continuously adapt the dose to clinical needs and to distinguish between treatment failure and insufficient treatment.

3.3. No Hint of a Primary Treatment Failure

In the previously mentioned report on CoDA graph drawing [24,25], a subgroup was detected with a poor response during the entire duration of treatment (PR subgroup). These 12 (18%) out of 66 patients were classified as primary non-responders, had the lowest improvement in TSUI score (mean IMPTSUI = 1.6), and reported the least improvement (mean IMPQ = 11.3%; mean IMPD = 7%), and they had the longest time to therapy (mean DURS = 93 months = 7.75 years) and the shortest duration of treatment (mean DURT = 75 months = 6.25 years). The obvious reason is that adherence to therapy is low when the efficacy of the BoNT treatment is low [30].
In the present study, no poor or primary non-responders could be detected. The initial response was low in the DR group. The simple reason for this is that the initial dose of 132 U incoBoNT/A with respect to the mean was too low. With a considerable increase in the dose (INDOSE) by 118 U, the best mean outcome (BTSUI) could be achieved. This further emphasizes the necessity for the adaptation of the dose to clinical needs. In a previous paper, we emphasized that in patients with fairly high initial severity (as in the DR subgroup of the present cohort), an unusually high dose may be necessary at the beginning of BoNT therapy to achieve a satisfying response [31]. If this adaptation is not performed, the risk is high that the patient terminates BoNT therapy and is classified as a primary non-responder [31].

3.4. Strengths and Limitations of the Study

The strength of the study is that antibody testing, patient assessment of efficacy, and the treating physician scoring of the treatment effect all confirm the low antigenicity of incoBoNT/A, and there is evidence showing that CoD graph drawing may be a useful clinical tool. The size of the present cohort is small (n = 33), but it is large enough that MHDA-positive patients or patients with an STF could have been detected if the incidences for NAB induction or STF development under incoBoNT/A therapy were equally high as under abo- or onaBoNT/A therapy.
For the present study, a mixed population of patients with CD and other forms of cranial dystonia was recruited. However, the small number of patients did not allow us to analyze differences between patient subgroups, although the course of the disease and response to BoNT/A may have been different.
Furthermore, CoD graphs were produced on the day of recruitment and were based on the patient’s rcall. Therefore, a longitudinal study is recommended for testing CoD graph drawing repeatedly at short and long time intervals to control for recall bias.
We recommend that a multi-center, long-term, prospective study be performed in order to analyze the patient’s assessment of the efficacy of BoNT/A therapy using CoD graph drawing, the treating physician’s assessment of the efficacy of BoNT/A therapy by means of clinical scales and the risk of antibody formation by testing patients repeatedly for the presence of NABs. We are aware that this will be a challenging but nevertheless necessary study to more clearly demonstrate differences in the antigenicity of different BoNT/A preparations and long-term outcomes.

4. Conclusions

The patient assessment of the clinical effect of BoNT therapy and treating physician scoring both demonstrate that the risk of antibody formation and the development of a secondary treatment failure are low under continuous incoBoNT/A therapy. An analysis of patient drawings of the course of disease severity may yield helpful information for the treating physician to optimize BoNT/A therapy.

5. Materials and Methods

The present study was performed according to the guidelines for good clinical practice (GCP) and according to the Declaration of Helsinki. It was approved by the local ethics committee of the University of Düsseldorf (number: 4085).

5.1. Patients: Demographical and Treatment-Related Data

The inclusion criteria of the study were (i) age over 17; (ii) diagnosis of idiopathic cervical dystonia (CD), Meige syndrome or oromandibular dystonia; (iii) onset of therapy in the outpatient department of the University of Düsseldorf (Germany) and continuous treatment every 12 to 13 weeks without the interruption of BoNT therapy of more than one treatment cycle; (iv) at least three injections of BoNT; and (v) treatment with incoBoNT/A only. Exclusion criteria were (i) patients under legal care; (ii) patients with multifocal or segmental dystonia; (iii) additional disabling disease other than CD; and (iv) patients with a clinical overt disturbance of mood or perception.
More than 500 charts of regularly treated patients in the outpatient department of the Neurological Clinic of the University hospital in Düsseldorf (Germany) were screened for interruptions in ongoing BoNT therapy. Patients with interruptions of less than two treatment cycles who fulfilled all inclusion criteria but no exclusion criteria were informed of the purpose of the study while waiting in the outpatient department for their next injection. In total, 35 patients (26 with CD and 9 with other cranial dystonia) who gave informed written consent were consecutively recruited.
The following demographic data (age at day of recruitment (AGE), age at onset of symptoms (AOS), age at onset of therapy (AOT), duration of therapy (DURT)) and the following treatment-related data (initial total dose (IDOSE) and actual total dose (ADOSE)) were extracted from the charts of the patients. The time to therapy (DURS = time span during which patients tolerated symptoms without BoNT therapy) was calculated as DURS = AOT − AOS. The increase in dose (INDOSE) during treatment was calculated as ADOSE-IDOSE.
Patients were asked to rate the change in the severity of their disease since the onset of BoNT therapy in percent of the severity at the onset of therapy (IMPQ, improvement (plus value) and worsening (minus value)).
In patients with CD, the treating physician scored the actual severity of CD on the day of recruitment by means of the TSUI score [32] (ATSUI). The initial TSUI score at the onset of therapy (ITSUI) was extracted from the chart of the patient, and improvement in the severity of CD determined by means of the TSUI score (IMPTSUI) was calculated as (ITSUI − ATSUI) × 100/ITSUI). The best TSUI score (BTSUI) during incoBoNT/A therapy was also extracted from the chart as well as the corresponding dose (BDOSE) at the time BTSUI occurred.

5.2. Drawing of the Course of Disease Graphs

The courses of disease before and after the onset of BoNT therapy were recalled by the patient on the day of recruitment.
The drawing of the course of disease graphs (CoD graphs) has been described in detail previously [24,25]. The patients were comfortably seated in front of a desk; one hand held a square piece of paper with a size of 10 × 10 cm, and the other held a pen. For the drawing of the CoD graph before BoNT therapy (CoDB graph), patients were instructed to draw a continuous graph representing their CoD severity from the onset of symptoms to the onset of BoNT/A therapy by starting at 0 at the left lower corner (onset of symptoms) and ending at the right upper corner (100% = severity of CD at the onset of BoNT/A therapy). Thereafter, a second square piece of paper measuring 10 × 10 cm in size was presented to the patient. Before drawing the CoD graph from the onset of BoNT therapy to the day of recruitment (CoDA graph), patients had to mark the actual severity of their disease on the day of recruitment (ASD) on a line running through the right edge of the square. Then, they were instructed to draw a continuous graph into a second square (representing their CoD severity from the onset of BoNT/A therapy until the actual day of recruitment) starting from the left upper corner (=100% = severity at the onset of BoNT/A therapy) to the ASD mark on the right edge of the square. Three attempts for CoDB and CoDA graph drawing were allowed, as well as verbal help by the investigator, but drawing assistance was not allowed. No example of a CoD graph was shown to avoid any bias. The improvement estimated by drawing the CoDA graph (IMPD) was calculated as (10 − ASD) × 10.
After the drawing of the CoD graphs, patients underwent a detailed clinical investigation and received their routine incoBoNT/A-injection. Thereafter, a blood sample was taken, centrifuged and deeply frozen for later NAB testing.

5.3. Classification of the CoD Graphs

Two of the thirty-five patients were unable to draw a continuous CoDB and/or CoDA graph. Thirty-three CoDB and CoDA graphs were scanned by means of a standard scanner. The commercially available software DIGITIZEIT® [33] was used to digitize the graphs. The origin and end of the x-axis, the origin and end of the y-axis and the origin and end of the CoD graphs were necessarily marked on the scan. The software was used to produce an x,y-table for a graph when a stick was moved along the scan from the origin to the end of the graph. These data were used to produce the digitized version of the graph, which was used for further analysis.
The classification of CoDB graphs into three different types depending on the main curvature has been described previously [24,25]. When more than 75% of the CoDB graph was drawn above the 45-degree line from the left lower to the right upper corner, the graph was classified as a “rapid onset” (RO) type. When the graph oscillated around the 45-degree line, the graph was classified as a “continuous onset” (CO) type. When 75% of the graph was drawn below the 45-degree line, the graph was classified as a “delayed onset” (DO) type.
The classification of the CoDA graphs was performed similarly. In the first step, a line between the left upper corner, and the ASD mark was drawn. A graph that was drawn more than 75% below this line was classified as a “rapid response” (RR) type, a graph that closely followed this line was classified as a “continuous response” (CR) type and a graph that was drawn 75% above this line was classified as a “delayed response” (DR) type.
The CoD graphs were independently classified by both authors: RB and BÜ. In five discordant cases, the final classification was achieved during a consensus meeting.

5.4. Antibody Testing

After the recruitment of all patients, pseudorandomized coded blood samples were sent to the Toxogen® laboratory (MMH, University of Hannover, Hanover, Germany) (without any information about clinical data) to be tested for the presence of NABs by means of the MHDA. All 33 blood samples were tested within one batch. The Toxogen® laboratory determined the time to paralysis (TTP) for each of the 33 blood samples and decided whether the blood sample was MHDA-positive or not.

5.5. Statistics

The final data analysis was based on 33 patients (26 patients with CD, 4 patients with Meige syndrome and 3 patients with oromandibular or oropharyngeal dystonia) with a complete data set.
The patients were split up into three subgroups (RO, CO and DO subgroups) according to the CoDB graphs. A chi2 analysis was performed for whether sex distribution was different across patient subgroups. A three-group ANOVA was performed to test whether AGE, AOS, DURS, DURT, IDOSE, ADOSE, INCD, ITSUI, ATSUI, IMPTSUI, IMPQ, IMPD, BDOSE, BTSUI and TTP were significantly different between the RO, CO and DO subgroups (see Table 1).
The patients were also split up into three other subgroups (RR, CR and DR subgroup) depending on the CoDA graph type. Again, a chi2 analysis was performed for whether sex distribution was different across patient subgroups. A three-group ANOVA was performed to test whether AGE, AOS, DURS, DURT, IDOSE, ADOSE, INCD, ITSUI, ATSUI, IMPTSUI, IMPQ, IMPD, BDOSE, BTSUI and TTP were significantly different between the RR, CR and DR subgroup (see Table 2). All statistical analyses were performed using the SPSS® statistics package (version 25; IBM, Armonk, NY, USA).

Author Contributions

Conceptualization, H.H. and S.S.; methodology, H.H.; software, D.R.; validation, B.Ü., R.B. and S.S.; formal analysis, D.R.; investigation, H.H.; resources, B.Ü. and R.B.; data curation, B.Ü. and R.B.; writing—original draft preparation, H.H.; writing—review and editing, H.H.; visualization, S.S.; supervision, H.H. and P.A.; project administration, P.A.; funding acquisition, H.H. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by a restricted grant of the private institution Inge Diesbach-Stiftung to HH. This funding did not influence the design and performance of the present study.

Institutional Review Board Statement

This study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board (or Ethics Committee) of Heinrich Heine University of Düsseldorf/number: 4085/date: 5 April 2013/updated date: 8 May 2018.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study of humans.

Data Availability Statement

Data are available upon request related to the restrictions of privacy or ethics. The data presented in this study are available upon request from the corresponding author.

Conflicts of Interest

All authors declare that they do not have any financial disclosures or conflicts of interest related directly to the work carried out in this study.

Abbreviations

aboBoNT/A: abobotulinum neurotoxin type A (Dysport®); ADOSE: actual dose at day of recruitment; AGE: age at day of recruitment; AOS: age at onset of symptoms; AOT: age at onset of therapy; ASD: actual severity of dystonia; ATSUI: actual TSUI score at day of recruitment; BoNT: botulinum neurotoxin; BoNT/A: botulinum neurotoxin type A; CD: idiopathic cervical dystonia; CoD: course of disease; CoDA graph: drawing of the course of disease from onset of BoNT therapy to recruitment; CoDB graph: drawing of the course of disease from onset of symptoms to onset of therapy; cSTF: complete secondary treatment failure; DURS: time from onset of symptoms to therapy (DURS: AOT-AOS); DURT: duration of therapy; IDOSE: initial dose at onset of BoNT therapy, IMPD: improvement according to drawing (see Materials and Methods); IMPQ: improvement according to questionnaire (see Materials and Methods); IMPTSUI: improvement according to TSUI score (see Materials and Methods); incoBoNT/A: incobotulinum neurotoxin type A (Xeomin®); INDOSE: increase in dose during BoNT therapy; ITSUI: initial TSUI score at onset of therapy; MHDA: mouse hemidiaphragma assay, NABs: neutralizing antibodies against BoNT, onaBoNT/A: onabotulinum neurotoxin type A (Botox®); OS/OT line: line from the left lower corner (onset of symptoms) to the right upper corner (onset of therapy) of the CoDB graph; OT/ASD line: line between the left upper corner (onset of therapy) and the mark for the actual severity of the disease (ASD mark) on the right edge of the CoDA graph; pSTF: partial secondary treatment failure; PTF: primary treatment failure; STF: secondary treatment failure; TSUI: score introduced by the author TSUI [10]; TTP: time to paralysis of the MHDA.

References

  1. Montecucco, C.; Schiavo, G.; Rossetto, O. The mechanism of action of tetanus and botulinum neurotoxins. Arch. Toxicol. Suppl. 1996, 18, 342–354. [Google Scholar] [PubMed]
  2. Gu, S.; Rumpel, S.; Zhou, J. Botulinum neurotoxin is shielded by NTNHA in an interlocked complex. Science 2012, 335, 977–981. [Google Scholar] [CrossRef] [Green Version]
  3. Lee, K.; Zhong, X.; Gu, S. Molecular basis for disruption of E-cadherin adhesion by botulinum neurotoxin A complex. Science 2014, 344, 1405–1410. [Google Scholar] [CrossRef] [Green Version]
  4. Eisele, K.H.; Taylor, H.V. Dissociation of the 900 kDa neurotoxin complex from C. botulinum under physiological conditions. Toxicon 2008, 51, 10. [Google Scholar] [CrossRef]
  5. Eisele, K.H.; Fink, K.; Vey, M.; Taylor, H. Studies on the dissociation of botulinum neurotoxin type A complexes. Toxicon 2011, 57, 555–565. [Google Scholar] [CrossRef] [PubMed]
  6. Frevert, J.; Dressler, D. Complexing Proteins in Botulinum Toxin Type A Drugs: A Help or a Hindrance? Biologics 2010, 4, 325–332. [Google Scholar] [CrossRef] [Green Version]
  7. Lee, J.C.; Yokota, K.; Arimitsu, H.; Hwang, H.J.; Sakaguchi, Y.; Cui, J.; Takeshi, K.; Watanabe, T.; Ohyama, T.; Oguma, K. Production of Anti-Neurotoxin Antibody Is Enhanced by Two Subcomponents, HA1 and HA3b, of Clostridium Botulinum Type B 16S Toxin-Haemagglutinin. Microbiology 2005, 151, 3739–3747. [Google Scholar] [CrossRef] [Green Version]
  8. Kukreja, R.; Chang, T.W.; Cai, S.; Lindo, P.; Riding, S.; Zhou, Y.; Ravichandran, E.; Singh, B.R. Immunological Characterization of the Subunits of Type A Botulinum Neurotoxin and Different Components of Its Associated Proteins. Toxicon 2009, 53, 616–624. [Google Scholar] [CrossRef]
  9. Joshi, S.G.; Elias, M.; Singh, A.; Al-Saleem, F.H.; Ancharski, D.; Nasser, Z.; Takahashi, T.; Simpson, L.L. Modulation of Botulinum Toxin-Induced Changes in Neuromuscular Function with Antibodies Directed against Recombinant Polypeptides or Fragments. Neuroscience 2011, 179, 208–222. [Google Scholar] [CrossRef]
  10. Van Kooyk, Y. C-type lectins on dendritic cells: Key modulators for the induction of immune responses. Biochem. Soc. Trans. 2008, 36, 1478–1481. [Google Scholar] [CrossRef]
  11. Oshima, M.; Deitiker, P.; Jankovic, J.; Atassi, M.Z. The Regions on the light chain of botulinum neurotoxin type A recognized by T cells from toxin-treated cervical dystonia patients. The complete human T-cell recognition map of the toxin molecule. Immunol. Investig. 2018, 47, 18–39. [Google Scholar] [CrossRef] [PubMed]
  12. Atassi, M.Z.; Dolimbek, B.Z.; Jankovic, J.; Steward, L.E.; Aoki, K.R. Molecular Recognition of Botulinum Neurotoxin B Heavy Chain by Human Antibodies from Cervical Dystonia Patients That Develop Immunoresistance to Toxin Treatment. Mol. Immunol. 2008, 45, 3878–3888. [Google Scholar] [CrossRef] [PubMed]
  13. Atassi, M.Z.; Dolimbek, B.Z.; Jankovic, J.; Steward, L.E.; Aoki, K.R. Regions of Botulinum Neurotoxin A Light Chain Recognized by Human Anti-Toxin Antibodies from Cervical Dystonia Patients Immunoresistant to Toxin Treatment. The Antigenic Structure of the Active Toxin Recognized by Human Antibodies. Immunobiology 2011, 216, 782–792. [Google Scholar] [CrossRef] [PubMed]
  14. Barinaga, M. Secrets of secretion revealed. Science 1993, 260, 487–489. [Google Scholar] [CrossRef]
  15. Eleopora, R.; Tugnoli, V.; Quatrale, R.; Rossetto, O.; Montecucco, C. Different types of botulinum toxin in humans. Mov. Disord. 2004, 19, 53–59. [Google Scholar] [CrossRef]
  16. Hefter, H.; Spiess, C.; Rosenthal, D. Very early reduction in efficacy of botulinum toxin therapy for cervical dystonia in patients with subsequent secondary treatment failure—A retrospective analysis. J. Neur. Trans. 2013, 121, 513–519. [Google Scholar] [CrossRef] [Green Version]
  17. Walter, U.; Mühlenhoff, C.; Benecke, R.; Dressler, D.; Mix, E.; Alt, J.; Wittstock, M.; Dudesek, A.; Storch, A.; Kamm, C. Frequency and risk factors of antibody-induced secondary failure of botulinum neurotoxin therapy. Neurology 2020, 94, e2109–e2120. [Google Scholar] [CrossRef]
  18. Schulte-Baukloh, H.; Bigalke, H.; Miller, K.; Heine, G.; Pape, D.; Lehmann, J.; Knispel, H.H. Botulinum Neurotoxin Type A in Urology: Antibodies as a Cause of Therapy Failure. Int. J. Urol. 2008, 15, 407–415. [Google Scholar] [CrossRef]
  19. Dressler, D. Clinical presentation and management of antibody-induced failure of botulinum toxin therapy. Mov. Disord. 2004, 19 (Suppl. S8), S92–S100. [Google Scholar] [CrossRef]
  20. Lange, O.; Bigalke, H.; Dengler, R.; Wegner, F.; de Groot, M.; Wohlfarth, K. Neutralizing antibodies and secondary therapy failure after treatment with botulinum toxin type A: Much ado about nothing? Clin. Neuropharmacol. 2009, 32, 213–218. [Google Scholar] [CrossRef]
  21. Fabbri, M.; Leodori, G.; Fernandes, R.M.; Bhidayasiri, R.; Marti, M.J.; Colosimo, C.; Ferreira, J.J. Neutralizing Antibody and Botulinum Toxin Therapy: A Systematic Review and Meta-Analysis. Neurotox. Res. 2016, 29, 105–117. [Google Scholar] [CrossRef] [PubMed]
  22. Hefter, H.; Rosenthal, D.; Moll, M. High botulinum toxin-neutralizing antibody prevalence under long-term cervical dystonia treatment. Mov. Disord. Clin. Pract. 2016, 3, 500–506. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Albrecht, P.; Jansen, A.; Lee, J.I.; Moll, M.; Ringelstein, M.; Rosenthal, D.; Bigalke, H.; Aktas, O.; Hartung, H.P.; Hefter, H. High prevalence of neutralizing antibodies after long-term botulinum neurotoxin therapy. Neurology 2019, 92, e48–e54. [Google Scholar] [CrossRef]
  24. Hefter, H.; Schomaecker, I.; Schomaecker, M.; Rosenthal, D.; Samadzadeh, S. The impact of the course of disease before botulinum toxin therapy on the course of treatment and long-term outcome in cervical dystonia. Toxins 2021, 13, 493. [Google Scholar] [CrossRef] [PubMed]
  25. Schomaecker, I. Einfluss des Beschwerdeverlaufes vor der Botulinumtoxintherapie Zervikaler Dystonien auf das Langzeitergebnis. 2022. Available online: https://docserv.uni-duesseldorf.de/ (accessed on 11 July 2023).
  26. Hefter, H.; Schomaecker, I.; Schomaecker, M.; Ürer, B.; Brauns, R.; Rosenthal, D.; Albrecht, P.; Samadzadeh, S. Lessons about Botulinum Toxin A Therapy from Cervical Dystonia Patients Drawing the Course of Disease: A Pilot Study. Toxins 2023, 15, 431. [Google Scholar] [CrossRef]
  27. Hefter, H.; Rosenthal, D.; Jansen, A.; Brauns, R.; Ürer, B.; Bigalke, H.; Hartung, H.-P.; Meuth, S.G.; Lee, J.-I.; Albrecht, P.; et al. Significantly lower antigenicity of incobotulinumtoxin than abo- or onabotulinumtoxin. J. Neurol. 2023, 270, 788–796. [Google Scholar] [CrossRef]
  28. Hefter, H.; Brauns, R.; Ürer, B.; Rosenthal, D.; Albrecht, P. Effective long-term treatment with incobotulinumtoxin (Xeomin®) without neutralizing antibody induction: A monocentric, cross-sectional study. J. Neurol. 2020, 267, 1340–1347. [Google Scholar] [CrossRef] [Green Version]
  29. Hefter, H.; Schoemaeker, I.; Schomaecker, M.; Hefter, H. Disease progression of idiopathic cervical dystonia in spite of improvement after botulinum toxin therapy. Front. Neurol. 2020, 11, 588395. [Google Scholar] [CrossRef]
  30. Lee, J.-I.; Jansen, A.; Samadzadeh, S.; Kahlen, U.; Moll, M.; Ringelstein, M.; Soncin, G.; Bigalke, H.; Aktas, O.; Moldovan, A.S.; et al. Long-term adherence and response behaviour to botulinum toxin in different indications. Ann. Clin. Trans. Neurol. 2021, 8, 15–28. [Google Scholar] [CrossRef]
  31. Samadzadeh, S.; Brauns, R.; Hefter, H. The extreme ends of the treatment response spectrum to botulinum toxin in cervical dystonia. Toxins 2021, 13, 22. [Google Scholar] [CrossRef]
  32. Tsui, J.K.; Eisen, A.; Stoessl, A.J.; Calne, S.; Calne, D.B. Double-blind study of botulinum toxin in spasmodic torticollis. Lancet 1986, 2, 245–247. [Google Scholar] [CrossRef] [PubMed]
  33. Available online: https://www.digitizeIT.de/ (accessed on 11 July 2023).
Figure 1. For each of the three patient subgroups (DO subgroup (upper row), CO subgroup (middle row) and RO subgroup (lower row)) a typical CoDB graph is demonstrated on the left side; all CoDB graphs in the middle part and the average CoDB graph and the corresponding plus/minus 1 standard deviation range across all patients within the subgroup are on the right side.
Figure 1. For each of the three patient subgroups (DO subgroup (upper row), CO subgroup (middle row) and RO subgroup (lower row)) a typical CoDB graph is demonstrated on the left side; all CoDB graphs in the middle part and the average CoDB graph and the corresponding plus/minus 1 standard deviation range across all patients within the subgroup are on the right side.
Toxins 15 00454 g001
Figure 2. For each of the three patient subgroups (DR subgroup (upper row), CR subgroup (middle row) and RR subgroup (lower row)), a typical CoDA graph is demonstrated on the left side; all CoDA graphs in the middle part and the average CoDA graph and the corresponding plus/minus 1 standard deviation range across all patients within the subgroup are on the right side. No patient had a CoDA graph exhibiting initial improvement and secondary worsening, indicating a secondary treatment failure.
Figure 2. For each of the three patient subgroups (DR subgroup (upper row), CR subgroup (middle row) and RR subgroup (lower row)), a typical CoDA graph is demonstrated on the left side; all CoDA graphs in the middle part and the average CoDA graph and the corresponding plus/minus 1 standard deviation range across all patients within the subgroup are on the right side. No patient had a CoDA graph exhibiting initial improvement and secondary worsening, indicating a secondary treatment failure.
Toxins 15 00454 g002
Table 1. Statistical comparison (three-group ANOVA) of demographic and treatment-related data between the RO, CO and DO subgroups.
Table 1. Statistical comparison (three-group ANOVA) of demographic and treatment-related data between the RO, CO and DO subgroups.
ParameterROCODOALLSignificance-Level
(p < 0.05)
n =7151133
Female/male¾10/54/717/16n.s.
AGE (years)MV/SD53.9/14.159.67/13.1360.5/13.158.72/13.15n.s.
MIN–MAX28.62–71.5834.76–82.2230.35–81.4428.62–82.22
AOS (years)MV/SD43.4/17.646.46/14.2051.4/15.047.57/15.04n.s.
MIN–MAX15.89–63.0113.18–67.0322.38–73.8913.18–73.89
DURS (months)MV/SD67.2/139.273.08/108.3642/52.862.04/96.96n.s.
MIN–MAX1.2–336.003.6–336.001.2–192.001.2–336.00
DURT (months)MV/SD63.36/21.4884/29.6472/2476.32/25.29n.s.
MIN–MAX48.00–108.0048.00–132.0048.00–108.0048.00–132.00
IDOSEMV/SD202.86/69.63105.50/71.95218.64/58.66163.86/84.91p < 0.009
MIN–MAX100.00–300.0030.00–230.0080.00–300.0030.00–300.00
ADOSEMV/SD314.29/69.01198.67/108.31309.55/100.56260.15/111.52p < 0.01
MIN–MAX200.00–400.0035.00–400.00160.00–500.0035.00– 500.00
INDOSEMV/SD111.43/23.2293.17/77.9190.91/99.6496.29/76.97n.s.
MIN–MAX80.00–150.000.00–300.00−40.00–260.00−40.00–300.00
ITSUIMV/SD9.67/3.675.57/2.157.75/2.967.57/3.25n.s.
MIN–MAX6.00–16.004.00–10.004.00–12.004.00–16.00
ATSUIMV/SD3.00/1.553.75/1.675.00/4.423.96/2.99n.s.
MIN–MAX1.00–5.002.00–7.000.00–12.000.00–12.00
IMPTSUIMV/SD6.67/3.881.86/2.733.63/5.133.60/3.5n.s.
MIN–MAX1.00–12.00−1.00–7.00−4.00–12.00−4.00–12.00
IMPQMV/SD77.86/8.0973.73/16.0757.00/23.2469.41/19.00p < 0.03
MIN–MAX65.00 -| 90.0040.00–96.000.00–90.000.00–96.00
IMPDMV/SD73.54/21.8871.44/15.7864.58/19.5769.60/18.22n.s.
MIN–MAX29.60–100.0035.20–88.0033.8–98.6029.60–100.00
BDOSEMV/SD274.29/95.54185.00/70.91301.67/73.40249.42/92.42p < 0.01
MIN-MAX170.00–400.0060.00–300.00200.00–400.0060.00–400.00
BTSUIMV/SD1.86/1.680.89/1.171.78/1.791.48/1.56n.s.
MIN–MAX0.00–4.000.00–3.000.00–5.000.00–5.00
TTP
(min)
MV/SD48.86/3.1348.54/3.5546.00/2.4947.71/3.28n.s.
MIN–MAX44.00–52.0043.00–55.0041.00–51.0041.00–55.00
The abbreviations of the parameters in column 1 are explained in the list of abbreviations and the methods. MV: Mean value; SD: standard deviation; MIN: minimum in the patient group; MAX: maximum in the patient group.
Table 2. Statistical comparison (three-group ANOVA) of demographic and treatment-related data between the RR, CR and DR subgroups.
Table 2. Statistical comparison (three-group ANOVA) of demographic and treatment-related data between the RR, CR and DR subgroups.
ParameterRRCRDRALLSignificance-Level (p < 0.05)
N =918633
Female/male2/712/64/218/15p = 0.05
AGE (years)MV/SD60.0/11.3255.27/14.0967.17/9.7958.72/13.15n.s.
MIN–MAX44.87–76.5728.62–81.4456.1–82.2228.62–82.22
AOS (years)MV/SD47.56/17.6345.94/15.7252.5/8.4147.57/15.03n.s.
MIN–MAX13.18–64.9315.89–72.8941.75–67.3013.18–72.89
DURS (months)MV/SD88.2/112.844.8/76.0873.8/120.9661.2/95.88n.s.
MIN–MAX8.04–323.641.2–338.766.00–343.441.2–343.44
DURT (months)MV/SD74.76/23.2844.8/21.2493.6/3676.32/25.92n.s.
MIN–MAX51.6–110.448.0–124.845.6–142.845.6–142.8
IDOSEMV/SD140.83/92.94186.11/76.50131.67/91.91163.86/84.91n.s.
MIN–MAX30.00–300.0030.00–300.0035.00–275.0030.00–300.00
ADOSEMV/SD215.0/130.0286.4/89.53249.17/137.86260.15/111.6n.s.
MIN–MAX35.00–400.00100.00–500.0080.00–400.0035.00–500.00
INDOSEMV/SD74.17/70.47100.27/72.52117.5/102.9996.29/76.97n.s.
MIN–MAX0.00–200.00−40.00–260.000.00–300.00−40.00– 300.00
ITSUIMV/SD6.20/2.287.54/2.7510.0/6.07.6/3.25n.s.
MIN–MAX4.00–9.004.00–12.004.00–16.004.00–16.00
ATSUIMV/SD4.00/2.123.77/3.062.67/1.153.96/2.99n.s.
MIN–MAX2.00–7.000.00–12.002.00–4.000.00–12.00
IMPTSUIMV/SD1.25/3.493.77/4,77.33/5.033.9/4.360.24; n.s.
MIN–MAX1.00–2.00−4.00–12.002.00–12.00−4.00–12.00
IMPQMV/SD70.11/29.967.06/11.1875.0/18.7169.4/18.99n.s.
MIN–MAX60.00–96.000.00–80.0040.00–90.000.00–96.00
IMPDMV/SD67.6170.52/16.4469.82/19.4969.6/18.22n.s.
MIN–MAX29.60–91.5033.80–100.0035.20–88.00−29.6–100.00
BDOSEMV/SD218.57/106.53246.79/88.1257.50/117.86249.42/92.42n.s.
MIN-MAX60.00–400.00100.00–400.00130.00–400.0060.00–400.00
BTSUIMV/SD1.43/1.811.26/1.492.67/1.151.68/1.8n.s.
MIN-MAX0.00–5.000.00–4.000.00–4.000.00–5.00
TTP
(min)
MV/SD48.56/3.3247.7/3.4146.20/2.7747.71/3.28n.s.
MIN–MAX44.00–55.0041.00–52.0044.00–51.0041.00–55.00
Abbreviations of the parameters in column 1 are explained in the list of abbreviations and in the Materials and Methods Section. MV: Mean value; SD: standard deviation; MIN: minimum in the patient group; MAX: maximum in the patient group.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hefter, H.; Brauns, R.; Ürer, B.; Rosenthal, D.; Albrecht, P.; Samadzadeh, S. No Secondary Treatment Failure during Incobotulinumtoxin—A Long-Term Treatment Demonstrated by the Drawing of Disease Severity. Toxins 2023, 15, 454. https://doi.org/10.3390/toxins15070454

AMA Style

Hefter H, Brauns R, Ürer B, Rosenthal D, Albrecht P, Samadzadeh S. No Secondary Treatment Failure during Incobotulinumtoxin—A Long-Term Treatment Demonstrated by the Drawing of Disease Severity. Toxins. 2023; 15(7):454. https://doi.org/10.3390/toxins15070454

Chicago/Turabian Style

Hefter, Harald, Raphaela Brauns, Beyza Ürer, Dietmar Rosenthal, Philipp Albrecht, and Sara Samadzadeh. 2023. "No Secondary Treatment Failure during Incobotulinumtoxin—A Long-Term Treatment Demonstrated by the Drawing of Disease Severity" Toxins 15, no. 7: 454. https://doi.org/10.3390/toxins15070454

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop