Next Article in Journal
Effects of Combining High-Definition Transcranial Direct Current Stimulation with Short-Foot Exercise on Chronic Ankle Instability: A Pilot Randomized and Double-Blinded Study
Next Article in Special Issue
Neuroprognostication of Consciousness Recovery in a Patient with COVID-19 Related Encephalitis: Preliminary Findings from a Multimodal Approach
Previous Article in Journal
Comprehensive Analysis of RNA-Seq Gene Expression Profiling of Brain Transcriptomes Reveals Novel Genes, Regulators, and Pathways in Autism Spectrum Disorder
Previous Article in Special Issue
Whole-Brain Models to Explore Altered States of Consciousness from the Bottom Up
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Auditory and Somatosensory P3 Are Complementary for the Assessment of Patients with Disorders of Consciousness

1
GIGA Consciousness, Coma Science Group, University of Liege, 4000 Liege, Belgium
2
Centre du Cerveau (C2), University Hospital Liege, 4000 Liege, Belgium
3
Schoen Klinik Bad Aibling, 83043 Bad Aibling, Germany
4
Department of Clinical Psychology, University of Tuebingen-, 72074 Tuebingen, Germany
5
Guger Technologies OG, 8020 Graz, Austria
6
Laboratory for NeuroImaging of Coma and Consciousness—Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, 02114 MA, USA
7
Experimental Oto-rino-laryngology, Department of Neuroscience, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
8
g.tec Medical Engineering, 08038 Barcelona, Spain
9
g.tec Medical Engineering GmbH, 4521 Schiedlberg, Austria
*
Author to whom correspondence should be addressed.
Contributed equally.
Brain Sci. 2020, 10(10), 748; https://doi.org/10.3390/brainsci10100748
Submission received: 2 September 2020 / Revised: 30 September 2020 / Accepted: 14 October 2020 / Published: 17 October 2020
(This article belongs to the Special Issue Recent Advances in the Study of Altered State of Consciousness)

Abstract

:
The evaluation of the level of consciousness in patients with disorders of consciousness (DOC) is primarily based on behavioural assessments. Patients with unresponsive wakefulness syndrome (UWS) do not show any sign of awareness of their environment, while minimally conscious state (MCS) patients show reproducible but fluctuating signs of awareness. Some patients, although with remaining cognitive abilities, are not able to exhibit overt voluntary responses at the bedside and may be misdiagnosed as UWS. Several studies investigated functional neuroimaging and neurophysiology as an additional tool to evaluate the level of consciousness and to detect covert command following in DOC. Most of these studies are based on auditory stimulation, neglecting patients suffering from decreased or absent hearing abilities. In the present study, we aim to assess the response to a P3-based paradigm in 40 patients with DOC and 12 healthy participants using auditory (AEP) and vibrotactile (VTP) stimulation. To this end, an EEG-based brain-computer interface was used at DOC patient’s bedside. We compared the significance of the P3 performance (i.e., the interpretation of significance of the evoked P3 response) as obtained by ‘direct processing’ (i.e., theoretical-based significance threshold) and ‘offline processing’ (i.e., permutation-based single subject level threshold). We evaluated whether the P3 performances were dependent on clinical variables such as diagnosis (UWS and MCS), aetiology and time since injury. Last we tested the dependency of AEP and VTP performances at the single subject level. Direct processing tends to overestimate P3 performance. We did not find any difference in the presence of a P3 performance according to the level of consciousness (UWS vs. MCS) or the aetiology (traumatic vs. non-traumatic brain injury). The performance achieved at the AEP paradigm was independent from what was achieved at the VTP paradigm, indicating that some patients performed better on the AEP task while others performed better on the VTP task. Our results support the importance of using multimodal approaches in the assessment of DOC patients in order to optimise the evaluation of patient’s abilities.

1. Introduction

Following a severe brain injury, patients may fall into a coma. Some of these patients evolve into a state with decreased awareness in the presence of eye opening, referred to as disorders of consciousness (DOC). In this state, patients can either only present reflexive behaviour without signs of awareness (unresponsive wakefulness syndrome, UWS [1], also referred to as vegetative state [2]), or present minimal signs of awareness (minimally conscious state, MCS [3]). Patients who recover functional object use or communication are considered as emerged from the MCS (EMCS), even though cognitive deficits are still common [3]. The differential diagnosis of patients with DOC in clinical practice is primarily based on structured behavioural assessments such as the Coma Recovery Scale-Revised (CRS-R) [4]. The risk of misdiagnosis due to arousal fluctuation can be reduced to some extent by repeating the measurements over time [5]. However, a limitation of the behavioural assessment is that it is highly dependent on motor and language abilities. The vast majority of DOC patients suffers from visual, auditory or motor limitations (e.g., spasticity in 88–96% of DOC patients [6,7]) that can impede their behavioural evaluation [8].
Bedside evaluation of behavioural responsiveness and laboratory/para-clinical investigation via neuroimaging or neurophysiological assessment lead to contradictory results in a considerable amount of patients [9]. Indeed, some patients may show preserved residual brain function as measured with neuroimaging, suggesting a level of cognitive function and consciousness more preserved than what is observable at bedside (e.g., referred to as MCS*) [10,11,12]. Some patients show a dissociation between the absence of command following at bedside and the presence of covert command following (i.e., modulation of brain activity in response to a command; referred to as or cognitive motor dissociation) [13]. A minority of patients who can produce a goal-oriented response to simple instructions, could use these voluntary alterations of brain function for communication purposes with a brain computer interface (BCI) (e.g., referred to as functional locked-in [14]) [15,16].
The limitations of clinical assessment of DOC patients highlight the need for additional diagnostic measurements in clinical routine. These assessments should work independently from behavioural responses, directly probing cerebral resting state activity or task-evoked cerebral responses. Electroencephalography (EEG) is cost-effective, requires limited preparation time, is mobile and easily applicable at the patient’s bedside. Another advantage is its high temporal resolution, making it especially suitable for brain-computer interface (BCI) applications. Yet, it is still difficult to transpose the use of EEG-BCI from healthy subjects to patients with DOC due to high false-negative and false-positive rates [17,18,19].
Event related potentials (ERPs) reflect the (averaged) electrophysiological response to certain sensory, cognitive, or motor events. Simple cortical responses (e.g., P1, N1, P2, P3a) could occur regardless of one’s level of consciousness, and are more likely when the baseline EEG shows activity above 4 Hz [20]. One of the most commonly used ERPs is the P3. It is defined as a positive deflection in the ongoing local field potential about 300 ms after a deviant stimulation in a train of standard stimuli. The P3 can be divided into an early P3a response with a frontal topography reflecting novelty and is unrelated to consciousness and can be present during sleep, coma and UWS ([21,22] for review). The later P3b response over the parietal cortex and is related to cognitive processing [23], is modulated by conscious attention [24,25], and therefore has been proposed as an objective marker of conscious awareness. At the group level, a significant P3 (i.e. not differentiated between the P3a and P3b) response is less commonly observed in UWS than in MCS patients [20]. MCS patients show a higher P3 amplitude in response to their own name compared to unfamiliar names, and following the instruction to count the deviant (active paradigm) as compared to measurements without instruction (passive paradigm) [26].
The P3 can be elicited by, amongst others, auditory [25] and somatosensory [27] stimuli. Given that DOC patients suffered from severe brain injury, it is possible that either of these stimuli cannot be processed. This would impede to evaluate the P3b responses to that modality, even if the patient might be conscious, and can therefore not be used reliably to probe signs of conscious attention. Previous P3 (or even hybrid BCI [28]) studies have however focused only on the brain response to a single sensory stimulus, impeding assessment of patients with limitations in the processing of certain modalities.
This multicentre study includes DOC patients and healthy participants from Liege (LI, Belgium) and Bad Aibling (BA, Germany). We tested if the interpretation of P3 significance (i.e., P3 performance) were equally reliable during direct (i.e., using a theoretical significance threshold) and offline (i.e., using a single subject permutation based significance threshold) processing, and dependent on diagnosis, aetiology and time since injury. Second, we tested whether the P3 performance to the auditory and tactile stimulation differed within participants to evaluate if multimodal assessment provides additional information over unimodal assessment.

2. Materials and Methods

2.1. Participants

Participants in this multicentre study were recruited in the University Hospital of Liège, Belgium (LI) and in the Schoen Klinik, Bad Aibling, Germany (BA). The study included a convenience sample of 58 DOC patients (31 from LI, 27 from BA) and 15 healthy participants (7 from LI and 8 from BA). Patients suffered either from a traumatic or non-traumatic (e.g., haemorrhage, stroke, anoxia) brain injury. Time elapsed since injury was at least one month before study enrolment. All patients were spontaneously breathing and had no history of neurological or mental disease prior the event of brain injury. Patients with known auditory deficits or open wounds following craniotomy were excluded from the study.
Patients were evaluated several times with the CRS-R [29]. Precisely, the patients in LI were assessed five times within one week of the BCI assessment including once on the day of the BCI assessment; the patients in BA were repeatedly tested every two weeks before study enrolment and retested on the day of BCI assessment. CRS-R examinations were performed by experienced and trained assessors. The diagnosis for each patient was given as the best diagnosis out of the series of clinical tests, in order to account for vigilance fluctuations [5]. Clinical, demographic and P3 data are summarised in Table 1. The study was approved by the ethical committees of the University of Tuebingen and the University hospital of Liège. Written informed consent was obtained from the patients’ legal representatives and from the healthy participants.

2.2. P3 Assessment and Data Processing

In the present study, we used an auditory and a vibrotactile P3 paradigm from a commercially available EEG-based BCI system (mindBEAGLE, g.tec medical engineering, Austria). All settings of mindBEAGLE, as described in this section, are preconfigured and cannot be tuned by users. P3 assessments were performed at the patient’s bedside. If the patient showed prolonged eye closure before or during the assessment, the paradigm was paused and the patient was aroused (using the CRS-R arousal facilitation protocol) before the start or continuation of the assessment. The assessment consisted of two oddball paradigms: auditory-evoked potentials (AEP) and vibrotactile-evoked somatosensory potentials (VTP). For both active paradigms, the patient was instructed to mentally count the number of deviant stimuli (i.e., the high pitch tones or attended hand receiving vibrations less frequently). In both paradigms, a total of 480 stimuli (of which 60 deviant stimuli) were delivered.
For the AEP paradigm, insert earphones were used to deliver the deviant and the standard stimulus binaurally. Both stimuli had a duration of 100 ms, and the onset-to-onset inter-stimulus interval was 900 ms. The rare (probability of 0.125) deviant stimulus was a pure tone burst with a base frequency of 1000 Hz. The frequent (probability of 0.875) standard stimulus was a pure tone burst with a base frequency of 500 Hz. The AEP paradigm had a total duration of 8 min.
For the VTP paradigm, mechanical vibrating tactors were fixed to the patient’s left and right wrists. The vibrotactile stimuli were delivered by the g.STIMbox (g.tec, Austria) and had a duration of 30 ms and a frequency of 225 Hz with an onset-to-onset inter-stimulus interval of 270 ms. The tactors on one wrist delivered the rare (probability of 0.125) deviant stimulus and the tactor on the other wrist delivered the frequent (probability of 0.875) standard stimulus. In patients from BA, the tactor that delivered the deviant stimulus was applied on the left wrist and the tactor that delivered the standard stimulus on the right wrist, which was reversed in patients from LI. The VTP paradigm had a total duration of 2.4 min.
The EEG was recorded by eight active gel electrodes (g.SCARABEO Ag/AgCl electrodes, g.tec, Austria) placed according to the international 10–20 electrode system at FCz, C3, Cz, C4, CP1, CPz, CP2 and Pz. The ground electrode was on the forehead (AFz) and to the reference was on the right earlobe (BA) or mastoid (LI). Data were recorded at 256 Hz, and band-pass filtered between 0.01 Hz and 30 Hz with a 4th order Butterworth filter.
The BCI system includes a data processing tool, consisting of automatic EEG preprocessing, artefact rejection and calculation of the true positive rate of the deviant stimulus detection (see below and Figure 1 for an overview of the data processing, or [29]).
Continuous EEG data were segmented into 700 ms-epochs, starting 100 ms before and ending 600 ms after the onset of the stimulus. Each epoch was baseline corrected using the 100 ms period preceding stimulus onset. Trials exceeding an amplitude of 100 µV were marked as artefact and excluded from the analysis. The remaining trials were averaged to compute the deviant and standard P3. The deviant and standard P3 performances were down-sampled to 6 samples by the factor of 24 with a moving average filter, resulting in a 48-features space (6 samples *8 channels). A linear discrimination analysis was used to discriminate standard and deviant trials. A two-fold cross-validation was used to evaluate the true positive rate for every subject, and was repeated ten times.
The true positive rate was calculated as the percentage of detected deviant trials over the total number of deviant trials (i.e., 60). To evaluate if the true positive rate was above chance level, which we refer here as ‘differentiated response’, two different approaches were used. In the ‘direct processing’, the significance level was set at 23% (binomial test, n = 60 trials, alpha = 0.05, for more details, see the previous studies in completely locked-in syndrome [30] and UWS [31] patients). In the ‘offline processing’, a subject-specific level of significance was computed using a permutation test (as described in [32,33], 1000 repetitions, p < 0.05).

2.3. Statistics

Statistics were performed using the statistical computing software R [34].
Chi-square statistics were used to test for group differences (Healthy participants, EMCS, MCS, UWS) in the distribution of gender and aetiology. ANOVA followed by Tukey HSD post-hoc comparisons were used to test group differences (Healthy participants, EMCS, MCS, UWS) in age and time elapsed since injury. A Welch two sample t-test was employed to test age differences between the patients and healthy participant group.
To evaluate the quality of the data processing algorithm, the differences in true positive rate between ‘direct processing’ and ‘offline processing’ were compared by means of one-sample Chi-Square test.
For further calculations, the results of the ‘offline processing’ were used. To investigate the relationship between group and ‘differentiated response’ in none, either or both paradigms, Chi square statistics of independence was calculated. For calculations that included the P3 performance in both paradigms, participants with a missing value in one of the paradigms were excluded list-wise. The Chi-square statistics were calculated for the whole sample (patients and healthy participants) and for patients only, to ensure that the results are not solely driven by the healthy participants.
In order to estimate the predictive value of diagnosis (UWS and MCS only), aetiology and time since injury on the differentiated response, a logarithmic regression model was employed for both paradigms separately. The ‘differentiated response’ (i.e., for the AEP or VTP) was used as dependent variable. Diagnosis, time since injury, aetiology, were integrated as independent variables in the logarithmic regression model.

3. Results

Data acquisition problems affecting either or both paradigms occurred and led to data exclusion of 18 DOC patients and 3 healthy participants. The final and complete dataset consisted of 15 UWS (51.8 ± 15.9 years, 9 males, 4 TBI), 23 MCS (42.3 ± 16.4 years, 16 males, 10 TBI) and 2 EMCS (25.0 ± 17.6 years, 2 males, 1 TBI) patients and 12 healthy participants (26.3 ± 7.2 years, 4 males).
Patients were older than healthy participants (t (34.06) = −6.21, p < 0.0001, 95% CI = [−27.1, −13.7]), but age did not differ amongst the different patient groups (adjusted p-value EMCS-MCS = 0.17; EMCS-UWS = 0.05; MCS-UWS = 0.45). There was no difference in the distribution of gender between patients and healthy participants (χ2 = 5.74, p = 0.11). More UWS than MCS patients suffered from a non-traumatic brain injury (χ2 = 7.73, p = 0.048) but no difference was found for time since injury (F (2, 36) = 1.82, p = 0.18).
There was evidence for a difference in the proportion of ‘differentiated responses’ in the two ways of defining the significance threshold (i.e., the ‘direct’ and ‘offline’ single subject-based threshold) for both paradigms (AEP: (χ2 (1, N = 52) = 11.3, p < 0.0001), VTP: (χ2 (1, N = 52) = 17.0, p <0.0001)).
‘Direct processing’ suggested that the P3 response was significant for 28 (of 52 healthy and DOC) participants for the AEP, and for 29 (of 52 healthy and DOC) for the VTP. The ‘offline processing’ revealed a ‘differentiated response’ in the AEP paradigm for 25 (of 52 healthy and DOC) participants and in the VTP for 29 (of 52 healthy and DOC) participants (Table 1). Seven participants (3 UWS, 4 MCS) showed solely a ‘differentiated response’ during the AEP. Eleven participants (5 UWS, 6 MCS) showed solely a ‘differentiated response’ during the VTP. Eighteen participants (5 MCS, 1 EMCS, 12 healthy participants) showed a ‘differentiated response’ during both paradigms. Sixteen participants did not show a ‘differentiated response’ to either paradigm (7 UWS, 8 MCS, 1 EMCS). Grand average ERPs per diagnostic group and significance of the response are presented in Figure 2.
The logarithmic regression model to predict ‘differentiated response’ in the AEP paradigm showed that neither diagnosis (OR: 0.48, 95%CI: [−2.45, 0.82]), aetiology (OR: 0.92, 95%CI: [−1.75, 1.44]) or time since injury (OR: 1.00, 95%CI: [−0.0005, 0.001]) were significant predictors (Figure 3, top). The logarithmic regression model to predict ‘differentiated response’ in the VTP paradigm did not show diagnosis (OR: 0.68, 95%CI [−1.86, 1.06]), aetiology (OR: 2.27, 95%CI [−0.61, 2.29]) or disease duration (OR: 1.00, 95%CI [−0.0009, 0.002]) to be significant predictors (Figure 3 bottom).
The distributions of participants with a ‘differentiated response’ for the AEP and VTP were dependent on the performance of the other paradigm in healthy participants and patients together (χ2 (1, N = 52) = 3.95, p = 0.047). However, independency between the two paradigms was observed when considering patients only (χ2 (1, N = 40) = 0, p = 1, Figure 4).

4. Discussion

In the present study, P3-based oddball paradigms were employed to evaluate patients’ P3 performance to auditory and somatosensory stimulation as additional diagnostic measurements to complement the behavioural assessment of patients with DOC.
We first tested if the P3 performances were equally reliable during direct and offline processing, and dependent on diagnosis, aetiology and time since injury. The ‘direct’ and ‘offline’ processing yielded a different interpretation of the true positive rate (i.e., if the obtained true positive rate corresponds to a ‘differentiated response’), suggesting that caution is required when using a fixed and theoretically based threshold (in this case of 23%). The permutation-based (i.e., tailored to the patient) threshold was often higher than 23%, hence false positive results are to be expected using ‘direct’ processing. Additional ‘offline processing’ increases the validity and interpretability of the results as false positive or false negative results (both raising ethical issues [35]) are significantly reduced when a single-subject threshold is defined [33]. Even if the direct processing of ERP recordings provides a promising perspective for real-time BCI applications, its clinical application as implemented in the current system seems premature. Efforts should be intensified to improve online processing of P3 performance.
There was no evidence for a difference in the presence of ‘differentiated response’ between UWS and MCS patients, regardless of aetiology. This finding corroborates with previous research showing the presence of the P3 in different subacute and chronic states of unconsciousness [36]. Yet, a P3 performance to the own name might be observed prior to the first behavioural signs of consciousness [36] and the presence of auditory discrimination during coma is predictive for awakening [37]. However, the current study focused on patients in a sub-acute and chronic DOC in which our findings confirm previous work suggesting that the P3 performance is less informative for these patients [22,38].
Second, we tested whether the P3 performance to the auditory and tactile stimulation differed within participants to evaluate if multimodal assessment provides additional information over unimodal assessment. We evaluated whether participants showed a ‘differentiated response’ to both, one or none of the paradigms. About a quarter of the patients showed a ‘differentiated response’ to only one of the paradigms. Given that DOC patients suffer from a severe brain injury, it is possible that either stimulus is not processed efficiently. Hence, we propose that a multimodal assessment of DOC patients can account for the individual impairments in the patient group, and in this way improve the detection of potential covert abilities. Future studies should formally test this by assessing P3 performance to different modalities in patients with characterised sensory impairments (e.g., using classical auditory/somatosensory evoked potentials), and select the most promising sensory modality for every patient. Then, once above chance level true positive rate (i.e., using offline permutation-based single subject thresholds) is established, the modality with highest true positive rate could be employed in active paradigms to detect signs of covert command following, and ultimately for BCI-based communication. However, as mentioned above, for BCI applications it is crucial that the online detection of above chance-level P3 performance improves. This would ensure to establish reliable communication, avoid false positive (and false negative) results. Furthermore, supplementary neuroimaging could provide insights in the residual cognitive function and help to evaluate whether the P3 performance (and ultimately communication) fits with the patient’s residual brain function [39].
Previous EEG studies have found signs of covert command following in DOC patients. EEG-based systems for DOC patients have successfully employed motor imagery paradigms in 19% of the UWS [40] and 22% of the MCS [41] patients. A recent study reports that 75% of severely brain injured patients (including UWS, MCS and EMCS patients) were able to show command following using various active imagery paradigms [42]. Our findings built up on these results and support the need of different active paradigms to maximise the chances of establishing covert command following and potentially communication in this heterogeneous group of DOC patients.
The P3 could be used for communication purposes. However, even if not tested in this study, it is important to stress that communication should be assessed in a structured way similar to as should be done during behavioural evaluation. First, by asking the participant to reply ‘yes’ and ‘no’, then by asking simple biographical or situational oriented questions as described in the CRS-R [43] that includes a double question to which the answer is once ‘yes’ and once ‘no’. Only then it can be confirmed that communication is reliable.
A limitation of the proposed method is its requirement in recording the brain response to a sufficient number of stimuli in order to draw valid conclusions; each patient being evaluated only once with the system. However, even if the patient was positioned upright and the measurement was paused several times to avoid fatigue, fluctuations in the level of arousal could impact the assessments. Similar to behavioural assessment [5], future studies should repeat the assessment and include different ultradian and circadian time windows [44,45] to maximise the chance to detect a ‘differentiated response’ for the P3 paradigm. Another limitation of the auditory P3 paradigm is its monotonous structure. The assessment could benefit from incorporating more complex stimuli (e.g., natural voice, words, own names [46,47]), as the P3 is elicited more frequently by complex harmonic tones (e.g., musical chords, words) than by sinusoidal tones [20]. Furthermore, classical somatosensory and auditory evoked potentials could be implemented to evaluate if the top-down connections are preserved and the specific modality could be used. In order to increase the salience of the active paradigms, future studies could also use different somatosensory stimuli. A multisensory integration task could increase the patient’s involvement, and would allow studying multisensory integration. In the future, a combination of P3, motor imagery, steady state visually evoked potentials, steady state somatosensory evoked potentials paradigms and other BCIs should be applied (with stimulation parameters adjustable by the user) and compared within participants to evaluate the effectiveness of every paradigm for the assessment of command following and (ultimately) communication in DOC patients. Indeed, monitoring multiple sensory channels recruits a more extended brain network than either modality-specific network [48], and the information transfer rate during an auditory-tactile P3 session is about 50% higher than during either unimodal session [49]. Thus, the cortical response seems to be spatially extended and of higher amplitude, which should facilitate the quantification of the P3 performance in general and in DOC patients in specific.

5. Conclusions

In conclusion, we here show that even if the P3 performance using AEP and VTP does not depend on diagnosis or aetiology, some patients showed a ‘differentiated response’ to only one of the paradigms. This has important implications for future BCI technologies as it supports the need for development of tools involving multiple, and not only auditory, modalities.

Author Contributions

Conceptualisation, J.A., I.M., C.C., S.L. and F.M.; data curation, J.A. and I.M.; formal analysis, J.A., I.M., R.X., R.O. and D.L.; funding acquisition, S.L.; investigation, J.A., I.M., C.C. and D.L.; methodology, J.A., I.M., R.X., C.C., R.O., D.L. and C.G.; project administration, J.A.; resources, C.G., S.L. and F.M.; software, C.G.; supervision, C.C., S.L. and F.M.; visualisation, J.A. and R.O.; writing—original draft, J.A. and I.M.; writing—review and editing, J.A., C.C. and E.A.C.B. All authors have read and agreed to the published version of the manuscript.

Funding

The study was supported by the University and University Hospital of Liège, the Belgian National Funds for Scientific Research (FRS-FNRS), the European Union’s Horizon 2020 Framework Programme for Research and Innovation under the Specific Grant Agreement No. 945539 (Human Brain Project SGA3), the European Space Agency (ESA) and the Belgian Federal Science Policy Office (BELSPO) in the framework of the PRODEX Programme, “Fondazione Europea di Ricerca Biomedica”, the Bial Foundation, the Mind Science Foundation and the European Commission, the fund Generet, the King Baudouin Foundation, DOCMA project [EU-H2020-MSCA–RISE–778234]. RX and CC are Marie Sklodowska-Curie fellows (H2020-MSCA-IF-2016-MoveAGAIN-752620 and H2020-MSCA-IF-2016-ADOC-752686). SL is research director at FRS-FNRS.

Acknowledgments

We are highly grateful to the members of the Liège Coma Science Group, the University hospital of Liège and the scientific and medical staff of the Schoen Klinik Bad Aibling for their assistance in clinical evaluations. The authors would like to thank the patients and their caregivers for their participation in this study.

Conflicts of Interest

The authors declare that the hard- and software were made available by g.tec. Author R.X. is employed by Guger Technologies OG, and C.G. is the CEO of Guger Technologies OG and g.tec Medical Engineering GmbH. Author R.O. is employed by g.tec medical engineering Spain S.L., S.L. is on the scientific advisory board of g.tec Medical Engineering. The other authors declare no competing interests.

References

  1. Laureys, S.; Celesia, G.G.; Cohadon, F.; Lavrijsen, J.; León-Carrión, J.; Sannita, W.G.; Sazbon, L.; Schmutzhard, E.; Von Wild, K.R.; Zeman, A.; et al. Unresponsive wakefulness syndrome: A new name for the vegetative state or apallic syndrome. BMC Med. 2010, 8, 68. [Google Scholar] [CrossRef] [Green Version]
  2. Monti, M.; Laureys, S.; Owen, A.M. The vegetative state. Br. Med. J. 2010, 341, 292–296. [Google Scholar] [CrossRef] [Green Version]
  3. Fins, J.J.; Master, M.G.; Gerber, L.M.; Giacino, J.T. The Minimally Conscious State: Definition and diagnostic criteria. Neurology 2002, 58, 349–353. [Google Scholar]
  4. Giacino, J.; Kalmar, K.; Whyte, J. The JFK Coma Recovery Scale-Revised: Measurement characteristics and diagnostic utility. Arch. Phys. Med. Rehabil. 2004, 85, 2020–2029. [Google Scholar] [CrossRef]
  5. Wannez, S.; Eheine, L.; Ethonnard, M.; Gosseries, O.; Laureys, S.; Coma Science Group Collaborators. The repetition of behavioral assessments in diagnosis of disorders of consciousness. Ann. Neurol. 2017, 81, 883–889. [Google Scholar] [CrossRef] [Green Version]
  6. Thibaut, A.; Chatelle, C.; Wannez, S.; Deltombe, T.; Stender, J.; Schnakers, C.; Laureys, S.; Gosseries, O. Spasticity in disorders of consciousness: A behavioral study. Eur. J. Phys. Rehabil. 2015, 51, 389–397. [Google Scholar]
  7. Fossati, M.C.B.; Bejor, M.; Chatelle, C.; Martens, G.; Laureys, S.; Thibaut, A. Spasticity and pain in patients with disorders of consciousness. Ann. Phys. Rehabil. Med. 2018, 61, e267–e268. [Google Scholar] [CrossRef]
  8. Andrews, K.; Murphy, L.; Munday, R.; Littlewood, C. Misdiagnosis of the vegetative state: Retrospective study in a rehabilitation unit. Br. Med. J. 1996, 313, 13–16. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Stender, J.; Gosseries, O.; Bruno, M.-A.; Charland-Verville, V.; Vanhaudenhuyse, A.; Demertzi, A.; Chatelle, C.; Thonnard, M.; Thibaut, A.; Heine, L.; et al. Diagnostic precision of PET imaging and functional MRI in disorders of consciousness: A clinical validation study. Lancet 2014, 6736, 8–16. [Google Scholar] [CrossRef]
  10. Edlow, B.L.; Chatelle, C.; Spencer, C.A.; Chu, C.J.; Bodien, Y.G.; O’Connor, K.L.; Hirschberg, R.E.; Hochberg, L.R.; Giacino, J.T.; Rosenthal, E.S.; et al. Early detection of consciousness in patients with acute severe traumatic brain injury. Brain 2017, 140, 2399–2414. [Google Scholar] [CrossRef]
  11. Coleman, M.R.; Rodd, J.M.; Davis, M.H.; Johnsrude, I.S.; Menon, D.K.; Pickard, J.D.; Owen, A.M. Do vegetative patients retain aspects of language comprehension? Evidence from fMRI. Brain 2007, 130, 2494–2507. [Google Scholar] [CrossRef] [PubMed]
  12. Gosseries, O.; Zasler, N.D.; Laureys, S. Recent advances in disorders of consciousness: Focus on the diagnosis. Brain Inj. 2014, 28, 1141–1150. [Google Scholar] [CrossRef] [PubMed]
  13. Schiff, N.D. Cognitive Motor Dissociation Following Severe Brain Injuries. JAMA Neurol. 2015, 72, 1413–1415. [Google Scholar] [CrossRef] [PubMed]
  14. Di Perri, C.; Thibaut, A.; Heine, L.; Annen, J.; Laureys, S. Towards new methods of diagnosis in disorders of consciousness—Authors’ reply. Lancet Neurol. 2016, 15, 1115–1116. [Google Scholar] [CrossRef]
  15. Owen, A.M.; Coleman, M.R.; Boly, M.; Davis, M.H.; Laureys, S.; Pickard, J.D. Detecting awareness in the vegetative state. Science 2006, 313, 1402. [Google Scholar] [CrossRef] [Green Version]
  16. Monti, M.M.; Vanhaudenhuyse, A.; Coleman, M.R.; Boly, M.; Pickard, J.D.; Tshibanda, L.; Owen, A.M.; Laureys, S. Willful Modulation of Brain Activity in Disorders of Consciousness. N. Engl. J. Med. 2010, 362, 579–589. [Google Scholar] [CrossRef] [Green Version]
  17. Lulé, R.; Noirhomme, Q.; Kleih, S.C.; Chatelle, C.; Halder, S.; Demertzi, A.; Bruno, M.-A.; Gosseries, O.; Vanhaudenhuyse, A.; Schnakers, C.; et al. Probing command following in patients with disorders of consciousness using a brain-computer interface. Clin. Neurophysiol. 2013, 124, 101–106. [Google Scholar] [CrossRef]
  18. Chennu, S.; Finoia, P.; Kamau, E.; Monti, M.M.; Allanson, J.; Pickard, J.D.; Owen, A.M.; Bekinschtein, T.A. Dissociable endogenous and exogenous attention in disorders of consciousness. NeuroImage Clin. 2013, 3, 450–461. [Google Scholar] [CrossRef] [Green Version]
  19. Pokorny, C.; Klobassa, D.S.; Pichler, G.; Erlbeck, H.; Real, R.G.L.; Kübler, A.; Lesenfants, D.; Habbal, D.; Noirhomme, Q.; Risetti, M.; et al. The auditory P300-based single-switch brain-computer interface: Paradigm transition from healthy subjects to minimally conscious patients. Artif. Intell. Med. 2013, 59, 81–90. [Google Scholar] [CrossRef] [Green Version]
  20. Kotchoubey, B.; Lang, S.; Mezger, G.; Schmalohr, D.; Schneck, M.; Semmler, A.; Bostanov, V.; Birbaumer, N. Information processing in severe disorders of consciousness: Vegetative state and minimally conscious state. Clin. Neurophysiol. 2005, 116, 2441–2453. [Google Scholar] [CrossRef]
  21. Perrin, F.; Schnakers, C.; Schabus, M.; Degueldre, C.; Goldman, S.; Brédart, S.; Faymonville, M.-E.; Lamy, M.; Moonen, G.; Luxen, A.; et al. Brain Response to One’s Own Name in Vegetative State, Minimally Conscious State, and Locked-in Syndrome. Arch. Neurol. 2006, 63, 562–569. [Google Scholar] [CrossRef] [Green Version]
  22. Chennu, S.; Bekinschtein, T.A. Arousal Modulates Auditory Attention and Awareness: Insights from Sleep, Sedation, and Disorders of Consciousness. Front. Psychol. 2012, 3, 1–9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Polich, J. Updating P300: An integrative theory of P3a and P3b. Clin. Neurophysiol. 2009, 118, 2128–2148. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Bekinschtein, T.A.; Dehaene, S.; Rohaut, B.; Tadel, F.; Cohen, L.; Naccache, L. Neural signature of the conscious processing of auditory regularities. Proc. Natl. Acad. Sci. USA 2009, 106, 1672–1677. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Faugeras, F.; Rohaut, B.; Weiss, N.; Bekinschtein, T.A.; Galanaud, D.; Puybasset, L.; Bolgert, F.; Sergent, C.; Cohen, L.; Dehaene, S.; et al. Event related potentials elicited by violations of auditory regularities in patients with impaired consciousness. Neuropsychologia 2012, 50, 403–418. [Google Scholar] [CrossRef] [Green Version]
  26. Schnakers, C.; Perrin, F.; Schabus, M.; Majerus, S.; LeDoux, D.; Damas, P.; Boly, M.; Vanhaudenhuyse, A.; Bruno, M.-A.; Moonen, G.; et al. Voluntary brain processing in disorders of consciousness. Neurology 2008, 71, 1614–1620. [Google Scholar] [CrossRef] [Green Version]
  27. Lugo, Z.R.; Rodriguez, J.; Lechner, A.; Ortner, R.; Gantner, I.S.; Laureys, S.; Noirhomme, Q.; Eguger, C. A Vibrotactile P300-Based Brain–Computer Interface for Consciousness Detection and Communication. Clin. EEG Neurosci. 2014, 45, 14–21. [Google Scholar] [CrossRef]
  28. Pan, J.; Xie, Q.; He, Y.; Wang, F.; Di, H.; Laureys, S.; Yu, R.; Li, Y. Detecting awareness in patients with disorders of consciousness using a hybrid brain–computer interface. J. Neural Eng. 2014, 11, 56007. [Google Scholar] [CrossRef]
  29. Chatelle, C.; Spencer, C.A.; Halgren, E.; Hochberg, L.R.; Edlow, B.L. Feasibility of an EEG-based brain-computer interface in the intensive care unit. Clin. Neurophysiol. 2018, 129, 1519–1525. [Google Scholar] [CrossRef]
  30. Eguger, C.; Spataro, R.; Allison, B.Z.; Heilinger, A.; Ortner, R.; Cho, W.; La Bella, V. Complete Locked-in and Locked-in Patients: Command Following Assessment and Communication with Vibro-Tactile P300 and Motor Imagery Brain-Computer Interface Tools. Front. Neurosci. 2017, 11, 251. [Google Scholar]
  31. Guger, C.; Spataro, R.; Pellas, F.; Allison, B.Z.; Heilinger, A.; Ortner, R.; Cho, W.; Xu, R.; La Bella, V.; Edlinger, G.; et al. Assessing Command-Following and Communication with Vibro-Tactile P300 Brain-Computer Interface Tools in Patients With Unresponsive Wakefulness Syndrome. Front. Neurosci. 2018, 12, 423. [Google Scholar] [CrossRef] [Green Version]
  32. Nichols, T.E.; Holmes, A.P. Nonparametric Permutation Tests for Functional Neuroimaging. Hum. Brain Mapp. 2001, 25, 887–910. [Google Scholar]
  33. Noirhomme, Q.; Lesenfants, D.; Gomez, F.; Soddu, A.; Schrouff, J.; Garraux, G.; Luxen, A.; Phillips, C.; Laureys, S. Biased binomial assessment of cross-validated estimation of classification accuracies illustrated in diagnosis predictions. NeuroImage Clin. 2014, 4, 687–694. [Google Scholar] [CrossRef] [Green Version]
  34. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2012. [Google Scholar]
  35. Jox, R.J.; Bernat, J.L.; Laureys, S.; Racine, E. Disorders of consciousness: Responding to requests for novel diagnostic and therapeutic interventions. Lancet Neurol. 2012, 11, 732–738. [Google Scholar] [CrossRef]
  36. Schnakers, C.; Perrin, F.; Schabus, M.; Hustinx, R.; Majerus, S.; Moonen, G.; Boly, M.; Vanhaudenhuyse, A.; Bruno, M.-A.; Laureys, S. Detecting consciousness in a total locked-in syndrome: An active event-related paradigm. Neurocase 2009, 15, 271–277. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Tzovara, A.; Rossetti, A.O.; Juan, E.; Suys, T.; Viceic, D.; Rusca, M.; Oddo, M.; De Lucia, M. Prediction of awakening from hypothermic post anoxic coma based on auditory discrimination. Ann. Neurol. 2016, 79, 748–757. [Google Scholar] [CrossRef] [Green Version]
  38. Sitt, J.D.; King, J.-R.; El Karoui, I.; Rohaut, B.; Faugeras, F.; Gramfort, A.; Cohen, L.; Sigman, M.; Dehaene, S.; Naccache, L. Large scale screening of neural signatures of consciousness in patients in a vegetative or minimally conscious state. Brain 2014, 137, 2258–2270. [Google Scholar] [CrossRef]
  39. Annen, J.; Blandiaux, S.; Lejeune, N.; Bahri, M.A.; Thibaut, A.; Cho, W.; Guger, C.; Chatelle, C.; Laureys, S. BCI Performance and Brain Metabolism Profile in Severely Brain-Injured Patients Without Response to Command at Bedside. Front. Neurosci. 2018, 12, 370. [Google Scholar] [CrossRef] [Green Version]
  40. Cruse, D.; Chennu, S.; Chatelle, C.; Bekinschtein, T.A.; Fernández-Espejo, D.; Pickard, J.D.; Laureys, S.; Owen, A.M. Bedside detection of awareness in the vegetative state: A cohort study. Lancet 2011, 378, 2088–2094. [Google Scholar] [CrossRef] [Green Version]
  41. Cruse, D.; Chennu, S.; Chatelle, C.; Fernández-Espejo, D.; Bekinschtein, T.A.; Pickard, J.D.; Laureys, S.; Owen, A.M. Relationship between etiology and covert cognition in the minimally conscious state. Neurology 2012, 78, 816–822. [Google Scholar] [CrossRef] [Green Version]
  42. Curley, W.H.; Forgacs, P.B.; Voss, H.U.; Conte, M.M.; Schiff, N.D. Characterization of EEG signals revealing covert cognition in the injured brain. Brain 2018, 141, 1404–1421. [Google Scholar] [CrossRef]
  43. Kalmar, K.; Giacino, J.T. The JFK coma recovery scale-revised. Neuropsychol. Rehabil. 2005, 15, 454–460. [Google Scholar] [CrossRef] [PubMed]
  44. Kotchoubey, B.; Pavlov, Y.G. Approaches to sleep in severely brain damaged patients: Opposite or complementary? Reply to “Sleep and Circadian Rhythms in Severely Brain-Injured Patients—A Comment”. Clin. Neurophysiol. 2018, 129, 1785–1787. [Google Scholar]
  45. Piarulli, A.; Bergamasco, M.; Thibaut, A.; Cologan, V.; Gosseries, O.; Laureys, S. EEG ultradian rhythmicity differences in disorders of consciousness during wakefulness. J. Neurol. 2016, 263, 1746–1760. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Kempny, A.M.; James, L.; Yelden, K.; Duport, S.; Farmer, S.F.; Playford, E.D.; Leff, A.P. NeuroImage: Clinical Patients with a severe prolonged Disorder of Consciousness can show classical EEG responses to their own name compared with others’ names. NeuroImage Clin. 2018, 19, 311–319. [Google Scholar] [CrossRef] [PubMed]
  47. Wangshan, H.; Di, H.; Hu, X.; Jing, S.; Thibaut, A.; Di Perri, C.; Huang, W.; Nie, Y.; Schnakers, C.; Laureys, S. Cerebral response to subject’s own name showed high prognostic value in traumatic vegetative state. BMC Med. 2015, 13, 83. [Google Scholar]
  48. Langner, R.; Kellermann, T.; Eickhoff, S.B.; Boers, F.; Chatterjee, A.; Willmes, K.; Sturm, W. Staying responsive to the world: Modality-specific and -nonspecific contributions to speeded auditory, tactile, and visual stimulus detection. Hum. Brain Mapp. 2012, 33, 398–418. [Google Scholar] [CrossRef]
  49. Yin, E.; Zeyl, T.; Saab, R.; Hu, D.; Zhou, Z.; Chau, T.T. An Auditory-Tactile Visual Saccade-Independent P300 Brain–Computer Interface. Int. J. Neural Syst. 2016, 26, 1650001. [Google Scholar] [CrossRef]
Figure 1. Schematic overview of data processing and classification. Data preprocessing and classification is performed right after data acquisition in order to provide feedback about the patient’s performance directly. Additional offline processing was performed to calculate a subject specific statistical threshold of the observed true positive rate.
Figure 1. Schematic overview of data processing and classification. Data preprocessing and classification is performed right after data acquisition in order to provide feedback about the patient’s performance directly. Additional offline processing was performed to calculate a subject specific statistical threshold of the observed true positive rate.
Brainsci 10 00748 g001
Figure 2. Grand average event-related potentials (ERP) at electrode Cz for the auditory and somatosensory (i.e., vibrotactile) paradigms. ERPs are grouped by diagnostic group and significance of the response. The response (and 95% confidence interval) to the standard stimulus is represented in red and the response to the deviant stimulus is represented in blue. Significant differences between the two responses, as obtained from a Mann-Whitney U test considered significant at p < 0.05, are presented by the green line above the ERP.
Figure 2. Grand average event-related potentials (ERP) at electrode Cz for the auditory and somatosensory (i.e., vibrotactile) paradigms. ERPs are grouped by diagnostic group and significance of the response. The response (and 95% confidence interval) to the standard stimulus is represented in red and the response to the deviant stimulus is represented in blue. Significant differences between the two responses, as obtained from a Mann-Whitney U test considered significant at p < 0.05, are presented by the green line above the ERP.
Brainsci 10 00748 g002
Figure 3. Boxplot showing the ‘differentiated response’ as obtained from offline processing and true positive rate for the auditory-evoked potentials (AEP) (top) and vibrotactile-evoked potentials (VTP) (bottom) paradigms, depending on diagnosis, aetiology and disease duration. The ‘differentiated response’ is independent from diagnosis aetiology, and disease duration.
Figure 3. Boxplot showing the ‘differentiated response’ as obtained from offline processing and true positive rate for the auditory-evoked potentials (AEP) (top) and vibrotactile-evoked potentials (VTP) (bottom) paradigms, depending on diagnosis, aetiology and disease duration. The ‘differentiated response’ is independent from diagnosis aetiology, and disease duration.
Brainsci 10 00748 g003
Figure 4. Visualisation of the true positive rate for the auditory (x-axis) and somatosensory (y-axis) paradigms. There is a correlation between the true positive rate in both paradigms, however the presence of a ‘differentiated response’ as obtained from offline processing in one paradigm is independent from the presence of a ‘differentiated response’ on the other paradigm.
Figure 4. Visualisation of the true positive rate for the auditory (x-axis) and somatosensory (y-axis) paradigms. There is a correlation between the true positive rate in both paradigms, however the presence of a ‘differentiated response’ as obtained from offline processing in one paradigm is independent from the presence of a ‘differentiated response’ on the other paradigm.
Brainsci 10 00748 g004
Table 1. Clinical data (gender, age in years, time post injury in months, aetiology, CRS-R subscores) and P3 true positive rate for all participants (HC, EMCS, MCS, UWS) enrolled in the study after direct processing and after offline processing of the two paradigms (AEP, VTP). True positive rate in bold represents that is is above chance level (i.e. ‘differentiated responses’).
Table 1. Clinical data (gender, age in years, time post injury in months, aetiology, CRS-R subscores) and P3 true positive rate for all participants (HC, EMCS, MCS, UWS) enrolled in the study after direct processing and after offline processing of the two paradigms (AEP, VTP). True positive rate in bold represents that is is above chance level (i.e. ‘differentiated responses’).
DirectOffline
GroupGenderAgeTime Since InjuryAetiologyCRS-R Subscores AEPVTPAEPVTP
HCF28 nonTBI 100100100100
HCF23 nonTBI 100100100100
HCM23 nonTBI 90100100100
HCF21 nonTBI 100100100100
HCF24 nonTBI 1008010090
HCF22 nonTBI 10010090100
HCF27 nonTBI 100100100100
HCM24 nonTBI 10010080100
HCF25 nonTBI 10010010070
HCF24 nonTBI 1002090100
HCM nonTBI 10010090100
HCM48 nonTBI 100100100100
EMCSM24 nonTBI1,3,2,1,0,22060040
EMCSM263.9TBI3,5,4,1,0,270909080
MCSM664.5TBI2,3,5,3,1,210702010
MCSF432.6nonTBI2,3,6,2,1,230206010
MCSF194.2nonTBI1,0,5,1,0,12020400
MCSM254.8nonTBI1,0,5,1,0,220705080
MCSF515.1nonTBI2,3,2,2,1,260553090
MCSM632.1nonTBI2,2,0,1,0,11010040
MCSM473.5TBI2,3,2,1,0,2601004080
MCSM582.4nonTBI3,1,5,2,1,20305035
MCSM533.0nonTBI2,3,2,2,0,20406090
MCSM614.3nonTBI2,3,2,1,0,11000100
MCSM565.0nonTBI2,1,5,2,1,12020020
MCSM341.7TBI4,5,6,1,1,2201010020
MCSM521.9TBI3,3,5,1,1,10201050
MCSM6455.9TBI3,5,6,2,1,2090060
MCSM187.8TBI3,3,5,2,0,12010080100
MCSM5568.7TBI2,0,5,1,0,130102030
MCSM2239.2TBI1,3,1,1,0,150205030
MCSF4179.0nonTBI3,0,1,1,0,140609070
MCSM2013.7TBI3,3,5,2,0,21010020100
MCSM577.8nonTBI1,1,1,1,0,1202500
MCSF493.9nonTBI2,1,1,2,0,2300300
MCSF473.9nonTBI1,3,5,1,0,120102030
MCSF4058.9TBI0,3,2,1,0,2601009060
UWSF3310.5nonTBI2,1,1,1,0,230401020
UWSM464.9TBI1,0,1,1,0,20102080
UWSF272.2TBI2,1,1,1,0,210403045
UWSM592.0nonTBI2,0,2,1,0,21001010
UWSM655.0nonTBI1,0,2,1,0,21004040
UWSF544.3nonTBI1,0,1,1,0,20501045
UWSM505.6TBI2,2,2,1,0,21020025
UWSM573.7nonTBI0,0,5,1,0,030102030
UWSM571.5nonTBI2,1,2,1,0,180030100
UWSM654.9nonTBI1,1,1,1,0,1100010010
UWSM565.9nonTBI1,1,1,1,0,110752055
UWSF465.9nonTBI0,0,1,1,0,2700800
UWSF711.3nonTBI0,0,1,1,0,11010150
UWSF3212.7TBI1,0,1,1,0,260101000
UWSM592.0nonTBI2,1,1,1,0,22001010
HC = healthy control, EMCS = emerged from minimally conscious state, MCS = minimally conscious state, UWS = unresponsive wakefulness syndrome, M = male, F = female, TBI = traumatic brain injury; nonTBI = non-traumatic brain injury, CRS-R = coma recovery scale-revised presenting auditory, visual, motor, verbal, communication, arousal subscores, Direct = direct processing provided by a theoretical threshold of 23%, Offline = further offline processing taking the individual threshold based on permutation tests, AEP = auditory evoked potential, VTP = vibrotactile potentials. Bold numberdenotes significant true positive rate.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Annen, J.; Mertel, I.; Xu, R.; Chatelle, C.; Lesenfants, D.; Ortner, R.; Bonin, E.A.C.; Guger, C.; Laureys, S.; Müller, F. Auditory and Somatosensory P3 Are Complementary for the Assessment of Patients with Disorders of Consciousness. Brain Sci. 2020, 10, 748. https://doi.org/10.3390/brainsci10100748

AMA Style

Annen J, Mertel I, Xu R, Chatelle C, Lesenfants D, Ortner R, Bonin EAC, Guger C, Laureys S, Müller F. Auditory and Somatosensory P3 Are Complementary for the Assessment of Patients with Disorders of Consciousness. Brain Sciences. 2020; 10(10):748. https://doi.org/10.3390/brainsci10100748

Chicago/Turabian Style

Annen, Jitka, Isabella Mertel, Ren Xu, Camille Chatelle, Damien Lesenfants, Rupert Ortner, Estelle A.C. Bonin, Christoph Guger, Steven Laureys, and Friedemann Müller. 2020. "Auditory and Somatosensory P3 Are Complementary for the Assessment of Patients with Disorders of Consciousness" Brain Sciences 10, no. 10: 748. https://doi.org/10.3390/brainsci10100748

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop