Using N400 Event-Related Potential to Detect Differences in Design-Mode and Belief-Mode Scaffold Use
Highlights
- A mixed-methods integration of machine learning classification algorithms shows reliable differences between Design-mode and Belief-mode discussion patterns in Knowledge Forum.
- ERP tasks show preliminary evidence consistent with semantic processing differences between scaffolds from Design-mode and Belief-mode, with Belief-mode scaffolded sentences showing larger N400 amplitudes than Design-mode in the 380–430 ms time window, suggesting different semantic processing demands.
- Linguistic scaffolds function as “epistemic cues”: Future research can intentionally manipulate sentence starters to experimentally shape epistemic stance in collaborative discussions.
- Scaffold mode modulates semantic processing (N400 window): Belief-mode scaffolded sentences elicited larger N400 negativity than Design-mode, indicating greater semantic conflict. Thus, scaffold choice could shape meaning-making at millisecond timescales even when content is held constant, highlighting the potential value of incorporating Design-mode scaffolds in future learning designs.
Abstract
1. Introduction
2. Methodology
3. Data
4. Data Analysis
5. Results
5.1. RQ1: How Do Conversational Patterns Differ Between Two Experimental Conditions Using Design-Mode and Belief-Mode Scaffolds?
5.2. RQ2: How DOES the N400 Differ Between Design-Mode and Belief-Mode Sentence Sets During a Stimulus-Based Decision-Making Task?
5.3. RQ3: How Do Participants’ Attitudes Differ Between Design-Mode and Belief-Mode Conditions in Their Pre- and Post-Survey?
6. Discussion
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Poehner, M.E.; Lu, X. Sociocultural Theory and Corpus-Based English Language Teaching. TESOL Q. 2024, 58, 1256–1263. [Google Scholar] [CrossRef]
- Jin, Z.; Yin, J.; Pan, Y.; Zhang, Y.; Li, Y.; Xu, X.; Luo, J. Teach a Man to Fish: Hyper-Brain Evidence on Scaffolding Strategy Enhancing Creativity Acquisition and Transfer. NeuroImage 2024, 297, 120757. [Google Scholar] [CrossRef]
- Bereiter, C. Education and Mind in the Knowledge Age; Lawrence Erlbaum Associates Publishers: Mahwah, NJ, USA, 2002. [Google Scholar]
- Bereiter, C.; Scardamalia, M. Learning to work creatively with knowledge. In Powerful Learning Environments: Unravelling Basic Components and Dimensions; De Corte, E., Verschaffel, L., Eds.; Emerald Group Publishing: Bingley, UK, 2003; pp. 55–68. [Google Scholar]
- Scardamalia, M.; Bereiter, C. Knowledge building and knowledge creation: Theory, pedagogy, and technology. In The Cambridge Handbook of the Learning Sciences; Sawyer, R.K., Ed.; Cambridge University Press: Cambridge, UK, 2014; pp. 397–417. [Google Scholar]
- Chan, C.K.K.; van Aalst, J. Knowledge Building: Theory, Design, and Analysis. In International Handbook of the Learning Sciences; Fischer, F., Goldman, S.R., Reimann, P., Eds.; Routledge: New York, NY, USA, 2018; pp. 295–307. [Google Scholar]
- Scardamalia, M. Crossing the digital divide: Literacy as by-product of knowledge building. J. Distance Educ. 2003, 17, 78–81. [Google Scholar]
- Bereiter, C.; Scardamalia, M. Knowledge building and knowledge creation: One concept, two hills to climb. In Knowledge Creation in Education; Tan, S.C., So, H.J., Yeo, J., Eds.; Springer: Singapore, 2014; pp. 35–52. [Google Scholar]
- Chen, B. Fostering Scientific Understanding and Epistemic Beliefs through Judgments of Promisingness. Educ. Technol. Res. Dev. 2017, 65, 255–277. [Google Scholar] [CrossRef]
- Yuan, G.; Teo, C.L.; Lee, A.V.Y.; Ong, A.K.K.; Lim, J.H. Designing informal knowledge building learning spaces: Students’ knowledge building design studio. Qwerty-Interdiscip. J. Technol. Cult. Educ. 2023, 18, 13–36. [Google Scholar] [CrossRef]
- Levari, T.; Snedeker, J. Understanding Words in Context: A Naturalistic EEG Study of Children’s Lexical Processing. J. Mem. Lang. 2024, 137, 104512. [Google Scholar] [CrossRef]
- Stephens, G.J.; Silbert, L.J.; Hasson, U. Speaker-Listener Neural Coupling Underlies Successful Communication. Proc. Natl. Acad. Sci. USA 2010, 107, 14425–14430. [Google Scholar] [CrossRef]
- Kutas, M.; Federmeier, K.D. Thirty Years and Counting: Finding Meaning in the N400 Component of the Event-Related Brain Potential (ERP). Annu. Rev. Psychol. 2011, 62, 621–647. [Google Scholar] [CrossRef] [PubMed]
- Kutas, M.; Hillyard, S.A. Reading Senseless Sentences: Brain Potentials Reflect Semantic Incongruity. Science 1980, 207, 203–205. [Google Scholar] [CrossRef] [PubMed]
- Klingvall, E.; Heinat, F. Lexical Cues and Discourse Integration: An ERP Study of the N400 and P600 Components. Cortex 2024, 178, 91–103. [Google Scholar] [CrossRef] [PubMed]
- Armstrong, S.R.; Copland, D.A.; Escudero, P.; Angwin, A.J. Tracking the Acquisition and Retention of Novel Word Representations: An ERP Study. Lang. Cogn. Neurosci. 2024, 39, 401–422. [Google Scholar] [CrossRef]
- Momenian, M.; Vaghefi, M.; Sadeghi, H.; Momtazi, S.; Meyer, L. Language Prediction in Monolingual and Bilingual Speakers: An EEG Study. Sci. Rep. 2024, 14, 6818. [Google Scholar] [CrossRef]
- Zhang, Y.; Ding, R.; Frassinelli, D.; Tuomainen, J.; Klavinskis-Whiting, S.; Vigliocco, G. The Role of Multimodal Cues in Second Language Comprehension. Sci. Rep. 2023, 13, 20824. [Google Scholar] [CrossRef]
- Psychology Software Tools, Inc. [E-Prime 3.0]. 2016. Available online: https://support.pstnet.com/ (accessed on 1 March 2025).
- Scardamalia, M. CSILE/Knowledge Forum®. In Education and Technology: An Encyclopedia; Kovalchick, A., Dawson, K., Eds.; ABC-CLIO: Santa Barbara, CA, USA, 2004; pp. 183–192. [Google Scholar]
- Delorme, A.; Makeig, S. EEGLAB: An Open Source Toolbox for Analysis of Single-Trial EEG Dynamics Including Independent Component Analysis. J. Neurosci. Methods 2004, 134, 9–21. [Google Scholar] [CrossRef]
- Salton, G.; Buckley, C. Term-Weighting Approaches in Automatic Text Retrieval. Inf. Process. Manag. 1988, 24, 513–523. [Google Scholar] [CrossRef]
- Cortes, C.; Vapnik, V. Support-Vector Networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
- Reimers, N.; Gurevych, I. Sentence-BERT: Sentence Embeddings Using Siamese BERT-Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 3–7 November 2019; Association for Computational Linguistics: Stroudsburg, PA, USA, 2019; pp. 3980–3990. [Google Scholar]
- Devlin, J.; Chang, M.-W.; Lee, K.; Toutanova, K. BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA, 2–7 June 2019; Association for Computational Linguistics: Stroudsburg, PA, USA, 2019; pp. 4171–4186. [Google Scholar]
- Sanh, V.; Debut, L.; Chaumond, J.; Wolf, T. DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter. arXiv 2019, arXiv:1910.01108. [Google Scholar]
- R Core Team. R: A Language and Environment for Statistical Computing, Version 4.3.2; R Foundation for Statistical Computing: Vienna, Austria, 2023. [Google Scholar]
- Toffolo, K.K.; Freedman, E.G.; Foxe, J.J. Evoking the N400 Event-Related Potential (ERP) Component Using a Publicly Available Novel Set of Sentences with Semantically Incongruent or Congruent Eggplants (Endings). Neuroscience 2022, 501, 143–158. [Google Scholar] [CrossRef] [PubMed]
- Duncan, C.C.; Barry, R.J.; Connolly, J.F.; Fischer, C.; Michie, P.T.; Näätänen, R.; Polich, J.; Reinvang, I.; Van Petten, C. Event-Related Potentials in Clinical Research: Guidelines for Eliciting, Recording, and Quantifying Mismatch Negativity, P300, and N400. Clin. Neurophysiol. 2009, 120, 1883–1908. [Google Scholar] [CrossRef]
- Hagoort, P.; Brown, C.M. ERP Effects of Listening to Speech: Semantic ERP Effects. Neuropsychologia 2000, 38, 1518–1530. [Google Scholar] [CrossRef] [PubMed]
- Nachowitz, M. Scaffolding Progressive Online Discourse for Literary Knowledge Building. Online Learn. 2018, 22, 133–156. [Google Scholar] [CrossRef]
- van Aalst, J. Distinguishing Knowledge-Sharing, Knowledge-Construction, and Knowledge-Creation Discourses. Int. J. Comput.-Support. Collab. Learn. 2009, 4, 259–287. [Google Scholar] [CrossRef] [PubMed]
- Fu, E.L.F.; van Aalst, J.; Chan, C.K.K. Toward a Classification of Discourse Patterns in Asynchronous Online Discussions. Intern. J. Comput.-Support. Collab. Learn. 2016, 11, 441–478. [Google Scholar] [CrossRef]
- Alturayeif, N.; Luqman, H.; Ahmed, M. A Systematic Review of Machine Learning Techniques for Stance Detection and Its Applications. Neural Comput. Appl. 2023, 35, 5113–5144. [Google Scholar] [CrossRef] [PubMed]
- Shyrokykh, K.; Girnyk, M.; Dellmuth, L. Short Text Classification with Machine Learning in the Social Sciences: The Case of Climate Change on Twitter. PLoS ONE 2023, 18, e0290762. [Google Scholar] [CrossRef]
- Karande, H.; Walambe, R.; Benjamin, V.; Kotecha, K.; Raghu, T. Stance Detection with BERT Embeddings for Credibility Analysis of Information on Social Media. PeerJ Comput. Sci. 2021, 7, e467. [Google Scholar] [CrossRef] [PubMed]
- van Berkum, J.J.A.; Hagoort, P.; Brown, C.M. Semantic Integration in Sentences and Discourse: Evidence from the N400. J. Cogn. Neurosci. 1999, 11, 657–671. [Google Scholar] [CrossRef]
- Jiang, J.; Fan, L.; Liu, J.; Liang, M.; Wang, Y. An ERP Study on the Certainty of Epistemic Modality in Predictive Inference Processing. Q. J. Exp. Psychol. 2024, 77, 577–592. [Google Scholar] [CrossRef]
- Aurnhammer, C.; Delogu, F.; Schulz, M.; Brouwer, H.; Crocker, M.W. Retrieval (N400) and Integration (P600) in Expectation-Based Comprehension. PLoS ONE 2021, 16, e0257430. [Google Scholar] [CrossRef]
- Fischer, K.W.; Bidell, T.R. Dynamic Development of Action and Thought. In Handbook of Child Psychology: Theoretical Models of Human Development, 6th ed.; Damon, W., Lerner, R.M., Eds.; John Wiley & Sons: Hoboken, NJ, USA, 2006; Volume 1, pp. 313–399. [Google Scholar]
- Gkintoni, E.; Sortwell, A.; Vassilopoulos, S.P.; Nikolaou, G. Neuroplasticity-Informed Learning Under Cognitive Load: A Systematic Review of Functional Imaging, Brain Stimulation, and Educational Technology Applications. Multimodal Technol. Interact. 2026, 10, 5. [Google Scholar] [CrossRef]
- Boudewyn, M.A.; Luck, S.J.; Farrens, J.L.; Kappenman, E.S. How Many Trials Does It Take to Get a Significant ERP Effect? It Depends. Psychophysiology 2018, 55, e13049. [Google Scholar] [CrossRef] [PubMed]
- Šoškić, A.; Jovanović, V.; Styles, S.J.; Kappenman, E.S.; Ković, V. How to Do Better N400 Studies: Reproducibility, Consistency and Adherence to Research Standards in the Existing Literature. Neuropsychol. Rev. 2022, 32, 577–600. [Google Scholar] [CrossRef] [PubMed]





| Topic | Mode | Notes (n) | Words/Note Mean (SD) | Build-On Notes (n) | Build-Ons (%) |
|---|---|---|---|---|---|
| Topic 1 | Design | 203 | 45.22 (34.01) | 118 | 58.1% |
| Belief | 214 | 42.75 (31.69) | 108 | 50.5% | |
| Total (Topic1) | 417 | 43.95 (32.83) | 226 | 54.2% | |
| Topic 2 | Design | 205 | 51.34 (35.60) | 119 | 58.0% |
| Belief | 236 | 47.39 (32.33) | 132 | 55.9% | |
| Total (T2) | 441 | 49.22 (33.91) | 251 | 56.9% | |
| Topic 3 | Design | 239 | 41.93 (31.81) | 148 | 61.9% |
| Belief | 248 | 37.27 (24.69) | 149 | 60.1% | |
| Total (T3) | 487 | 39.56 (28.47) | 297 | 61.0% | |
| All Topics | Design | 647 | 46.22 (34.19) | 385 | 59.5% |
| Belief | 698 | 42.30 (29.78) | 389 | 55.7% | |
| Total (All) | 1345 | 44.23 (32.16) | 774 | 57.5% |
| Model | Overall (Acc/F1) | Topic 1 (Acc/F1) | Topic 2 (Acc/F1) | Topic 3 (Acc/F1) |
|---|---|---|---|---|
| TF-IDF + Linear SVM (lexical) | 0.684/0.672 | 0.583/0.598 | 0.652/0.644 | 0.653/0.653 |
| Sentence Embeddings + Logistic Regression | 0.651/0.638 | 0.619/0.644 | 0.584/0.543 | 0.602/0.571 |
| DistilBERT (contextual) | 0.736/0.703 | 0.619/0.467 | 0.618/0.553 | 0.622/0.584 |
| Model | Fold1_Acc | Fold2_Acc | Fold3_Acc | Mean_Acc | SD_Acc | Mean_F1 | SD_F1 |
|---|---|---|---|---|---|---|---|
| TF-IDF + SVM | 0.655 | 0.637 | 0.669 | 0.654 | 0.013 | 0.623 | 0.010 |
| Embeddings + LR | 0.552 | 0.503 | 0.567 | 0.541 | 0.027 | 0.565 | 0.040 |
| DistilBERT | 0.722 | 0.744 | 0.743 | 0.736 | 0.010 | 0.705 | 0.035 |
| Comparison | All N = 52 M % (SD) | Design-Mode Participant (n = 23) M % (SD) | Belief-Mode Participant (n = 29) M % (SD) | t (df) | p | d |
|---|---|---|---|---|---|---|
| 1. Within-subjects analysis: agree rate for Design-mode vs. Belief-mode sentences (all N = 52, paired-sample t-test, df = 51; group columns descriptive only) | ||||||
| Design-mode sentences | ||||||
| Agree % | 92.7 (9.0) | 93.0 (9.1) | 92.6 (9.1) | — | — | — |
| Disagree % | 4.8 (7.8) | 5.2 (7.9) | 4.5 (7.8) | — | — | — |
| Neutral % | 2.5 (5.7) | 1.8 (5.2) | 3.0 (6.1) | — | — | — |
| Belief-mode sentences | ||||||
| Agree % | 59.5 (20.3) | 53.6 (19.5) | 64.1 (19.9) | — | — | — |
| Disagree % | 36.0 (20.9) | 42.0 (21.9) | 31.3 (19.2) | — | — | — |
| Neutral % | 4.5 (10.5) | 4.4 (12.3) | 4.6 (9.2) | — | — | — |
| Agree rate: Design-mode vs. Belief-mode sentences | — | — | — | 11.303 (51) | <0.001 | 1.567 |
| 2. Effect of prior scaffold use on Belief-mode sentence agree rate (independent t-test, df = 50) | ||||||
| Belief-mode sentence agree rate | — | 53.6 (19.5) | 64.1 (19.9) | −1.917 (50) | 0.030 | 0.535 |
| Survey Item | t | df | p | Cohen’s d |
|---|---|---|---|---|
| I don’t think it’s necessary to evaluate or reflect on the progress of a learning community as long as individual goals are met. | 2.183 | 31 | 0.037 | 0.386 |
| 0.758 | 33 | 0.454 | 0.130 | |
| I prefer to stick to familiar ideas and concepts rather than taking risks and exploring new directions in my learning. | 2.396 | 31 | 0.023 | 0.424 |
| 0.751 | 33 | 0.458 | 0.129 | |
| I believe that my peers and I share the responsibility for our learning. | 2.436 | 31 | 0.021 | −0.431 |
| 2.510 | 33 | 0.017 | −0.431 | |
| I enjoy working with my peers to create a shared understanding of a topic rather than just focusing on my individual learning. | 5.463 | 31 | <0.001 | −0.966 |
| 2.534 | 33 | 0.016 | −0.435 | |
| I find providing and receiving feedback from my peers to be a crucial part of learning. | 2.609 | 31 | 0.014 | −0.461 |
| 2.264 | 33 | 0.030 | −0.388 | |
| I can identify which idea is promising for further investigation. | 3.150 | 31 | 0.004 | −0.557 |
| 1.139 | 33 | 0.131 | −0.195 | |
| I can come up with good questions. | 2.709 | 31 | 0.011 | −0.479 |
| 1.997 | 33 | 0.054 | −0.343 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Yuan, G.; Begum, J.; Yuvaraj, R.; Teo, C.L. Using N400 Event-Related Potential to Detect Differences in Design-Mode and Belief-Mode Scaffold Use. Brain Sci. 2026, 16, 407. https://doi.org/10.3390/brainsci16040407
Yuan G, Begum J, Yuvaraj R, Teo CL. Using N400 Event-Related Potential to Detect Differences in Design-Mode and Belief-Mode Scaffold Use. Brain Sciences. 2026; 16(4):407. https://doi.org/10.3390/brainsci16040407
Chicago/Turabian StyleYuan, Guangji, Jumaylha Begum, Rajamanickam Yuvaraj, and Chew Lee Teo. 2026. "Using N400 Event-Related Potential to Detect Differences in Design-Mode and Belief-Mode Scaffold Use" Brain Sciences 16, no. 4: 407. https://doi.org/10.3390/brainsci16040407
APA StyleYuan, G., Begum, J., Yuvaraj, R., & Teo, C. L. (2026). Using N400 Event-Related Potential to Detect Differences in Design-Mode and Belief-Mode Scaffold Use. Brain Sciences, 16(4), 407. https://doi.org/10.3390/brainsci16040407

