Abstract
Knowledge-intensive language understanding suffers a structural reliability bottleneck: fluent answers can be produced without logically sufficient support, especially in multi-hop question answering and dynamic knowledge graphs where edge drift degrades retrieval. We introduce Counterfactual Neuro-Symbolic Proof-Carrying Memory (CNS-PCM), a backbone-agnostic neuro-symbolic harness that decouples frozen neural representations from inspectable symbolic verification checks. Candidate reasoning chains are discovered via ontology-constrained beam search () and compiled into a compact proof-carrying memory carrying crisp domain validity flags (), NLI-derived contradiction scores (), and textual support confidences (). At inference time, a counterfactual verifier stress-tests prediction stability across a targeted pool of graph interventions sampled via betweenness centrality, requiring localized re-scoring operations over the retained proofs (or at fixed memory capacity K, where empirical proof depth satisfies for of retained paths under a search ceiling , bounding verifier latency overhead to ≈45 ms per query), and abstains when evidence is unstable. Rather than invasive early token fusion or prompt linearization, CNS-PCM externalizes verification into an inspectable audit record while training lightweight adapter heads using task, logical-consistency, intervention-invariance, and differentiable Brier calibration objectives. Evaluated on official public splits of HoVer, HotpotQA, and FEVEROUS with headline F1 scoring ABSTAIN as incorrect, CNS-PCM achieves test F1 scores of , , and , outperforming LLaMA-2-7B + CoT (), GraphRAG (), and unthresholded Logic-LM (). Specifically, CNS-PCM reduces total gold-unsupported accepted assertions on the validation splits by up to percentage points (lowering total unsupported rate from to , and correct-but-ungrounded assertions from to ) and reduces Expected Calibration Error (ECE) to , maintaining final test coverage via a bounded re-try feedback loop ( re-tries). Component ablations confirm that training invariance and inference gating provide complementary gains, while sensitivity analyses identify Stage-2 entity linking as the primary reliability lever.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.