A Quantitative Explainability Quality Index Framework for Visual XAI in Fuzzy Group Decision-Making for Supply Chain Facility Localization
Abstract
1. Introduction
2. Literature Review
2.1. Explainability Evaluation in Industrial AI Systems
2.2. Visual XAI and Trust
2.3. Fuzzy Multi-Criteria Decision-Making (MCDM) and Visual Explainability
2.4. Supply Chain XAI and Decision Support
3. Research Framework and Hypotheses
4. Methodology
4.1. Research Design
4.2. Participants
4.3. Measurement
5. Mathematical Formulation of XQI
5.1. Notation
5.2. Objective Explainability Layer
5.3. Subjective Explainability Layer
5.4. Integrated XQI
5.5. Structural Model
6. Planned Validation Protocol and Reporting Structure
6.1. Between-Group Comparison
6.2. Planned Structural Model and Reporting Structure
7. Discussion
8. Conclusions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Olan, F.; Spanaki, K.; Ahmed, W.; Zhao, G. Enabling explainable artificial intelligence capabilities in supply chain decision support making. Prod. Plan. Control 2025, 36, 808–819. [Google Scholar] [CrossRef] [Scilit]
- Sadeghi, K.; Ojha, D.; Kaur, P.; Mahto, R.V.; Dhir, A. Explainable artificial intelligence and agile decision-making in supply chain cyber resilience. Decis. Support Syst. 2024, 180, 114194. [Google Scholar] [CrossRef] [Scilit]
- Arrieta, A.B.; Díaz-Rodríguez, N.; Del Ser, J.; Bennetot, A.; Tabik, S.; Barbado, A.; García, S.; Gil-López, S.; Molina, D.; Benjamins, R.; et al. Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Inf. Fusion 2020, 58, 82–115. [Google Scholar] [CrossRef] [Scilit]
- Gunning, D.; Stefik, M.; Choi, J.; Miller, T.; Stumpf, S.; Yang, G.-Z. XAI—Explainable artificial intelligence. Sci. Robot. 2019, 4, eaay7120. [Google Scholar] [CrossRef] [Scilit]
- Abhilash, P.M.; Luo, X.; Liu, Q.; Madarkar, R.; Walker, C. Towards next-gen smart manufacturing systems: The explainability revolution. npj Adv. Manuf. 2024, 1, 8. [Google Scholar] [CrossRef] [Scilit]
- Nikiforidis, K.; Kyrtsoglou, A.; Vafeiadis, T.; Kotsiopoulos, T.; Nizamis, A.; Ioannidis, D.; Votis, K.; Tzovaras, D.; Sarigiannidis, P. Enhancing transparency and trust in AI-powered manufacturing: A survey of XAI applications in smart manufacturing in the era of Industry 4.0/5.0. ICT Express 2025, 11, 135–148. [Google Scholar] [CrossRef] [Scilit]
- Moktadir, M.A.; Ren, J. Global semiconductor supply chain resilience challenges and mitigation strategies: A novel integrated decomposed fuzzy set Delphi, WINGS and QFD model. Int. J. Prod. Econ. 2024, 273, 109280. [Google Scholar] [CrossRef] [Scilit]
- Xiong, W.; Wu, D.D.; Yeung, J.H. Semiconductor supply chain resilience and disruption: Insights, mitigation, and future directions. Int. J. Prod. Res. 2025, 63, 3442–3465. [Google Scholar] [CrossRef] [Scilit]
- Chen, T.-C.T.; Wang, Y.-C.; Wang, Y.-C. An explainable decision model for selecting facility locations in supply chain networks. Supply Chain Anal. 2025, 11, 100148. [Google Scholar] [CrossRef] [Scilit]
- Rudin, C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 2019, 1, 206–215. [Google Scholar] [CrossRef] [Scilit]
- Coussement, K.; Abedin, M.Z.; Kraus, M.; Maldonado, S.; Topuz, K. Explainable AI for enhanced decision-making. Decis. Support Syst. 2024, 184, 114276. [Google Scholar] [CrossRef] [Scilit]
- Salih, A.M.; Raisi-Estabragh, Z.; Galazzo, I.B.; Radeva, P.; Petersen, S.E.; Lekadir, K.; Menegaz, G. A perspective on explainable artificial intelligence methods: SHAP and LIME. Adv. Intell. Syst. 2025, 7, 2400304. [Google Scholar] [CrossRef] [Scilit]
- Dolgui, A.; Haddou Benderbal, H.; Sgarbossa, F.; Ivanov, D.; Thevenin, S. Editorial for the special issue: AI and data-driven decisions in manufacturing. J. Intell. Manuf. 2024, 35, 3599–3604. [Google Scholar] [CrossRef] [Scilit]
- Adadi, A.; Berrada, M. Peeking inside the black-box: A survey on explainable artificial intelligence (XAI). IEEE Access 2018, 6, 52138–52160. [Google Scholar] [CrossRef] [Scilit]
- Tjoa, E.; Guan, C. A survey on explainable artificial intelligence (XAI): Toward medical XAI. IEEE Trans. Neural Netw. Learn. Syst. 2021, 32, 4793–4813. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Mohseni, S.; Zarei, N.; Ragan, E.D. A multidisciplinary survey and framework for design and evaluation of explainable AI systems. ACM Trans. Interact. Intell. Syst. 2021, 11, 1–45. [Google Scholar] [CrossRef] [Scilit]
- Lundberg, S.M.; Lee, S.-I. A unified approach to interpreting model predictions. Adv. Neural Inf. Process. Syst. 2017, 30, 4765–4774. [Google Scholar] [CrossRef] [Scilit]
- Ribeiro, M.T.; Singh, S.; Guestrin, C. “Why should I trust you?”: Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; ACM: New York, NY, USA, 2016; pp. 1135–1144. [Google Scholar] [CrossRef] [Scilit]
- Kovari, A. AI for decision support: Balancing accuracy, transparency, and trust across sectors. Information 2024, 15, 725. [Google Scholar] [CrossRef] [Scilit]
- Alicioglu, G.; Sun, B. A survey of visual analytics for Explainable Artificial Intelligence methods. Comput. Graph. 2022, 102, 502–520. [Google Scholar] [CrossRef] [Scilit]
- Cheung, J.C.; Ho, S.S. The effectiveness of explainable AI on human factors in trust models. Sci. Rep. 2025, 15, 23337. [Google Scholar] [CrossRef] [Scilit]
- Liao, Q.V.; Gruen, D.; Miller, S. Questioning the AI: Informing design practices for explainable AI user experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25–30 April 2020; ACM: New York, NY, USA, 2020; pp. 1–15. [Google Scholar] [CrossRef] [Scilit]
- Chen, T.-C.T.; Wang, Y.-C.; Jiang, P.H. A selectively calibrated derivation technique and generalized fuzzy TOPSIS for semiconductor supply chain localization assessment. Decis. Anal. J. 2023, 8, 100275. [Google Scholar] [CrossRef] [Scilit]
- Lin, Y.-C.; Chen, T.C.T. Type-II fuzzy approach with explainable artificial intelligence for nature-based leisure travel destination selection amid the COVID-19 pandemic. Digit. Health 2022, 8, 20552076221106322. [Google Scholar] [CrossRef] [Scilit]
- Mendel, J.M.; John, R.I. Type-2 fuzzy sets made simple. IEEE Trans. Fuzzy Syst. 2002, 10, 117–127. [Google Scholar] [CrossRef] [Scilit]
- Wang, Y.-C.; Chen, T.C.T. A partial-consensus posterior-aggregation FAHP method—Supplier selection problem as an example. Mathematics 2019, 7, 179. [Google Scholar] [CrossRef] [Scilit]
- Wang, Y.-C.; Chen, T. New XAI tools for selecting suitable 3D printing facilities in ubiquitous manufacturing. Complex Intell. Syst. 2023, 9, 6813–6829. [Google Scholar] [CrossRef] [Scilit]
- Deveci, M.; Pamucar, D.; Gokasar, I.; Isik, M.; Coffman, D.M. Fuzzy Einstein WASPAS approach for the economic and societal dynamics of the climate change mitigation strategies in urban mobility planning. Struct. Change Econ. Dyn. 2022, 61, 1–17. [Google Scholar] [CrossRef] [Scilit]
- Jauhar, S.K.; Harinath, S.; Krishnaswamy, V.; Paul, S.K. Explainable artificial intelligence to improve the resilience of perishable product supply chains by leveraging customer characteristics. Ann. Oper. Res. 2025, 354, 103–142. [Google Scholar] [CrossRef] [Scilit]
- Bhatia, S.; Albarrak, A.S. A blockchain-driven food supply chain management using QR code and XAI-faster RCNN architecture. Sustainability 2023, 15, 2579. [Google Scholar] [CrossRef] [Scilit]
- Lipton, Z.C. The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery. Queue 2018, 16, 31–57. [Google Scholar] [CrossRef] [Scilit]
- Puthanveettil Madathil, A.; Luo, X.; Liu, Q.; Walker, C.; Madarkar, R.; Qin, Y. A review of explainable artificial intelligence in smart manufacturing. Int. J. Prod. Res. 2025, 63, 8654–8697. [Google Scholar] [CrossRef] [Scilit]
- Hair, J.F.; Risher, J.J.; Sarstedt, M.; Ringle, C.M. When to use and how to report results of PLS-SEM. Eur. Bus. Rev. 2019, 31, 2–24. [Google Scholar] [CrossRef] [Scilit]
- Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef] [Scilit]
- Henseler, J.; Ringle, C.M.; Sarstedt, M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J. Acad. Mark. Sci. 2015, 43, 115–135. [Google Scholar] [CrossRef] [Scilit]



| Reference | Method | XAI Type | Fuzzy Type | Supply Chain Focus | Explainability Metric |
|---|---|---|---|---|---|
| Chen et al. (2025) [9] | SCDT-GFTOPSIS | Visual charts | Type-1 TFN | Semiconductor location | SAD |
| Olan et al. (2025) [1] | Decision support XAI | Post-hoc review | — | General supply chain | Qualitative |
| Sadeghi et al. (2024) [2] | Survey-based XAI | Transparency index | — | Cyber resilience | Questionnaire |
| Lin & Chen (2022) [24] | IT2F-VIKOR | Segmented distance | Type-2 IT2FS | Tourism destination | SAD |
| Wang & Chen (2023) [27] | XAI-FGDM | Gradient bar charts | Type-1 TFN | 3D printing facilities | SAD |
| Coussement et al. (2024) [11] | XAI-DSS review | SHAP/LIME | — | General DSS | Decision accuracy |
| Proposed (this study) | XQI-FGDM | OEI + SEI + XQI | Type-1 TFN | Semiconductor location | XQI (composite) |
| Task | Corresponding XAI Tool | Objective Measure | Ground-Truth Source | Weight |
|---|---|---|---|---|
| Task 1: Pairwise-comparison interpretation | Hanging gradient bar chart | Expert fuzzy judgment matrix | 0.35 | |
| Task 2: Overall-performance discrimination | Gradient bidirectional scatterplot | GFTOPSIS closeness | 0.35 | |
| Task 3: Traceable aggregation comprehension | Traceable aggregation chart | Aggregated closeness | 0.30 |
| Construct | Abbreviation | Layer | No. of Items | Sample Item | Source |
|---|---|---|---|---|---|
| Perceived understanding | U | Subjective | 4 | I clearly understand what this chart conveys. | Kovari (2024) [19] |
| Perceived transparency | TR | Subjective | 4 | This chart shows how the recommendation was derived. | Kovari (2024) [19] |
| Trust | T | Subjective | 4 | I trust the recommendation shown in this chart. | Cheung & Ho (2025) [21] |
| Cognitive load | CL | Subjective | 4 | Reading this chart requires significant mental effort. | NASA-TLX adapted |
| Decision confidence | DC | Subjective | 3 | I feel confident making a decision based on this chart. | This study |
| Acceptance | A | Subjective | 3 | I would use this chart to support real facility decisions. | This study |
| Decision quality | DQ | Outcome | — | Kendall τ vs. expert consensus ranking | Objective |
| Symbol | Definition | Range | Default Value |
|---|---|---|---|
| Participant index | — | ||
| Visualization type index | — | ||
| Task family index | 1, 2, 3 | — | |
| Normalized fuzzy interpretation deviation | — | ||
| Normalized response time | — | ||
| Ranking fidelity (Kendall rescaled) | — | ||
| Interpretation accuracy for task t, measured as the proportion of Correctly answered task-specific interpretation questions | — | ||
| OEI sub-component weight | ≥0, sum = 1 | 0.25 each | |
| Task weight | ≥0, sum = 1 | 0.35/0.35/0.30 | |
| SEI construct weight | 0.25 each | ||
| OEI–SEI blending weight | 0.5 |
| Construct | Items | Reliability Check | Convergent Validity Check | Discriminant Validity Check |
|---|---|---|---|---|
| Understanding (U) | 4 | Cronbach’s alpha; CR | AVE | HTMT |
| Transparency (TR) | 4 | Cronbach’s alpha; CR | AVE | HTMT |
| Trust (T) | 4 | Cronbach’s alpha; CR | AVE | HTMT |
| Cognitive load (CL) | 4 | Cronbach’s alpha; CR | AVE | HTMT |
| Decision confidence (DC) | 3 | Cronbach’s alpha; CR | AVE | HTMT |
| Acceptance (A) | 3 | Cronbach’s alpha; CR | AVE | HTMT |
| Analysis Target | Planned Comparison | Statistical Test | Reporting Item |
|---|---|---|---|
| Objective explainability | Condition A vs. B vs. C | MANOVA/ANOVA | Mean, partial |
| Subjective explainability | Condition A vs. B vs. C | MANOVA/ANOVA | Mean, partial |
| Integrated XQI | Condition A vs. B vs. C | ANOVA | Mean, partial |
| Pairwise differences | A–B, B–C, A–C | Tukey’s HSD | Mean difference, adjusted |
| Robustness of XQI ranking | Alternative settings | Sensitivity analysis | Rank stability across parameter settings |
| Hypothesis | Structural Path | Hypothesized Direction | Planned Reporting Item |
|---|---|---|---|
| H1 | OEI → Understanding | Positive | confidence interval, |
| H2 | OEI → Transparency | Positive | confidence interval, |
| H3 | Understanding/Transparency → Trust | Positive | confidence interval, |
| H4a | Cognitive Load → Trust | Negative | confidence interval, |
| H4b | Cognitive Load → Acceptance | Negative | confidence interval, |
| H5 | Trust → Acceptance | Positive | confidence interval, |
| H6 | XQI → Decision Quality | Positive | confidence interval, |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Wang, Y.-C. A Quantitative Explainability Quality Index Framework for Visual XAI in Fuzzy Group Decision-Making for Supply Chain Facility Localization. Information 2026, 17, 519. https://doi.org/10.3390/info17060519
Wang Y-C. A Quantitative Explainability Quality Index Framework for Visual XAI in Fuzzy Group Decision-Making for Supply Chain Facility Localization. Information. 2026; 17(6):519. https://doi.org/10.3390/info17060519
Chicago/Turabian StyleWang, Yu-Cheng. 2026. "A Quantitative Explainability Quality Index Framework for Visual XAI in Fuzzy Group Decision-Making for Supply Chain Facility Localization" Information 17, no. 6: 519. https://doi.org/10.3390/info17060519
APA StyleWang, Y.-C. (2026). A Quantitative Explainability Quality Index Framework for Visual XAI in Fuzzy Group Decision-Making for Supply Chain Facility Localization. Information, 17(6), 519. https://doi.org/10.3390/info17060519

