Design and Validation of PACTUS 2.0: Usability for Neurological Patients, Seniors and Caregivers
Abstract
1. Introduction
2. Related Work
2.1. Antecedents
2.2. Previous PACTUS Systems
2.3. Proposal
3. PACTUS 2.0 System
3.1. Design Considerations
3.2. Device Dynamics
3.3. Proposed Games
4. Design and Implementation
4.1. Hardware Resources
- ESP32-WROOM-32 module (Espressif Systems, Shanghai, China): A low-cost, low-power microcontroller with integrated Wi-Fi and Bluetooth, widely used in IoT and embedded applications.
- TCS34725 RGB color sensor module (Hongkong Yingli International Trading Co., Limited, Hong Kong, China): chosen for its high-precision RGB measurements with a built-in IR filter and 16-bit ADCs per channel. Its I2C interface simplifies the wiring and minimizes the pin count, enabling a compact handle design without compromising direct, linear, and stable readings.
- Touchscreen TFT display: A 2.8-inch ILI9341 TFT LCD display module (Shenzhen HiLetgo E-Commerce Co., Ltd., Shenzhen, China) was initially chosen and then replaced by 4-inch TFT LCD touch display module, 480 × 320, ST7796S (Shenzhen Hongshuyuan Technology Co., Ltd. [LAFVIN], Shenzhen, China). It communicates with the microcontroller via the SPI.
- Arcade button (sourced from Electrónica Caballero, Córdoba, Spain): Used to return to the main menu during a game session without power-cycling the system.
- Potentiometer 4.7 kΩ (sourced from Electrónica Caballero, Córdoba, Spain): Used to enhance the rehabilitation of the fine psychomotor skills of the fingers by controlling one of the games through this element.
- Battery (sourced from Electrónica Caballero, Córdoba, Spain): Two 18650 lithium-ion batteries, each with a capacity of 2500 mAh and voltage of 3.7 V, were used to power the sensorized handle. The display station will either use a 20,000 mAh power bank (external battery) or be directly connected to the mains using a 220-5 V transformer (UGREEN 17W USB wall charger; Ugreen Group Limited, Shenzhen, China) and a micro USB cable for the ESP32.
- MP1584EN (Hongkong Yingli International Trading Co. Limited [DollaTek], Hong Kong, China): This synchronous step-down integrated circuit converts input voltages ranging from 4.5 V to 28 V into an adjustable output starting at 0.8 V and delivering up to 3 A. Owing to its high-frequency (1.5 MHz) and internal MOSFETs, it provides a compact solution with overcurrent and temperature protection. It regulates the 7.4 V from the batteries to 5 V, which supplies ESP32 in the sensorized handle.
4.2. Station Firmware
4.2.1. Graphical User Interface (GUI)
4.2.2. State Machine
4.3. Power Supply Subsystem
- For the station, as mentioned above, a 20,000 mAh (77 Wh) external power bank providing 5 V and 2.4 A was used. However, it can also be used with a 220 V to 5 V adapter and micro-USB cable, allowing for direct connection to the main power when desired.
- The sensorized handle uses two 3.7 V 18,650 batteries in series (theoretical 7.4 V), regulated by an MP1584EN module to supply the ESP32 VIN pin. The ESP32 board then uses its onboard AMS1117 linear regulator to step 5 V down to the 3.3 V required [68], also protecting against voltage fluctuations.
4.4. PACTUS Casing
4.5. RGB Sensor Processing
5. Experimental Design
5.1. Design of the Study on Energy Consumption
- —charge withdrawn.
- —pack voltage.
- —average discharge current during the test.
5.2. RGB Signal-Processing Design
5.3. Usability Study Design with Subjects
5.3.1. Caregivers’ Subjects
5.3.2. Elderly Healthy and Neurological Subjects
6. Results
6.1. Total Energy Consumption of TCS34725 RGB Sensor
- —charge withdrawn during the operational test (mAh);
- —nominal capacity of the two-cell pack (mAh);
- —pack voltage drop observed in the test (V);
- —nominal pack voltage (two cells in series) (V);
- —duration of the test (h);
- —average discharge current over the interval (mA).
6.2. PACTUS 2.0 Usability
7. Discussion
7.1. What Does PACTUS 2.0 Offer?
- Personalization and customization. As mentioned several times, PACTUS 2.0 offers the possibility to “program” different game boards depending on how the colored sheets are arranged. This allows the therapist to adapt the movement that each patient must perform according to their needs and the stage of the rehabilitation process. This flexibility, as previously noted in the literature, provides significant advantages compared with other systems with predefined movements [17,18,19,20,24,26].
- Low cost and accessibility. In addition to complete customization of movements, PACTUS 2.0 ensures accessibility by using common, low-cost elements. This allows for possible implementation at both the clinic and home levels. Being a compact system, with small dimensions and easy implementation, PACTUS 2.0 has the potential to be integrated into home-based rehabilitation, following the guidelines established in [10,18]. Furthermore, the feedback received from caregivers is encouraging, as they agreed that the system is quite intuitive and requires no extensive prior training.
- User engagement. Finally, PACTUS 2.0 has the potential to enhance patient motivation through variety and interaction. The platform integrates three different SG, prevents habituation to a single task, and encourages sustained engagement. The inclusion of a tangible rotary knob extends the rehabilitation focus from gross upper-limb movements to fine motor skills, while the touchscreen interface and visual feedback (e.g., PACMAN avatar) further increase immersion. The results of the usability study with caregivers and elderly participants, as discussed below, supported these design choices, showing high ratings for satisfaction and ergonomics.
7.2. Limitations of the Study
7.3. Future Work: PACTUS 3.0
8. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A. Description of PACTUS 2.0 Games
Game | Description & Objectives | Rehabilitation Domains | Image |
---|---|---|---|
Free mode | A PACMAN avatar simulates eating and changes color according to the detected color ID, offering immediate visual feedback. Patients can freely explore the recommended range of motion, repeat movements at their own pace, and gain motor confidence through positive reinforcement. | Motor: repetitive upper limb movements (free exploration of movements). Cognitive: very low cognitive load; mainly basic interaction and hand–eye coordination. | |
Feeding PACMAN | A hungry PACMAN must eat randomly colored fruits without repeats, moving from a static blue start to a green end. This trains hand–eye coordination, motor planning, and working memory as patients identify colors, direct the avatar, and remember pending fruits. | Motor: wide and repetitive upper limb movements to select colors (fruits); accuracy in positioning. Cognitive: working memory (avoid repeating fruits already eaten), sustained attention, hand–eye coordination. | |
Space Invaders | A spaceship defends a colored bar from an alien that fires every 6 s. Patients must align the ship’s column (color) to intercept the alien, enhancing reaction speed, movement strength, sustained attention, and decision-making under pressure. Alien appearances are randomized. In addition to using the sensorized handle, players can use a rotatory knob to move the ship through the columns, which promotes the rehabilitation of fine psychomotor skills in the fingers. | Motor: repetitive and fast upper-limb movements; fine motor control with the rotatory knob for shooting. Cognitive: intermediate cognitive load (recognize new alien position), reaction speed, visuomotor coordination. |
Appendix B. Full RGB Signal Processing
Color | Color ID | Rc (*) | Gc (*) | Bc (*) |
---|---|---|---|---|
Red | C1 | 5053 | 1076 | 1103 |
Orange | C2 | 7227 | 2326 | 1595 |
Yellow | C3 | 8884 | 4797 | 2659 |
Pink | C4 | 8470 | 3890 | 3029 |
Blue | C5 | 2177 | 2859 | 2356 |
Green | C6 | 2965 | 3028 | 1678 |
Unidentified | C0 | ≠ | ≠ | ≠ |
- Fast reading and filtering: Three quick samples are averaged to cancel sensor shot–noise and stop the color ID from the fluctuation frame-to-frame.
- Chromatic normalization: Divides by the RGB sum so that the ensuing decision depends on the hue, not on how bright the scene is.
- Euclidean distance: Compares the normalized vector to the six calibrated centers and finds the closest one in a single lightweight step.
- Threshold assignment: Ignores the “closest” class when its distance still lies outside the threshold, thereby eliminating undefined readings.
- Temporal stabilizer: Requires the new ID to persist for 120 ms before it is published, suppressing flicker caused by hand tremors or specular highlights.
- ESP-NOW transmission: Sends a stable ID every 200 ms, keeping traffic and power consumption to a minimum.
Appendix B.1. Fast Reading and Filtering
Appendix B.2. Chromatic Normalization
Appendix B.3. Euclidean Distance
Appendix B.4. Threshold Assignment
- Winner search. It determines an index that minimizes the distance
- Confidence checks. The candidate is accepted only if its distance is smaller than the empirical radius of its own class.
Color | (*) | ||
---|---|---|---|
Red | 2.38 × 10−4 | 5.20 × 10−6 | 2.52 × 10−4 |
Orange | 3.20 × 10−4 | 3.30 × 10−6 | 3.30 × 10−4 |
Yellow | 1.20 × 10−4 | 2.60 × 10−6 | 1.28 × 10−4 |
Pink | 9.39 × 10−4 | 7.00 × 10−6 | 9.60 × 10−4 |
Blue | 8.34 × 10−4 | 5.00 × 10−6 | 8.48 × 10−4 |
Green | 0.669 × 10−4 | 1.10 × 10−6 | 0.69 × 10−4 |
Appendix B.5. Temporal Stabilizer
- Match. If the freshly validated candidate coincides with the official color the reading simply confirms that the current state and internal timer are reset.
- Mismatch. If , the candidate is stored and a timer starts. Only if the same persists for(approximately six consecutive main–loop iterations of ms each) is promoted to the new official value,Otherwise, the system maintains the previous .
Appendix B.6. ESP-NOW Transmission
Appendix B.7. Synthesis
- Fast reading and filtering
- Chromatic normalization
- Euclidean distance & threshold test. For each class i the firmware computes the squared distance and immediately checks it against the class threshold :The smallest distance was , but it still exceeded its threshold by two orders of magnitude . Therefore, the candidate is rejected, and the classifier outputs (“undefined color”).
Class | ||
---|---|---|
1862.2 | 2.52 | |
1329.6 | 3.30 | |
562.8 | 1.28 | |
603.9 | 9.60 | |
51.8 | 8.48 | |
51.1 | 0.69 |
References
- Lekoubou, A.; Nguyen, C.; Kwon, M.; Nyalundja, A.D.; Agrawal, A. Post-stroke Everything. Curr. Neurol. Neurosci. Rep. 2023, 23, 785–800. [Google Scholar] [CrossRef]
- Malik, A.; Tariq, H.; Afridi, A.; Rathore, F. Technological advancements in stroke rehabilitation. JPMA J. Pak. Med. Assoc. 2022, 72, 1672–1674. [Google Scholar] [CrossRef] [PubMed]
- Volpe, B.; Krebs, H.; Hogan, N. Is robot-aided sensorimotor training in stroke rehabilitation a realistic option? Curr. Opin. Neurol. 2002, 14, 745–752. [Google Scholar] [CrossRef] [PubMed]
- Belagaje, S. Stroke Rehabilitation. Continuum 2017, 23, 238–253. [Google Scholar] [CrossRef]
- Rizvi, M.R.; Sharma, A.; Malki, A.; Sami, W. Enhancing Cardiovascular Health and Functional Recovery in Stroke Survivors: A Randomized Controlled Trial of Stroke-Specific and Cardiac Rehabilitation Protocols for Optimized Rehabilitation. J. Clin. Med. 2023, 12, 6589. [Google Scholar] [CrossRef] [PubMed]
- Lohse, K.; Lambert-Shirzad, N.; Verster, A.; Hodges, N.; Loos, H. Video Games and Rehabilitation: Using Design Principles to Enhance Engagement in Physical Therapy. J. Neurol. Phys. Ther. JNPT 2013, 37, 166–175. [Google Scholar] [CrossRef]
- Olcay, D.; Ulusam Seckiner, S. Gamification of Upper Limb Tangible-Wearable Rehabilitation Devices. In Industrial Engineering in the Digital Disruption Era; Calisir, F., Korhan, O., Eds.; Lecture Notes in Management and Industrial Engineering, Springer: Cham, Switzerland, 2020. [Google Scholar] [CrossRef]
- Kelley, R.E.; Borazanci, A.P. Stroke rehabilitation. Neurol. Res. 2009, 31, 832–840. [Google Scholar] [CrossRef] [PubMed]
- Marques, A.; Caldas, H.; Barbosa, M.; Soares, L.; Ribeiro, M.; Simões-Silva, V. Gamification in Stroke Rehabilitation; IGI Global: Hershey, PA, USA, 2022; pp. 187–199. [Google Scholar] [CrossRef]
- Tamayo-Serrano, P.; Garbaya, S.; Blazevic, P. Gamified In-Home Rehabilitation for Stroke Survivors: Analytical Review. Int. J. Serious Games 2018, 5. [Google Scholar] [CrossRef]
- Adlakha, S.; Chhabra, D.; Shukla, P. Effectiveness of gamification for the rehabilitation of neurodegenerative disorders. Chaos Solitons Fractals 2020, 140, 110192. [Google Scholar] [CrossRef]
- Lee, J.J.; Hammer, J. Gamification in Education: What, How, Why Bother? Acad. Exch. Q. 2011, 15, 1–5. [Google Scholar]
- Sánchez-Gil, J.J.; Sáez-Manzano, A.; López-Luque, R.; Ochoa-Sepúlveda, J.J.; Cañete-Carmona, E. Gamified devices for stroke rehabilitation: A systematic review. Comput. Methods Programs Biomed. 2024, 258, 108476. [Google Scholar] [CrossRef] [PubMed]
- Damaševičius, R.; Maskeliūnas, R.; Blažauskas, T. Serious Games and Gamification in Healthcare: A Meta-Review. Information 2023, 14, 105. [Google Scholar] [CrossRef]
- Randolph, S.A. Ischemic Stroke. Workplace Health Saf. 2016, 64, 444. [Google Scholar] [CrossRef] [PubMed]
- Sánchez-Gil, J.J.; Sáez-Manzano, A.; López-Luque, R.; Ochoa-Sepúlveda, J.J.; Cañete-Carmona, E. Design and validation of PACTUS: A gamified electronic device for stroke rehabilitation. Comput. Methods Programs Biomed. 2025, 260, 108563. [Google Scholar] [CrossRef]
- Ozgur, A.G.; Faucon, L.P.; Maceira-Elvira, P.; Wessel, M.J.; Johal, W.; Özgür, A.; Cadic-Melchior, A.; Hummel, F.C.; Dillenbourg, P. Towards an Adaptive Upper Limb Rehabilitation Game with Tangible Robots. In Proceedings of the 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR), Toronto, ON, Canada, 24–28 June 2019; pp. 294–299. [Google Scholar] [CrossRef]
- Ozgur, A.G.; Jonas Wessel, M.; Johal, W.; Sharma, K.; Özgür, A.; Vuadens, P.; Mondada, F.; Hummel, F.C.; Dillenbourg, P. Iterative Design of an Upper Limb Rehabilitation Game with Tangible Robots. In Proceedings of the 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Chicago, IL, USA, 5–8 March 2018; pp. 241–250. [Google Scholar]
- Ozgur, A.G.; Wessel, M.J.; Olsen, J.K.; Cadic-Melchior, A.G.; Zufferey, V.; Johal, W.; Dominijanni, G.; Turlan, J.L.; Mühl, A.; Bruno, B.; et al. The effect of gamified robot-enhanced training on motor performance in chronic stroke survivors. Heliyon 2022, 8, e11764. [Google Scholar] [CrossRef]
- Ozgur, A.G.; Khodr, H.; Bruno, B.; Gandar, N.; Wessel, M.J.; Hummel, F.C.; Dillenbourg, P. Detecting Compensatory Motions and Providing Informative Feedback During a Tangible Robot Assisted Game for Post-Stroke Rehabilitation. In Proceedings of the 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), Vancouver, BC, Canada, 8–12 August 2021; pp. 243–249. [Google Scholar] [CrossRef]
- Özgür, A.; Johal, W.; Mondada, F.; Dillenbourg, P. Haptic-Enabled Handheld Mobile Robots: Design and Analysis. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, 6–11 May 2017; pp. 2449–2461. [Google Scholar] [CrossRef]
- Rogers, J.; Duckworth, J.; Middleton, S.; Steenbergen, B.; Wilson, P. Elements virtual rehabilitation improves motor, cognitive, and functional outcomes in adult stroke: Evidence from a randomized controlled pilot study. J. Neuroeng. Rehabil. 2019, 16, 56. [Google Scholar] [CrossRef]
- Wilson, P.; Rogers, J.; Vogel, K.; Steenbergen, B.; McGuckian, T.B.; Duckworth, J. Home-based (virtual) rehabilitation improves motor and cognitive function for stroke patients: A randomized controlled trial of the Elements (EDNA-22) system. J. Neuroeng. Rehabil. 2021, 18, 165. [Google Scholar] [CrossRef]
- Pouplin, S.; Bonnyaud, C.; Bouchigny, S.; Mégard, C.; Bertholier, L.; Goulamhoussen, R.; Foulon, P.; Bensmail, D.; Barbot, F.; Roche, N. Feasibility of a serious game system including a tangible object for post stroke upper limb rehabilitation: A pilot randomized clinical study. Front. Neurol. 2023, 14, 1176071. [Google Scholar] [CrossRef] [PubMed]
- Jung, H.T.; Daneault, J.F.; Lee, H.; Kim, K.; Kim, B.; Park, S.; Ryu, T.; Kim, Y.; Lee, S.I. Remote Assessment of Cognitive Impairment Level Based on Serious Mobile Game Performance: An Initial Proof of Concept. IEEE J. Biomed. Health Inform. 2019, 23, 1269–1277. [Google Scholar] [CrossRef]
- Song, X.; Van De Ven, S.S.; Liu, L.; Wouda, F.J.; Wang, H.; Shull, P.B. Activities of Daily Living-Based Rehabilitation System for Arm and Hand Motor Function Retraining After Stroke. IEEE Trans. Neural Syst. Rehabil. Eng. 2022, 30, 621–631. [Google Scholar] [CrossRef] [PubMed]
- Pereira, F.; Bermúdez i Badia, S.; Jorge, C.; Cameirão, M.S. The use of game modes to promote engagement and social involvement in multi-user serious games: A within-person randomized trial with stroke survivors. J. Neuroeng. Rehabil. 2021, 18, 62. [Google Scholar] [CrossRef]
- Burdea, G.; Kim, N.; Polistico, K.; Kadaru, A.; Grampurohit, N.; Hundal, J.; Pollack, S. Robotic Table and Serious Games for Integrative Rehabilitation in the Early Poststroke Phase: Two Case Reports. JMIR Rehabil. Assist. Technol. 2022, 9, e26990. [Google Scholar] [CrossRef] [PubMed]
- Dash, A.; Lahiri, U. Design of Virtual Reality-Enabled Surface Electromyogram-Triggered Grip Exercise Platform. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 444–452. [Google Scholar] [CrossRef]
- Tosto, J.; Tabacof, L.; Herrera, J.; Breyman, E.; Dewil, S.; Cortes, M.; Correa-esnard, L.; Kellner, C.; Dangayach, N.; Putrino, D. Gamified Neurorehabilitation Strategies for Post-stroke Motor Recovery: Challenges and Advantages. Curr. Neurol. Neurosci. Rep. 2022, 22, 183–195. [Google Scholar] [CrossRef]
- Hashim, S.H.B.M.; Ismail, M.B.; Manaf, H.B.A.; Hanapiah, F.A.B. Framework of virtual reality game on dual cognitive task for stroke rehabilitation. In Proceedings of the 2018 IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE), Penang, Malaysia, 28–29 April 2018; pp. 114–118. [Google Scholar] [CrossRef]
- Demofonti, A.; Carpino, G.; Zollo, L.; Johnson, M.J. Affordable Robotics for Upper Limb Stroke Rehabilitation in Developing Countries: A Systematic Review. IEEE Trans. Med. Robot. Bionics 2021, 3, 11–20. [Google Scholar] [CrossRef]
- Toh, S.F.M.; Fong, K.N.K.; Gonzalez, P.C.; Tang, Y.M. Application of Home-Based Wearable Technologies in Physical Rehabilitation for Stroke: A Scoping Review. IEEE Trans. Neural Syst. Rehabil. Eng. 2023, 31, 1614–1623. [Google Scholar] [CrossRef]
- Pine, R.; Fleming, T.; McCallum, S.; Sutcliffe, K. The Effects of Casual Videogames on Anxiety, Depression, Stress, and Low Mood: A Systematic Review. Games Health J. 2020, 9, 255–264. [Google Scholar] [CrossRef] [PubMed]
- Sheng, B.; Zhao, J.; Zhang, Y.; Xie, S.; Tao, J. Commercial device-based hand rehabilitation systems for stroke patients: State of the art and future prospects. Heliyon 2023, 9, e13588. [Google Scholar] [CrossRef]
- Kim, E.K.; Kang, J.H.; Park, J.S.; Jung, B.H. Clinical Feasibility of Interactive Commercial Nintendo Gaming for Chronic Stroke Rehabilitation. J. Phys. Ther. Sci. 2012, 24, 901–903. [Google Scholar] [CrossRef]
- Unibaso-Markaida, I.; Iraurgi, I. Effect of the Wii Sports Resort on Mobility and Health-Related Quality of Life in Moderate Stroke. Behav. Neurol. 2021, 2021, 6635298. [Google Scholar] [CrossRef]
- Sana, V.M.; Ghous, M.M.; Kashif, M.P.; Albalwi, A.P.P.; Muneer, R.M.; Zia, M.M. Effects of vestibular rehabilitation therapy versus virtual reality on balance, dizziness, and gait in patients with subacute stroke: A randomized controlled trial. Medicine 2023, 102, e33203. [Google Scholar] [CrossRef] [PubMed]
- Taske, A.; Oppermann, L.; Niemann, K.; Wilken, R. Design and Evaluation of a Stroke Rehabilitation Program. In Proceedings of the GI VR/AR Workshop 2015, Sankt Augustin, Germany, 10–11 September 2015. [Google Scholar] [CrossRef]
- Rizzato, A.; Pizzichemi, M.; Gobbi, E.; Gerardi, A.; Fortin, C.; Copcia, A.; Paoli, A.; Marcolin, G. Effectiveness and therapeutic compliance of digital therapy in shoulder rehabilitation: A randomized controlled trial. J. Neuroeng. Rehabil. 2023, 20, 87. [Google Scholar] [CrossRef]
- Hung, Y.X.; Huang, P.C.; Chen, K.T.; Chu, W.C. What Do Stroke Patients Look for in Game-Based Rehabilitation: A Survey Study. Medicine 2016, 95, e3032. [Google Scholar] [CrossRef]
- van Ommeren, A.L.; Smulders, L.C.; Prange-Lasonder, G.B.; Buurke, J.H.; Veltink, P.H.; Rietman, J.S. Assistive Technology for the Upper Extremities After Stroke: Systematic Review of Users’ Needs. JMIR Rehabil. Assist. Technol. 2018, 5, e10510. [Google Scholar] [CrossRef] [PubMed]
- Hussain, S.; Jamwal, P.K.; Van Vliet, P.; Ghayesh, M.H. State-of-the-Art Robotic Devices for Wrist Rehabilitation: Design and Control Aspects. IEEE Trans. Hum.-Mach. Syst. 2020, 50, 361–372. [Google Scholar] [CrossRef]
- Li, L.; Fu, Q.; Tyson, S.; Preston, N.; Weightman, A. A scoping review of design requirements for a home-based upper limb rehabilitation robot for stroke. Top. Stroke Rehabil. 2022, 29, 449–463. [Google Scholar] [CrossRef]
- Niyomyart, A.; Ruksakulpiwat, S.; Benjasirisan, C.; Phianhasin, L.; Nigussie, K.; Thorngthip, S.; Shamita, G.; Thampakkul, J.; Begashaw, L. Current Status of Barriers to mHealth Access Among Patients With Stroke and Steps Toward the Digital Health Era: Systematic Review. JMIR Mhealth Uhealth 2024, 12, e54511. [Google Scholar] [CrossRef] [PubMed]
- Shah, M.F.; Hussain, S.; Goecke, R.; Jamwal, P.K. Mechanism Design and Control of Shoulder Rehabilitation Robots: A Review. IEEE Trans. Med. Robot. Bionics 2023, 5, 780–792. [Google Scholar] [CrossRef]
- Zhang, B.; Wong, K.P.; Kang, R.; Fu, S.; Qin, J.; Xiao, Q. Efficacy of Robot-Assisted and Virtual Reality Interventions on Balance, Gait, and Daily Function in Patients With Stroke: A Systematic Review and Network Meta-analysis. Arch. Phys. Med. Rehabil. 2023, 104, 1711–1719. [Google Scholar] [CrossRef]
- Gupta, N.; Kasula, V.; Sanmugananthan, P.; Panico, N.; Dubin, A.H.; Sykes, D.A.; D’Amico, R.S. SmartWear body sensors for neurological and neurosurgical patients: A review of current and future technologies. World Neurosurg. X 2024, 21, 100247. [Google Scholar] [CrossRef] [PubMed]
- Olawade, D.B.; Aderinto, N.; Clement David-Olawade, A.; Egbon, E.; Adereni, T.; Popoola, M.R.; Tiwari, R. Integrating AI-driven wearable devices and biometric data into stroke risk assessment: A review of opportunities and challenges. Clin. Neurol. Neurosurg. 2025, 249, 108689. [Google Scholar] [CrossRef] [PubMed]
- Kopalli, S.R.; Shukla, M.; Jayaprakash, B.; Kundlas, M.; Srivastava, A.; Jagtap, J.; Gulati, M.; Chigurupati, S.; Ibrahim, E.; Khandige, P.S.; et al. Artificial intelligence in stroke rehabilitation: From acute care to long-term recovery. Neuroscience 2025, 572, 214–231. [Google Scholar] [CrossRef]
- Wang, X.; Zhang, J.; Xie, S.Q.; Shi, C.; Li, J.; Zhang, Z.Q. Quantitative Upper Limb Impairment Assessment for Stroke Rehabilitation: A Review. IEEE Sens. J. 2024, 24, 7432–7447. [Google Scholar] [CrossRef]
- Favata, A.; Gallart-Agut, R.; Pàmies-Vilà, R.; Torras, C.; Font-Llagunes, J.M. IMU-Based Systems for Upper-Limb Kinematic Analysis in Clinical Applications: A Systematic Review. IEEE Sens. J. 2024, 24, 28576–28594. [Google Scholar] [CrossRef]
- Proietti, T.; Bandini, A. Wearable Technologies for Monitoring Upper Extremity Functions During Daily Life in Neurologically Impaired Individuals. IEEE Trans. Neural Syst. Rehabil. Eng. 2024, 32, 2737–2748. [Google Scholar] [CrossRef]
- Hutabarat, Y.; Owaki, D.; Hayashibe, M. Recent Advances in Quantitative Gait Analysis Using Wearable Sensors: A Review. IEEE Sens. J. 2021, 21, 26470–26487. [Google Scholar] [CrossRef]
- Baranyi, R. DeapSea: Workflow-Supported Serious Game Design for Stroke Rehabilitation. Int. J. Comput. Games Technol. 2023, 2023, 3169262. [Google Scholar] [CrossRef]
- Mubin, O.; Alnajjar, F.; Mahmud, A.; Jishtu, N.; Alsinglawi, B. Exploring serious games for stroke rehabilitation: A scoping review. Disabil. Rehabil. Assist. Technol. 2020, 17, 159–165. [Google Scholar] [CrossRef]
- Johnson, D.; Deterding, S.; Kuhn, K.A.; Staneva, A.; Stoyanov, S.; Hides, L. Gamification for health and wellbeing: A systematic review of the literature. Internet Interv. 2016, 6, 89–106. [Google Scholar] [CrossRef]
- Ibrahim, E.N.M.; Jamali, N.; Suhaimi, A.I.H. Exploring gamification design elements for mental health support. Int. J. Adv. Technol. Eng. Explor. 2021, 8, 114–125. [Google Scholar] [CrossRef]
- Tuah, N.M.; Ahmedy, F.; Gani, A.; Yong, L.N. A Survey on Gamification for Health Rehabilitation Care: Applications, Opportunities, and Open Challenges. Information 2021, 12, 91. [Google Scholar] [CrossRef]
- Omar, M.Y.B.; Rambli, D.R.A.; Sulaiman, S.; Shiratuddin, M.F.; Merienne, F.; Vanhalle, D. Proposed Conceptual Design Model of Persuasive Game for Upper limb for Stroke Rehabilitation. In Proceedings of the 2019 IEEE Conference on Graphics and Media (GAME), Pulau Pinang, Malaysia, 19–21 November 2019; pp. 44–48. [Google Scholar] [CrossRef]
- Schöbel, S.M.; Janson, A.; Söllner, M. Capturing the complexity of gamification elements: A holistic approach for analysing existing and deriving novel gamification designs. Eur. J. Inf. Syst. 2020, 29, 641–668. [Google Scholar] [CrossRef]
- Grudpan, S.; Wattanakul, S.; Choosri, N.; Palee, P.; Wongta, N.; Malaka, R.; Klaphajone, J. Virtual Reality Games for Stroke Rehabilitation: A Feasibility Study. In Proceedings of the Entertainment Computing—ICEC 2020, Xi’an, China, 10–13 November 2020; Nunes, N., Ma, L., Wang, M., Correia, N., Pan, Z., Eds.; Lecture Notes in Computer Science. Springer: Cham, Switzerland, 2020; Volume 12523. [Google Scholar] [CrossRef]
- Dykens, I.; Wetzel, A.; Dorton, S.; Batchelor, E. Towards a Unified Model of Gamification and Motivation. In Proceedings of the Adaptive Instructional Systems. Design and Evaluation. HCII 2021, Virtual, 24–29 July 2021; Sottilare, R., Schwarz, J., Eds.; Lecture Notes in Computer Science. Springer: Cham, Switzerland, 2021; Volume 12792. [Google Scholar] [CrossRef]
- Korn, O.; Tietz, S. Strategies for Playful Design when Gamifying Rehabilitation: A Study on User Experience. In Proceedings of the PETRA ’17: 10th International Conference on PErvasive Technologies Related to Assistive Environments, Island of Rhodes, Greece, 21–23 June 2017. [Google Scholar] [CrossRef]
- Alankus, G.; Lazar, A.; May, M.; Kelleher, C.L. Towards customizable games for stroke rehabilitation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, GA, USA, 10–15 April 2010. [Google Scholar]
- Eridani, D.; Rochim, A.F.; Cesara, F.N. Comparative Performance Study of ESP-NOW, Wi-Fi, Bluetooth Protocols based on Range, Transmission Speed, Latency, Energy Usage and Barrier Resistance. In Proceedings of the 2021 International Seminar on Application for Technology of Information and Communication (iSemantic), Semarangin, Indonesia, 18–19 September 2021; pp. 322–328. [Google Scholar] [CrossRef]
- Urazayev, D.; Eduard, A.; Ahsan, M.; Zorbas, D. Indoor Performance Evaluation of ESP-NOW. In Proceedings of the 2023 IEEE International Conference on Smart Information Systems and Technologies (SIST), Astana, Kazakhstan, 4–6 May 2023; pp. 1–6. [Google Scholar] [CrossRef]
- Sánchez-Gil, J.J.; Cañete-Carmona, E.; Brox, M.; Gersnoviez, A.; Molina-Espinosa, M.Á.; Gámez-Granados, J.C.; Moreno, J. An Electronic Barrel Bung to Wirelessly Monitor the Biological Aging Process of Fino Sherry Wine. IEEE Access 2024, 12, 35337–35350. [Google Scholar] [CrossRef]
- Moan, M.E.; Vonstad, E.K.; Su, X.; Vereijken, B.; Solbjør, M.; Skjæret-Maroni, N. Experiences of Stroke Survivors and Clinicians With a Fully Immersive Virtual Reality Treadmill Exergame for Stroke Rehabilitation: A Qualitative Pilot Study. Front. Aging Neurosci. 2021, 13, 735251. [Google Scholar] [CrossRef] [PubMed]
- Bobin, M.; Bimbard, F.; Boukallel, M.; Anastassova, M.; Ammi, M. SpECTRUM: Smart ECosystem for sTRoke patient’s Upper limbs Monitoring. Smart Health 2019, 13, 100066. [Google Scholar] [CrossRef]
- Deutsch, J.E.; James-Palmer, A.; Damodaran, H.; Puh, U. Comparison of neuromuscular and cardiovascular exercise intensity and enjoyment between standard of care, off-the-shelf and custom active video games for promotion of physical activity of persons post-stroke. J. Neuroeng. Rehabil. 2021, 18, 63. [Google Scholar] [CrossRef]
- Bouatrous, A.; Meziane, A.; Zenati, N.; Hamitouche, C. A new adaptive VR-based exergame for hand rehabilitation after stroke. Multimed. Syst. 2023, 29, 3385–3402. [Google Scholar] [CrossRef]
- Brooke, J. SUS: A quick and dirty usability scale. Usability Eval. Ind. 1995, 189, 4–7. [Google Scholar]
- Joha, M.; Kumarana, S.; Shin, Y.; Cha, H.; Oh, E.; Lee, K.H.; Choi, H.J. An ensemble model of machine learning regression techniques and color spaces integrated with a color sensor: Application to color-changing biochemical assays. RSC Adv. 2025, 15, 1754–1765. [Google Scholar] [CrossRef] [PubMed]
- Shchelkanova, E.; Shchapova, L.; Shchelkanov, A.; Shibata, T. Blue as an Underrated Alternative to Green: Photoplethysmographic Heartbeat Intervals Estimation under Two Temperature Conditions. Sensors 2021, 21, 4241. [Google Scholar] [CrossRef] [PubMed]
- Gevers, T.; Smeulders, A.W. Color-based object recognition. Pattern Recognit. 1999, 32, 453–464. [Google Scholar] [CrossRef]
- Sun, D.; Zhao, X.; Kan, J. Performance Evaluation of Color Descriptors under Illumination Variation. J. Sens. 2021, 2021, 6687087. [Google Scholar] [CrossRef]
- To, D.T.H.; Myung, N.V. Critical review of hydrogen cyanide (HCN) sensors and their applications. Sens. Actuators Rep. 2024, 8, 100254. [Google Scholar] [CrossRef]
- Greenawald, L.A.; Boss, G.R.; Snyder, J.L.; Reeder, A.; Bell, S. Development of an Inexpensive RGB Color Sensor for the Detection of Hydrogen Cyanide Gas. ACS Sens. 2017, 2, 1458–1466. [Google Scholar] [CrossRef] [PubMed]
- Syafutra, H.; Anam, M.; Ahmad, F.; Nadalia, D.; Heryanto, R.; Antarnusa, G.; Umam, R.; Takahashi, H. Development of portable color detector: Its application for determination of Munsell Soil Color. Sains Tanah-J. Soil Sci. Agroclimatol. 2025, 22, 1–11. [Google Scholar] [CrossRef]
- Lin, Y.; Chen, D.; Liang, S.; Xu, Z.; Qiu, Y.; Zhang, J.; Liu, X. Color Classification of Wooden Boards Based on Machine Vision and the Clustering Algorithm. Appl. Sci. 2020, 10, 6816. [Google Scholar] [CrossRef]
- Xiong, N.; Shen, Y.; Yang, K.; Lee, C.; Wu, C. Color sensors and their applications based on real-time color image segmentation for cyber physical systems. J. Image Video Process. 2018, 2018, 23. [Google Scholar] [CrossRef]
- Danti, A.; Suresha. Segmentation and Classification of Raw Arecanuts Based on Three Sigma Control Limits. Procedia Technol. 2012, 4, 215–219. [Google Scholar] [CrossRef]
- Dhanddra, B.; Hegadi, R. Classification of Abnormal Endoscopic Images using RGB Color and Morphological Watershed Segmentation. In Proceedings of the Thirteenth International Conference on Advanced Computing and Communications, (ADCOM-2005), Coimbatore, India, 14–17 December 2005. [Google Scholar]
- Vu, P.P.; Vaskov, A.K.; Irwin, Z.T.; Henning, P.T.; Lueders, D.R.; Laidlaw, A.T.; Davis, A.J.; Nu, C.S.; Gates, D.H.; Gillespie, R.B.; et al. A regenerative peripheral nerve interface allows real-time control of an artificial hand in upper limb amputees. Sci. Transl. Med. 2020, 12, eaay2857. [Google Scholar] [CrossRef] [PubMed]
- Cao, S.; Feng, P.; Kang, W.; Chen, Z.; Wang, B. Optimized driver fatigue detection method using multimodal neural networks. Sci. Rep. 2025, 15, 12240. [Google Scholar] [CrossRef]
Design Element | Refs. | Implementation |
---|---|---|
Comfort (ease of use of the system) | [35,42,43,44] | → Improved sensorized tangible grip, increasing the diameter to 5 cm to allow for better grip. |
Intuitive interface | [45,46,47,48,49,50] | → The main touchscreen menu consists of three grids, each displaying a series of sprites (2D images used to represent game objects, characters, or elements). Tapping any grid launches the corresponding game. → A “Return to Menu” button has been added so that, if a session needs to be interrupted, the patient can go back to the main menu without power-cycling the entire system. |
Robustness | [42,43] | → Processing has been added to the RGB sensor readings, enabling robust output at all times. → The sensor has been shielded from ambient light to prevent interference with the readings [35]. |
Lightness and ergonomics of materials | [33,43] | → The materials have been designed and developed on a 3D printer, ensuring that they are not only shock-resistant but also lightweight. |
Accessibility (economic) | [32,35,42,46] | → The aforementioned 3D printing and selection of hardware resources make PACTUS 2.0 economical. |
Monitoring | [48,51,52,53] | → The feedback provided allows the patient’s progress to be monitored during the playing session. |
Non-invasive | [48,52,53,54] | → By using a sensorized tangible grip, the patient only needs to hold it; there is no need to attach anything to their body or clothing. → All cables connecting the sensor to the station have been removed, unlike previous PACTUS versions, so nothing interferes with arm movements. |
Caregivers | |||
---|---|---|---|
Subject | Sex | Age | Formation |
Caregiver 1 | Male | 35 | Nursing Assistant (equivalent to Spanish TCAE) |
Caregiver 2 | Female | 60 | Geriatric Nursing Assistant |
Caregiver 3 | Female | 49 | Nursing Assistant (equivalent to Spanish TCAE) |
Volunteers’ subjects | |||
Subject | Sex | Age | Neurological disorders? |
Volunteer 1 | Female | 96 | No |
Volunteer 2 | Male | 72 | No |
Volunteer 3 | Male | 85 | Moderate–severe Alzheimer’s disease |
Volunteer 4 | Female | 93 | Dementia |
Volunteer 5 | Male | 89 | Ischemic stroke (dysphagia, Brunnstrom Scale = 5, three months since affection), and Parkinson’s disease. |
Volunteer 6 | Female | 90 | Dementia, moderate Alzheimer`s disease, and Parkinson’s disease. |
Volunteer 7 | Male | 92 | No |
Volunteer 8 | Male | 86 | Meningitis (cognitive sequelae: partial memory loss) |
Volunteer 9 | Female | 84 | No |
Volunteer 10 | Male | 94 | No |
Volunteer 11 | Female | 88 | No |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Sánchez-Gil, J.J.; Sáez, A.; Ochoa-Sepúlveda, J.J.; López-Luque, R.; Cáceres-Gómez, D.; Cañete-Carmona, E. Design and Validation of PACTUS 2.0: Usability for Neurological Patients, Seniors and Caregivers. Sensors 2025, 25, 6158. https://doi.org/10.3390/s25196158
Sánchez-Gil JJ, Sáez A, Ochoa-Sepúlveda JJ, López-Luque R, Cáceres-Gómez D, Cañete-Carmona E. Design and Validation of PACTUS 2.0: Usability for Neurological Patients, Seniors and Caregivers. Sensors. 2025; 25(19):6158. https://doi.org/10.3390/s25196158
Chicago/Turabian StyleSánchez-Gil, Juan J., Aurora Sáez, Juan José Ochoa-Sepúlveda, Rafael López-Luque, David Cáceres-Gómez, and Eduardo Cañete-Carmona. 2025. "Design and Validation of PACTUS 2.0: Usability for Neurological Patients, Seniors and Caregivers" Sensors 25, no. 19: 6158. https://doi.org/10.3390/s25196158
APA StyleSánchez-Gil, J. J., Sáez, A., Ochoa-Sepúlveda, J. J., López-Luque, R., Cáceres-Gómez, D., & Cañete-Carmona, E. (2025). Design and Validation of PACTUS 2.0: Usability for Neurological Patients, Seniors and Caregivers. Sensors, 25(19), 6158. https://doi.org/10.3390/s25196158