Next Article in Journal
High Physical Activity Level and the Long-Term Risk of Atrial Fibrillation in Two Swedish Cohorts
Previous Article in Journal
Association Between Muscle Quality Assessed by the 5-Repetition Sit-to-Stand Test and Falls in Community-Dwelling Older Adults in Japan: A Cross-Sectional Study
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Geriatrics
Volume 10
Issue 3
10.3390/geriatrics10030079
Due to scheduled maintenance work on our database systems, there may be short service disruptions on this website between 10:00 and 11:00 CEST on June 14th.
geriatrics-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Behaviours in Dementia Toolkit: A Descriptive Study on the Reach and Early Impact of a Digital Health Resource Library About Dementia-Related Mood and Behaviour Changes

by
Lauren Albrecht
1,
Nick Ubels
1,
Brenda Martinussen
1,
Gary Naglie
2,3,
Mark Rapoport
4,5,
Stacey Hatch
6,
Dallas Seitz
1,6,
Claire Checkland
1 and
David Conn
1,4,7,*
1
Canadian Coalition for Seniors’ Mental Health, Markham, ON L3R 9X9, Canada
2
Department of Medicine and Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON M6A 2E1, Canada
3
Department of Medicine and Rotman Research Institute, Baycrest, Toronto, ON M6A 2E1, Canada
4
Department of Psychiatry, University of Toronto, Toronto, ON M5T 1R8, Canada
5
Sunnybrook Health Sciences Centre, Toronto, ON M5T 1R8, Canada
6
Cummings School of Medicine, Department of Psychiatry, University of Calgary, Calgary, AB T2N 1N4, Canada
7
Department of Psychiatry, Baycrest, Toronto, ON M6A 2E1, Canada
*
Author to whom correspondence should be addressed.
Geriatrics 2025, 10(3), 79; https://doi.org/10.3390/geriatrics10030079
Submission received: 16 April 2025 / Revised: 16 May 2025 / Accepted: 3 June 2025 / Published: 11 June 2025
Review Reports Versions Notes

Abstract

:
Background: Dementia is a syndrome with a high global prevalence that includes a number of progressive diseases of the brain affecting various cognitive domains such as memory and thinking and the performance of daily activities. It manifests as symptoms which often include significant mood and behaviour changes that are highly varied. Changed moods and behaviours due to dementia may reflect distress and may be stressful for both the person living with dementia and their informal and formal carers. To provide dementia care support specific to mood and behaviour changes, the Behaviours in Dementia Toolkit website (BiDT) was developed using human-centred design principles. The BiDT houses a user-friendly, digital library of over 300 free, practical, and evidence-informed resources to help all care partners better understand and compassionately respond to behaviours in dementia so they can support people with dementia to live well. Objective: (1) To characterize the users that visited the BiDT; and (2) to understand the platform’s early impact on these users. Methods: A multi-method, descriptive study was conducted in the early post-website launch period. Outcomes and measures examined included the following: (1) reach: unique visitors, region, unique visits, return visits, bounce rate; (2) engagement: engaged users, engaged sessions, session duration, pages viewed, engagement rate per webpage, search terms, resources accessed; (3) knowledge change; (4) behaviour change; and (5) website impact: relevance, feasibility, intention to use, improving access and use of dementia guidance, recommend to others. Data was collected using Google Analytics and an electronic survey of website users. Results: From 4 February to 31 March 2024, there were 76,890 unique visitors to the BiDT from 109 countries. Of 76,890 unique visitors to the BiDT during this period, 16,626 were engaged users as defined by Google Analytics (22%) from 80 countries. The highest number of unique engaged users were from Canada (n = 8124) with an engagement rate of 38%. From 5 March 2024 to 31 March 2024, 100 electronic surveys were completed by website users and included in the analysis. Website users indicated that the BiDT validated or increased their dementia care knowledge, beliefs, and activities (82%) and they reported that the website validated their current care approaches or increased their ability to provide care (78%). Further, 77% of respondents indicated that they intend to continue using the BiDT and 81.6% said that they would recommend it to others to review and adopt. Conclusions: The BiDT is a promising tool for sharing practical and evidence-informed information resources to support people experiencing dementia-related mood and behaviour changes. Early evaluation of the website has demonstrated significant reach and engagement with users in Canada and internationally. Survey data also demonstrated high ratings of website relevance, feasibility, intention to use, knowledge change, practice support, and its contribution to dementia guidance.

1. Introduction

Dementia is a syndrome that includes a number of progressive diseases of the brain affecting memory, thinking and the performance of daily activities [1]. Globally, more than 55 million people have dementia; this figure is projected to triple by 2050 [2].
Dementia can manifest as symptoms across a number of domains [3]. Dementia-related mood and behaviour changes, often called the behavioural and psychological symptoms of dementia or responsive behaviours, affects nearly all people living with dementia at some point during their disease course [4]; however, the ways in which these changes are individually expressed varies widely [5]. Changed moods and behaviours due to dementia are highly complex, varied, and stressful [4,5,6], and may reflect distress and unmet needs from the person living with dementia [7]. These changes are associated with deterioration of relationships, increased caregiver burden, institutionalization, and mortality [8]. A research study identified that an increase in caregiver burden was found to increase the frequency and severity of the behaviours [9].
In the USA, approximately 65% of people with dementia live at home [10] and 60% of people in long term care have dementia [10,11]. In low- and middle-income countries, as many as 94% of people living with dementia reside at home. A longitudinal study determined that 97% of people living with dementia in community settings experienced at least one behaviour or mood symptom, most commonly depression, apathy, or agitation [12]. The occurrence of dementia-related mood or behaviour changes are associated with increased long-term care (nursing home) placement for people living with dementia [13]. This means that formal (i.e., professional) and informal (i.e., non-professional) caregivers including spouses, family members, home care staff, care aides, nursing staff, allied health professionals, and physicians will be involved in their care. Formal and informal care partners need assistance to cope with dementia-related mood and behaviour changes to help ease the emotional and physical strain of caregiving [14] and reduce the distress experienced by the person living with dementia [9].
Health information websites are a common source of complex health information [15]. The internet is the most frequently used venue for older adults seeking health information; however, it is simultaneously the least trusted [16]. Online health information should mitigate this mistrust by demonstrating credibility, supporting ease of use, and reducing information overload [16]. Health care providers are increasingly required to use information and communication technologies in their work; however, uptake has not been optimal [17]. Due to the ubiquitous use of the internet and the different ways varied information seekers obtain appropriate information and use it in their lives, health information websites are challenging to design for high usability and maximum benefit [15].
To support the physical, mental, and social wellbeing of people living with dementia, the Canadian Coalition for Seniors’ Mental Health (CCSMH) developed the Behaviours in Dementia Toolkit (BiDT). The BiDT is a free, English-language website (https://behavioursindementia.ca/ (accessed on 3 May 2024)) that contains a user-friendly, digital library of over 300 free resources about dementia-related mood and behaviour changes for informal and formal care partners [18]. The goal of the BiDT is to help all care partners, both formal and informal, better understand and compassionately respond to behaviours in dementia so they can support people with dementia to live well. See Supplementary File Figures S1–S3 and Table S1 for an overview of the website structure and content.
A human-centred design approach was used to develop the BiDT, which considers the multiplicity of users and systems in the design of an innovation and is widely regarded as an effective approach for creating digital health innovations [19,20]. Employing a human-centred design approach in medical devices has also been shown to reduce the need for modifications and updates after they have been made publicly available, supporting cost-effectiveness [21]. A 2020 systematic review indicated that co-designed technologies positively impacted disease knowledge, access to health care, patient satisfaction, health outcomes, medical errors, and medical costs [22]. It is a particularly salient approach for developing digital health solutions for older adults [21,23] and specifically for developing effective health websites [15]. Tables S2–S4 provides a detailed overview of the human-centred design phases and activities that took place in the development process for the BiDT. Three separate publications detail various aspects of the BiDT development and design process [16,24,25].
The BiDT project team conducted a number of activities to create a person-centred and user-friendly platform that would attend to diverse audience needs. The objective of this study was to characterize the users that visited the BiDT in the early launch period and understand the platform’s early impact on these users.

2. Materials and Methods

The BiDT was launched to the public in February 2024. Promotion of the website was comprehensive and extensive from January 2024 through March 2024. Outreach activities targeted to audiences in Canada included direct emails and presentations; a press release and media engagement; sponsored articles in digital and print magazines; and distribution of 26,000 postcards publicizing the BiDT. International outreach activities included social media posts and Google, Facebook, and YouTube advertisements. Collectively, these efforts connected us with a potential audience of approximately seven million people.
The subject of this study was to determine whether the development and implementation of the BiDT was successful. We conducted a multi-method, descriptive study in the early post-launch period (i.e., up to two months post-launch) to address the following research questions:
  • How many users visited the BiDT?
  • How did users engage with the BiDT?
  • How did users rate their change in knowledge about behaviours in dementia and effective responses after using the BiDT?
  • How did users anticipate their care may change after using the BiDT?
  • How did users rate the contribution of the BiDT to dementia guidance in Canada?
These research questions were mapped to five main outcomes and nineteen outcome measures (Table 1). Our study received research ethics board approval from Baycrest (REB# 24-07).

2.1. Google Analytics

Reach and engagement outcome measures were collected via Google Analytics (https://marketingplatform.google.com/about/analytics/ (accessed 5 November 2023)) [26]. Unique visitors are distinct, unduplicated users defined by IP address; traffic from bots and spiders is automatically excluded [27,28]. Google Analytics 4 defines engagement metrics as follows: (1) engaged users have completed a session lasting longer than 10 s, having a key event, or having at least two page or screen views; (2) engaged sessions last longer than 10 s, have a key event, or have at least two page views or screen views; (3) bounce rate is the percentage of sessions that were not engaged; and (4) engagement rate measures the percentage of visitors who interacted with content or spent a significant amount of time on a specific page [29].
Data were collected from 4 February 2024 to 31 March 2024. Google Analytics cookies collect information including IP address, device type and operating system, referring URLs, geolocation, and pages visited. This information is de-personalized and not connected to any individual. Website users were advised of our use of Google Analytics with our website privacy policy and provided tools and instructions to opt out [30].

2.2. Electronic Survey

Knowledge change, behaviour change, and website impact measures were collected through a voluntary electronic survey of website users via Qualtrics (https://www.qualtrics.com/ (accessed 29 October 2023)) (Table S5) [31]. These questions were required by the project funder. The survey and survey recruitment were aimed at Canadian website users and available in English-only due to time and funding constraints. Survey recruitment took place from 5 March to 31 March 2024. Website users were invited to participate in the survey through (1) a banner with an invitation and survey link in the website header; (2) two Facebook advertisements; (3) e-newsletter and social media posts; and (4) direct emails from members of the Behaviours in Dementia Working Group to their networks. Potential participants were first presented with a digital information letter about the study at the survey link. Advancing to the survey implied their consent to participate. Once the data collection period ended, the survey was closed for data collection and the Excel file was downloaded from Qualtrics to CCSMH’s secure server for cleaning, analysis, and secure, long-term storage. Survey responses were included in the analysis if all demographic items and at least one outcome measure were completed.

2.3. Data Analysis

Quantitative data from Google Analytics and the electronic survey were analyzed using descriptive statistics. Google Analytics 4 [32] and Microsoft Excel (https://www.microsoft.com/en-ca/microsoft-365/excel (accessed on 4 June 2023)) [33] were used for analysis.

3. Results

3.1. Google Analytics

From 4 February to 31 March 2024, there were 76,890 unique visitors to the BiDT from 109 countries. The highest number of unique visitors were from the Philippines (n = 31,816); Canada (n = 21,530); Nigeria (n = 8086); Malaysia (n = 3962); and Uganda (n = 2319). Within Canada, where the BiDT was developed, unique visitors opened the BiDT website from all provinces and territories.
Of 76,890 unique visitors to the BiDT during this period, 16,626 were engaged users (22%) from 80 countries. The highest number of unique engaged users were from Canada (n = 8124) with an engagement rate of 38%. Unique engaged users in Canada visited the BiDT from all provinces and territories.
Reach and engagement outcome measures and results are described in Table 2. The results are reported for two groups: total visitors who came to the website and the sub-group of visitors with engaged sessions on the website.
The most often used keyword terms used to search the library catalogue were (1) driving (n = 22); (2) won’t eat (n = 6); and (3) apathy (n = 5). Of the 318 resources in the collection, the five most frequently viewed were (1) caregiver tip sheet: anger, frustration, and fidgeting (n = 604); (2) supporting independence and personhood (n = 367); (3) five seriously fun ideas from a recreation therapist (n = 278); (4) effective online supports help navigate behaviours in dementia (n = 245); and (5) ten helpful resources to increase meaningful engagement (n = 169).

3.2. Electronic Survey

From 5 March 2024 to 31 March 2024, 297 people accessed the survey information page; 230 people consented to participate (77% consent rate); 104 started the survey (45% response rate); and 100 surveys were included in the analysis (96% completion rate).
All survey respondents resided in Canada in the following regions: Ontario (n = 49, 49%); British Columbia (n = 18, 18%); Alberta (n = 11, 11%); Nova Scotia (n = 6, 6%); Manitoba (n = 6, 6%); Saskatchewan (n = 5, 5%); New Brunswick (n = 2, 2%); Newfoundland and Labrador (n = 1, 1%); Northwest Territories (n = 1, 1%); and Prince Edward Island (n = 1, 1%). There were no respondents from Nunavut, Quebec, or Yukon.
Survey respondents identified as (multi-response) caring for someone living with dementia (n = 40, 40%); having a general interest in dementia (n = 33, 33%); knowing someone living with dementia (n = 27, 27%); working in a clinical or non-clinical role connected to dementia (n = 17, 17%); other role (n = 17, 17%); or someone living with dementia (n = 3, 3%).
Knowledge change, behaviour change, and website impact results are reported in Table 3.

4. Discussion

4.1. Reach and Engagement

The Google Analytics results showed high traffic from users in the Philippines, Canada, Nigeria, Malaysia, and Uganda. This is likely a result of our Google, Facebook, and YouTube advertisements targeting English-speaking countries around the world, which were optimized towards low-middle income countries where the cost per click is less (e.g., cost for users in Philippines is PHP 0.02 per click vs. the United States at USD 1.21 per click). It may also reflect less access to health information and care in Sub-Saharan Africa and Southern Asia [34]. The second largest group and most engaged users were from Canada. This was expected as the project took place in Canada and incorporated extensive outreach activities across Canada.
The bounce rate of 71% was high compared to the average bounce rate for health care websites of 58% [35]. Users tend to form an opinion about a website in 0.05 s [36], so it is likely that our paid advertisements through Google and Facebook were not optimally targeted to our intended audiences, which is likely why they did not remain on the website beyond ten seconds or engage with web content. We would expect the bounce rate to improve as our more targeted and sustained outreach activities (e.g., postcard distribution; direct emails and meetings; library listings, etc.) grow our engaged user base and the BiDT becomes more deeply embedded in the dementia care information ecosystem. This data point should be examined at regular intervals over time to ensure that our strategies are working as intended to attract users who find the website useful to support their caregiving.
For the sub-set of engaged users of the BiDT, our results demonstrate a high number of users and sessions. During the study period, 16,626 engaged users visited the website; a figure nearly seven times higher than the number of average users for health care websites [34]. Additionally, those users had 23,714 sessions on the website, which is nearly six times higher than the average number of sessions for health care websites [35]. This is likely a result of the novelty of the website and points to the BiDT meeting a real and present need for informal and formal care partners of people experiencing mood issues and behaviours in dementia. The usefulness of the website is bolstered by high engagement rates on the additional main navigation (i.e., level 1) pages in the BiDT (i.e., other than the home page). For comparison, the all industry average engagement rate for level 1 pages is 75% and the average engagement rate of level 1 pages for non-profit organizations is 53% [37]. Level 1 page engagement rates ranging from 84% to 94% confirm that the BiDT is relevant and engaging; readable and scannable; and facilitates a positive user experience [37].
The return views for both the overall group (21,204, 28%) and engaged users’ sub-group (7088, 43%) demonstrates that the BiDT met its value proposition for providing practical and evidence-informed resources to support people experiencing behaviours in dementia. Users returned, even in the short study timeline, which means that they found something of value on the website or in the library. This data point should also be tracked over time to ensure the BiDT remains relevant to our key audiences.

4.2. Knowledge Change, Behaviour Change, and Website Impact

The results of the electronic survey further highlighted that the BiDT may help carers of people living with dementia. More than 80% of website users indicated that the BiDT validated (40%) or increased (42%) their dementia care knowledge, beliefs, and activities and more than 75% of website users indicated that the BiDT validated their current care approaches (44%) or increased their ability to provide care (34%). Further, over three quarters of respondents (78%) indicated that they intend to continue to use the BiDT and over four fifths (86%) said that they would recommend it to others to use. Additional high ratings on relevance (76%), feasibility (75%), and improved access to dementia guidance (80%) demonstrate that the BiDT will be a highly accessed tool into the future. Particularly as the BiDT becomes more widely known, the use of the website becomes integrated into practice, and users return for more and different resources to meet their needs.

4.3. Limitations

The BiDT is currently an English language website, though it does contain 122 multilingual resources in 12 different languages. The evaluation survey was also only conducted in English, which limits its generalizability, and the data presented is a snapshot immediately post-launch when we had considerable capacity for outreach. Ongoing monitoring of reach and engagement metrics will confirm whether the BiDT remains relevant to users over time. Expansion of the BiDT to other languages would also facilitate greater uptake in Canada, which is an officially bilingual English/French country with over 200 other languages represented in the population [38], and worldwide.
For the electronic survey, fewer participants filled out the survey after consenting (45%). This attrition could be attributed to the request for participants to visit the BiDT before initiating the survey if they had not yet done so and providing an external link. While the drop in participation was not ideal, it was important that users provide an honest assessment of their website experience, which required them to have used the BiDT. Of those that returned or continued with the survey, we observed an excellent survey completion rate (96%).
To understand the sustained impact of the website, it will be important to conduct a future similar survey to solicit feedback from a higher proportion of formal care partners, from participants proportionally representing all provinces and territories, and from non-English speaking users to understand the perspectives, needs, and contextual nuances of different roles and locations. The addition of qualitative data collection (e.g., survey questions, focus groups, or interviews) may also be important to solicit users’ positive and negative feedback in a more open-ended and detailed fashion, as well as to explore more complex considerations including digital literacy.

5. Conclusions

Previous research has demonstrated the critical importance of thoughtful design for digital interfaces to support ease of use, particularly for older adults, including consistent interface and terminology and clear processes [20,39], leading to a user-friendly experience [40,41]. The objective of this study was to characterize the users that visited the BiDT in the early launch period and understand the platform’s early impact on these users. Our findings demonstrated that employing a human-centred design approach in the development of the BiDT led to high reach and engagement as well as positive knowledge change, behaviour change, and website impact results. Longer term evaluation is needed to monitor these metrics over time to ensure sustained enthusiasm for and usefulness of the website. Future investments in the website could also help expand its offerings to reflect emerging evidence and the unique contexts of a variety of equity deserving groups. Sustained outreach and engagement activities will facilitate the integration of this useful tool in dementia care information ecosystems.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/geriatrics10030079/s1, Figure S1. Behaviours in Dementia Toolkit homepage and main navigation; Figure S2: Behaviours in Dementia Toolkit search library function; Figure S3: Behaviours in Dementia Toolkit search categories for informal and formal care partners; Table S1: Behaviours in Dementia Toolkit resource collection snapshot; Table S2: Human-centred design inspiration phase activities for Behaviours in Dementia Toolkit; Table S3: Human-centred design ideation phase activities for Behaviours in Dementia Toolkit; Table S4: Human-centred design implementation phase activities for Behaviours in Dementia Toolkit; Electronic survey questions. Table S5: Electronic survey questions.

Author Contributions

Conceptualization, C.C., D.C., D.S., L.A. and N.U.; Methodology, C.C., D.C., D.S., L.A. and N.U.; Software, L.A. and N.U.; Validation, B.M., G.N., M.R. and S.H.; Formal Analysis, N.U.; Investigation, N.U. and L.A.; Writing—Original Draft Preparation, L.A. and N.U.; Writing—Review and Editing, D.C., B.M., G.N., M.R., S.H., D.S. and C.C.; Supervision, B.M., D.C. and C.C.; Project Administration, L.A. and B.M.; Funding Acquisition, C.C., D.C. and D.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Public Health Agency of Canada grant number 2223-HQ-000421. Dr. Stacey Hatch is funded by the Canadian Institutes of Health Research (CIHR) Institute of Aging as a Postdoctoral Fellow through the CIHR Health System Impact Fellow program.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of Baycrest (REB# 24-07, 11 March 2024).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the electronic survey.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors on request.

Acknowledgments

Many individuals generously contributed their time and talents to the Behaviours in Dementia Toolkit project, including but not limited to the following: Sarah Crane, Christine Roberts, Angel Long, Carolyn Brandly, Lisabelle Tan, Woon Chee Koh, Youya Huang, Brenda Lesperance, Kara Wychnenka, Maya Patrich, and Elder Larry Frost. A special thank you to Meaghan Adams, Monique Beneteau, Cassandra Curtis, Kate Dupuis, Prachi Gandhi, Yael Goldberg, Emily Little, Jim Mann, Isabella Messa, Dawn Shea, Debra Sheets, Adriana Shnall, Leslie Udell, and Trisha Wilson for providing blog posts about their experiences, and to the numerous colleagues, older adults, health care providers, and professional organizations who thoughtfully provided input and feedback throughout the design phase of the project.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. Dementia; World Health Organization: Geneva, Switzerland, 2023; Available online: https://www.who.int/news-room/fact-sheets/detail/dementia (accessed on 28 May 2024).
  2. GBD 2019 Dementia Forecasting Collaborators. Estimation of the global prevalence of dementia in 2019 and forecasted prevalence in 2050: An analysis for the global burden of disease study 2019. Lancet Public Health 2022, 7, e105–e125. [Google Scholar] [CrossRef] [PubMed]
  3. Livingston, G.; Huntley, J.; Sommerlad, A.; Ames, D.; Ballard, C.; Banerjee, S.; Brayne, C.; Burns, A.; Cohen-Mansfield, J.; Cooper, C.; et al. Dementia prevention, intervention, and care: 2020 report of the lancet commission. Lancet 2020, 396, 413–446. [Google Scholar] [CrossRef] [PubMed]
  4. Kales, H.C.; Gitlin, L.N.; Lyketsos, C.G. Assessment and management of behavioral and psychological symptoms of dementia. BMJ 2015, 350, h369. [Google Scholar] [CrossRef] [PubMed]
  5. Calsolaro, V.; Femminella, G.D.; Rogani, S.; Esposito, S.; Franchi, R.; Okoye, C.; Rengo, G.; Monzani, F. Behavioral and psychological symptoms in dementia (BPSD) and the use of antipsychotics. Pharmaceuticals 2021, 14, 246. [Google Scholar] [CrossRef]
  6. Canadian Coalition for Seniors’ Mental Health. Canadian Clinical Practice Guidelines for Assessing and Managing Behavioural and Psychological Symptoms of Dementia (BPSD). March 2024. Available online: https://ccsmh.ca/wp-content/uploads/2024/03/CCSMH-BPSD-Clinical-Guidelines_FINAL_March-2024.pdf (accessed on 3 May 2024).
  7. National Institute for Health and Care Excellence. Dementia: Assessment, Management and Support for People Living with Dementia and Their Carers. 20 June 2018. Available online: https://www.nice.org.uk/guidance/ng97 (accessed on 12 May 2024).
  8. Forester, B.P.; Vahia, I. Behavioral and psychological symptoms—An emerging crisis of the Alzheimer dementia epidemic. JAMA Netw. Open 2019, 2, e190790. [Google Scholar] [CrossRef]
  9. Isik, A.T.; Soysal, P.; Solmi, M.; Veronese, N. Bidirectional relationship between caregiver burden and neuropsychiatric symptoms in patients with Alzheimer’s disease: A narrative review. Int. J. Geriatr. Psychiatry 2019, 34, 1326–1334. [Google Scholar] [CrossRef]
  10. Sturge, J.; Nordin, S.; Patil, D.S.; Jones, A.; Légaré, F.; Elf, M.; Meijering, L. Features of the social and built environment that contribute to the well-being of people with dementia who live at home: A scoping review. Health Place 2021, 67, 102483. [Google Scholar] [CrossRef]
  11. Seitz, D.; Purandare, N.; Conn, D. Prevalence of psychiatric disorders among older adults in long-term care homes: A systematic review. Int. Psychogeriatr. 2010, 22, 1025–1039. [Google Scholar] [CrossRef]
  12. Steinberg, M.; Shao, H.; Zandi, P.; Lyketsos, C.G.; Welsh-Bohmer, K.A.; Norton, M.C.; Breitner, J.C.; Steffens, D.C.; Tschanz, J.T. Point and 5-year period prevalence of neuropsychiatric symptoms in dementia: The Cache County Study. Int. J. Geriatr. Psychiatry 2008, 23, 170–177. [Google Scholar] [CrossRef]
  13. Lyons, T.L.; Champion, J.D. Nonpharmacological interventions for management of behavioral and psychological symptoms of dementia in long-term care facilities by direct caregivers: A systematic review. J. Gerontol. Nurs. 2022, 48, 18–23. [Google Scholar] [CrossRef]
  14. Prince, M.; Wimo, A.; Guerchet, M.; Ali, G.C.; Wu, Y.T.; Prina, M. World Alzheimer Report 2015 the Global Impact of Dementia an Analysis of Prevalence, Incidence, Cost and Trends. October 2015. Available online: https://www.alzint.org/u/WorldAlzheimerReport2015.pdf (accessed on 22 February 2023).
  15. Taylor, H.A.; Sullivan, D.; Mullen, C.; Johnson, C.M. Implementation of a user-centered framework in the development of a web-based health information database and call center. J. Biomed. Inform. 2011, 44, 897–908. [Google Scholar] [CrossRef] [PubMed]
  16. Ubels, N.; Albrecht, L. Evidence-based principles to accelerate health information flow and uptake among older adults. Evid. Based Libr. Inf. Pract. 2024, 19, 109–118. [Google Scholar] [CrossRef]
  17. Virtanen, L.; Kaihlanen, A.M.; Laukka, E.; Gluschkoff, K.; Heponiemi, T. Behavior change techniques to promote healthcare professionals’ eHealth competency: A systematic review of interventions. Int. J. Med. Inform. 2021, 149, 104432. [Google Scholar] [CrossRef] [PubMed]
  18. Canadian Coalition for Seniors’ Mental Health. Behaviours in Dementia Toolkit. Available online: https://behavioursindementia.ca/ (accessed on 3 May 2024).
  19. Dopp, A.R.; Parisi, K.E.; Munson, S.A.; Lyon, A.R. A glossary of user-centered design strategies for implementation experts. Transl. Behav. Med. 2018, 9, 1057–1064. [Google Scholar] [CrossRef]
  20. Nimmanterdwong, Z.; Boonviriya, S.; Tangkijvanich, P. Human-Centered Design of Mobile Health Applications for Older Adults: Systematic Review and Narrative Synthesis (Preprint). JMIR Mhealth Uhealth 2021, 10, e29512. [Google Scholar] [CrossRef]
  21. Harte, R.P.; Glynn, L.G.; Broderick, B.J.; Rodriguez-Molinero, A.; Baker, P.M.A.; McGuiness, B.; O’Sullivan, L.; Diaz, M.; Quinlan, L.R.; Ólaighin, G. Human centred design considerations for connected health devices for the older adult. J. Pers. Med. 2014, 4, 245–281. [Google Scholar] [CrossRef]
  22. Sumner, J.; Chong, L.S.; Bundele, A.; Lim, Y.W. Co-designing technology for aging in place: A systematic review. Gerontologist 2021, 61, e395–e409. [Google Scholar] [CrossRef]
  23. van Velsen, L.; Ludden, G.; Grünloh, C. The limitations of user-and human-centered design in an eHealth context and how to move beyond them. J. Med. Internet Res. 2022, 24, e37341. [Google Scholar] [CrossRef]
  24. Ubels, N.; Albrecht, L.; Tan, L.; Long, A. Developing person-centered metadata: A case study of the Behaviours in Dementia Toolkit. Knowl. Organ. Spec. Issue Crit. Soc. Knowl. Organ. 2024, 51, 478–494. [Google Scholar] [CrossRef]
  25. Ubels, N.; Albrecht, L.; Koh, E.; Conn, D. Pragmatic human centered design in action: Assessing the tone and usability of the Behaviours in Dementia Toolkit. Evid. Based Libr. Inf. Pract. 2025; Submitted manuscript. [Google Scholar]
  26. Fundingsland, E.L., Jr.; Fike, J.; Calvano, J.; Beach, J.; Lai, D.; He, S. Methodological guidelines for systematic assessments of health care websites using web analytics: Tutorial. J. Med. Internet Res. 2022, 24, e28291. [Google Scholar] [CrossRef]
  27. Google. Understand User Metrics—Explore the Different Ways Google Analytics Classifies Users Through Metrics. 2025. Available online: https://support.google.com/analytics/answer/12253918?hl=en (accessed on 15 May 2025).
  28. Google. Known Bot-Traffic Exclusion. 2025. Available online: https://support.google.com/analytics/answer/9888366?hl=en (accessed on 16 May 2025).
  29. Google. Engagement Rate and Bounce Rate—Analytics Help. 2023. Available online: https://support.google.com/analytics/answer/12195621?hl=en (accessed on 28 March 2024).
  30. Canadian Coalition for Seniors’ Mental Health. Behaviours in Dementia Toolkit Privacy Policy. 28 January 2024. Available online: https://behavioursindementia.ca/privacy-policy/ (accessed on 3 May 2024).
  31. Qualtrics. The Leading Research & Experience Software. 2024. Available online: https://www.qualtrics.com/ (accessed on 21 January 2024).
  32. Google. Meet the Next Generation of Google Analytics—Analytics Help. 2023. Available online: https://support.google.com/analytics/answer/10089681?hl=en (accessed on 28 March 2024).
  33. Microsoft. Microsoft Excel Spreadsheet Software. 2024. Available online: https://www.microsoft.com/en-ca/microsoft-365/excel (accessed on 3 February 2024).
  34. World Health Organization. World Bank and WHO: Half the World Lacks Access to Essential Health Services, 100 Million Still Pushed into Extreme Poverty Because of Health Expenses. 13 December 2017. Available online: https://www.who.int/news/item/13-12-2017-world-bank-and-who-half-the-world-lacks-access-to-essential-health-services-100-million-still-pushed-into-extreme-poverty-because-of-health-expenses (accessed on 14 March 2024).
  35. Rudan, N. Website Traffic Benchmarks by Industry. 18 May 2023. Available online: https://databox.com/website-traffic-benchmarks-by-industry (accessed on 28 April 2024).
  36. Haan, K. Top Website Statistics for 2024. 2 April 2024. Available online: https://www.forbes.com/advisor/business/software/website-statistics/ (accessed on 28 April 2024).
  37. Yu, T. Study: Average GA4 Engagement Rates by Industry. 20 March 2024. Available online: https://www.portent.com/blog/content/ga4-engagement-rates.htm (accessed on 28 April 2024).
  38. Government of Canada. Statistics on Official Languages in Canada. 26 November 2019. Available online: https://www.canada.ca/en/canadian-heritage/services/official-languages-bilingualism/publications/statistics.html (accessed on 29 April 2024).
  39. Li, C.; Neugroschl, J.; Zhu, C.W.; Aloysi, A.; Schimming, C.A.; Cai, D.; Grossman, H.; Martin, J.; Sewell, M.; Loizos, M.; et al. Design considerations for mobile health applications targeting older adults. J. Alzheimer’s Dis. 2021, 79, 1–8. [Google Scholar] [CrossRef] [PubMed]
  40. Cajita, M.I.; Hodgson, N.A.; Lam, K.W.; Yoo, S.; Han, H.R. Facilitators of and barriers to mHealth adoption in older adults with heart failure. CIN Comput. Inform. Nurs. 2018, 36, 1. [Google Scholar] [CrossRef] [PubMed]
  41. Kampmeijer, R.; Pavlova, M.; Tambor, M.; Golinowska, S.; Groot, W. The use of e-health and m-health tools in health promotion and primary prevention among older adults: A systematic literature review. BMC Health Serv. Res. 2016, 16, 290. [Google Scholar] [CrossRef] [PubMed]
Table 1. Study questions, outcomes, and measures.
Table 1. Study questions, outcomes, and measures.
Research QuestionOutcomeOutcome MeasureData Collection Tool
How many users visited the website?Reach
  • number of unique visitors
  • number of unique visitors by region
  • number of unique visits
  • number of return visits
  • bounce rate (definition below)
Google Analytics
How did users engage with the website?Engagement
  • engaged users (definition below)
  • engaged sessions (definition below)
  • average session duration
  • average pages viewed per session
  • engagement rate per webpage (definition below)
  • top keyword search terms used
  • top resources accessed
Google Analytics
How did users rate their change in knowledge about behaviours in dementia and effective responses?Knowledge change
  • change in knowledge after using the BiDT
Electronic survey
How did users anticipate their care may change?Behaviour change
  • change in ability to provide care to people experiencing behaviours in dementia after using the BiDT
Electronic survey
How did users rate the website’s contribution to dementia guidance in Canada?Website impact
  • relevance of the BiDT
  • feasibility of the BiDT
  • intention to continue to use the BiDT
  • the BiDT makes a meaningful contribution to improving access and use of dementia guidance and support in Canada
  • would recommend the BiDT to others to use
Electronic survey
Table 2. Reach and engagement outcome measures and results.
Table 2. Reach and engagement outcome measures and results.
Outcome MeasuresResults
Total visitors
Total number of unique visitors76,890
Number of unique views98,094
Bounce rate70.9%
Number of return views21,204
Mean session duration, minutes/seconds1:49
Mean pages per session1.64
Engagement rate for homepage28.9%
Engagement rate for behaviours in dementia information page84.2%
Engagement rate for search library page93.7%
Engagement rate for advanced search page91.3%
Engagement rate for recommended resources page90.0%
Engagement rate for about page86.9%
Engaged users
Number of unique engaged users16,626
Number of unique views23,714
Number of return views7088
Mean session duration, minutes/seconds3:26
Mean pages per session2.65
Engagement rate of users in Philippines15.0%
Engagement rate of users in Canada37.7%
Engagement rate of users in Nigeria14.5%
Engagement rate of users in Malaysia16.5%
Engagement rate of users in Uganda16.9%
Table 3. Knowledge change, behaviour change, and website impact outcome measures results.
Table 3. Knowledge change, behaviour change, and website impact outcome measures results.
OutcomeSurvey Question
(Number and Percentage of Respondents Completing the Question)		Response
(Number, Percentage of Respondents)
Change in knowledgeHow did the BiDT impact your knowledge about behaviours in dementia (n = 100, 100.0%)?
  • I had no change in knowledge (n = 18, 18.0%)
  • The BiDT validated my current knowledge, beliefs, and activities (n = 40, 40.0%)
  • The BiDT increased my knowledge of the topic (n = 42, 42.0%)
Change in behaviourHow did the BiDT impact your ability to provide care to people experiencing behaviours in dementia (n = 97, 97.0%)?
  • I had no change in my ability to provide care (n = 21, 21.6%)
  • The BiDT validated my current approaches to care (n = 43, 44.3%)
  • The BiDT increased my ability to provide care (n = 33, 34.0%)
Website impactThe BiDT is relevant to your situation (n = 84, 84.0%)
  • Strongly Disagree (n = 2, 2.4%)
  • Somewhat Disagree (n = 3, 3.6%)
  • Neither Agree or Disagree (n = 15, 17.9%)
  • Somewhat Agree (n = 30, 35.7%)
  • Strongly Agree (n = 34, 40.5%)
The BiDT is feasible to use in your situation (n = 83, 83.0%)
  • Strongly Disagree (n = 2, 2.4%)
  • Somewhat Disagree (n = 4, 4.8%)
  • Neither Agree or Disagree (n = 15, 18.1%)
  • Somewhat Agree (n = 27, 32.5%)
  • Strongly Agree (n = 35, 42.1%)
The BiDT is something you intend to use (n = 86, 86.0%)
  • Strongly Disagree (n = 3, 3.5%)
  • Somewhat Disagree (n = 3, 3.5%)
  • Neither Agree or Disagree (n = 13, 15.1%)
  • Somewhat Agree (n = 30, 34.9%)
  • Strongly Agree (n = 37, 43.0%)
The BiDT makes a meaningful contribution to improving access and use of dementia guidance in Canada (n = 83, 83.0%)
  • Strongly Disagree (n = 3, 3.6%)
  • Somewhat Disagree (n = 2, 2.4%)
  • Neither Agree or Disagree (n = 12, 14.5%)
  • Somewhat Agree (n = 21, 25.3%)
  • Strongly Agree (n = 45, 54.2%)
I would recommend the BiDT to others to use (n = 83, 83.0%)
  • Strongly Disagree (n = 2, 2.4%)
  • Somewhat Disagree (n = 3, 3.6%)
  • Neither Agree or Disagree (n = 7, 8.4%)
  • Somewhat Agree (n = 22, 26.5%)
  • Strongly Agree (n = 49, 59.0%)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Albrecht, L.; Ubels, N.; Martinussen, B.; Naglie, G.; Rapoport, M.; Hatch, S.; Seitz, D.; Checkland, C.; Conn, D. The Behaviours in Dementia Toolkit: A Descriptive Study on the Reach and Early Impact of a Digital Health Resource Library About Dementia-Related Mood and Behaviour Changes. Geriatrics 2025, 10, 79. https://doi.org/10.3390/geriatrics10030079

AMA Style

Albrecht L, Ubels N, Martinussen B, Naglie G, Rapoport M, Hatch S, Seitz D, Checkland C, Conn D. The Behaviours in Dementia Toolkit: A Descriptive Study on the Reach and Early Impact of a Digital Health Resource Library About Dementia-Related Mood and Behaviour Changes. Geriatrics. 2025; 10(3):79. https://doi.org/10.3390/geriatrics10030079

Chicago/Turabian Style

Albrecht, Lauren, Nick Ubels, Brenda Martinussen, Gary Naglie, Mark Rapoport, Stacey Hatch, Dallas Seitz, Claire Checkland, and David Conn. 2025. "The Behaviours in Dementia Toolkit: A Descriptive Study on the Reach and Early Impact of a Digital Health Resource Library About Dementia-Related Mood and Behaviour Changes" Geriatrics 10, no. 3: 79. https://doi.org/10.3390/geriatrics10030079

APA Style

Albrecht, L., Ubels, N., Martinussen, B., Naglie, G., Rapoport, M., Hatch, S., Seitz, D., Checkland, C., & Conn, D. (2025). The Behaviours in Dementia Toolkit: A Descriptive Study on the Reach and Early Impact of a Digital Health Resource Library About Dementia-Related Mood and Behaviour Changes. Geriatrics, 10(3), 79. https://doi.org/10.3390/geriatrics10030079

Article Metrics

Back to TopTop