Abstract
Local authorities in the UK often try to improve their residents’ financial well-being by promoting changes in behaviour. The extent to which these behaviour change activities are based on relevant theory or evidence is unknown. This research aims to retrospectively analyse the content of local authorities’ policies to identify opportunities for improvement. The Action, Actor, Context, Target, Time (AACTT) framework was used to assess the specification of target behaviours. The Behaviour Change Wheel (BCW) process was used to assess intervention content. Within the policy documents, target behaviours were not consistently specified in terms of the AACTT criteria. Descriptions of interventions lacked detail with 28% unable to be categorised and there was a reliance on Education (46%) to change financial behaviour. The designing and reporting of interventions to change residents’ financial behaviour were not always aligned with behavioural science evidence and utilising systematic frameworks could help local authorities achieve policy objectives.
1. Introduction
The combined impacts of the COVID-19 pandemic and increases in the cost of living has meant that financial security is becoming increasingly difficult for households in the UK [,]. A state of financial security has been characterised as ‘financial well-being’. In the US, the Consumer Financial Protection Bureau (CFPB) define financial well-being as “a state of being wherein a person can fully meet current and ongoing financial obligations, can feel secure in their financial future, and is able to make choices that allow enjoyment of life” []. In 2020, the Money and Pensions Service (MaPS) launched the UK strategy for financial well-being defining it as “about feeling secure and in control. It is knowing that you can pay the bills today, can deal with the unexpected, and are on track for a healthy financial future. In short: confident and empowered” [].
Both organisations highlight financial behaviour as the primary driver of financial well-being. The CFPB highlights four important behavioural areas: effective routine money management, financial research and knowledge seeking, financial planning and goal setting and following through on financial decisions []. The MaPS strategy highlights five key behavioural areas: getting a meaningful financial education, saving regularly, managing credit, accessing debt advice and making good decisions about future well-being []. Other behavioural areas such as meeting day-to-day spending commitments and financial product choices are also suggested to influence an individual’s financial well-being [,]. For the purposes of this research, ‘behavioural areas’ will refer to categories of discrete behaviours that are linked to a similar broad outcome.
It is important that, when defining the determinants of financial well-being, these behavioural areas are representative and relevant to households across the income spectrum. For example, in the UK, in 2017, GBP 10 billion worth of state benefits went unclaimed by those who were entitled to them []. The claiming of state benefits could have a considerable impact on the financial well-being of lower income households.
Within this research, three behavioural areas will be seen to represent key drivers of financial well-being. These are: individuals maximising their income by claiming the financial support available, individuals paying regular bills on time and individuals saving regularly to protect against income shocks. These areas are consistently highlighted as important factors in the financial well-being literature and are likely to be relevant to households across the income spectrum [,,,]. These will be referred to as ‘behavioural areas of interest’.
In the UK, local authorities are in a unique position to influence the financial well-being, and associated behavioural areas, of their residents. They have daily interactions with residents’ lives whilst also having a direct financial relationship by collecting council tax payments, administering some benefits and, for some, acting as the landlord []. In recognition of this, local authorities often develop policies and strategies to outline the actions they are going to take to support their residents towards better financial outcomes whilst ensuring continued collection of revenue []. These policies often outline funding and service provision commitments as well as describing activities to encourage particular behaviours within residents (also known as “interventions”) (e.g., council tenants paying their rent on time, residents paying council tax via direct debit, or residents applying for local and national financial support schemes). For example, in 2021, Maidstone Borough Council launched their Financial Inclusion Strategy 2021–2026. This outlined some broad aims to improve the living conditions and financial circumstances of their residents as well as aims to change resident behaviour to help drive these improved circumstances (e.g., “increase awareness and take up of mainstream financial services amongst low-income households”) [].
The policies and strategies that local authorities publish represent their, publicly available, documentation of the planned activities to change residents’ financial behaviour. Policies are highlighted as a means of generating and guiding the implementation of behaviour change interventions [,]. Therefore, the content and specification of policies are suggested to be extremely important in the later implementation of interventions and the associated outcomes [,].
It is suggested that any intervention aimed at changing behaviour should be informed by relevant theoretical and empirical evidence [,,]. Theory can be used to inform interventions by highlighting constructs that are hypothesised to have causal relationships with the behaviour and therefore represent relevant targets for intervention []. The utilisation of empirical evidence allows for a more informed assessment of whether an intervention is likely to be effective across different contexts, populations and behaviours [].
A crucial first step in the design of interventions is the specification of a behavioural target []. A clearly specified behaviour can help to highlight the various people at different levels that need to do something differently, identify any barriers and enablers of the behaviour and design interventions to overcome them whilst providing metrics for evaluation [,,]. Although research into the content of local authority policy documents is limited, it has been suggested that the design and specification of some policies do not allow for clear monitoring or evaluation of outcomes [].
Theories, models and frameworks can aid both the specification of target behaviours and design of interventions [,,,]. The use of these tools can help intervention development via two main ways: more effective design and clearer reporting [,,].
The use of systematic theories and frameworks aids more effective design of interventions by enabling policymakers and practitioners to build on an existing evidence base []. A systematic approach also creates a common language for characterizing intervention activities, which helps to prevent false innovation where new labels are used for existing theoretical constructs []. Theories and frameworks help to utilise important intervention options that could have been otherwise missed [,].
Accurate reporting of behaviour change interventions is important for understanding their effectiveness []. The inconsistency of reporting behaviour change interventions has been recognised [], leading to calls for more detailed descriptions of intervention content, delivery and implementation []. In health behaviour, The Consolidated Standards for Reporting Trials (CONSORT) Statement was developed to improve the design and reporting of interventions [].
Policy documents are often the initial, and sometimes only, record of behaviour change interventions and can be used to guide their later implementation []. Therefore, it could be argued that the design and reporting within policy documents should be approached using the same systematic methods. This could increase the effective implementation of interventions, allow for clearer policy evaluation and contribute to the evidence base of what works, when and for whom.
To current knowledge, there has been no prior research analysing the content of local authority policy documents using frameworks informed by behavioural science. This type of analysis is important for two main reasons. Firstly, it would be an important first step in identifying any gaps between the evidence base within behaviour change research and the current practices of local authorities in terms of their designing of behaviour change interventions and reporting within policy documents. It also empowers policymakers through an enhanced understanding of the theoretical and empirical foundations of the policies and behaviour change activities they implement and provides a roadmap to enhancing effectiveness.
Secondly, this type of analysis helps to advance understanding of how behavioural science frameworks can be used to analyse a wide range of policy documents, specifically in the context of financial behaviour. Behaviour change theories and frameworks have started to become more widely used to design interventions and retrospectively analyse policies in health settings [,,]. However, their use has been less common in the context of financial behavior and financial well-being. This research aims to understand the transferability of these theories and frameworks to novel contexts.
The Behaviour Change Wheel (BCW) is a framework that could guide this type of analysis. The BCW is a theory-based framework used to characterise and design behaviour change interventions [,]. At its core, the BCW uses the COM-B model (capability (C), opportunity (O), motivation (M) and behaviour (B)) to first understand the sources of the behaviours that could be useful targets of intervention. The COM-B model suggests that an individual’s physical and psychological capability (e.g., physical skill, strength, psychological skills or knowledge), social and physical opportunity (e.g., interpersonal influences, cultural norms, time or resources) and reflective and automatic motivation (e.g., plans, beliefs about what is good and bad, emotional reactions, desires and impulses) all interact to generate behaviour [,]. Therefore, any interventions should target the sources of behaviour that are most likely to be effective in the given context [,].
Within the BCW process, one of the first, and often overlooked, steps in designing a behaviour change intervention is to select and specify a target behaviour. Specialised frameworks, such as the Action, Actor, Context, Target, Time (AACTT) framework [], have been developed to guide the specification of target behaviours.
Once a target behaviour has been specified, the BCW recommends performing a behavioural diagnosis to understand what factors could inhibit (known as barriers) or facilitate (known as enablers) the performance of the behaviour. The barriers and enablers can be categorised under the three main sources of behaviour within the COM-B model to help select the most suitable interventions options [,].
The BCW categorises potential intervention activities into nine broad intervention types (ITs). These are Education, Persuasion, Incentivisation, Coercion, Training, Restriction, Environmental Restructuring, Modelling and Enablement. It also presents seven policy categories that can support or enable these activities [,]. Intervention content can be specified further through the use of a Behaviour Change Technique Taxonomy (BCTTv1) which contains 93 ‘Behaviour Change Techniques’ (BCTs) []. For example, an education-based intervention may include BCTs like providing feedback on the social and environmental consequences of a behaviour and instructions on how to perform the behaviour.
1.1. Literature Review
Previous research has used the AACTT framework to evaluate the descriptions of behaviours within health policy documents []. It was found that the Actor, Target, Time and Context were often poorly specified in the documents analysed []. The framework has also been used to understand the level of specification of behaviours within pharmacy practice standards []. It was found that the Actor was never specified within these documents and the Action, Context, Target, and Time were often poorly and inconsistently specified. This research from other policy settings suggests that the framework can be adapted and applied to retrospectively analyse the specification of behaviourally relevant content within documents [,].
The BCW process has previously been used to ‘retrofit’ planned health interventions [] and has demonstrated its utility in characterising existing interventions. It was also used to analyse health policy documents [] to understand the types of interventions, their content and the mechanism through which they could have an effect. The research found that descriptions of recommendations were sometimes too vague to confidently identify the type of intervention or its content. When it could be identified, the recommendations were mainly trying to influence behaviour through Psychological Capability, Physical Opportunity and Social Opportunity []. The most commonly identified ITs were Environmental Restructuring, Education and Enablement.
A literature review did not identify any examples where either the AACTT framework or BCW process had been used to analyse local authority policy documents. There was also no prior research identified where any types of policy documents were analysed within the sequential intervention design steps of the BCW process.
1.2. The Current Research
This research will use the AACTT framework [] to assess the extent to which the target behaviours of interventions, to influence residents’ financial behaviour, are specified within local authority policy documents. The BCW [,] will be used to guide the analysis of any reported barriers or enablers of relevant behaviour, the types of interventions being described, the content of those interventions and the mechanisms through which they could be having an effect. The selection of interventions will be assessed on their suitability to influence the recognised barriers and enablers.
Research Questions
- Research Question 1 (RQ1): To what extent are the target behaviours of interventions, reported in the documents, specified in terms of Action, Actor, Context, Target and Time (AACTT framework)?
The clear specification of a target behaviour is a critical first step in designing an intervention. It allows for a better understanding of the factors that are driving or facilitating that behaviour in a given context and what might need to be changed. This aids a more effective selection of the most appropriate intervention for changing that behaviour [,,,]. Local authority policy documents are likely to be read and interpreted by a wide range of people; therefore, the clarity of target behaviours is particularly important to ensure intervention activities are designed and implemented as consistently and effectively as possible. This research will use the AACTT framework [] to assess the extent to which the target behaviours of interventions, to influence residents’ financial behaviour, are specified within local authority policy documents.
- Research Question 2 (RQ2): Which sources of behaviour (capability, opportunity and/or motivation) are cited as barriers or enablers of relevant financial behaviour?
A behavioural diagnosis is an important step when designing an intervention, as it helps to identify factors that may be inhibiting (barriers) or facilitating (enablers) a behaviour. Reporting the perceived behavioural barriers and enablers in a policy document helps to create shared understanding and allows for a more effective selection of interventions in a given context. This research will use the COM-B model to identify the different sources of behaviour that are explicitly mentioned as barriers or enablers of relevant behaviours.
- Research Question 3 (RQ3): Which types of interventions, recognised by the BCW process, feature within the documents?
A clear specification of the target behaviour and explicit behavioural diagnosis can aid more effective selection of interventions [,,]. This research will aim to, where possible, categorise the interventions described in the policy documents in line with the nine ITs included in the BCW. This will provide insight on how well the selection of interventions align with the current theory and evidence within behavioural science.
- Research Question 4 (RQ4): Which behavioural mechanisms could the selected interventions effect according to the BCW matrix?
The BCW includes a matrix which links the nine ITs to the COM-B components. This helps to explain the mechanisms through which each intervention could have an effect. Using this matrix, the current research will look to retrospectively identify the behavioural mechanisms that the interventions, described in the policy documents, could be targeting. This will provide insight on how well the selection of interventions align with theory and evidence within behavioural science and how effective they could be at influencing any explicitly mentioned barriers or enablers of that behaviour.
2. Methods
2.1. Design
This study used a directed content analysis design []. A content analysis was chosen because it is a well-established and widely used method of systematically analysing textual data and is therefore suitable for the examination of policy documents. A directed content analysis reflects a deductive approach which allowed for the use of existing theoretical frameworks to develop pre-determined categories for data coding. The deductive approach ensured that the analysis was structured and guided by established theoretical frameworks. This methodology was important for evaluating the content of policy documents and alignment with behavioural science frameworks. Figure 1 gives an overview of the key stages involved in conducting this research.
Figure 1.
An overview of the key stages of the research.
2.2. Document Search
A systematic search process was developed to efficiently identify local authority policy documents containing information regarding their activities related to the three behavioural areas of interest (i.e., residents claiming financial support, paying bills, and saving). The official websites of all English district, borough and city councils as well as unitary tier local authorities were searched. The steps involved in the search process are outlined in Supplementary Materials, Figure S1.
Key search terms were used within the search bar of each local authority website to identify potentially relevant documents. The search terms were developed through a piloting exercise where a variety of local authority policy documents were examined, and a judgement was made on their relevance to the research questions. The most common terms within the names of relevant documents were used as search terms. These were “Financial Inclusion”, “Poverty”, “Anti-Poverty”, “Income” and “Rent”. Documents that were identified through this search and met the following initial criteria were deemed to warrant a further search for relevant content: (1) the document must be published officially by the local authority; (2) it must be outlining a policy or strategy that the council has committed to (e.g., not a set of recommendations from an external organisation or commissioned research); (3) it must represent a live policy or strategy that is currently in place (i.e., it covered the year of the search, 2022). If no date was present on the document but it was the most recent version on the website, then it was included.
The documents that met this criterion were searched for potentially relevant content using a second set of key terms: “rent”, “council tax”, “income”, “benefits”, “take up”, “income maximisation”, “bills”, “saving” and “save”. These search terms were again developed through a piloting exercise where common terms within relevant sections of the document were collected and assessed. The terms were used as a method of navigating to the relevant sections of the document and did not impact data extraction. If the document contained any information relevant to any of the three behavioural areas of interest, then it was included in the final sample for data extraction. See Table 1 for a more detailed description of the three behavioural areas of interest.
Table 1.
A description of each behavioural area of interest.
2.3. Data Extraction
A data extraction form was developed to capture the following document characteristics: local authority, name of the document, and the years the policies were in place. The form also captured whether the data had been extracted because it met the criteria to be analysed under RQ1, RQ2 or RQ3/RQ4. Table 2 shows the criteria that data fragments had to meet to be extracted for analysis. The data fragments were only extracted if residents were judged to be the target population rather than council employees or any other group. The data fragment had to meet all the criteria, for at least one research question, to be extracted.
Table 2.
The criteria that data fragments had to meet to be extracted for analysis under RQ1, RQ2 or RQ3/RQ4.
2.4. Analysis
2.4.1. Coding Form
A coding form was developed (see Supplementary Materials, Table S1) and fragments of data were transferred from the extraction form to the coding form to perform the analysis. The coding form had a row for each data fragment and a column for each coding criterion. Standardised drop-down options were used to assign codes which helped with frequency calculations. Codebooks were developed to guide the coding of each criterion to data fragments. The development of the codebooks is explained in more detail below.
- RQ1: To what extent are the target behaviours of interventions reported in the documents specified in terms of Action, Actor, Context, Target and Time (AACTT framework)?
The AACTT framework [] was used to assess the specification of target behaviours within the extracted data. The definitions for each domain (e.g., ‘Action’) were adapted from previous research []. Table 3 shows the codebook used to assign codes to the descriptions of target behaviours. If the data fragment did not contain a description of a target behaviour (i.e., because it had met the extraction criteria for RQ2 or RQ3/RQ4 but not RQ1) the fragment was coded as “No” within a column labelled “Has a target behaviour been specified?” and the AACTT criteria were not applied.
Table 3.
The codebook developed to apply the AACTT to any descriptions of target behaviours.
The criteria for the ‘Action’ domain within the AACTT framework required an assessment of whether the Action could be considered discrete and observable. Discrete Actions are said to be “a single self-contained action without consideration to whether there are ancillary actions that may precede or proceed on from that single self-contained action. A non-discrete action may be the result of a series of discrete actions though were considered non-discrete if it is stated without further description of the process. The assessment of whether the action is discrete includes an assessment of whether the reader is provided with the full details of the action or expected to bring pre-existing knowledge to interpret the action in a consistent manner” [].
Whereas, an observable Action is “specified as an externally visible manifestation and/or the direct outcome of the action would be a physical object. Non-observable actions are those where there is no external physical sign that an action is performed” []
To support the consistent application of the codebook, and following the methodology used in previous research, ambiguous verbs were assessed, alongside their dictionary definitions, to indicate whether their use indicated discrete and observable actions []. A record of the assessment made for each Action word can be found in Supplementary Materials, Table S2. For example, “take-up” was used to describe a target behaviour of residents within the documents (e.g., “We will encourage residents to take up the benefits they are entitled to”), but it was considered to be neither a discrete nor observable Action. Therefore, it was coded as “No” (i.e., ‘Action’ criteria not met) whenever it appeared.
- RQ2: Which sources of behaviour (capability, opportunity and/or motivation) are cited as barriers or enablers of relevant financial behaviour?
A codebook was adapted from previous research to identify when barriers or enablers of relevant behaviours could be categorised under any of the COM-B components []. Table 4 shows the definition used, a general example and the coding criteria for each COM-B component. The barriers and enablers had to be explicitly recognised within the document and could not be inferred from the content of an intervention. For example, “People may not have the right knowledge or resources to make a claim for Universal Credit” explicitly recognises a lack of knowledge as a barrier to claiming Universal Credit.
Table 4.
The codebook developed to identify COM-B components from the recognised barriers or enablers within the documents.
If no barriers or enablers had been explicitly described, then it was coded under “No” in the column “Have any barriers/enablers been specified?”. If a barrier or enabler had been recognised but it was not described in enough detail to code to any COM-B component, then it was coded under “Too vague to be coded”.
- RQ3: Which types of interventions, recognised by the BCW process, feature within the documents?
A codebook was developed to code occurrences of the nine ITs outlined in the BCW process. A data fragment could be coded to multiple ITs if it was judged that more than one was present. Table 5 shows the definitions of each IT, alongside a general example and an example relevant to the research context.
Table 5.
The codebook developed to identify ITs.
If a data fragment did not contain any description of an intervention, then it was coded as “No” in the column “Has an intervention been specified?”. If an intervention was present but the description was not explicit enough to code under any of the ITs, it was coded as “Too vague to be coded”.
The descriptions of intervention content was also coded to identify any possible BCTs using the BCTTv1 []. The BCTTv1 contains 93 BCTs; therefore, it was not considered feasible to create relevant examples for each. Within the taxonomy, the BCTs are organised into clusters (e.g., feedback and monitoring, shaping knowledge) which were used to narrow down the search for potentially relevant BCTs. For example, if an intervention was coded to Education, then the feedback and monitoring and shaping knowledge BCT clusters were checked first to see if any were present in the intervention.
If a description of the intervention content was not detailed enough to code for any BCTs then this was coded as “No” in the column “Is the intervention able to be categorised using BCTTv1?”. All data fragments that were coded as “No” in the column “Has an intervention been specified?” were not assessed for BCTs. The full coding instructions for BCTs can be seen in Supplementary Materials, File S1.
- RQ4: Which behavioural mechanisms could the selected interventions effect according to the BCW matrix?
Within the BCW process, there is a matrix used to link sources of behaviour (recognised by the COM-B model) to congruent ITs (see Table 6). This matrix can be used to identify suitable ITs following an analysis of the possible barriers or enablers of the chosen target behaviour. This matrix was used in reverse within this research. The ITs that had been identified were mapped back to all the possible behavioural mechanisms through which they could have an effect [,].
Table 6.
The matrix that links the components of the COM-B model of behaviour to the ITs. Grey box indicates link.
For example, an intervention coded to Education was mapped back to Psychological Capability and Reflective Motivation, as according to the BCW matrix, the intervention could be affecting behaviour through one or both of these mechanisms.
2.4.2. Pilot Coding and Reliability Checks
To aid the accuracy and consistency of the coding, a pilot coding exercise was conducted before finalising the codebooks. The first coder (ZM) coded approximately 16% (n = 39) of the total sample of data fragments. The pilot coding was used to ensure a full understanding of all the criteria within the frameworks. A second coder (KW) then reviewed the same sample of data fragments.
The first and second coder discussed any differences in their coding and attempted to reach a consensus. For data where the coding was still ambiguous, a third coder (DD) was consulted before iterations to the code book were made. For example, for interventions where a new advice service had been provided for residents, there was some ambiguity as to whether this should be coded to the Education, Environmental Restructuring and/or Enablement ITs. Following consultation with the third coder, it was decided that these interventions should be coded to Education and Environmental Restructuring as, from the descriptions, there was no clear link to Enablement. Descriptions of all the data fragments that were referred to the third coder can be seen in Supplementary Materials, Table S3.
The first and second coders (ZM and KW) were selected due to their postgraduate level training on the frameworks used in this research and application using qualitative methods. The third coder (DD) is a senior behavioural scientist with experience of applying the frameworks in this context and training others to do so.
3. Results
3.1. Document Search
A total of 316 local authority websites were searched using the search process outlined. In total, 22 policy documents from 21 different local authorities met all the inclusion criteria and were included in the final sample. The types of documents that were included can be categorised into three broad areas: (1) promoting financial well-being (e.g., financial inclusion strategies, financial well-being strategies), (2) tackling poverty (e.g., anti-poverty strategies, poverty reduction strategies) and (3) council income management (e.g., rent arrears policy, debt management strategies). A list of the documents included in the final sample can be seen in Supplementary Materials, Table S4.
3.2. Data Extraction
The number of data fragments that were extracted per document ranged from 3 to 29. A total of 238 data fragments were extracted from the 22 documents. For example, “Encourage low-income residents who are claiming either Working Tax Credit, Child Tax Credit or Universal Credit to save by promoting the Help to Save savings account” (Blackpool, Financial Inclusion Strategy) was extracted, as it includes a description of a target behaviour (saving) and a description of an intervention (promoting the Help to Save savings account) related to one of the behavioural areas of interest (saving). Whereas, “Emergency support can be provided to help with daily living costs, housing-related costs and household items” (East Riding of Yorkshire, Financial Inclusion Strategy) does not describe a target behaviour, barriers or enablers, or intervention related to one of the behavioural areas of interest, and therefore was not extracted. See Supplementary Materials, Table S5 for further examples of data fragments that were and were not extracted from the documents.
The number of data fragments related to each behavioural area of interest can be seen in Table 7.
Table 7.
The number of data fragments that related to each behavioural area of interest.
3.3. Analysis
Pilot Coding and Reliability Checks
A reliability score was calculated for AACTT (60%), ITs (67%), BCTTv1 (80%) and COM-B (80%) individually. The combined reliability score was 73%.
- RQ1: To what extent are the target behaviours of interventions, reported in the documents, specified in terms of Action, Actor, Context, Target and Time (AACTT framework)?
A total of 131 of the data fragments included descriptions of target behaviours. Table 8 shows the number and percentage of the descriptions of target behaviours that met each coding criteria within the AACTT framework.
Table 8.
The number and percentage of the descriptions of target behaviour that met the Action, Actor, Context, Target and Time (AACTT) coding criteria.
Action. None of the descriptions of target behaviours were judged to meet the Action criteria. This was because the descriptions were often not specific or detailed enough to identify the discrete Action. For example, “The housing officer will meet the prospective tenant and advise them to apply for Universal Credit or Housing Benefit” (Dartford, Rent Arrears Policy). The target behaviour of this intervention is judged to be the tenant applying for Universal Credit or Housing Benefit. However, without more information given on how the tenant should do this, it does not meet the Action criteria.
Actor. Within 99 (76%) of the descriptions of target behaviours, an Actor was specified. The Actor was often described as “the resident” or “the tenant” which was judged to be sufficient given the context of the documents. The descriptions that did not specify the Actor required an assumption or pre-existing knowledge from the reader (e.g., “encourage payment by Direct Debit”). Other descriptions made some reference to non-specific groups (e.g., “individuals”) which would not be useful in determining who was supposed to be performing the behaviour and did not meet the criteria.
Context. The Context in which the behaviour should be performed was described sufficiently to meet the criteria in four examples (3%). All four of these descriptions involved the council specifying the methods through which a resident could pay their rent (e.g., “There are a range of methods through which rent payments can be made including direct debit, online, standing order, over the telephone and all pay cards” Hinckley and Bosworth, Rent Arrears and Recovery Policy).
A further eleven examples (8%) included some attempt at describing the Context, but more information was needed to establish the exact setting or location the residents would be performing the behaviour (e.g., “Work with GP surgeries and walk-in-centre services to support residents in completing application forms and to promote signposting to current service providers” Blackpool, Financial Inclusion Strategy).
Target. The Target was not deemed necessary in the context of this research and the documents being analysed. The behaviours of residents were unlikely to be on behalf of anyone else other than themselves. A possible exception would have been if the resident was expected to behave on behalf of another household member, but examples of this were not identified within the documents.
Time. The Time at which the resident would perform the behaviour was described in sufficient detail in four examples (3%). This was often when the document was describing when residents were expected to pay their rent (e.g., “Tenants who pay their rent weekly, need to pay on the Monday each week and tenants who pay it on a fortnightly or monthly basis need to pay in advance” East Devon, Income Management Strategy).
In a further 16 examples (12%) there was some reference to the Time, but more detail was needed. This was often when the description had indicated that residents should pay their rent “on time” or seek advice “at an early stage”. This gives some broad indication as to when a resident should perform the given behaviour but there could be multiple interpretations.
Table 9 provides illustrative examples of possible amendments that could be made to the descriptions of target behaviours to meet each specification criteria within the framework.
Table 9.
Examples of possible amendments to target behaviour descriptions to aid better specification and ensure they met the AACTT criteria.
- RQ2: Which sources of behaviour (capability, opportunity and/or motivation) are cited as barriers or enablers of relevant financial behaviour?
A total of 8 out of the 22 documents, included in the final sample, included descriptions of barriers or enablers of behaviours within the areas of interest. Therefore, only 26 data fragments explicitly mentioned barriers or enablers. Of these, 22 were described in enough detail to confidently code under any of the COM-B components. When a barrier or enabler had been identified but was not able to be coded under a COM-B component, this was often because there was not enough detail about what the specific barrier or enabler actually was. For example, “Lone parents face issues around the use of banking services, low levels of savings and debt” (East Riding of Yorkshire, Financial Inclusion Strategy) recognises that lone parents face issues (and therefore barriers exist), but does not describe what these are or why they have an effect on their use of services and saving.
Table 10 shows the number of data fragments that could be coded to each COM-B component alongside an example of each. Some data fragments could be categorised under more than one COM-B component. For example, “People may not have the right knowledge or resources to identify the best product for their financial circumstances” (East Riding of Yorkshire, Financial Inclusion Strategy) was coded under Psychological Capability and Physical Opportunity.
Table 10.
The number and percentage of descriptions of barriers/enablers that could be coded to each COM-B component.
- RQ3: Which types of interventions, recognised by the BCW process, feature within the documents?
A total of 185 of the extracted fragments of data contained a description of an intervention.
ITs. Table 11 contains an overview of the number and percentage of data fragments that could be coded to each of the nine ITs, alongside an example from the research. Data fragments would often be coded to more than one IT if they were judged to be present. For example, “The Rental section will work in partnership with agencies to facilitate the provision of independent advice to tenants about money management” (East Devon, Income Management Strategy) was coded to both Education and Environmental Restructuring.
Table 11.
The number and percentage of interventions where each IT was identified.
BCTs. There were 81 data fragments (44% of the data fragments that contained a description of an intervention) where BCTs could be identified. Where BCTs could not be identified (n = 104, 56%) within the data fragments this was due to a lack of granular detail regarding the content of the intervention. All interventions where the IT was not able to be identified were also not coded to any BCTs.
There were 14 different BCTs identified across all the data fragments. Table 12 provides an overview of the number and percentage of data fragments where each BCT was present, alongside an example from the research.
Table 12.
The number and percentage of interventions where each BCT was identified.
- RQ4: Which behavioural mechanisms could the selected interventions effect according to the BCW matrix?
All of the sources of behaviour could have been influenced by the described interventions. Almost two-thirds (61%) of the described interventions could have influenced the Psychological Capability of residents. Additionally, almost half (47%) could have been influencing the Reflective Motivation of residents. Table 13 gives an overview of the number and percentage of interventions that could be influencing behaviour through the different COM-B components.
Table 13.
The number and percentage of interventions that could be influencing each COM-B component.
4. Discussion
This research used the AACTT framework [] and BCW process [,] to perform a retrospective content analysis of local authorities’ documented activities to influence behaviour within three key behavioural areas of financial well-being (claiming financial support, paying bills, and saving). The research aimed to highlight any gaps between the evidence within behavioural science and current practices by local authorities, in terms of their designing of behaviour change interventions and reporting within policy documents.
The findings demonstrate that the target behaviours of interventions could be specified further within the documents to be closer aligned with reporting frameworks within behavioural science. There was no description of a target behaviour where the Action, Actor, Context and Time could all be confidently identified. Additionally, only a small number of the documents made any explicit references to potential behavioural barriers or enablers. The descriptions of interventions to influence behaviour often did not include sufficient detail to confidently identify their type and content. When the type of intervention could be identified, there appeared to be reliance on Education to change residents’ financial behaviour within the areas of interest. Finally, the mechanisms of action, through which the selected interventions could influence behaviour, were not necessarily the most suitable to address the recognised barriers and enablers of relevant behaviours.
- RQ1: To what extent are the target behaviours of interventions, reported in the documents, specified in terms of Action, Actor, Context, Target and Time (AACTT framework)?
The lack of specification of target behaviours in terms of Action, Actor, Context and Time (Target was not considered necessary in this context) is consistent with the limited previous research that has explored the specification of target behaviours in policy documents [] and pharmacy practice standards [].
The findings show that the Actor (i.e., the person who should perform the behaviour) was most often identified and met the criteria within the AACTT framework in 76% of the descriptions. Interestingly, this differs from previous research where the Actor was never specified within pharmacy practice standards []. Within practice standards, it is likely that the intended reader is also the intended Actor of the behaviours being described. Therefore, it may have seemed less relevant to include specification of the Actor. Within the local authority policy documents, there was frequent reference to “residents” and “tenants” which was deemed sufficient to meet the criteria. However, in a practical guidance document, a more specific description of the Actor may be useful.
- RQ2: Which sources of behaviour (capability, opportunity and/or motivation) are cited as barriers or enablers of relevant financial behaviour?
Most reported barriers and enablers of behaviours within the areas of interest were related to Physical Opportunity or Psychological Capability. This appears to suggest that these local authorities recognise that time and other physical resources (Physical Opportunity) plays an important role in residents performing behaviours relating to claiming financial support, paying bills and saving. Additionally, the knowledge and mental capacity of residents (Psychological Capability) are seen to be important.
To current knowledge, there has been no previous research that utilised the COM-B model to identify any barriers or enablers of targeted behaviours within policy documents. This was a novel feature of this research.
- RQ3: Which types of interventions, recognised by the BCW process, feature within the documents?
- ITs
The descriptions of interventions often lacked detail which meant their type and content was not always able to be identified. When the type of intervention could be identified, there was a reliance on Education as a means of changing behaviour. Many of the interventions also had elements of Environmental Restructuring and Enablement. The other six ITs were identified rarely or not at all.
These findings overlap with previous research with some interesting differences. Within the health policy documents analysed in previous research, the descriptions of interventions were also not always sufficiently described to identify if any of the nine ITs were present []. Within the health policy documents, the most commonly identified IT was Environmental Restructuring, followed by Education and Enablement []. All of the nine ITs were identified at least once within the documents analysed.
- BCTs
The lack of granular detail in intervention content meant that BCTs were only able to be identified in under half (44%) of the data fragments that included a description of an intervention. When the content of interventions could be identified, there was a lack of variety. Only 14 (out of a possible 93) different BCTs could be identified, with practical social support and adding objects to the environment being the most prominent.
These findings differ from previous research where a wider variety (35 out of a possible 93) of BCTs were identified within health policy documents []. The nature of the BCTs also differed, the health policy documents reported interventions that put more emphasis on giving information about health consequences and instructions on how to perform the behaviour. This is to be expected as the interventions are targeting very different behaviours. There was some overlap, however, with both sets of policy documents including social support and restructuring of the physical environment [].
The better specification and more diverse selection of interventions and intervention content within health policy documents could be due to more advanced knowledge and utilisation of behavioural science frameworks. There is considerably more literature regarding the explicit use of systematic behavioural science frameworks within health settings [,,] compared to local authority settings. This could be reflected in the content and reporting of behaviour change interventions and policies.
- RQ4: Which behavioural mechanisms could the selected interventions effect according to the BCW matrix?
All of the sources of behaviour could have been influenced by the described interventions, with Psychological Capability and Reflective Motivation being the most commonly identified. These findings differ from previous research where Physical Opportunity and Social Opportunity were the most commonly identified mechanisms of action through which the interventions could be having an effect [].
The mechanisms through which the selected interventions could have an effect do not align perfectly with the barriers or enablers that were recognised as influences on relevant behaviour. Physical Opportunity was recognised as the most likely barrier or enabler; however, only 38% of the interventions could influence Physical Opportunity. Additionally, 47% of the selected interventions could influence residents’ Reflective Motivation; however, this was never explicitly highlighted as a likely barrier or enabler in any of the documents. On the other hand, Psychological Capability was the second most recognised barrier or enabler and could be influenced by 61% of the interventions selected.
To current knowledge, the assessment of the suitability of selected interventions to influence the recognised barriers or enablers of behaviour with policy documents was also a novel feature of this research.
4.1. Implications
This research has some practical implications for the design, reporting and implementation of local authorities’ policy documents in the context of financial behaviour. Firstly, the research highlights that the target behaviours, barriers and enablers, and interventions are not always reported in sufficient detail to confidently categorise them using recognised behavioural science frameworks. Regardless of the intended audience or purpose, any documentation of behaviour change interventions benefits from clear reporting [,,]. As discussed, a clearly specified target behaviour helps to highlight the various people at each level that need to do something differently, is a crucial first step in identifying the barriers and enablers and provides an indicator of what to measure to evaluate an interventions effectiveness [,,]. Clear reporting of intervention content within policy documents could also help local authority practitioners implement consistent interventions, allow for clearer policy evaluation and contribute to the evidence base of what works, when and for whom [,,,].
The use of systematic frameworks could help to create common terminology and reporting standards for local authorities’ policy documents and the interventions to change residents’ financial behaviour []. This could help to improve the dissemination and interpretation of interventions and their outcomes within and across different local authorities further adding to the evidence base of works, when and for whom.
Secondly, this research has highlighted that the selection of interventions reported within policy documents does not represent the full range of intervention options recognised as being effective in changing behaviour. The use of systematic frameworks to design behaviour change interventions can help policymakers and practitioners utilise important intervention options that could have been otherwise missed and select the most appropriate intervention options to influence the key barriers and enablers of behaviour [,]. Additionally, the behavioural mechanisms through which the selected interventions could have an effect are not necessarily the most suitable to influence the reported barriers or enablers. A systematic framework could help local authorities create a clear and evidence-based, audit trail within policy documents from the identification of barriers and enablers to the selection of potentially effective intervention options [,].
In addition to the practical implications, this research also has theoretical implications for the field of behavioural science. Firstly, this research has highlighted that the BCW is a useful tool for systematically analysing descriptions of behaviour change interventions outside of the health context. It can help to create a common understanding and shared language to categorise interventions reported within policy documents. This research has also identified where the BCW approach is not always sufficient to accurately characterise the intervention activities reported in local authority policy documents. It could be beneficial to further differentiate some of the broader ITs (e.g., Environmental Restructuring) or BCTs (e.g., practical social support) to allow for more precise specification of activities. For example, interventions that included the provision or adaptation of a service to help residents would be categorised under Environmental Restructuring. However, this does not paint a detailed picture as to the different activities that could be occurring on the ground as a result of these changes in the environment. Further specification would allow for more accurate reporting of intervention activities and strengthen understanding of what works.
Secondly, this type of research could be used to contribute to the science of behaviour change and inform future refinements of behavioural science theories, models and frameworks. For example, a similar content analysis of policy documents could be conducted alongside an evaluation of the intervention strategies. This would help to understand if the interventions have the predicted effects on behaviour and the extent to which these effects occur via the hypothesized mechanisms of change. These findings could be used to inform updates to the BCW matrices, for example, which represent the hypothesised links between intervention types and mechanisms of change.
4.2. Strengths and Limitations
To the researchers’ knowledge, this is the first study that has applied any behavioural science frameworks to analyse the content of local authority policy documents aimed at changing resident financial behaviour. This could have caused issues regarding the interpretation of novel data and meant the coding criteria were open to a high degree of subjectivity. However, the researchers ensured rigour in the process by firstly adapting an initial version of the codebook from similar research where the frameworks had been used to analyse documents in different policy settings. The codebook was adapted for this research to include clear definitions, generic and context-specific examples, and instructions to aid the consistency of coding. A pilot coding and reliability coding exercise was also undertaken which helped to sense check the researchers’ interpretation of the data and coding criteria. There was space within the methodology to iterate the codebook following this process.
A limitation of this research is that the documents used did not perfectly align with the behavioural areas of interest. The documents were not created to specifically or exclusively promote behaviours related to residents claiming financial support, paying their bills and savings. This is reflected by the large amount of data related to paying bills, rather than claiming financial support or saving. Local authorities act as landlords for council tenants and collect council tax from residents and are, therefore, more likely to have policies and strategies within this area. These behavioural areas of interest were chosen as points of investigation due to their important role in determining financial well-being. However, it is possible that not all of the activities that councils were undertaking to influence behaviour within these areas would be reported in the documents analysed.
A second limitation was the methodology used to identify the mechanism of actions within the described interventions. The BCW matrix identifies all of the possible mechanisms through which the interventions could be having an effect [,]. The linking of COM-B components to the ITs was proposed by experts in the field of behaviour change [,], but it does not necessarily reflect the actual mechanisms through which interventions are having their effect (or lack thereof) in a given context.
4.3. Future Research
Future research could look to replicate this type of content analysis on policy documents that focus on other key behavioural areas of financial well-being, as highlighted by CFPD and MaPS. For example, the MaPS suggested ‘accessing debt advice’ as an important behaviour []. Many local authorities develop debt management policies to outline how they are going to collect a debt owed to them (e.g., rent or council tax arrears). These often include descriptions of interventions designed to encourage specific behaviours such as accessing debt advice and making re-payments. The documents could benefit from an analysis to see how well the interventions are reported and where the gaps are between the evidence within behavioural science and current practices.
It would also be useful to conduct research with policymakers in local government to explore the current barriers and enablers of using behavioural science frameworks in the development of policies and strategies. This could be used to inform any necessary adaptions to the frameworks to improve their usability for policymakers in different settings.
5. Conclusions
This research has shown that descriptions of target behaviours could be specified further within local authority policy documents to align with reporting frameworks within behavioural science. Local authorities rarely describe potential barriers or enablers of these financial behaviours within their policy documents. This makes it harder to build a common understanding of the key factors that need addressing to change behaviour and could result in the design and implementation of interventions targeting inappropriate and ineffective sources of behaviour. The descriptions of interventions often lack detail which can make it difficult to identify the type of intervention being utilised and the activities involved. This could limit local authority practitioners’ ability to implement consistent interventions, inhibits policy evaluation and makes it harder to build an evidence base of what works, when and for whom. When intervention content can be identified, councils appear to often use Education as a means to change residents’ behaviour regarding claiming financial support, paying their bills or saving. The interventions selected by councils were not necessarily the most suitable to influence the barriers or enablers reported within the documents.
The research has highlighted the current gaps between the evidence within behavioural science and the current practices of local authorities in their design of behaviour change interventions and reporting within policy documents. The use of systematic frameworks to guide the design and reporting of behaviour change policies and interventions could help improve their effectiveness and allow local authorities to build the evidence base of what works, when and for whom. This could help local authorities achieve policy objectives and, ultimately, improve the financial circumstances of their residents.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/bs13120991/s1, Figure S1: Search strategy; File S1: Instructions for coding Behaviour Change Techniques (BCT); Table S1: A sample of the coding form used and explanations for each criteria; Table S2: Assessment of the common Action words within the documents; Table S3: A list of the themes of coding discrepancies, and individual examples, that were referred to the third coder; Table S4: A list of all the documents included in the final sample; Table S5: Data fragments that did and did not meet the extraction criteria.
Author Contributions
Conceptualization, Z.M.; methodology, Z.M. and K.W.; formal analysis, Z.M. and K.W.; writing—original draft, Z.M.; writing—review and editing, Z.M. and D.D.; supervision, D.D. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data presented in this study are listed within Supplementary Materials Table S4.
Conflicts of Interest
The authors declare no conflict of interests.
References
- Cribb, J.; Waters, T.; Wernham, T.; Xu, X.; Payne, J. Living Standards, Poverty and Inequality in the UK 2022; Institute for Fiscal Studies: London, UK, 2022. [Google Scholar]
- Tatch, J.; Hopley, L.; Banerjee, K. Household Finance Review—Q1 2022; UK Finance: London, UK, 2022. [Google Scholar]
- CFPD. Financial Well-Being: The Goal of Financial Education; Consumer Financial Protection Bureau: Washington, DC, USA, 2015.
- MaPS. The UK Strategy fo Financial Wellbeing 2020–2030; Money and Pensions Service: London, UK, 2020.
- Oquaye, M.; Owusu, G.M.Y.; Bokpin, G.A. The antecedents and consequence of financial well-being: A survey of parliamentarians in Ghana. Rev. Behav. Financ. 2022, 14, 68–90. [Google Scholar] [CrossRef]
- Sehrawat, K.; Vij, M.; Talan, G. Understanding the Path toward Financial Well-Being: Evidence from India. Front. Psychol. 2021, 12, 638408. [Google Scholar] [CrossRef] [PubMed]
- DWP. Income-Related Benefits: Estimates of Take-Upfinancial Year 2016/17; Department for Work & Pensions: London, UK, 2018.
- Gibbons, D.; Walker, C. Reshaping Financial Support: How Councils Can Help to Support Low-Income Households in Financial Difficulty; Local Government Association: London, UK, 2019.
- Maidstone Borough Council. Maidstone Borough Council Financial Inclusion Strategy 2021–2026; Maidstone Borough Council: Maidstone, UK, 2021.
- de Leeuw, E.; Clavier, C.; Breton, E. Health policy—Why research it and how: Health political science. Health Res. Policy Syst. 2014, 12, 55. [Google Scholar] [CrossRef] [PubMed]
- Seppälä, T.; Hankonen, N.; Korkiakangas, E.; Ruusuvuori, J.; Laitinen, J. National policies for the promotion of physical activity and healthy nutrition in the workplace context: A behaviour change wheel guided content analysis of policy papers in Finland. BMC Public Health 2018, 18, 87. [Google Scholar] [CrossRef] [PubMed]
- Brownson, R.C.; Colditz, G.A.; Proctor, E.K. (Eds.) Dissemination and Implementation Research in Health: Translating Science to Practice, 2nd ed.; Oxford University Press: Oxford, UK; New York, NY, USA, 2018. [Google Scholar]
- Durlak, J.A.; DuPre, E.P. Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am. J. Community Psychol. 2008, 41, 327–350. [Google Scholar] [CrossRef]
- Michie, S.; van Stralen, M.M.; West, R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement. Sci. 2011, 6, 42. [Google Scholar] [CrossRef] [PubMed]
- Michie, S.; Atkins, L.; West, R. The Behaviour Change Wheel: A Guide to Designing Interventions, 1st ed.; Sliverback Publishing: Surrey, UK, 2014. [Google Scholar]
- Michie, S.; Prestwich, A. Are interventions theory-based? Development of a theory coding scheme. Health Psychol. Off. J. Div. Health Psychol. Am. Psychol. Assoc. 2010, 29, 1–8. [Google Scholar] [CrossRef] [PubMed]
- Hardeman, W.; Sutton, S.; Griffin, S.; Johnston, M.; White, A.; Wareham, N.J.; Kinmonth, A.L. A causal modelling approach to the development of theory-based behaviour change programmes for trial evaluation. Health Educ. Res. 2005, 20, 676–687. [Google Scholar] [CrossRef]
- Michie, S.; Johnston, M. Changing clinical behaviour by making guidelines specific. BMJ 2004, 328, 343–345. [Google Scholar] [CrossRef]
- Michie, S.; Lester, K. Words matter: Increasing the implementation of clinical guidelines. Qual. Saf. Health Care 2005, 14, 367–370. [Google Scholar] [CrossRef]
- Presseau, J.; McCleary, N.; Lorencatto, F.; Patey, A.M.; Grimshaw, J.M.; Francis, J.J. Action, actor, context, target, time (AACTT): A framework for specifying behaviour. Implement. Sci. 2019, 14, 102. [Google Scholar] [CrossRef]
- Smith, D.; Sekhon, M.; Francis, J.J.; Aitken, L.M. How actionable are staff behaviours specified in policy documents? A document analysis of protocols for managing deteriorating patients. J. Clin. Nurs. 2019, 28, 4139–4149. [Google Scholar] [CrossRef]
- Alcock, P.; Craig, G. Monitoring and evaluation of local authority anti-poverty strategies in the UK. Int. J. Public Sect. Manag. 1998, 11, 553–565. [Google Scholar] [CrossRef]
- Peters, L.W.; Kok, G.; Dam, G.T.T.; Buijs, G.J.; Paulussen, T.G. Effective elements of school health promotion across behavioral domains: A systematic review of reviews. BMC Public Health 2009, 9, 182. [Google Scholar] [CrossRef] [PubMed]
- Webb, T.L.; Joseph, J.; Yardley, L.; Michie, S. Using the Internet to Promote Health Behavior Change: A Systematic Review and Meta-analysis of the Impact of Theoretical Basis, Use of Behavior Change Techniques, and Mode of Delivery on Efficacy. J. Med. Internet Res. 2010, 12, e1376. [Google Scholar] [CrossRef] [PubMed]
- Bartholomew, L.; Parcel, G.; Kok, G.; Gottlieb, N. Planning Health Promotion Programs: Intervention Mapping; Jossey-Bass: San Francisco, CA, USA, 2011. [Google Scholar]
- Johnston, M. A science for all reasons: A comment on Ogden (2016). Health Psychol. Rev. 2016, 10, 256–259. [Google Scholar] [CrossRef] [PubMed]
- Arnott, B.; Rehackova, L.; Errington, L.; Sniehotta, F.F.; Roberts, J.; Araujo-Soares, V. Efficacy of behavioural interventions for transport behaviour change: Systematic review, meta-analysis and intervention coding. Int. J. Behav. Nutr. Phys. Act. 2014, 11, 133. [Google Scholar] [CrossRef] [PubMed]
- Abraham, C.; Michie, S. A taxonomy of behavior change techniques used in interventions. Health Psychol. Off. J. Div. Health Psychol. Am. Psychol. Assoc. 2008, 27, 379–387. [Google Scholar] [CrossRef]
- Abraham, C.; Johnson, B.T.; de Bruin, M.; Luszczynska, A. Enhancing Reporting of Behavior Change Intervention Evaluations. J. Acquir. Immune Defic. Syndr. 2014, 66, S293–S299. [Google Scholar] [CrossRef]
- Davidson, K.W.; Goldstein, M.; Kaplan, R.M.; Kaufmann, P.G.; Knatterud, G.L.; Orleans, C.T.; Spring, B.; Trudeau, K.J.; Whitlock, E.P. Evidence-based behavioral medicine: What is it and how do we achieve it? Ann. Behav. Med. Publ. Soc. Behav. Med. 2003, 26, 161–171. [Google Scholar] [CrossRef]
- Mill, D.; Page, A.; Johnson, J.; Lee, K.; Salter, S.M.; Seubert, L.; Clifford, R.; D’Lima, D. Do pharmacy practice standards effectively describe behaviour? Reviewing practice standards using a behavioural specificity framework. BMC Health Serv. Res. 2022, 22, 71. [Google Scholar] [CrossRef]
- Michie, S.; Richardson, M.; Johnston, M.; Abraham, C.; Francis, J.; Hardeman, W.; Eccles, M.P.; Cane, J.; Wood, C.E. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Ann. Behav. Med. Publ. Soc. Behav. Med. 2013, 46, 81–95. [Google Scholar] [CrossRef]
- Steinmo, S.; Fuller, C.; Stone, S.P.; Michie, S. Characterising an implementation intervention in terms of behaviour change techniques and theory: The ‘Sepsis Six’ clinical care bundle. Implement. Sci. 2015, 10, 111. [Google Scholar] [CrossRef] [PubMed]
- Hsieh, H.-F.; Shannon, S.E. Three Approaches to Qualitative Content Analysis. Qual. Health Res. 2005, 15, 1277–1288. [Google Scholar] [CrossRef] [PubMed]
- Davis, R.; Campbell, R.; Hildon, Z.; Hobbs, L.; Michie, S. Theories of behaviour and behaviour change across the social and behavioural sciences: A scoping review. Health Psychol. Rev. 2015, 9, 323–344. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).