1. Introduction
Recreational scuba diving developed from the mid-1940s, when equipment became more reliable and accessible to the general public [
1]. Since the 1940s, the dive industry has grown substantially to become a multi-billion dollar industry. As a result of the dive community being active and mobile, dive tourism has become significant to many local economies and now forms an important part of the global tourism industry [
1,
2,
3,
4,
5].
Increased interest in, and demand for, wreck diving has corresponded with the growth and maturation of the dive industry and improvements in technology. Wreck diving is a specialized type of scuba diving that typically involves the exploration of shipwrecks and submerged aircraft (aircraft wrecks). It can also include the exploration of submerged vehicles, such as train carriages, cars and trucks, and machinery [
6,
7]. Wreck diving offers more diverse and challenging diving experiences, which divers seek as their level of skill and experience rise [
3,
8].
Shipwrecks have, therefore, become important recreational and tourism resources. They are also important components of underwater cultural heritage, and use of shipwreck sites by divers can diminish their cultural heritage, tourism, and recreation values [
9]. The increase in volume of divers visiting shipwrecks has seen an increase in adverse impacts on these sites, particularly those with high levels of visitation. The impacts associated with recreational scuba diving include boat anchor and mooring damage, impairment of site integrity and stability (including removal of artefacts), the effects of unintentional and intentional diver contacts with wrecks, and the effects of divers exhaled air bubbles coming into contact with wrecks. These impacts are described in detail in Edney [
3,
9].
Shipwrecks are fragile, non-renewable, and finite resources [
10,
11,
12]. Effective management of shipwreck sites is, therefore, essential if their cultural heritage, recreation, and tourism values are to be protected [
4,
9]. Adverse impacts on the marine environment associated with recreational use are known to be greater when managers do not understand recreational user groups’ preferences and attitudes towards various management strategies that may be used to manage these impacts [
13]. Understanding the divers visiting shipwrecks is therefore crucial to the effective management of these sites. More effective management of sites can be achieved when managers understand the characteristics and motivations of the groups using sites and their attitudes to management rules because it enables a better balance between management objectives and access to sites to be achieved [
4,
13,
14].
There is now a substantial and growing body of literature about general scuba divers, however, literature specific to wreck divers is sparse. Wreck divers are a special interest group of divers, and as such, differ from general scuba divers. Until recently, the literature only contained one example of research specific to wreck divers, Holecek and Lothrop’s [
15,
16] study, which examined the demographics, behavior, expenditure patterns and attitudes towards government regulation of underwater resources of wreck divers in the Great Lakes region of the United States. This study found a predominance of young people (63% aged 21–30) and males (86%), with high levels of income. Observing wrecks was overwhelmingly the most important activity to these divers (85%), followed by “treasure/trophy” (30%), photography (27%), and research (19%). There was a high level of support (around 85%) for the need for some level of management controls to prevent items being removed from the wrecks. However, this study is dated, based on a small sample size and is focused on cold, freshwater wreck diving, and of limited relevance today.
Other more recent studies of wreck divers are Edney’s [
17] study of wreck divers at Chuuk in the Federated States of Micronesia (survey administered in 2009), and Edney’s study of Australian wreck divers (survey administered in 2010), reported in Edney [
18,
19] and Edney and Spennemann [
20,
21]. Both studies focused on wreck diver demographics and dive experience, motivations for wreck diving, and wreck diver attitudes to a range of management controls commonly used to manage diver impacts to shipwrecks. These studies found that wreck divers were predominantly male, middle-aged, with high levels of education and income, and highly experienced divers. Their primary motivations for wreck diving were to see marine life, historically significant shipwrecks and artefacts, and to enjoy the peace and tranquility of the underwater environment. Most wreck divers supported some management controls, including invasive controls. These included the use of penalties for removing items from wrecks, the need for permits and special certifications to dive certain shipwrecks, and the use of dive guides to control diver behavior. Motivations and attitudes were found to be moderated by demographic variables and level of dive experience, indicating diversity within the wreck diving community.
These recent studies have provided some baseline data that can assist managers when developing management strategies for sites visited by divers. However, it is only a starting point. More research is required to gain a more comprehensive understanding of wreck diver motivations and attitudes. It needs to encompass a wider range of wreck divers and diversity within the wreck diving community. Understanding diversity within recreational user groups is advantageous for managers because management decisions based on the average participant are likely to overlook the needs of many in the group [
22].
Understanding diver motivations informs heritage managers of the types of experiences sought and preferred by divers and provides insights into the effects management decisions may have on diver experiences, enabling these factors to be accommodated in management strategies. A clear understanding of diver attitudes to management controls is also advantageous for heritage managers because it enables them to understand the likely acceptance or opposition to management rules at sites. These insights allow managers to gauge likely levels of voluntary compliance with these rules by divers. Shipwrecks are challenging to monitor due to their location, and costs of enforcement and surveillance are high [
9,
23,
24,
25]. Therefore, maximizing voluntary compliance is beneficial and likely to achieve more effective site management. It is also desirable from a recreation management perspective, because allowing divers more freedom at sites can deliver higher quality diving experiences [
9,
26,
27,
28]. This information is also relevant to dive and dive and tourism operators and planners because it enables them to offer experiences more closely aligned with wreck diver aspirations and can inform the marketing and promotion of dive opportunities.
The aim of this study was to gain a comprehensive understanding of wreck diver characteristics, motivations, and attitudes to assist heritage managers balance underwater cultural heritage protection and diver access to high-quality diving experiences. The two study objectives were: (1) identify wreck diver characteristics and (2) to examine and critique wreck diver motivations and attitudes. The empirical focus of the research was the Asia-Pacific region.
2. Materials and Methods
2.1. Sampling and Recruitment
Recreational wreck divers were surveyed between 9 October 2013 and 3 December 2015 using a self-completed web-based questionnaire administered via SurveyMonkey® and Qualtrics. The target population for the survey were significant source populations of wreck divers known to visit wreck diving destinations in the Asia-Pacific region, i.e., Australia, China, Japan, South Korea, Russia, and the United States. As such, the survey was available in five languages, i.e., Chinese, English, Japanese, Korean, and Russian. Divers from other nations, however, were not prevented from participating.
Non-probability sampling techniques were used to recruit participants. Links to the survey were sent to dive operators, dive clubs, and individuals, who were encouraged to participate and requested to forward the link to other wreck divers (snowballing). Dive operators and clubs were identified through internet searches and word of mouth referrals. Information about the survey and links to the survey were posted on a number of international and Australian online dive forums and diver-related Facebook pages. The survey was also promoted by word of mouth to divers and other dive researchers, who were encouraged to participate and forward the link to other wreck divers.
2.2. Survey Structure and Content
The survey covered three main areas: diver profiles, which included demographics (six questions) and dive experience (three questions); wreck diving profile, wreck diving frequency (one question) and motivations (one question with 14 parts); and, attitudes to underwater cultural heritage protection, i.e., shipwrecks (one question with nine parts). Closed questions with multiple choice checklists were used for the diver profile and wreck diving frequency questions. Five-point Likert-types scales were used to rate relative importance or level of agreement with the statements in the remaining sections of the survey. These questions also included a “do not know” option to prevent false or unreliable responses from participants who did not hold an opinion or whose views did not accord with the options presented (these responses were excluded from analyses). The survey was open to all divers, and wreck divers were screened from non-wreck divers by a question at the start of the survey.
The questions used in the diver profile were adapted from other scuba diver surveys, including Davis [
29,
30,
31,
32,
33,
34,
35]. The questions about management of underwater cultural heritage were derived from the range of management strategies used by heritage managers and dive operators throughout the world, some statements adapted were derived and adapted from Holecek and Lothrop [
15,
16] and Todd et al. [
36], and based on the experience of the researcher [
17,
18].
2.3. Ethics
This research was conducted in accordance with the Charles Sturt University Human Research Ethics approval (2012/202), where the study commenced. Then, it was conducted under Southern Cross University Human Research Ethics approval (ECN-15-005 and ECN-16-008), where the study was completed. Participants were required to be 18 years of age or older, and their participation was voluntary. Informed consent was obtained from all participants. Ethics approvals permitted the collection of IP addresses. This was to enable any incidences of multiple survey responses from a single IP address to be detected. This would suggest a single individual had made multiple responses to the survey, and such practices can distort survey results. The collection of IP addresses did not allow identification of individuals, ensuring that participants remained anonymous.
2.4. Data Analysis
The survey data were exported from SurveyMonkey® and Qualtrics to the Statistical Package for the Social Sciences (SPSS Statistics 24), and this software was used to analyze the data. Descriptive and non-parametric inferential statistical analyses (Chi square and Kruskal–Wallis test) were undertaken to investigate differences between groups. The significance threshold for Chi square analyses and Kruskal–Wallis tests were set at 0.05. Actual p values that were <0.05 were reported, unless they were below 0.001, and in these cases, they were reported as p < 0.001. In addition, not reported were cases where the p value was significant but the pairwise comparison follow-up analyses showed no significant differences (Kruskal–Wallis test). Due to small sample size, three countries of residence were excluded from inferential statistics: China (n = 4), South Korea (n = 4), and Russia (n = 10).
4. Discussion
The majority of wreck divers in this study were male, aged between 35 and 64 years and held an undergraduate or graduate degree. The largest segment of participants lived in the United States, followed by Australia. The gender ratio was similar to other recent studies of wreck divers and the age profile was consistent with Australian wreck divers, while levels of tertiary education were more consistent with the Chuuk survey [
17,
18,
19].
Wreck divers in the current study were experienced divers with high levels of certification. Almost half had completed more than 500 dives and had been diving 10 or fewer years. More than two-thirds held certifications above the Advanced Open Water diver level, one-third held leadership certifications, and one quarter were technical divers. There were similarities in the number of dives completed and years diving experience between all recent studies of wreck divers. Certification levels were broadly similar, although the wreck divers at Chuuk had a higher proportion of leadership certifications. The Chuuk and Australian wreck diver studies did not record technical diving certifications [
17,
18,
19].
Seeing historically significant shipwrecks, marine life and artefacts, and enjoying the peace and tranquility of the underwater environment were the highest motivations for wreck diving. These findings were similar to those of the other recent wreck diver studies. The history/heritage and environmental clusters featured in the top three motivations of all studies. Seeing historically significant shipwrecks was the top motivation in this current study and the Chuuk study. The top five motivations in the current study were the same as those in the Australian wreck diver study and the top three were consistent with the Chuuk study, although the rankings differed. Importantly, common to all three studies were the rankings of the least important motivations, both in the treasure hunting cluster. Collecting artefacts was ranked lowest and searching for artefacts second lowest. This consistency is encouraging for heritage and tourism managers, as it indicates that treasure hunting activities are not the focus for the majority of wreck divers and are only important to a minority of wreck divers [
17,
18,
19].
The current study found that motivations were moderated by frequency of wreck diving and dive profile variables. The most influential were frequency of wreck diving, level of certification, and gender. Country of residence and level of dive experience (i.e., number of dives completed and years diving) influenced motivations to a lesser degree. These findings were generally consistent with the Australian and Chuuk studies [
17,
18,
19], which found gender, age, country of residence, and level of dive experience moderated motivations, and attitudes. These studies also found that seeing marine life was more important to female wreck divers. Searching for artefacts along with the more challenging, technical, and mechanical aspects of wrecks, including wreck penetration, exploring machinery and fittings, and the size and complexity of a wreck, were of more importance to male divers.
Wreck divers indicated in principle support for the protection of shipwrecks. The majority of wreck divers, however, only supported two management controls: the use of penalties (high restriction) and permits (moderate restriction). Notably, preventing access to sites was not supported, suggesting that while there is in principle support for the protection of sites, divers want access. These findings are consistent with the Australian and Chuuk studies [
17,
18,
19,
20,
21]. Other notable findings were that two controls commonly used to manage diver underwater behavior, i.e., the use of guides and pre-dive briefings, received low levels of support. Both of these strategies are used at a number of dive locations throughout the world. Dive guides have been found effective in reducing diver impacts on reefs [
38,
39,
40] and pre-dive briefings have been found effective in reducing diver impacts on the marine environment [
38,
39,
40,
41,
42,
43]. These findings do not necessarily indicate opposition to dive guides and pre-dive briefings per-se, rather it indicates skepticism about their effectiveness in managing diver behavior. It also demonstrates that wreck divers’ perceptions about the effectiveness of dive guides and pre-dive briefings differ from research findings in the literature about their effectiveness in reducing diver impacts.
Attitudes were moderated by wreck diver profile variables and frequency of wreck diving. The variables that had the most influence were country of residence, frequency of wreck diving and gender. Level of dive experience and certification also influenced attitudes, although to a lesser extent. These findings were similar to those of recent wreck diver studies, which found that wreck diver attitudes were moderated by country of residence, gender, and age. Australian wreck divers had higher levels of support for the use of special certifications and permits than their North American counterparts, and female divers were more supportive of the use of dive guides to control diver behavior than were male divers. Older and more experienced wreck divers were less supportive of management controls generally, than younger and less experienced divers [
17,
18,
19,
20,
21]. A more detailed analysis of the similarities and differences between the recent studies of wreck divers is described in Edney [
37].
The consistency of results between this current study and those of recent wreck diver studies indicate that the findings of the current study are a good reflection of wreck diver profiles, motivations, and attitudes more broadly.
4.1. Wreck Diver Motivations Model
The motivations discussed above and presented in
Appendix D represent aggregated data, useful for gaining a broad understanding of the preferences of the majority of wreck divers, or the “average” wreck diver. Aggregated data, however, does not take into account the complexities in wreck diver motivations, resulting from diversity within the wreck diving community.
Understanding this diversity is beneficial. It enables heritage managers and dive and tourism operators to readily determine the types of experiences sought by and more popular with key segments of the wreck diving community. It allows site managers to better assess the effects of different management strategies on different segments of this community and provides opportunities for these factors to be taken into consideration when developing management strategies. Dive and tourism operators can use these data to identify preferences of different segments of the wreck diving community, to inform the choice of dive experiences offered to clients, and in their marketing.
The wreck diver motivations model seeks to illustrate the diversity in motivations within the wreck diving community (
Figure 6). It shows the influence wreck diver profile and frequency of wreck diving variables have on wreck diver motivations. The model was derived from the statistically significant differences found in the analyses of wreck diver motivations. Frequency of wreck diving, dive certification level, and gender had the strongest influence on motivations.
Figure 6 shows these variables with a thicker line connecting them with motivations to indicate their higher level of influence. Dive experience level (i.e., number of dives completed and years diving) and country of residence also influenced motivations, although to a lesser extent. A thinner line, therefore, connects these variables to motivations.
The wreck diver motivations model highlights the intricacy of wreck diver motivations, as well as some patterns. It illustrates the similarities in motivations between more frequent wreck divers, technical divers, and males. Both structure and technology cluster motivations were of greater importance to these groups of wreck divers, as was wreck penetration (technique/challenge cluster). They also placed higher level of importance on searching for artefacts (treasure hunting).
More frequent wreck divers and technical divers placed greater importance on all three of the history/heritage cluster motivations (seeing historically significant shipwrecks and artefacts, and researching or learning about shipwrecks). Two of these motivations (seeing historically significant shipwrecks and artefacts) were more important for male wreck divers.
There were also similarities between less frequent wreck divers, less experienced divers, and females. Three of the four environmental cluster motivations were more important for this group of wreck divers. These included seeing marine life, clear water, and enjoying the peace and tranquility of the underwater environment.
However, not all motivations fitted neatly into groups. Wreck penetration was also important to more experienced divers, those holding leadership certifications and wreck divers from Australia. Collecting artefacts (treasure hunting) was more important to frequent wreck divers. Researching and learning more about wreck, and observing the effects of time (decay) on wrecks were important to more frequent wreck divers and those with leadership certifications. Clear water was also important to participants holding leadership certifications.
Two distinct groups within the wreck diving community emerged from the Wreck Diver Motivation Model, shown in
Figure 7. Less frequent and less experienced wreck divers and females formed one group. The environmental thematic cluster motivations were of greater importance to this group. The second group comprised more frequent and more experienced wreck divers, technical divers, and males. The history/heritage, structure and technology, and treasure hunting thematic cluster motivations, along with wreck penetration from the technique challenge cluster were more important to this latter group.
4.2. Wreck Diver Attitudes Model
Similar to motivations, the attitudes wreck divers have to management controls put in place to protect shipwrecks discussed above and shown in
Appendix E are aggregated data. This is useful for gaining a broad understanding of the preferences of the majority of wreck divers or the “average” wreck diver. Aggregated data, however, do not take into account the nuances of wreck diver attitudes resulting from heterogeneity in the wreck diving community. This research found frequency of wreck diving and a number of dive profile variables influenced wreck diver attitudes.
Importantly, these variables are shown to influence attitudes both positively and negatively. Two models are presented in
Figure 8 and Figure 10, which illustrate the influence of wreck diver profile variables on attitudes. The Wreck Diver Opposition to Management Controls Model (
Figure 8) illustrates the relationship between diver profile variables and specific management controls, where there was stronger opposition to management controls. The Wreck Diver Support for Management Controls Model (Figure 10) illustrates the relationship between diver profile variables and specific management controls, where there was stronger support for management controls. The thickness of the lines in the figures signifies the relative level or strength of influence of each variable. These models were derived from the statistically significant differences found in the analyses of wreck diver motivations.
These models are important because they can assist heritage managers in developing more robust management strategies. Although the aggregated data can indicate overall support for or opposition to specific management controls, it does not recognize the diversity in attitudes within the wreck diving community. If managers only cater to the “average” wreck diver, the likely outcome is potential disenfranchisement of certain segments of the wreck diving. Disenfranchised divers are less likely to voluntarily comply with management rules [
22,
44], resulting in less effective management of the sites in question. It follows that divers disenfranchised by management rules will be less likely to have political support for the protection of underwater cultural heritage, and low levels of political support ultimately mean less resources are allocated for management of these sites [
45].
4.2.1. Stronger Opposition to Management Controls
The variables that had the most influence over wreck diver opposition to management controls were, in order of influence, country of residence, frequency of wreck diving, and gender (
Figure 8). Level of dive experience and certification had a lesser influence, indicated by the thinner lines.
The Wreck Diver Opposition to Management Controls Model shows that more frequent wreck divers and males were more opposed to both high restriction controls: penalties and no visitation to wrecks by divers. Technical divers and wreck divers living in the United States also expressed stronger opposition to penalties. More experienced and more frequent wreck divers, males, and residents of the United States were more opposed to the use of permits (moderate restriction), while more experienced divers and residents of Australia and the United States expressed less support for special certifications (moderate restriction). There was stronger opposition to the other two moderate restrictions—the use of dive guides and some wrecks being off-limits to divers—by more experienced and more frequent wreck divers, males, and residents of Australia. Residents of the United States also expressed less support for some wrecks being off-limits. Allowing divers access to wrecks enables divers to form a connection with underwater cultural heritage and limiting access may lead to less political support for the protection of underwater cultural heritage.
More frequent wreck divers and residents of Australia and the United States expressed lower levels of agreement with the use of dive guides to control diver behavior (low restriction). Wreck divers from locations in the other countries category were more opposed to both low-level restrictions. Less experienced divers were more strongly opposed to there being no controls over divers on wrecks.
The Wreck Diver Opposition to Management Controls Model enriches our understanding of wreck diver attitudes. It demonstrates the complexities of wreck diver attitudes resulting from the diversity in the wreck diver community. The model shifts understanding of wreck diver attitudes beyond the realm of the average wreck diver to a more comprehensive understanding, which incorporates and represents the diversity of attitudes. This diversity is important for heritage managers to understand, as it identifies particular segments of the wreck diving community that are more strongly opposed to specific management controls. Divers strongly opposed to specific management controls are less likely to voluntarily comply with management rules and less likely to support the protection of underwater cultural heritage.
The relationships between wreck diver profile variables and their opposition to management controls, illustrated in the Wreck Diver Opposition to Management Controls Model, have been synthesized in
Figure 9.
Figure 9 aligns the three clusters of management controls with the diver profile variables that predicate stronger opposition to the controls listed. Strength of influence is indicated by the position of the variable on the list: those at the top have the strongest influence and the remainder are listed in descending order of influence.
4.2.2. Stronger Support for Management Controls
The variables that had the most influence over wreck diver support for management controls were, in order of priority, country of residence, frequency of wreck diving, and gender (
Figure 10). Level of dive experience and certification had a lower level of influence on specific management controls.
Support for the use of penalties (high restriction) is evident from less frequent wreck divers; those holding leadership certifications; females; and wreck divers from Australia, Japan, and locations in the other countries category. The less experienced wreck divers supported all four moderate-level restrictions. Less frequent wreck divers and females supported three of the moderate-level restrictions: the use of permits, dive guides, and some wrecks being off-limits to divers. Wreck divers from Japan also supported three of the moderate restrictions: the use of permits, special certifications, and dive guides. Residents from locations in the other countries category supported the use of special certifications, dive guides, and some wrecks being off-limits to divers. Wreck divers with leadership certifications supported the use of special certifications and dive guides. The use of briefings to control dive behavior (low restriction) gained stronger support from less frequent wreck divers and residents of Japan. The other low-level restriction was not having any controls over what divers can do on wrecks, and this was supported by more experienced divers and residents of the United States. Although the majority of divers did not support no controls over what divers can do on wrecks (low restriction), more experienced divers and residents of the United States expressed higher levels of agreement to this approach.
The Wreck Diver Support for Management Controls Model enhances our understanding of wreck diver attitudes. It demonstrates the complexities of wreck diver attitudes resulting from the diversity in the wreck diver community. The model shifts understanding of wreck diver attitudes beyond the average wreck diver to a more comprehensive understanding, which incorporates and represents the diversity of attitudes. This diversity is important for heritage managers, as it identifies particular segments of the wreck diving community that more strongly support specific management controls. This allows managers to gauge the management controls that are more likely to gain higher levels of voluntary compliance.
The relationships between wreck diver profile variables and their support for management controls, illustrated in the Wreck Diver Support for Management Controls Model, are synthesized in
Figure 11, which illustrates the links between the three clusters of management controls and diver profile variables that predicate stronger support. The strength of influence is indicated by the position of the variable in the list, with those at the top having the strongest influence and the others listed in descending order of influence.
5. Conclusions
The majority of wreck divers are motivated to see historically significant shipwrecks, artefacts, and marine life and to enjoy the peace and tranquility of the underwater environment, and least motivated by treasure hunting. Wreck diver motivations are complex, due to diversity within the wreck diving community. Motivations are heavily influenced by frequency of wreck diving, level of certification, and gender. Two distinct groups of wreck divers emerged based on motivation preferences: the first, females and the less frequent and less experienced wreck divers and second, males and more frequent wreck divers and technical divers.
Most wreck divers have in principle support for the use of management controls to protect shipwrecks. Penalties and permits, however, were the only two specific controls that gained convincing levels of support. Although management controls were generally supported, there was notable strong opposition to preventing diver access to shipwrecks. Importantly, wreck diver attitudes were nuanced, and this should be considered by site managers when developing management strategies.
When heritage managers understand the diversity in motivations within the wreck diving community, they are better placed to accommodate wreck diver aspirations when developing management strategies. They will also be better positioned to understand the impacts management actions that may have on wreck divers and which segments of the wreck diving community may be most affected. The conceptual models presented in this paper can help guide managers in this respect. They also allow the dive and tourism industries to identify the types of experiences more popular with different segments of the wreck diving community, which can assist when deciding on the choice of dive experiences offered to clients, and marketing of destinations.
A more comprehensive understanding of diver attitudes is also pertinent to heritage managers. Understanding the complexity and diversity in diver attitudes to management controls enables managers to gain a better appreciation of the way in which specific management controls may be received by different elements of the wreck diving community. It is beneficial to recognize which segments of the wreck diving community support certain rules and those who oppose them. Management strategies can then be designed to address these considerations, leading to potentially higher levels of voluntary compliance and more effective site management. Understanding the heterogeneity of wreck diver attitudes is also relevant to dive and tourism operators who may use certain management controls to protect the sites their businesses are reliant upon.
The study achieved its objectives of identifying wreck diver characteristics and examining and critiquing wreck diver motivations and attitudes. It highlighted the heterogeneity in motivations and attitudes that exist within a special interest group of divers and presented models that illustrate and synthesize this diversity. These findings contribute to informing cultural heritage and tourism management decisions. Further research is recommended. Future research can build on specific elements, in particular, the segments of wreck divers more opposed to management controls could be probed further to identify and examine management actions they would accept and why. It would be useful to test the applicability of the approach used to develop the conceptual models presented in this paper to other samples of divers, including special interest divers, e.g., cave divers or underwater photographers. More broadly, the potential to apply this approach to develop conceptual models of motivations and attitudes to other recreational activities and settings could be explored. Further research could also explore any relationships between diver motivations, attitudes, and knowledge about underwater cultural heritage protection, and the certification agency from where the dive certification was obtained, particularly, wreck diver certifications.