1. Introduction
In Europe, a disease is called rare (RD) when it has an incidence of less than five cases out of every 10,000 inhabitants. There are some 7000 known rare diseases, which according to the World Health Organization (WHO) estimates affect 7% of the world’s population [
1]. That is, there are more than three million people affected by a RD in Spain alone. The magnitude of the problem is huge given that these pathologies are characterized by
Early onset in life (two out of three appear before the age of two);
Chronic pain (one in five patients);
The development of motor, sensory or intellectual deficit in half of the cases, which give rise to a disability in autonomy (one in three cases); and
In almost half of cases, a vital prognosis is at stake, since rare diseases have a rate of 35% of deaths before one year, 10% between one and five years and 12% between five and fifteen years.
There are several associations about rare diseases, such as the Spanish Federation of Rare Diseases (in Spanish, Federación Española de Enfermedades Raras or FEDER); the European Organization for rare diseases (EURODIS); the Ibero-American Alliance of Rare or Uncommon Diseases (in Spanish, Alianza Iberoamericana de Enfermedades poco frecuentes or ALIBER); the National Organization for Rare Diseases (NORD) in the US; and Raregenomics (
http://www.raregenomics.org).
This research analyzed Facebook data in Spanish related to rare diseases. The analysis of these social networks had two objectives: (1) to help users interested in rare diseases, enabling them to maximize the engagement of their posts; and (2) to help organizations to align their priorities with the interests of people expressed in social networks.
In the first objective, an example of helping users to maximize the engagement of their posts is advising them to post their messages at a certain hour of the day. Facebook engagement is defined as the sum of comments, shares and reactions. Reactions are the six ways to react to posts with animated emotions: love, haha, wow, sad, angry, and the classic like. Another example is to advise them to adapt the content of their posts, including photos or a positive message, to maximize the number of likes or shares.
Regarding the second objective, FEDER was founded in 1999 with the aim of publicizing the RD, to serve as a link with the Administration and to fight for the normalization of the collective. To establish the lines of work, they have a decalogue of priorities [
2], which serves for all local associations to work on the same objectives. Therefore, this document provides the lines of action to be followed by political decision-makers to defend, promote and improve the quality of life of patients with rare diseases in Spain. This decalogue has been elaborated in alignment with the concerns of the collective, but it must remain alive to ensure its effectiveness. To do so, it must be guaranteed that it reflects social reality. Recently, the rise of social networks has been generating a volume of information that can be very useful to understand the concerns of the RD collective. The objective of this work was to study whether the conversations in Facebook Groups are aligned with the priorities of the FEDER. The aim of this comparison was to establish whether there are any improvements that can be done in FEDER’s decalogue to reflect the social reality shown in the FEDER groups. Furthermore, this might help FEDER to understand the best way to generate engagement, which would help to extend the social dissemination of RD knowledge.
There are several works about social networks in RD. Davies [
3] explained the insights of rare diseases from social media surveys, treating a specific rare disease and reviewing its advantages and limitations using social media surveys. The main advantages have been the use of on-line surveys, the ease of administration and low social desirability bias and participant engagement, while the main disadvantages have been the lack of objective participant assessment, the lack of opportunity for clarification, response bias and malicious responses.
Another interesting research study is [
4], in which the authors states that, although health professionals use social media to gather information, they are skeptical of their value in communicating with patients. The current work is an extension of the preliminary analysis described in [
5], which characterizes posts of the Spanish Federation of Rare Diseases (FEDER in Spanish). We found that the decalogue should focus more on help, life, people and children and less on disability, professionals and diseases. However, in that study, we did not perform a temporal analysis of the data. Reguera [
6] performed a preliminary study in Spanish finding that there was statistical significance between the polarity of the message and the hour it was posted. However, no deeper conclusions were extracted.
Rareconnect (EURODIS), for example, is a platform where communities are created according to diseases or discussion groups of RD. Another platform is Crowdmed, a collaborative platform where patients explain their story (not their diagnosed disease or chronic symptoms) and a professional network gives information about its solution. #LoweResearchProject is a project which seeks to extract knowledge about the Lowe disease from information from social networks. Rooney [
7] showed how to promote social networks to broadcast RD, while Chempetitive Group [
8] showed how social networks are used to recruit patients to test new drugs. Finally, Smale [
9] listed the most influential people from social networks about RD.
In addition, there are numerous studies that exploit the information of social networks in health. For example, Armayones, M; Requena, S; Gómez-Zúniga, B; Pousada, M; Banón, A.M. [
10] confirmed that the use of social networks is not only extended by associations dedicated to RD, but also that its use is key to alleviate social isolation. In addition, Subirats et al. [
11] and Subirats et al. [
12] created new social platforms where doctors, patients and family members interested in neurological diseases can interact.
Regarding text mining in health science, it is used in several research studies. For instance, Palomino et al. [
13] tried to understand the impact of social networks through feelings analysis in relation to attention deficit. They made recommendations to disseminate information better by changing the framing of the messages.
Larsen et al. [
14], based on information collected from Twitter in real time, analyzed the mood of people with mental problems and understood their dispersion. They observed a correlation between the expression of emotions and the rates of suicide or burden of anxiety. Yang et al. [
15] extracted information from forums with health topics, making an analysis of feelings. Their experiments show that conLDA outperforms the original Latent Dirichlet Allocation (LDA), and can cluster relevant medical terms and relevant questions together. Lasker et al. [
16] analyzed the messages exchanged in a mailing list oriented to patients with a rare disease. The conclusions are that messages are rather biomedical than socioeconomic or organizational. In addition, it is found that the Internet provides a value to people with rare diseases to find people like them. Finally, Jacobs et al. [
17] focused on monitoring the activity of several groups on Facebook related to congenital anomalies and concluded that, to improve the care received by families and patients, it is necessary for medical personnel to be involved in the social network.
Sentiment analysis can be used to evaluate public health systems. There are three main types of sentiment analysis methods [
18]: knowledge-based, statistical and hybrid. The first one tries to classify text to identify emotions such as happiness, sadness or boredom, given that usually there are words that have a close relationship with emotions such as the aforementioned. On the other hand, statistical methods use machine learning techniques such as latent semantic analysis or support vector machines for improving emotion detection and recognition. Finally, hybrid approaches combine the use of machine learning techniques and ontologies to provide more context. In [
19], sentiment analysis is used to evaluate the experience of users of the English public health system. Through a webpage, users have the possibility to evaluate the system, both quantitatively and with written response. It is concluded that the analysis of feelings can correctly predict the polarity of the messages, comparing it with the qualitative evaluation of the users. On the other hand, other studies (e.g., [
20]) detect the intention and intensity of feelings on social networks. Experiments from five social networks demonstrate the effectiveness of the proposed Feeling Distinguisher system, which is a combination of supervised Latent Dirichlet Allocation (sLDA), Latent Dirichlet Allocation, and SentiWordNet. Finally, Akay et al. [
21] proposed a framework to identify user communities and influential users for ascertaining user opinions of cancer treatment. They focused on positive and negative sentiments, together with the side effects of the treatment. Their objective was to identify communities to discover opinions of cancer treatment.
When analyzing data content, there are several measures used in the literature to compare the corpus of data: log-likelihood (LL) [
22] is one of the most popular ones, together with DIFF [
23], Bayes factor (BIC) [
24], Effect size for Log Likelihood (ELL) [
25], relative risk, log ratio or odds ratio. On the other hand, regarding summarization of content in word clouds, Diakopoulos et al. [
26] provided a method for comparing two word clouds and gives as a recommendation to use 500 words to display on a standard computer screen (1150 × 550 pixels). For instance, Scanfeld et al. [
27] used twitter data to analyze whether there is misuse of antibiotics in cases such as “flu” or “cold”. A word cloud (150 terms) is used to show the results.
Having analyzed that the existing literature does not show the alignment between the priorities of rare disease associations and social networks and that they do not give recommendations to users about how to maximize their engagement in terms of type of posts, content and time of the post, we performed this study to contribute to this field.
The rest of the paper is organized as follows.
Section 2 describes how Facebook data were obtained and the methods for their evaluation.
Section 3 presents the results obtained and their usefulness. Finally, conclusions and future work are drawn in
Section 4 and
Section 4.1, respectively.
2. Materials and Methods
Around 3900 Facebook posts (
) were collected about rare diseases using Facebook Netvizz. As users’ information can be sensitive, guidelines provided by Townsend and Wallace [
28] were followed for this social media research. The research groups analyzed are public (which means that they belong to Facebook pages openly available to the public), users’ anonymity and privacy are preserved in the study, and information is only displayed in an aggregated way, removing names and email addresses. The selection criterion was the following:
A pre-selection of groups was carried out from the Facebook search engine, containing the words in Spanish of “Syndrome” or “Association of”.
The first 10 groups of each of the two searches were preselected.
The groups had to comply with the following terms: they are Spanish associations, they have presence in FEDER (i.e., representing one or more rare diseases), they have more than 300 participations, they have at least 10 different people participating, they have groups in Spanish, and they affect children.
From the first search group (Syndrome), five groups were selected. However, from the second search group (Association of), no groups were selected because they did not fulfill the requisites explained above. The five groups selected were the Spanish Association for Research and Support of Worfam Syndrome (in Spanish “Asociación Española para la Investigación y Apoyo al Síndrome de Worfam”), Moebius syndrome Spain (in Spanish “Síndrome de Moebius España”), Spanish Association of Cyclic Vomiting Syndrome (in Spanish “Asociación Española del Síndrome del Vómito Cíclico”), Spanish Association of Marfan Syndrome (in Spanish “Asociación Española de Síndrome de Marfan”) and Syndrome 5P or CRI du Chat (in Spanish “Síndrome 5P o CRIT du Chat”). Then, Facebook Netvizz was used to download the data.
Two types of analysis were done with this data: content-based and temporal. In the content-based analysis, the following were applied using R and Python: (1) a description of the number of posts; (2) a generation of word clouds; (3) a comparison of texts; and (4) sentiment analysis. Regarding temporal analysis, the temporal evolution was performed using R.
Word clouds were generated using R. The darker and bigger are the words, the more frequently they appear. In Facebook data, we divided our data into three groups according to the engagement value of each post. Our goal was to see whether words with a high engagement are different from those with a low engagement. We considered “low engagement” to be the lower 33% of values of engagement; analogously, we considered "high engagement" to be the higher 33% of values and “medium engagement” to be the rest of the values between low and high engagement. Therefore, word clouds were generated for four datasets: one for those having a high, medium and low engagement, as well as an additional one for the decalogue. The engagement word clouds were created on groups of words which were selected based on the term frequency-inverse document frequency (Tf-idf) measure to disregard the frequent words that appear on all levels of engagement. Tf-idf is the most popular applied weighting scheme in some studies [
29].
Facebook data were compared to the FEDER decalogue [
2] to understand how different they are. The decalogue must remain alive and updated to ensure its effectiveness. For this reason, its comparison with Facebook data is relevant because it ensures that it reflects social reality. To make this comparison, LL was chosen to compare among different texts because common words are highlighted. The reason of this choice was because LL puts more emphasis in common words for a given topic than other measures [
30], which are most likely to be used by non-expert users. LL was computed by constructing the contingency table of
Table 1. Then, we computed LL as follows:
and are odds-ratio measures and they can be seen as the “strength” of a given word in one dataset while also considering its popularity in the other dataset. Then, measures whether a word is likely to appear in both Facebook or the decalogue, while also considering its frequency. is larger for words that appear in one dataset more frequently than they do in the other one.
Sentiment analysis of the content was performed using the Python library TextBlob. In sentiment analysis, both the polarity and the subjectivity were analyzed, the former being one of the most popular measures [
31], although the latter is supposed to be more useful for analyzing emotions. To perform sentiment analysis, TextBlob Python library was used after translating text to English. This library is backed on Pattern (Natural Language Toolkit (NLTK)) [
32] which is widely used by several universities. This toolkit uses statistical approaches and regular expressions to determine the polarity and subjectivity of a given text. The values are based on the adjectives of the text and they are optimized based on the frequency of the adjectives and successive words. The sentiment analysis library returns two attributes when analyzing a text: polarity and subjectivity. The polarity score is a real number within the range [−1.0, 1.0], where −1.0 is a negative text, 0 is a neutral text, and 1.0 is a positive text. On the other hand, subjectivity is a real number within the range [0.0, 1.0], where 0.0 is very objective and 1.0 is very subjective.
4. Conclusions
The main goals of this research have been to characterize both social media data such as Facebook engagement and the decalogue of the Spanish Federation of Rare Diseases (FEDER) datasets. The characterization is carried out considering a content-based and a temporal analysis. In addition, the Facebook dataset is compared with the decalogue of the FEDER and recommendations are given to users to maximize the engagement of their posts.
In the characterization of the Facebook data, we found similar results to the existing literature: photos are the type of posts with the highest number of reactions and engagement, while statuses are the type of posts with the highest number of comments, and events are the type of posts with the highest number of shares. Regarding the word clouds, we could see that the words that appear in Facebook are words of gratitude, while words that appear in the decalogue word cloud are related to diseases, attention, disability and services. We also found differences among word clouds grouped by level of engagement: the low engagement word cloud is related to spam messages, while medium/high engagement word clouds are related to treatments. As for correlations, we found that the attributes with the highest correlations (an absolute value above or equal 0.10) are polarity–likes, polarity–reactions, subjectivity–comments, and subjectivity–engagement.
With respect to the values obtained by the log-likelihood (LL), we observed that the following words have a large presence in the decalogue and are little-used on Facebook: disability, professionals and diseases. Similarly, the following are the words most present on Facebook with little representation in the decalogue: help, life, people and children. The analysis of the temporal variables has shown us that there is high correlation between the polarity and the time of day, which is not observed either with the engagement or with the day of the week.
Studying polarity and subjectivity in social networks has several practical applications. For example, an early detection of depression system can be built [
36], or an early detection system of bipolar behavior. In [
31], the authors stated that most sentiment analysis studies are focused on polarity, but subjectivity is also very important to detect “private states” (opinions, emotions, sentiments, beliefs, and speculations) [
37].
Because of our study, the recommendations we give to users interested in rare diseases if they want to maximize their engagement of their posts are as follows: (1) use photos in their posts; (2) update their status; (3) post content of common interest; and (4) post at midday or late at night. Regarding the recommendations to FEDER, we recommend they focus more on concepts such as help, life, people and children.
4.1. Future Work
As for future work, there are several improvements that could be made. One is to improve the content-based analysis; a limitation of our current work is that only posts in Spanish were analyzed. In the future, other languages may be considered. In the same line, other associations of other countries different from FEDER may be considered. In addition, more Facebook groups will be analyzed. Concerning the improvement of the comparison of Facebook data with the FEDER decalogue, other initiatives such as the ones mentioned in
Section 2 could be applied and compared. To improve the content-based analysis, sentiment analysis of the images could be performed. There are some application programming interfaces (APIs) to perform this, such as
https://indico.io, which could allow us to obtain the polarity and subjectivity of images. From a language processing point of view, having such few data in the decalogue may cause the obtained results to not be reliable. For future work, a semantic analysis will be performed to compare results with LL measures. Finally, another interesting line of research would be to perform supervised and unsupervised learning to be able to predict engagement and determine profiles, respectively.