Next Article in Journal
A Space-Time Framework for Sentiment Scope Analysis in Social Media
Previous Article in Journal
Facial Age Estimation Using Machine Learning Techniques: An Overview
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Detecting and Understanding Sentiment Trends and Emotion Patterns of Twitter Users—A Study on the Demise of a Bollywood Celebrity

1
Department of Computer Science, University of Calgary, Calgary, AB T2N 1N4, Canada
2
Department of Computer Engineering, Istanbul Medipol University, Istanbul 34810, Turkey
3
Department of Heath Informatics, University of Southern Denmark, 5230 Odense, Denmark
*
Author to whom correspondence should be addressed.
Big Data Cogn. Comput. 2022, 6(4), 129; https://doi.org/10.3390/bdcc6040129
Submission received: 21 September 2022 / Revised: 18 October 2022 / Accepted: 19 October 2022 / Published: 31 October 2022

Abstract

:
Detecting societal sentiment trends and emotion patterns is of great interest. Due to the time-varying nature of these patterns and trends this detection can be a challenging task. In this paper, the emotion patterns and trends are detected among social media users in a certain case and it is noted that the detection of the trends and patterns is especially difficult in this medium because of the use of informal language. In particular, the role of social networks in the expression of emotions relating to the death of a well-known and loved Bollywood actor Sushant Singh Rajput (SSR) by their fans is explored. The data for the analysis of the emotional state and the sentiment levels of the fans has been acquired from Twitter posts. Different existing sentiment analysis algorithms were compared for the study and chosen for identifying the sentiment trend over a specific timeline of events. The same Twitter posts were also analyzed for emotional content by extracting linguistic features using the psycholinguistic package, Linguistic Inquiry and the Word Count package (LIWC), relating to emotions. Additionally, viral hashtags extracted from the Twitter posts have been segmented and analyzed in order to identify new viral hashtags expressed by the posts over time. The associations between the old and new viral hashtags and between sentiment trends and emotional shifts among the fan base of SSR have been determined and presented graphically.

1. Introduction

Social media platforms (e.g., Facebook, Twitter, Instagram etc.) have become the main source of information for many of its users. Many of the users are also using these platforms for other tasks such as communication between friends/connections, branding online shops, creating news, sharing opinions and so on. At the inception of online social media, the platforms were simple and not very sophisticated. The platforms have, however, improved and been enhanced over time so that in addition to the social network function they have become an important vehicle for interacting with other users by means of texts, photos and chats generating large amounts of data of various kinds. This user-generated content (UGC) can be mined for user profile-based analysis and detection systems, such as personality detection [1], recommendation systems [2,3], sentiment analysis [4], sarcasm detection [5], etc.
Currently according to the most recent statistics published by Zephoria [6], a digital marketing company, the Facebook metric Family Monthly Active People (MAP) shows Facebook had 3.51 billion users as of 28 July 2021, an increase of 12 percent year-over-year [6]. Twitter, the other heavily used social media platform, had increased their year-over-year monetizable Daily Active Users (mDAU) by 34 percent to 186 million mDAUs worldwide in 2020 [7]. Because of this increase in active users, the diversity in terms of culture, gender, and age of users is also expected to increase.
Users of social media platforms post discussions and comments on a variety of topics. Often, there is an expression of emotion underlying these topics. Identifying and extracting these emotions is a cross-domain research topic involving computer science, psychology, and neurobiology [8]. The emotions contained in the social media posts are expressed in various ways, such as using textual expression, emoticons, meme posts or related images. One of most widely used contents are text messages which can be analysed using the advanced natural language processing tools. Some of these text messages, including Facebook and Twitter text postings are therefore a potential source of textual data that can be interpreted as being emotional by using the insights provided by the word usage patterns. Interpretation of this use of vocabulary is part of psycholinguistic research and analyzing the textual data is part of natural language processing. The structure of social media networks is another important aspect to be considered while analyzing the posts.
The textual data extracted from posts on social media platforms such as Facebook, Twitter etc. are considered to be user-generated content [9]. Such user generated textual data in the posts is very much informal. The textual data contains deep insights into personality traits, which can be extracted after first performing a great deal of pre-processing and then using psycholinguistic methods [10].
The main motivation for this paper is to try to understand the psychology, behind posts and hashtags generated by the fan base of Bollywood actors in terms of sentiment and emotion. To further elucidate the aim of the paper, we have not worked on the psychological aspects or traits of the social media users in particular, but rather on the expressive responses by them. In particular, the news of the suicide of Sushant Singh Rajput together with the subsequent news suspecting that he might have been murdered has generated a large volume of social media posts having a particular emotional pattern. Indeed, this case did turn into a huge controversy in the world of Bollywood, the largest movie industry in the world. Based on the timeline of the events published by the news and paper media, people reacted differently to each event.
The aim of this paper is therefore to analyze sentiment trends and emotion patterns toward films and actors expressed by fan bases. It is the psychological viewpoint of the Twitter posts over time that is used to identify emotional patterns of the fan base. A second aim is to analyze the usage of hashtags by the social media users who are fans of SSR, who as noted, passed away in 2020. The analysis also includes how new hashtags have evolved due to the new media reports that has led to a sentiment that something should be done to honor the departed soul. Finding starting hashtags and associated hashtags that have gone viral over time and developing insights from the new hashtags that have appeared among users is another focus of the paper.

2. Event of Study

The term “Bollywood” is a portmanteau of “Bombay” and “Hollywood” indicating the local geographic and artistic origins of this industry which has now spread to all of India. According to Statistica, the total revenue of Bollywood in the year 2021 was around 93 billion dollars [11].
There is a huge fan base for Bollywood that uses social media platforms, especially Twitter, for expressing their reviews on Bollywood films, acting styles of Bollywood actors, quality of their acting etc. The fans also react to other Bollywood industry activities such as trends in Twitter claiming extreme levels of nepotism, trends related to the #MeToo movement, discussions on the demise of Sushant Singh Rajput and the subsequent CBI investigations, the marriage of Katrina Kaif and Vicky Kausal, the marriage of Alia Bhatt and Ranbir Kapoor etc. Accusations of the industry being controlled by political parties are also discussed, due to the involvement of 3 leaders from the Bharatiya Janata Party (BJP), the current ruling party of India, in the controversies. The Economist published an article on “BJP vs. Bollywood” saying “... as cases of COVID-19 were rising in India’s first wave and the BJP was preparing for elections in the poor eastern state of Bihar, a young actor called Sushant Singh Rajput (SSR)—a Bihari—committed suicide in Mumbai” [12]. Therefore, the demise of SSR does not only affect the fan base, but also the political establishment.
The significant events which took place after the demise of SSR are illustrated in Figure 1. Starting from finding the dead body until the confirmation of suicide by the supreme court, the timeline shows the behavior change of Twitter users based on these significant events.
Viral posts or hashtags by the fan base of their favorite celebrity, Sushant Singh Rajput, the very popular Bollywood actor, contain in some cases, extreme emotional expressions when posting on the event of their death. In this paper, we therefore want to identify the emotional state developed among Twitter users after their death. The news of their death was published on 14 June 2020, and the report stated it was a suicide. Following this, their fan base became so affected by the incident that they started showing what can be interpreted as extreme levels of emotions through Twitter posts.
The death of Sushant Singh Rajput (SSR) caused the fan base to become surprisingly emotional, mainly because he used to be a very open-minded actor and also a bit of a geek and Twitter users created viral hashtags such as #SushantSinghRajput, #SSR, #SSRSuicide etc. when discussing their death, while the newspapers and TV media first reported their passing as a suicide case, subsequently, some new evidence appeared during media investigations indicating that their death might possibly be a murder case. Because of this information, the fans reacted fiercely. A new hashtag was created for postings discussing the investigation of the case as if it was a case of murder. Evidence such as doubtful behavior of their last girlfriend and their friends was noted, and fans highlighted those viewpoints in Twitter posts. The government of India reopened the case of their death and proceeded to have the case being re-investigated by the Central Bureau of Investigation (CBI) and Narcotics Control Bureau (NCB). After transferring the case from the police to CBI, the case got more complex day by day as more evidence was forthcoming regarding the suspicion of murder. As time passed, the emotions and the tone of the language of posts discussing the SSR case evolved as expressed by their linguistic content and new hashtags.

3. Related Works

Posting information about current events such as COVID-19 [13], information about US Elections [14] and other events has become a normal activity for many social media users nowadays. Frequently these postings go viral, that is, they are re-posted repeatedly by new users as they read the posts. Unfortunately, this re-posting can also include the spreading of misinformation and/or disinformation [15]. For example, re-posting misguided information about coronavirus infections became a world-wide issue once it became an epidemic. Similarly, during the elections certain politicians are spreading false “alternative truths” [16]. In the case of the coronavirus, among the resulting societal impact of social media misinformation includes panic buying [17] and rumor spreading rumor [18]. This shows that the social media users are exhibiting very diversified as well as adverse patterns caused by the uncertainties associated with the ongoing development of the epidemic.
A recent paper surveyed on social media postings relating to COVID-19 covered Twitter emotion research in detail [19]. The paper covered the evolution of emotion descriptions and emotion models for textual posts in general. The different methods that are covered include keyword-based, lexicon-based, machine learning and hybrid methods. Methods for emotion intensity detection, sarcasm detection and emotion-cause detection are also summarized in the paper.
Posts or hashtags going viral or becoming trended can happen within a very short period of time over multiple social media. For example, posts by politicians tend to go viral before elections [20] and post about celebrities are frequently going viral when they perform publicity stunts [21]. Interestingly, viral posts often contain multiple hashtags which leads towards using hashtags to map the propagation of posts through networks.
In the literature, case studies have been done on suicide related publicity, mainly focusing on how TV or newspaper media react to such events. A meta-analysis was presented by T. Niederkrotenthaler et al. [22] on a celebrity suicide case reflected in media coverage. A pilot study has been reported in a medical journal on cross-country comparison of media reporting of celebrity suicide in the immediate week following the passing of the celebrity [23]. The effect of media coverage on suicide cases and the quality of media reports are presented in [24]. None of these studies have focused on the use of social media data for analyzing these cases. This paper, therefore, fills a gap in the literature through the analysis of emotions generated from posts relating to a suspected suicide.
The main contributions of the paper are:
  • A novel approach to the use of celebrity suicide-related tweets to extract psycholinguistic features from textual information, and to determine sentiments and emotion patterns among the posters of the tweets.
  • Timeline based analysis to determine new viral hashtags based on relationships among SSR related hashtags.
  • Detection and analysis of sentiments and emotions from SSR related tweets.

4. Research Methodology

The research methodology described in this paper that is applied to the set of Twitter posts considered has several steps which are described in detail in the next subsections.

4.1. Proposed Framework

In this section, the proposed framework and its implementation is discussed including data collection from Twitter, data pre-processing, annotation and a timeline-based approach to detect and understand the sentiment trend and emotion pattern expressed by the collected data.

4.1.1. Conceptual Diagram of the Framework

The conceptual diagram of the proposed framework to detect the sentiment trend and emotion pattern is shown in Figure 2.
For this framework all the data of the corpus is collected from Twitter and then fetched into the pre-processing step to remove erroneous and extraneous elements from the corpus. The collected text corpus contains mentions, hashtags, retweets and some promotional posts as they are commonly found in the Twitter posts. After removing those, the pre-processed data is used for annotating sentiment and emotion. Finally, quantitative, month-wise and event-wise analyses were performed to understand and visualize the trend and pattern in sentiment and emotion.

4.1.2. Data Collection

There are a number of ways that the data from Twitter posts can be collected, such as manually, or using Twitter API. Manual data collection is a time-consuming process while the Twitter API provides the data which are only publicly available. If data-scraping software is used, then this tends to be costly. On the other hand, using the Twitter API [25] only limits the data to the most recent data (30 days). Based on post-related information, such as hashtag, geographic location, topics of post etc. it gives integrated information (i.e., number of retweets, number of replies, web link etc.) for each of the posts. Table 1 shows the statistics of collected raw data from twitter. In total 16,647 posts have been collected from total 1214 unique Twitter users having four different hashtags (#SSR, #JusticeForSSR, #WorldUnitedForSSR and #FeedFood4SSR).
It was therefore decided to use the Python package, GetOldTweets version-3 [26] for the data collection. The package is appropriate for extracting the old posts based on the location or timeline of the tweets. The relevant data items extracted for each of the Twitter posts are date of tweet, username, no. of replies, no. of retweets, no. of favorites, text of the tweet, mentions, hashtags, id and the permanent link of the post. Figure 3 shows the steps of data collection process from Twitter.
The date information was collected since it was to be used for timeline-based representation of the tweets and for finding associated emotion pattern for each tweet. The difference between emotion patterns and sentiment patterns over time can also be visualized using this data.

4.1.3. Data Pre-Processing

This section describes the pre-processing steps applied to the collected data. For pre-processing textual data from social media, several aspects, such as mentions, hashtags, retweets and/or promotional posts need to be considered. For this purpose, the Python regular expression (re) package [27] and substitute function was used to segment and remove Mentions, Hashtags, Retweets and Promotional Posts. The reasons for removing these parts were:
  • Mentions are formatted as @USERNAME which mentions someone from the same social media that are included in this post. Using such usernames would mean that the privacy policies of the social media platforms would be violated, which is why these parts were skipped.
  • Hashtags “#HASHTAG” are used to attract other users and making the post relative to any practical matters. Therefore, using these hashtags to extract the psycholinguistic features may cause problems for extracting the emotional content of the posts.
  • Retweets (RT) are used for replying to someone else posts. These retweets are themselves considered to be tweets containing a good textual source for the purpose of the analysis of emotions. The word retweet has therefore been removed from the posts and the posts were accepted.
  • Promotional Posts are made using viral hashtags to attract customers who engage with the hashtags. Such posts are not related to the hashtag context. Instead, they are simply promotions. Promotional posts generally contain “http”, “https” or “https://” and “html tags”. Therefore, if any of these parts were detected in a post, then the post was removed by using regular expression functions.
After the pre-processing the statistics for the data are shown in Table 2. In total 15,566 posts remain after data cleaning steps performed as pre-processing, coming from 1087 unique users. ¶
After segmenting these parts as a data pre-processing step, the processed data was fed into the LIWC system for feature extraction. Some of the posts were removed using the above criteria and 15,566 Twitter posts remained that could be further analyzed.

4.2. Sentiment Detection and Analysis Approach

To determine sentiment patterns from a set of Twitter posts, the sentiments of each post must be recognized. The overall flow of analysis for the detection and analysis of the sentiments is shown in Figure 4.
In more detail, the data is first collected from Twitter. Then, data pre-processing steps, such as removal of mentions, retweets and promotional posts are performed. After the pre-processing step, the posts are tokenized, where by tokenization [28] is meant the splitting of collections of words, for example sentences, into units that are amenable to sentiment analysis. Determining the subjectivity and polarity value of a given text is then done using the Textblob package [29], which is a python package that enables the determination of the subjectivity and polarity values of a given text. The text could either be a single sentence or a whole a paragraph. Word-by-word polarity values are then utilized to determine a final polarity value for a given text fragment. From this polarity value the sentiment class (i.e., positive, negative and neutral) is determined and annotated.
The pseudocode in Table 3 shows the steps of sentiment analysis and annotation based on the polarity values. The dataframe for the pseudocode consists of the pre-processed Twitter posts, which are already tokenized. Then in the pseudocode the dataframe is passed to the subjectivity and polarity functions and a score is generated for each Twitter post. Based on the polarity score the getAnnotation() function is applied which determines the sentiment class labels. This function is used to annotate the whole dataframe. The subjectivity values are not used to determine the sentiment label, though they are used to understand the quality of the dataset through the subjectivity vs. polarity scatter plot. The scatter plot is illustrated and described in Section 6.1.
For analyzing the sentiment of tweets, Python NLTK [30] and Textblob [29] packages, which are widely accepted by the research community, were used. These packages were used to estimates the strengths of positive and negative values of emotions extracted from short informal texts [31,32]. As the tweet texts are considered to be short texts due to the character limitation imposed by the Twitter authority; this sentiment score extracting tool was found to be appropriate for finding the sentiments of the tweets. Based on the sentiment scores a mathematical model (shown in Pseudocode in Table 3) was derived to find the exact sentiment of the overall posts.

4.3. Emotion Detection and Analysis Method

In this section, an overview of the emotion detection and annotation method used is provided. Figure 5 shows the processing architecture. The data collection and data pre-processing steps were exactly the same as for the emotion detection and analysis and the same dataset was used. After the pre-processing had been performed, the pre-processed data was forwarded to the feature extraction step. The feature extraction step is in this instant considerably different from the other text feature retrieval processes in this paper. The regular feature extractors, such as, TF-IDF [33], n-gram models [34] etc. are not used. These feature extractors are used to represent the structure of the sentences inputted, not any kind of emotion or sentiment related relations. Therefore, the use of these methods would not be appropriate in this case. Hence, the LIWC [35] is used to extract the psycholinguistic features, such as positive, negative emotion scores, from the texts.
Psycholinguistic features are numerical or word-counter based features that convey an understanding of the emotional impact of the vocabulary used in a user-generated post. The insights of the post were made clear through the optimal use of the categorization methods proposed in LIWC.
In this step the LIWC (Linguistic Inquiry and Word Count) LIWC 2015 [35], the gold standard for computerized text analysis, was used. This tool can convert the words used in everyday language for expressing our thoughts, feelings, personality, and motivations into categories representing emotions. An earlier version of the program was labelled LIWC2007. The new version, which was used here, provides additional improved features for the analysis. Based on years of scientific research, LIWC2015 is more accurate, easier to use, and provides a broader range of social and psychological insights compared to earlier LIWC versions. The LIWC2015 outputs 90 attributes from different types of text inputs, such as personal writing, personal email correspondence, professional correspondence, social media posts (Twitter, Facebook, Blog), commercial writing, professional and scientific writings. The core of the text analysis strategy is the LIWC2015 Dictionary. The words and the percentages of positive, negative emotions etc. features acquired (shown in Pseudocode in Table 4) from LIWC2015 were used to annotate the Twitter posts.
The psycholinguistic features that are extracted from the post, which provides the context for natural language processing, are important for understanding the psychological insight of the posts. Table 4, which shows the process of extracting psycho-linguistic features. Then, the labeled data was used for identifying tweet patterns using several machine learning algorithms.
In Figure 6, some features from LIWC have been applied to the annotated data. Only emotion related features were considered, and annotations were applied to find the emotion pattern of the social media entities. Figure 7 shows a snapshot of the annotated data.
For an example, suppose the word “cried” is part of five word-categories: sadness, negative emotion, overall affect, verbs, and past focus. Then Table 5 shows the six (6) LIWC2015 emotions related to the emotion/affect categories of cried.
The steps to extract the psycholinguistic features and the annotation of emotional state for each dataframe (df) are shown in the pseudocode in Table 3. For this process, the tokenizer and LIWC package we have to be initialized. The dataframe is then fed into the tokenizer, which outputs the tokens. Then, the counter is imported, which is used for counting the words for each of the categories. There are more than 90 categories (i.e., linguistic dimensions, language variables, psychological processes) [36]. The “category counter” holds the frequency values for each of the categories. Then, only the emotional or affect related categories are segmented from the whole list of categories and stored in “Affect Category Counter”. Based on the maximum frequency count on the affect categories, the Twitter post is annotated as that specific category. The switch case determines the category based on the maximum value of the Affect Category Counter. Finally, a new column named “Class” is added to the dataframe.

5. Instruments Used

Several tools are used for the experiments in detecting sentiments and emotions. These tools include machine learning tools and Python packages. The main packages used in the experiments were TextBlob [29], NLTK [30] and LIWC [35]. The documentations for each of these packages can be found in the Python Package Index (PyPI) [37]. A user interface and the Application Programming Interface (APIs) for academic and commercial versions of LIWC is publicly available by payment [38].

6. Experimental Results

This section demonstrates the results of the experiments related to sentiment and emotion detection along with hashtag segmentation and timeline-based analysis.

6.1. Sentiment Detection

For analyzing the sentiment of tweets, the Python NLTK [30] and Textblob [29] packages, which are widely accepted by the research community were used. These packages were used to estimate the strengths of positive and negative values of emotions extracted from short informal texts [26,32]. As the tweet texts are considered to be short texts due to the character limitation imposed by the Twitter authority this sentiment score extracting tool was found to be appropriate for finding the sentiment of the tweets. Based on the sentiment scores a mathematical model (shown in Pseudocode 1) was derived to find the exact sentiment of the overall tweet. The percentage of sentiment class is determined and shown in Table 6.
It is evident that the negative sentiment is higher for #SSR, #JusticeForSSR and #WorldUnitedForSSR. On the other hand, the positive sentiment is higher when #FeedFood4SSR and #Plant4SSR hashtags were used. The neutral values are significant, because of this is due to the mixture of positive and negative words, which leads to a neutral mode.
Figure 8 shows the word cloud generated by the most frequent words uttered by the Twitter users using the referred hashtags. These words are mostly utilized for the sentiment analysis unless they are cleaned by any data pre-processing steps.
The subjectivity vs. polarity graph is depicted in Figure 9. for #SSR and #JusticeForSSR. From the literatures [39,40,41,42,43], it is evident that the subjectivity vs. polarity graph creates a v-shape that is also found in this study. Basically, the higher scores of subjectivity means the sentence if more formal, therefore, the polarity scores are also closer to zero, except for some exceptions.

6.2. Emotion Detection

For the emotion detection and annotation, the psycholinguistic feature extraction step were performed (shown in the Pseudocode in Table 3). The sample of the outcome for the LIWC feature categories is shown in Figure 5. Along with the texts from the dataframe, the numerical values for some of the LIWC features are shown. As we can see, the output is a floating-point number, due to the average weighted counting in the LIWC dictionary. Figure 6 shows the “Class” which is being generated and added to the dataframe (shown in Pseudocode 2). Along with the Affect Category Counter entries, “posemo”, “negemo”, “anx”, “anger” and “sad” are added representing the positive emotion, negative emotion, anxiety, anger and sad values.
Utilizing the psycholinguistic features and annotations, the emotion detection method gives the percentages of emotional pattern for the different hashtags. From Table 7, it is evident that negative emotions are higher than the positive emotion for the first three hashtags (#SSR, #JusticeForSSR and #WorldUnitedForSSR) whereas the positive emotions are higher than the negative emotions for the #FeedFood4SSr and #Plant4SSR hashtags.

6.3. Hashtag Segmentation & Timeline-Based Analysis

A hashtag network graph was generated based on the viral hashtags being used in the posts and the connection between the primary hashtags and the new hashtags was used to identify the trendy hashtags in this special context. The Python NLTK package [30] and Python Regular Expressions (RE) [27] was used to extract regular expressions. The most used hashtags were extracted using the initial hashtags #SSR, #JusticeForSSR, #WorldUnitedForSSR and #FeedFoodforSSR. Using these hashtags, all the associated hashtags used on the same posts were collected. These extracted hashtags were used for generating word clouds. The mostly used hashtags are detected form the word clouds and used as viral hashtags for the further analysis. In Figure 10 and Figure 11, timelines starting from 13 July 2020, the day of the SSR demise, are shown and new hashtags are first detected in August 2020.

7. Conclusions

This paper presents a novel approach to detecting and understanding sentiment trends and emotional patterns of social media users in a celebrity suicide case. The process of detecting the sentiments and emotions is illustrated and results for sentiments (positive, negative and neutral) and emotions (positive, negative, anxiety, anger, sad) are shown. The highest positive sentiment (51.2%) and positive emotion (63.1%) is reported for the #Plant4SSR hashtag, the highest negative sentiment (38.9%) reported is for #SSR and the highest negative emotion (70.2%) reported is for #JusticeForSSR. On the other hand, more sad posts (31.7%) were reported with the #JusticeForSSR. Moreover, viral hashtags are detected from the posts from the initial occurrence of hashtags on a timeline. For further study, the detected emotion patterns and the sentiment patterns might be used to analyze the machine learning models applied. The models can predict future viral hashtags as well as the emotional sentiment analysis from social media in a similar context. Unsupervised learning methods could be applied for sentiment and emotion analysis.

Author Contributions

Conceptualization, A.A.M. and J.G.R.; methodology, A.A.M. and J.G.R.; software, A.A.M. and J.G.R.; validation, A.A.M., J.G.R. and R.A.; formal analysis, A.A.M.; investigation, A.A.M.; resources, A.A.M.; data curation, A.A.M. and J.G.R.; writing—original draft preparation, A.A.M. and J.G.R.; writing—review and editing, A.A.M. and J.G.R.; visualization, A.A.M. and J.G.R.; supervision, R.A.; project administration, A.A.M. and R.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are available from the first author and can be shared with anyone upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Al Marouf, A.; Hasan, M.K.; Mahmud, H. Comparative analysis of feature selection algorithms for computational personality prediction from social media. IEEE Trans. Comput. Soc. Syst. 2020, 7, 587–599. [Google Scholar] [CrossRef]
  2. Middleton, S.E.; Shadbolt, N.R.; De Roure, D.C. Ontological user profiling in recommender systems. Acm Trans. Inf. Syst. (TOIS) 2004, 22, 54–88. [Google Scholar] [CrossRef] [Green Version]
  3. Lu, Z.; Pan, S.J.; Li, Y.; Jiang, J.; Yang, Q. Collaborative evolution for user profiling in recommender systems. In Proceedings of the IJCAI’16: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, New York, NY, USA, 9–15 July 2016; pp. 3804–3810. [Google Scholar]
  4. Yue, L.; Chen, W.; Li, X.; Zuo, W.; Yin, M. A survey of sentiment analysis in social media. Knowl. Inf. Syst. 2019, 60, 617–663. [Google Scholar] [CrossRef]
  5. Sarsam, S.M.; Al-Samarraie, H.; Alzahrani, A.I.; Wright, B. Sarcasm detection using machine learning algorithms in Twitter: A systematic review. Int. J. Mark. Res. 2020, 62, 578–598. [Google Scholar] [CrossRef]
  6. Zephoria. The Top 20 Valuable Facebook Statistics—Updated July 2021. 2021. Available online: https://zephoria.com/top-15-valuable-facebook-statistics/ (accessed on 20 October 2022).
  7. Noyes, D. The Top 10 Valuable Twitter Statistics—Updated August 2020. 2020. Available online: https://zephoria.com/twitter-statistics-top-ten/ (accessed on 20 October 2022).
  8. Izard, G.E. The Psychology of Emotions; Springer: Berlin/Heidelberg, Germany, 1991. [Google Scholar]
  9. Smith, A.N.; Fischer, E.; Yongjian, C. How Does Brand-Related User-Generated Content Differ Across Youtube, Facebook, and Twitter? J. Interact. Mark. 2012, 26, 102–113. [Google Scholar] [CrossRef]
  10. Tskhay, K.O.; Rule, N.O. Perceptions of personality in text-based media and OSN: A meta-analysis. J. Res. Personal. 2014, 49, 25–30. [Google Scholar] [CrossRef]
  11. Statista Report. Statistics on Revenue of Bollywood in 2021. 2022. Available online: https://www.statista.com/statistics/627512/film-revenue-by-stream-india/ (accessed on 20 October 2022).
  12. The Economist. What Does India’s Government Have against Bollywood? 30 October 2021. Available online: https://www.economist.com/asia/2021/10/30/what-does-indias-government-have-against-bollywood (accessed on 20 October 2022).
  13. Gruzd, A.; Mai, P. Going viral: How a single tweet spawned a covid- 19 conspiracy theory on twitter. Big Data Soc. 2020, 7, 2053951720938405. [Google Scholar] [CrossRef]
  14. Hua, Y.; Ristenpart, T.; Naaman, M. Towards measuring adversarial twitter interactions against candidates in the us midterm elections. In Proceedings of the International AAAI Conference on Web and social media, Atlanta, GA, USA, 8–11 June 2020; Volume 14, pp. 272–282. [Google Scholar]
  15. Pierri, F.; Artoni, A.; Ceri, S. Investigating Italian disinformation spreading on twitter in the context of 2019 European elections. PLoS ONE 2020, 15, e0227821. [Google Scholar] [CrossRef] [Green Version]
  16. Radford, P.I.; Brown, B. (Eds.) Alternative Truths (Alternatives); B Cubed Press: Benton, WA, USA, 2017. [Google Scholar]
  17. Laato, S.; Islam, A.N.; Farooq, A.; Dhir, A. Unusual purchasing behavior during the early stages of the COVID-19 pandemic: The stimulus-organism- response approach. J. Retail. Consum. Serv. 2020, 57, 102224. [Google Scholar] [CrossRef]
  18. Islam, A.M.; Laato, S.; Talukder, S.; Sutinen, E. Misinformation sharing and social media fatigue during COVID-19: An affordance and cognitive load perspective. Technol. Forecast. Soc. Chang. 2020, 159, 120201. [Google Scholar] [CrossRef]
  19. Sailunaz, K.; Dhaliwal, M.; Rokne, J.; Alhajj, R. Emotion detection from text and speech: A survey. Soc. Netw. Anal. Min. 2018, 8, 28. [Google Scholar] [CrossRef]
  20. Bene, M. Sharing is caring! Investigating viral posts on politicians’ Facebook pages during the 2014 general election campaign in Hungary. J. Inf. Technol. Politics 2017, 14, 387–402. [Google Scholar] [CrossRef]
  21. Kwon, K.H. Public referral, viral campaign, and celebrity participation: A social network analysis of the ice bucket challenge on youtube. J. Interact. Advert. 2019, 19, 87–99. [Google Scholar] [CrossRef]
  22. Niederkrotenthaler, T.; Fu, K.-W.; Yip, P.S.; Fong, D.Y.; Stack, S.; Cheng, Q.; Pirkis, J. Changes in suicide rates following media reports on celebrity suicide: A meta-analysis. J. Epidemiol. Community Health 2012, 66, 1037–1042. [Google Scholar] [CrossRef] [PubMed]
  23. Menon, V.; Arafat, S.Y.; Akter, H.; Mukherjee, S.; Kar, S.H.; SKPadhy, S.K. Cross-country comparison of media reporting of celebrity suicide in the immediate week: A pilot study. Asian J. Psychiatry 2020, 54, 102302. [Google Scholar] [CrossRef]
  24. Menon, V.; Kar, S.K.; Varadharajan, N.; Kaliamoorthy, C.; Pattnaik, J.I.; Sharma, G.; Mukherjee, S.; Shirahatti, N.B.; Ransing, R.; Padhy, S.K.; et al. Quality of media reporting following a celebrity suicide in India. J. Public Health 2020, 44, e133–e140. [Google Scholar] [CrossRef]
  25. Twitter. Twitter API. 2021. Available online: https://developer.twitter.com/en/docs/twitter-api (accessed on 15 June 2022).
  26. GetOldTweets3. GetOldTweets3, Python Package Index. 2021. Available online: https://pypi.org/project/GetOldTweets3/ (accessed on 10 January 2022).
  27. Python Regular Expression. Regular Expression, Python Package Index. 2022. Available online: https://pypi.org/project/regex/ (accessed on 10 January 2022).
  28. Grefenstette, G. Tokenization. In Syntactic Wordclass Tagging; Springer: Dordrecht, The Netherlands, 1999; pp. 117–133. [Google Scholar]
  29. Textblob. Textblob Package. 2021. Available online: https://textblob.readthedocs.io/en/dev/ (accessed on 10 January 2022).
  30. NTLK. Natural Language Toolkit. 2021. Available online: https://www.nltk.org/install.html (accessed on 10 January 2022).
  31. Kiritchenko, S.; Zhu, X.; Mohammad, S.M. Sentiment analysis of short informal texts. J. Artif. Intell. Res. 2014, 50, 723–762. [Google Scholar] [CrossRef] [Green Version]
  32. Thelwall, M.; Buckley, M.; Paltoglou, G.; Cai, D.; Kappas, A. Sentiment strength detection in short informal text. J. Am. Soc. Inf. Sci. Technol. 2010, 61, 2544–2558. [Google Scholar] [CrossRef] [Green Version]
  33. Ramos, J. Using TF-IDF to determine word relevance in document queries. In Proceedings of the 1st Instructional Conference on Machine Learning, December 2003; Volume 242, pp. 29–48. Available online: https://www.researchgate.net/publication/228818851_Using_TF-IDF_to_determine_word_relevance_in_document_queries (accessed on 10 January 2022).
  34. Cavnar, W.B.; Trenkle, J.M. N-gram-based text categorization. In Proceedings of the SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval, Las Vegas, NV, USA, 11–13 April 1994; Volume 161175. [Google Scholar]
  35. Tausczik, Y.R.; Pennebaker, J.W. The psychological meaning of words: Liwc and computerized text analysis methods. J. Lang. Soc. Psychol. 2010, 29, 24–54. [Google Scholar] [CrossRef]
  36. Pennebaker, J.W.; Boyd, R.L.; Jordan, K.; Blackburn, K. The Development and Psychometric Properties of LIWC2015; University of Texas at Austin: Austin, TX, USA, 2015. [Google Scholar]
  37. Python Package Index. Python Package Index (PyPi). 2021. Available online: https://pypi.org/ (accessed on 10 January 2022).
  38. LIWC 2015 Software. API and UI for LIWC (Academic and Commercial Version). 2021. Available online: https://liwc.wpengine.com/ (accessed on 10 January 2022).
  39. Neogi, A.S.; Garg, K.A.; Mishra, R.K.; Dwivedi, Y.K. Sentiment analysis and classification of Indian farmers’ protest using twitter data. Int. J. Inf. Manag. Data Insights 2021, 1, 100019. [Google Scholar] [CrossRef]
  40. Saha, A.; Marouf, A.A.; Hossain, R. Sentiment analysis from depression-related user-generated contents from social media. In Proceedings of the 2021 8th International Conference on Computer and Communication Engineering (ICCCE), Kuala Lumpur, Malaysia, 22–23 June 2021; pp. 259–264. [Google Scholar]
  41. Gorodnichenko, Y.; Pham, T.; Talavera, O. Social Media, Sentimentand Public Opinions: Evidence from #Brexit and #Uselection; Working Paper 24631; National Bureau of Economic Research: Cambridge, MA, USA, 2018. [Google Scholar]
  42. Hendrayati, H.; Pamungkas, P. Viral marketing and e-word of mouth communication in social media marketing. In Proceedings of the 3rd Global Conference on Business, Management, and Entrepreneurship (GCBME 2018), Bandung, Indonesia, 8 August 2018; Atlantis Press: Paris, France, 2020; pp. 41–48. [Google Scholar]
  43. Lindhren, S. Akerlundm, TAPS: Tweets across the Political Spectrum 2016–2020. Preprint. 2022. Available online: https://osf.io/preprints/socarxiv/c7dqy/ (accessed on 10 January 2022).
Figure 1. Timeline of significant events related to SSR case. [SSR: Sushant Singh Rajput; FIR: First Information Report; ED: Enforcement Directorate; SCI: Supreme Court of India; CBI: Central Bureau of Investigation; NCB: Narcotics Control Bureau].
Figure 1. Timeline of significant events related to SSR case. [SSR: Sushant Singh Rajput; FIR: First Information Report; ED: Enforcement Directorate; SCI: Supreme Court of India; CBI: Central Bureau of Investigation; NCB: Narcotics Control Bureau].
Bdcc 06 00129 g001
Figure 2. Overview of proposed framework for detecting sentiment trend and emotion pattern.
Figure 2. Overview of proposed framework for detecting sentiment trend and emotion pattern.
Bdcc 06 00129 g002
Figure 3. Process of data collection from Twitter.
Figure 3. Process of data collection from Twitter.
Bdcc 06 00129 g003
Figure 4. Overview of proposed mechanism for sentiment detection and analysis.
Figure 4. Overview of proposed mechanism for sentiment detection and analysis.
Bdcc 06 00129 g004
Figure 5. Overview of proposed mechanism for emotion detection and analysis.
Figure 5. Overview of proposed mechanism for emotion detection and analysis.
Bdcc 06 00129 g005
Figure 6. Snapshot of LIWC features.
Figure 6. Snapshot of LIWC features.
Bdcc 06 00129 g006
Figure 7. Snapshot of Annotated Data.
Figure 7. Snapshot of Annotated Data.
Bdcc 06 00129 g007
Figure 8. Word cloud using the (a) #SSR, (b) #JusticeForSSR, (c) #WorldUnited4SSR, and (d) #Food4SSR.
Figure 8. Word cloud using the (a) #SSR, (b) #JusticeForSSR, (c) #WorldUnited4SSR, and (d) #Food4SSR.
Bdcc 06 00129 g008
Figure 9. Subjectivity vs. Polarity Graph for #SSR and #JusticeForSSR.
Figure 9. Subjectivity vs. Polarity Graph for #SSR and #JusticeForSSR.
Bdcc 06 00129 g009
Figure 10. Viral Hashtags detection using initial hashtag #SSR.
Figure 10. Viral Hashtags detection using initial hashtag #SSR.
Bdcc 06 00129 g010
Figure 11. Viral Hashtags detection using initial hashtag #JusticeForSSR.
Figure 11. Viral Hashtags detection using initial hashtag #JusticeForSSR.
Bdcc 06 00129 g011
Table 1. Statistics of data collected from Twitter.
Table 1. Statistics of data collected from Twitter.
PropertiesValues
No. of Unique Users1214
Total No. of Posts16,647
No. of Posts using #SSR9500
No. of Posts using #JusticeForSSR6200
No. of Posts using #WorldUnitedforSSR879
No. of Posts using #FeedFood4SSR68
Table 2. Statistics of the dataset after pre-processing.
Table 2. Statistics of the dataset after pre-processing.
PropertiesValues
No. of Unique Users1087
Total No. of Posts15,566
No. of Posts using #SSR8827
No. of Posts using #JusticeForSSR5897
No. of Posts using #WorldUnitedforSSR782
No. of Posts using #FeedFood4SSR60
Table 3. Pseudocode 1—Sentiment Detection and Annotation.
Table 3. Pseudocode 1—Sentiment Detection and Annotation.
Require: n > 0, where n is number be Twitter post
1. Initialize TextBlob
2. df = “Pre-processed Twitter posts”
3. getSubjectivity(df):
return TextBlob(text).sentiment.subjectivity
4. getPolarity(df):
return TextBlob(text).sentiment.polarity
5. df[’Subjectivity’] = df[’text’].apply(getSubjectivity)
6. df[’Polarity’] = df[’text’].apply(getPolarity)
7. getAnnotation(score):
8. if score < 0 then
9. return ’Negative’
10. else
11. if score == 0 then
12. return ’Neutral’
13. else
14. return ’Positive’
15. end if
16. end if
17. df[’Class’] = df[’Polarity’].apply(getAnnotation)
Table 4. Pseudocode 2—Emotion Detection and Annotation.
Table 4. Pseudocode 2—Emotion Detection and Annotation.
Require: n > 0, where n is number be Twitter post
1. Initialize LIWC and Tokenizer
2. df = “Pre-processed Twitter posts”
3. df tokens = tokenize (dataframe)
4. Import counter from collections
5. category counter = Counter (category for token in
dataframe tokens for category in parse(token))
6. Affect Category Counter = Segment emotional/affect
category features only
7. getAnnotation(Affect Category Counter):
8. switch max (Affect Category Counter) do
9. case PositiveEmotion:
10. return ’Positive’
11. case NegativeEmotion:
12. return ’Negative’
13. case Anxiety:
14. return ’Anxiety’
15. case Anger:
16. return ’Anger’
17. case Sad:
18. return ’Sad’
19. df[’Class’] =
df[’Affect Category Counter’].apply(getAnnotation)
Table 5. Emotion-related Feature Extraction.
Table 5. Emotion-related Feature Extraction.
Feature NameAbbreviationExamples
Affective ProcessAffectHappy, cried
Positive emotionPosemoLove, nice. Sweet
Negative EmotionNegemoHurt, ugly, nasty
AnxietyAnxWorried, fearful
AngerAngerHate, kill, annoyed
SadnessSadCrying, grief, sad
Table 6. Percentages of Sentiment Analysis.
Table 6. Percentages of Sentiment Analysis.
HashtagsPositiveNegativeNeutral
#SSR23.8%38.9%37.2%
#JusticeForSSR17.9%32.6%49.5%
#WorldUnitedForSSR17.2%36.7%46.1%
#FeedFood4SSR49.2%23.7%27.1%
#Plant4SSR51.2%19.7%29.1%
Table 7. Percentages of Emotion Analysis.
Table 7. Percentages of Emotion Analysis.
TagsPositiveNegativeAnxietyAngerSad
#SSR32.4%67.6%19.3%19.1%29.2%
#JusticeForSSR29.8%70.2%20.3%18.2%31.7%
#WorldUnitedForSSR30.9%69.1%21.5%19.5%28.1%
#FeedFood4SSR57.7%42.3%13.2%8.7%20.4%
#Plant4SSR63.1%36.9%10.8%7.2%18.9%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Marouf, A.A.; Rokne, J.G.; Alhajj, R. Detecting and Understanding Sentiment Trends and Emotion Patterns of Twitter Users—A Study on the Demise of a Bollywood Celebrity. Big Data Cogn. Comput. 2022, 6, 129. https://doi.org/10.3390/bdcc6040129

AMA Style

Marouf AA, Rokne JG, Alhajj R. Detecting and Understanding Sentiment Trends and Emotion Patterns of Twitter Users—A Study on the Demise of a Bollywood Celebrity. Big Data and Cognitive Computing. 2022; 6(4):129. https://doi.org/10.3390/bdcc6040129

Chicago/Turabian Style

Marouf, Ahmed Al, Jon G. Rokne, and Reda Alhajj. 2022. "Detecting and Understanding Sentiment Trends and Emotion Patterns of Twitter Users—A Study on the Demise of a Bollywood Celebrity" Big Data and Cognitive Computing 6, no. 4: 129. https://doi.org/10.3390/bdcc6040129

Article Metrics

Back to TopTop