Search Results (88)

Sentiment classification is a key technique for analyzing the emotional tendency of user reviews and is of great significance to movie recommendation systems. However, existing methods often face challenges in practical applications due to complex model structures, low computational efficiency, or difficulties in balancing local details with global contextual features. To address these issues, this paper proposes a Multi-Scale Feature Fusion Linear Attention model (MSFFLA). The model consists of three core modules: the BERT Encoder module for extracting basic semantic features; the Parallel Multi-scale Feature Extraction module (PMFE) , which employs multi-branch dilated convolutions to accurately capture local fine-grained features; and the Global Multi-scale Linear Feature Extraction module (MGLFE) , which introduces a Multi-Scale Linear Attention mechanism (MSLA) to efficiently model global contextual dependencies with approximately linear computational complexity. Extensive experiments were conducted on three public datasets: SST-2, Amazon Reviews, and MR. The results show that compared to the state-of-the-art BERT-CondConv model, our model achieves improvements in accuracy and F1-Score by 1.8% and 0.4%, respectively, on the SST-2 dataset, and by 1.5% and 0.3% on the Amazon Reviews dataset. This study not only validates the effectiveness of the proposed model but also provides an efficient and lightweight solution for sentiment classification tasks in movie recommendation systems, demonstrating promising practical application prospects. Full article

In recent years, social media-related sentiment classification has been researched extensively and is applied in various fields such as opinion mining, commodity feedback, and market analysis. Therefore, it is important to understand and analyse the opinions of the public, their feedback, and data related to social media. Consumers continue to face challenges in accessing review-based sentiment classification expressed by their peers, and the existing method does not provide satisfactory results. Hence, an innovative sentiment classification method, the Convoluted Graph Pyramid Attention (CGPA) model, combined with the Updated Greater Cane Rat Algorithm (UGCRA), is proposed. This method improves sentiment classification by optimizing accuracy and efficiency while addressing inherent uncertainties, allowing for precise sentiment intensity evaluation across multiple dimensions. Explainable Artificial Intelligence (XAI) techniques, particularly SHapley Additive exPlanations (SHAPs), enhance the model’s transparency and interpretability. This approach enables the final ranking of classified reviews, predicts ratings on a scale of one to five stars, and generates a recommendation list based on the predicted user ratings. Comparison between other traditional existing methods and the result indicates that the proposed method achieves superior performance. From the experimental results, the proposed approach achieves an accuracy of 99.5% in the Restaurant Review dataset, 99.8% in the Edmund Consumer Car Ratings Reviews dataset, 99.9% in the Flipkart Cell Phone Reviews dataset, and 99.7% in the IMDB Movie database, showing its effectiveness in analysing sentiments with an increase in performance. Full article

Aspect-based sentiment analysis (ABSA) plays a pivotal role in understanding the nuances of sentiment expressed in text, particularly in the context of diverse languages and cultures. This paper presents a novel deep convolutional neural network (CNN)-based model tailored for aspect and polarity classification in Hausa movie reviews, as Hausa is an underrepresented language with limited resources and presence in sentiment analysis research. One of the primary implications of this work is the creation of a comprehensive Hausa ABSA dataset, which addresses a significant gap in the availability of resources for sentiment analysis in underrepresented languages. This dataset fosters a more inclusive sentiment analysis landscape and advances research in languages with limited resources. The collected dataset was first preprocessed using Sci-Kit Learn to perform TF-IDF transformation for extracting feature word vector weights. Aspect-level feature ontology words within the analyzed text were derived, and the sentiment of the reviewed texts was manually annotated. The proposed model combines convolutional neural networks (CNNs) with an attention mechanism to aid aspect word prediction. The model utilizes sentences from the corpus and feature words as vector inputs to enhance prediction accuracy. The proposed model leverages the advantages of the convolutional and attention layers to extract contextual information and sentiment polarities from Hausa movie reviews. The performance demonstrates the applicability of such models to underrepresented languages. With 91% accuracy on aspect term extraction and 92% on sentiment polarity classification, the model excels in aspect identification and sentiment analysis, offering insights into specific aspects of interest and their associated sentiments. The proposed model outperformed traditional machine models in both aspect word and polarity prediction. Through the creation of the Hausa ABSA dataset and the development of an effective model, this study makes significant advances in ABSA research. It has wide-ranging implications for the sentiment analysis field in the context of underrepresented languages. Full article

Adversarial attacks in Natural Language Processing (NLP) present a critical challenge, particularly in sentiment analysis, where subtle input modifications can significantly alter model predictions. In search of more robust defenses against adversarial attacks on sentimental analysis, this research work introduces two novel defense mechanisms: the Lexicon-Based Random Substitute Model (LRSM) and the Word-Variant Voting Model (WVVM). LRSM employs randomized substitutions from a dataset-specific lexicon to generate diverse input variations, disrupting adversarial strategies by introducing unpredictability. Unlike traditional defenses requiring synonym dictionaries or precomputed semantic relationships, LRSM directly substitutes words with random lexicon alternatives, reducing overhead while maintaining robustness. Notably, LRSM not only neutralizes adversarial perturbations but occasionally surpasses the original accuracy by correcting inherent model misclassifications. Building on LRSM, WVVM integrates LRSM, Frequency-Guided Word Substitution (FGWS), and Synonym Random Substitution and Voting (RS&V) in an ensemble framework that adaptively combines their outputs. Logistic Regression (LR) emerged as the optimal ensemble configuration, leveraging its regularization parameters to balance the contributions of individual defenses. WVVM consistently outperformed standalone defenses, demonstrating superior restored accuracy and F1 scores across adversarial scenarios. The proposed defenses were evaluated on two well-known sentiment analysis benchmarks: the IMDB Sentiment Dataset and the Yelp Polarity Dataset. The IMDB dataset, comprising 50,000 labeled movie reviews, and the Yelp Polarity dataset, containing labeled business reviews, provided diverse linguistic challenges for assessing adversarial robustness. Both datasets were tested using 4000 adversarial examples generated by established attacks, including Probability Weighted Word Saliency, TextFooler, and BERT-based Adversarial Examples. WVVM and LRSM demonstrated superior performance in restoring accuracy and F1 scores across both datasets, with WVVM excelling through its ensemble learning framework. LRSM improved restored accuracy from 75.66% to 83.7% when compared to the second-best individual model, RS&V, while the Support Vector Classifier WVVM variation further improved restored accuracy to 93.17%. Logistic Regression WVVM achieved an F1 score of 86.26% compared to 76.80% for RS&V. These findings establish LRSM and WVVM as robust frameworks for defending against adversarial text attacks in sentiment analysis. Full article

For the process of covert transmission of text information, in addition to the need to ensure the quality of the text at the same time, it is also necessary to make the text content match the current context. However, the existing text steganography methods excessively pursue the quality of the text, and lack constraints on the content and emotional expression of the generated steganographic text (stegotext). In order to solve this problem, this paper proposes an emotionally controllable text steganography based on large language model and named entity. The large language model is used for text generation to improve the quality of the generated stegotext. The named entity recognition is used to construct an entity extraction module to obtain the current context-centered text and constrain the text generation content. The sentiment analysis method is used to mine the sentiment tendency so that the stegotext contains rich sentiment information and improves its concealment. Through experimental validation on the generic domain movie reviews dataset IMDB, the results prove that the proposed method has significantly improved hiding capacity, perplexity, and security compared with the existing mainstream methods, and the stegotext has a strong connection with the current context. Full article

In this study, we present a groundbreaking approach to aspect-based sentiment analysis (ABSA) using transformer-based models. ABSA is essential for understanding the intricate nuances of sentiment expressed in text, particularly across diverse linguistic and cultural contexts. Focusing on movie reviews in Hausa, a language under-represented in sentiment analysis research, we propose HauBERT, a bidirectional transformer-based approach tailored for aspect and polarity classification, by fine-tuning a pre-trained mBERT model. Our work addresses the scarcity of resources for sentiment analysis in under-represented languages by creating a comprehensive Hausa ABSA dataset. Leveraging this dataset, we preprocess the text using state-of-the-art techniques for feature extraction, enhancing the model’s ability to capture nuanced aspects of sentiment. Furthermore, we manually annotate aspect-level feature ontology words and sentiment polarity assignments within the reviewed text, enriching the dataset with valuable semantic information. Our proposed transformer-based model utilizes self-attention mechanisms to capture long-range dependencies and contextual information, enabling it to effectively analyze sentiment in Hausa movie reviews. The proposed model achieves significant accuracy in aspect term extraction and sentiment polarity classification, with scores of 99% and 92% respectively, outperforming traditional machine models. This demonstrates the transformer’s ability to capture complex linguistic patterns and nuances of sentiment. Our study advances ABSA research and contributes to a more inclusive sentiment analysis landscape by providing resources and models tailored for under-represented languages. Full article

Artificial Intelligence (AI) models, including deep learning and rule-based approaches, often function as black boxes, limiting transparency and increasing uncertainty in decisions. This study addresses spurious correlations, defined as associations between patterns and classes that do not reflect causal relationships, affecting AI models’ reliability and applicability. In Natural Language Processing (NLP), these correlations lead to inaccurate predictions, biases, and challenges in model generalization. We propose a method that employs Explainable Artificial Intelligence (XAI) techniques to detect spurious patterns in textual datasets for binary classification tasks. The method applies the K-means algorithm to cluster patterns and interprets them based on their distance from centroids. It hypothesizes that patterns farther from the centroids are more likely to be spurious than those closer to them. We apply the method to public procurement datasets from the Court of Auditors of Piauí (TCE-PI) using models based on Support Vector Machine (SVM) and Logistic Regression with text representations from TFIDF and Word Embeddings, as well as a BERT model. The analysis is extended to the IMDB movie review dataset to evaluate generalizability. The results support the hypothesis that patterns farther from centroids exhibit higher spuriousness potential and demonstrate the clustering’s consistency across models and datasets. The method operates independently of the techniques used in its stages, enabling the automatic detection and quantification of spurious patterns without prior human intervention. Full article

We propose a novel recommendation model for diversifying furniture recommendations and aligning them more closely with user preferences. Our model builds upon the Recommender Variational Autoencoder (RecVAE), known for its effectiveness and ability to overcome overfitting by linking user feedback with user representation. However, since RecVAE relies on implicit feedback data, it tends to exhibit bias towards popular items, potentially creating a recommendation filter bubble. While previous work has proposed user profiles learned from a user’s personal information and the textual data of an item, we propose user profiles generated from the image data on the item given the points of interest when selecting items in e-commerce and the ease of data acquisition. We hypothesize that to capture user preferences and provide tailored furniture recommendations accurately, it is essential to incorporate both reviewed text information and visual data on furniture pieces. To utilize user preferences well, we incorporate the Conditional Variational Autoencoder (CVAE) architecture, where both the encoder and decoder are conditioned on a user profile indicating the user’s preference information. Additionally, the user profile is trained to capture the user’s preference for a specific predefined style. We trained our models using MovieLens-20M and the Amazon Furniture Review Dataset, a new dataset dedicated to furniture recommendations. As a result, on both datasets, our model outperformed previous models, including RecVAE. These findings show the effectiveness of our user profile approach in diversifying and personalizing furniture recommendations. Full article

Sentiment analysis via artificial intelligence, i.e., machine learning and large language models (LLMs), is a pivotal tool that classifies sentiments within texts as positive, negative, or neutral. It enables computers to automatically detect and interpret emotions from textual data, covering a spectrum of feelings without direct human intervention. Sentiment analysis is integral to marketing research, helping to gauge consumer emotions and opinions across various sectors. Its applications span analyzing movie reviews, monitoring social media, evaluating product feedback, assessing employee sentiments, and identifying hate speech. This study explores the application of both traditional machine learning and pre-trained LLMs for automated sentiment analysis of customer product reviews. The motivation behind this work lies in the demand for more nuanced understanding of consumer sentiments that can drive data-informed business decisions. In this research, we applied machine learning-based classifiers, i.e., Random Forest, Naive Bayes, and Support Vector Machine, alongside the GPT-4 model to benchmark their effectiveness for sentiment analysis. Traditional models show better results and efficiency in processing short, concise text, with SVM in classifying sentiment of short length comments. However, GPT-4 showed better results with more detailed texts, capturing subtle sentiments with higher precision, recall, and F1 scores to uniquely identify mixed sentiments not found in the simpler models. Conclusively, this study shows that LLMs outperform traditional models in context-rich sentiment analysis by not only providing accurate sentiment classification but also insightful explanations. These results enable LLMs to provide a superior tool for customer-centric businesses, which helps actionable insights to be derived from any textual data. Full article

Online product reviews provide valuable insights on user experiences and product qualities. However, issues such as information overload and the limited utilization of review features persist, particularly in personalized rankings for popular items like movies. To address these challenges—information overload in online reviews, limited review feature utilization, and personalized decision-making for high-demand products like movies—we introduce a personalized online decision-making framework that integrates a sentiment model for product attributes with an enhanced hesitant fuzzy scoring function. This framework incorporates the concept of symmetry in sentiment analysis. It employs feature words, sentiment terms, and modifiers to assess user sentiments within a hesitant fuzzy setting, utilizing symmetrical relationships between positive and negative sentiments. The improved fuzzy score function efficiently quantifies sentiment values for product features by considering the symmetrical balance of user opinions. Additionally, review quality assessment incorporates both content and reviewer characteristics, resulting in final attribute evaluations. An attribute weighting system, tailored to diverse product types, further captures product specifics and user inclinations, leveraging symmetry to balance varying user preferences. Validation through multi-genre movie sorting demonstrates the method’s capacity to handle review data across varied products and user tastes, offering a robust tool for enhancing online decision quality, especially for high-demand items. Full article

Sentiment analysis is a well-known task that has been used to analyse customer feedback reviews and media headlines to detect the sentimental personality or polarisation of a given text. With the growth of social media and other online platforms, like Twitter (now branded as X), Facebook, blogs, and others, it has been used in the investment community to monitor customer feedback, reviews, and news headlines about financial institutions’ products and services to ensure business success and prioritise aspects of customer relationship management. Supervised learning algorithms have been popularly employed for this task, but the performance of these models has been compromised due to the brevity of the content and the presence of idiomatic expressions, sound imitations, and abbreviations. Additionally, the pre-training of a larger language model (PTLM) struggles to capture bidirectional contextual knowledge learnt through word dependency because the sentence-level representation fails to take broad features into account. We develop a novel structure called language feature extraction and adaptation for reviews (LFEAR), an advanced natural language model that amalgamates retrieval-augmented generation (RAG) with a conversation format for an auto-regressive fine-tuning model (ARFT). This helps to overcome the limitations of lexicon-based tools and the reliance on pre-defined sentiment lexicons, which may not fully capture the range of sentiments in natural language and address questions on various topics and tasks. LFEAR is fine-tuned on Hellopeter reviews that incorporate industry-specific contextual information retrieval to show resilience and flexibility for various tasks, including analysing sentiments in reviews of restaurants, movies, politics, and financial products. The proposed model achieved an average precision score of 98.45%, answer correctness of 93.85%, and context precision of 97.69% based on Retrieval-Augmented Generation Assessment (RAGAS) metrics. The LFEAR model is effective in conducting sentiment analysis across various domains due to its adaptability and scalable inference mechanism. It considers unique language characteristics and patterns in specific domains to ensure accurate sentiment annotation. This is particularly beneficial for individuals in the financial sector, such as investors and institutions, including those listed on the Johannesburg Stock Exchange (JSE), which is the primary stock exchange in South Africa and plays a significant role in the country’s financial market. Future initiatives will focus on incorporating a wider range of data sources and improving the system’s ability to express nuanced sentiments effectively, enhancing its usefulness in diverse real-world scenarios. Full article

In today’s digital era, the abundance of online services presents users with a daunting array of choices, spanning from streaming platforms to e-commerce websites, leading to decision fatigue. Recommendation algorithms play a pivotal role in aiding users in navigating this plethora of options, among which collaborative filtering (CF) stands out as a prevalent technique. However, CF encounters several challenges, including scalability issues, privacy implications, and the well-known cold start problem. This study endeavors to mitigate the cold start problem by harnessing the capabilities of natural language processing (NLP) applied to user-generated reviews. A unique methodology is introduced, integrating both supervised and unsupervised NLP approaches facilitated by sci-kit learn, utilizing benchmark datasets across diverse domains. This study offers scientific contributions through its novel approach, ensuring rigor, precision, scalability, and real-world relevance. It tackles the cold start problem in recommendation systems by combining natural language processing (NLP) with machine learning and collaborative filtering techniques, addressing data sparsity effectively. This study emphasizes reproducibility and accuracy while proposing an advanced solution that improves personalization in recommendation models. The proposed NLP-based strategy enhances the quality of user-generated content, consequently refining the accuracy of Collaborative Filtering-Based Recommender Systems (CFBRSs). The authors conducted experiments to test the performance of the proposed approach on benchmark datasets like MovieLens, Jester, Book-Crossing, Last.fm, Amazon Product Reviews, Yelp, Netflix Prize, Goodreads, IMDb (Internet movie Database) Data, CiteULike, Epinions, and Etsy to measure global accuracy, global loss, F-1 Score, and AUC (area under curve) values. Assessment through various techniques such as random forest, Naïve Bayes, and Logistic Regression on heterogeneous benchmark datasets indicates that random forest is the most effective method, achieving an accuracy rate exceeding 90%. Further, the proposed approach received a global accuracy above 95%, a global loss of 1.50%, an F-1 Score of 0.78, and an AUC value of 92%. Furthermore, the experiments conducted on distributed and global differential privacy (GDP) further optimize the system’s efficacy. Full article

In the face of complex user behavior patterns and massive data, improving the performance of recommender system models is an urgent challenge. Traditional methods often struggle to effectively handle feature interactions and complex user-item relationships. Combining the advantages of graph neural networks and the Deep Crossing network, this paper proposes a recommendation method based on hybrid neural networks with Deep Crossing (Deep Crossing with Graph Convolution and GRU, DCGCN-GRU). First, by constructing the graph structure of users and items, higher-order feature representations are extracted, and node features are updated using a multilayer graph convolution operation. Then, the higher-order features learned by the graph convolution network are spliced and weighted with the original features to form new feature inputs. Next, a Gated Recurrent Unit (GRU) is introduced to capture the inter-feature temporal dynamic relationships and sequence information. Finally, the Deep Crossing model is utilized to learn the interactions between the fused features at multiple levels and enhance the interactions between the features. Comparative experiments on three public datasets, MovieLens-ml-25m, Book-Crossings, and Amazon Reviews’23, show that the model achieves significant improvements in accuracy, mean square error (MSE), and mean absolute error (MAE). Full article

This article contextualises the history of kaijū scholarship and looks particularly at the swell of publishing that has emerged in the last decade. It argues that the release of a series of new Godzilla films has led to a greater focus on the kaijū film, but that there is recurrence of critical themes that have persisted throughout scholarship on giant monster movies since the 1960s. This provides a literature review to understand how kaijū media has been critiqued, defined and challenged in response to the near three-quarter century history of kaijū cinema to consider if studies of the kaijū media provide the impetus to look at the kaijū as deserving of its own field of study. If zombie studies and vampire studies can occupy their own emerging fields of study, why not the kaijū? If the figure of the kaijū asks the biggest questions of our cultures, then do the giant monsters not deserve their own field? But, if this is an emerging field of study, the article poses, it needs to be more than kaijū film studies. Full article

This paper proposes a new robust model for text classification on the Stanford Sentiment Treebank v2 (SST-2) dataset in terms of model accuracy. We developed a Recurrent Neural Network Bert based (RNN_Bert_based) model designed to improve classification accuracy on the SST-2 dataset. This dataset consists of movie review sentences, each labeled with either positive or negative sentiment, making it a binary classification task. Recurrent Neural Networks (RNNs) are effective for text classification because they capture the sequential nature of language, which is crucial for understanding context and meaning. Bert excels in text classification by providing bidirectional context, generating contextual embeddings, and leveraging pre-training on large corpora. This allows Bert to capture nuanced meanings and relationships within the text effectively. Combining Bert with RNNs can be highly effective for text classification. Bert’s bidirectional context and rich embeddings provide a deep understanding of the text, while RNNs capture sequential patterns and long-range dependencies. Together, they leverage the strengths of both architectures, leading to improved performance on complex classification tasks. Next, we also developed an integration of the Bert model and a K-Nearest Neighbor based (KNN_Bert_based) method as a comparative scheme for our proposed work. Based on the results of experimentation, our proposed model outperforms traditional text classification models as well as existing models in terms of accuracy. Full article