Skip to Content

2,585 Results Found

  • Article
  • Open Access
6 Citations
5,422 Views
7 Pages

A Lite Romanian BERT: ALR-BERT

  • Dragoş Constantin Nicolae,
  • Rohan Kumar Yadav and
  • Dan Tufiş

Large-scale pre-trained language representation and its promising performance in various downstream applications have become an area of interest in the field of natural language processing (NLP). There has been huge interest in further increasing the...

  • Article
  • Open Access
38 Citations
4,776 Views
16 Pages

IUP-BERT: Identification of Umami Peptides Based on BERT Features

  • Liangzhen Jiang,
  • Jici Jiang,
  • Xiao Wang,
  • Yin Zhang and ,
  • Bowen Zheng,
  • Shuqi Liu,
  • Yiting Zhang,
  • Changying Liu,
  • Yan Wan and
  • Zhibin Lv
  • + 6 authors+ 1 author

21 November 2022

Umami is an important widely-used taste component of food seasoning. Umami peptides are specific structural peptides endowing foods with a favorable umami taste. Laboratory approaches used to identify umami peptides are time-consuming and labor-inten...

(This article belongs to the Special Issue Identification, Changes and Regulation of Flavor-Active Compound in Food Processing)
  • Article
  • Open Access
12 Citations
5,777 Views
14 Pages

11 November 2022

In recent years, Natural Language Processing (NLP) has become increasingly important for extracting new insights from unstructured text data, and pre-trained language models now have the ability to perform state-of-the-art tasks like topic modeling,...

(This article belongs to the Collection Digital Systems for Tourism)
  • Article
  • Open Access
6 Citations
5,784 Views
20 Pages

DynGraph-BERT: Combining BERT and GNN Using Dynamic Graphs for Inductive Semi-Supervised Text Classification

  • Eliton Luiz Scardin Perin,
  • Mariana Caravanti de Souza,
  • Jonathan de Andrade Silva and
  • Edson Takashi Matsubara

The combination of Bidirecional Encoder Representations from Transformers (BERT) and Graph Neural Networks (GNNs) has been extensively explored in the text classification literature, usually employing BERT as a feature extractor combined with heterog...

(This article belongs to the Section Machine Learning)
  • Article
  • Open Access
104 Citations
16,803 Views
10 Pages

28 January 2022

The task of summarization can be categorized into two methods, extractive and abstractive. Extractive summarization selects the salient sentences from the original document to form a summary while abstractive summarization interprets the original doc...

(This article belongs to the Special Issue Novel Methods and Applications in Natural Language Processing)
  • Feature Paper
  • Article
  • Open Access
14 Citations
7,248 Views
19 Pages

BERT4Loc: BERT for Location—POI Recommender System

  • Syed Raza Bashir,
  • Shaina Raza and
  • Vojislav B. Misic

Recommending points of interest (POI) is a challenging task that requires extracting comprehensive location data from location-based social media platforms. To provide effective location-based recommendations, it is important to analyze users’ histor...

(This article belongs to the Section Techno-Social Smart Systems)
  • Article
  • Open Access
85 Citations
18,021 Views
23 Pages

CyBERT: Cybersecurity Claim Classification by Fine-Tuning the BERT Language Model

  • Kimia Ameri,
  • Michael Hempel,
  • Hamid Sharif,
  • Juan Lopez Jr. and
  • Kalyan Perumalla

4 November 2021

We introduce CyBERT, a cybersecurity feature claims classifier based on bidirectional encoder representations from transformers and a key component in our semi-automated cybersecurity vetting for industrial control systems (ICS). To train CyBERT, we...

(This article belongs to the Collection Machine Learning and Data Analytics for Cyber Security)
  • Article
  • Open Access
40 Citations
13,115 Views
26 Pages

18 September 2024

This paper proposes a new robust model for text classification on the Stanford Sentiment Treebank v2 (SST-2) dataset in terms of model accuracy. We developed a Recurrent Neural Network Bert based (RNN_Bert_based) model designed to improve classificat...

(This article belongs to the Special Issue Natural Language Processing: Novel Methods and Applications)
  • Article
  • Open Access
249 Citations
23,187 Views
14 Pages

A BERT Framework to Sentiment Analysis of Tweets

  • Abayomi Bello,
  • Sin-Chun Ng and
  • Man-Fai Leung

2 January 2023

Sentiment analysis has been widely used in microblogging sites such as Twitter in recent decades, where millions of users express their opinions and thoughts because of its short and simple manner of expression. Several studies reveal the state of se...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
16 Citations
4,169 Views
22 Pages

2 February 2023

Drug-drug interaction (DDI) extraction has seen growing usage of deep models, but their effectiveness has been restrained by limited domain-labeled data, a weak representation of co-occurring entities, and poor adaptation of downstream tasks. This pa...

(This article belongs to the Special Issue Symmetry/Asymmetry and Fuzzy Systems)
  • Article
  • Open Access
5 Citations
3,776 Views
18 Pages

11 November 2023

In the realm of aviation, trajectory data play a crucial role in determining the target’s flight intentions and guaranteeing flight safety. However, the data collection process can be hindered by noise or signal interruptions, thus diminishing...

(This article belongs to the Topic Target Tracking, Guidance, and Navigation for Autonomous Systems)
  • Communication
  • Open Access
17 Citations
5,371 Views
12 Pages

Spatial-Spectral BERT for Hyperspectral Image Classification

  • Mahmood Ashraf,
  • Xichuan Zhou,
  • Gemine Vivone,
  • Lihui Chen and ,
  • Rong Chen and
  • Reza Seifi Majdard
  • + 1 author+ 0 author

31 January 2024

Several deep learning and transformer models have been recommended in previous research to deal with the classification of hyperspectral images (HSIs). Among them, one of the most innovative is the bidirectional encoder representation from transforme...

(This article belongs to the Topic Hyperspectral Imaging and Signal Processing)
  • Article
  • Open Access
65 Citations
10,491 Views
23 Pages

aeroBERT-Classifier: Classification of Aerospace Requirements Using BERT

  • Archana Tikayat Ray,
  • Bjorn F. Cole,
  • Olivia J. Pinon Fischer,
  • Ryan T. White and
  • Dimitri N. Mavris

The system complexity that characterizes current systems warrants an integrated and comprehensive approach to system design and development. This need has brought about a paradigm shift towards Model-Based Systems Engineering (MBSE) approaches to sys...

(This article belongs to the Special Issue Machine Learning for Aeronautics)
  • Article
  • Open Access
355 Views
35 Pages

16 September 2026

Rapid release cycles and user-centric design have transformed requirement engineering into a continuous process within software development. Analyzing user-generated feedback from diverse online platforms is essential for feature prioritization. Whil...

(This article belongs to the Special Issue Advances in Data-Driven Artificial Intelligence, 2nd Edition)
  • Review
  • Open Access
176 Citations
18,437 Views
20 Pages

4 June 2022

Bidirectional Encoder Representations from Transformers (BERT) has gained increasing attention from researchers and practitioners as it has proven to be an invaluable technique in natural languages processing. This is mainly due to its unique feature...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
1,453 Views
18 Pages

SpADE-BERT: Multilingual BERT-Based Model with Trigram-Sensitive Tokenization, Tuned for Depression Detection in Spanish Texts

  • Abdiel Reyes-Vera,
  • Magdalena Saldana-Perez,
  • Marco Moreno-Ibarra and
  • Juan Pablo Francisco Posadas-Durán

1 February 2026

This article proposes an automated approach, based on artificial intelligence techniques, for detecting indicators of depression in texts written in Spanish. Among the main contributions is the construction of a new specialized corpus, supervised by...

(This article belongs to the Topic Applications of NLP, AI, and ML in Software Engineering)
  • Article
  • Open Access
3 Citations
4,481 Views
20 Pages

A Green AI Methodology Based on Persistent Homology for Compressing BERT

  • Luis Balderas,
  • Miguel Lastra and
  • José M. Benítez

3 January 2025

Large Language Models (LLMs) like BERT have gained significant prominence due to their remarkable performance in various natural language processing tasks. However, they come with substantial computational and memory costs. Additionally, they are ess...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
7 Citations
4,834 Views
13 Pages

One of the most harmful and deceptive forms of cybercrime is phishing, which targets users with malicious emails and websites. In this paper, we focus on the use of natural language processing (NLP) techniques and transformer models for phishing emai...

(This article belongs to the Special Issue Sentiment-Driven Modelling in Business, Economics, and Social Sciences)
  • Article
  • Open Access
6 Citations
1,780 Views
18 Pages

Enhanced Semantic BERT for Named Entity Recognition in Education

  • Ping Huang,
  • Huijuan Zhu,
  • Ying Wang,
  • Lili Dai and
  • Lei Zheng

7 October 2025

To address the technical challenges in the educational domain named entity recognition (NER), such as ambiguous entity boundaries and difficulties with nested entity identification, this study proposes an enhanced semantic BERT model (ES-BERT). The m...

(This article belongs to the Special Issue Advances in Intelligent Data Analysis and Its Applications, 3rd Edition)
  • Article
  • Open Access
12 Citations
4,857 Views
18 Pages

Synonyms, Antonyms and Factual Knowledge in BERT Heads

  • Lorenzo Serina,
  • Luca Putelli,
  • Alfonso Emilio Gerevini and
  • Ivan Serina

In recent years, many studies have been devoted to discovering the inner workings of Transformer-based models, such as BERT, for instance, attempting to identify what information is contained within them. However, little is known about how these mode...

(This article belongs to the Section Big Data and Augmented Intelligence)
  • Article
  • Open Access
8 Citations
6,382 Views
25 Pages

Polarity of Yelp Reviews: A BERT–LSTM Comparative Study

  • Rachid Belaroussi,
  • Sié Cyriac Noufe,
  • Francis Dupin and
  • Pierre-Olivier Vandanjon

With the rapid growth in social network comments, the need for more effective methods to classify their polarity—negative, neutral, or positive—has become essential. Sentiment analysis, powered by natural language processing, has evolved...

(This article belongs to the Special Issue Advances in Natural Language Processing and Text Mining)
  • Article
  • Open Access
68 Citations
7,882 Views
15 Pages

Fine-tuning of BERT Model to Accurately Predict Drug–Target Interactions

  • Hyeunseok Kang,
  • Sungwoo Goo,
  • Hyunjung Lee,
  • Jung-woo Chae and ,
  • Hwi-yeol Yun and
  • Sangkeun Jung
  • + 1 author+ 0 author

The identification of optimal drug candidates is very important in drug discovery. Researchers in biology and computational sciences have sought to use machine learning (ML) to efficiently predict drug–target interactions (DTIs). In recent year...

(This article belongs to the Special Issue Computational Intelligence (CI) Tools in Drug Discovery and Design)
  • Article
  • Open Access
12 Citations
3,726 Views
32 Pages

GRU-BERT for NILM: A Hybrid Deep Learning Architecture for Load Disaggregation

  • Annysha Huzzat,
  • Ahmed S. Khwaja,
  • Ali A. Alnoman,
  • Bhagawat Adhikari and ,
  • Alagan Anpalagan and
  • Isaac Woungang
  • + 1 author+ 0 author

22 September 2025

Non-Intrusive Load Monitoring (NILM) aims to disaggregate a household’s total aggregated power consumption into appliance-level usage, enabling intelligent energy management without the need for intrusive metering. While deep learning has impro...

(This article belongs to the Section AI Systems: Theory and Applications)
  • Article
  • Open Access
39 Citations
5,862 Views
15 Pages

Arabic Gloss WSD Using BERT

  • Mohammed El-Razzaz,
  • Mohamed Waleed Fakhr and
  • Fahima A. Maghraby

13 March 2021

Word Sense Disambiguation (WSD) aims to predict the correct sense of a word given its context. This problem is of extreme importance in Arabic, as written words can be highly ambiguous; 43% of diacritized words have multiple interpretations and the p...

(This article belongs to the Special Issue 10th Anniversary of Applied Sciences: Invited Papers in Computing and Artificial Intelligence Section)
  • Article
  • Open Access
6 Citations
3,848 Views
19 Pages

17 June 2025

Improving medical text intent classification accuracy can assist the medical field in achieving more precise diagnoses. However, existing methods suffer from problems such as low accuracy and a lack of knowledge supplementation. To address these chal...

(This article belongs to the Special Issue Digital Innovations in Healthcare)
  • Article
  • Open Access
1 Citations
3,140 Views
15 Pages

4 October 2024

The low-Earth-orbit satellite internet supports the transmission of multiple business types. With increasing business volume and advancements in encryption technology, the quality of service faces challenges. Traditional models lack flexibility in op...

(This article belongs to the Special Issue Editorial Board Members’ Collection Series: Smart Cities/From 5G to 6G/Digital Twins)
  • Article
  • Open Access
400 Views
12 Pages

EDBERT: Predicting Emergency Department Disposition Using a BERT-Based Architecture

  • Md Ali Hossain,
  • Krishan Chavinda,
  • Mitchell D. Woodbright,
  • Isuru Senadheera and ,
  • Srikandabala Kogul,
  • Sam Freeman,
  • Mark Putland,
  • Hamed Akhlaghi,
  • Damminda Alahakoon and
  • Md Anisur Rahman
  • + 5 authors+ 0 author

30 August 2026

Objective: To develop and evaluate EDBERT (Emergency Department Bidirectional Encoder Representations from Transformers), a BERT-based architecture built around a multi-input fusion network that enriches free-text triage notes with the additional con...

(This article belongs to the Special Issue Algorithms in Data Classification (4th Edition))
  • Article
  • Open Access
57 Citations
12,894 Views
16 Pages

26 October 2022

The Internet of Things is a paradigm that interconnects several smart devices through the internet to provide ubiquitous services to users. This paradigm and Web 2.0 platforms generate countless amounts of textual data. Thus, a significant challenge...

(This article belongs to the Special Issue Sensors Data Processing Using Machine Learning)
  • Article
  • Open Access
5 Citations
6,392 Views
19 Pages

22 March 2023

In this study, we developed a similar text retrieval system using Sentence-BERT (SBERT) for our database of closed medical malpractice claims and investigated its retrieval accuracy. We assigned each case in the database a short Japanese summary of t...

  • Article
  • Open Access
11 Citations
7,531 Views
17 Pages

An Empirical Comparison of Portuguese and Multilingual BERT Models for Auto-Classification of NCM Codes in International Trade

  • Roberta Rodrigues de Lima,
  • Anita M. R. Fernandes,
  • James Roberto Bombasar,
  • Bruno Alves da Silva and ,
  • Paul Crocker and
  • Valderi Reis Quietinho Leithardt
  • + 1 author+ 0 author

Classification problems are common activities in many different domains and supervised learning algorithms have shown great promise in these areas. The classification of goods in international trade in Brazil represents a real challenge due to the co...

  • Article
  • Open Access
32 Citations
5,510 Views
9 Pages

Fine-Tuning BERT Models to Classify Misinformation on Garlic and COVID-19 on Twitter

  • Myeong Gyu Kim,
  • Minjung Kim,
  • Jae Hyun Kim and
  • Kyungim Kim

Garlic-related misinformation is prevalent whenever a virus outbreak occurs. With the outbreak of COVID-19, garlic-related misinformation is spreading through social media, including Twitter. Bidirectional Encoder Representations from Transformers (B...

(This article belongs to the Topic Fighting against COVID-19: Latest Advances, Challenges and Methodologies)
  • Article
  • Open Access
1 Citations
1,350 Views
18 Pages

Explainable Structured Pruning of BERT via Mutual Information

  • Hanjuan Huang,
  • Hao-Jia Song and
  • Qiling Zhao

2 December 2025

Bidirectional Encoder Representations from Transformers (BERT) excels in natural language processing (NLP) but is costly on edge devices. We introduce an unsupervised, retraining-free structured pruning scheme for BERT, guided by mutual information (...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
105 Views
18 Pages

9 November 2026

Financial sentiment analysis remains challenging due to the complexity of natural language, specialized financial terminology and the need for interpretable predictions in high-stakes applications. Although FinBERT provides strong contextual language...

(This article belongs to the Special Issue Deep Learning and Explainable Artificial Intelligence (2nd Edition))
  • Article
  • Open Access
3 Citations
4,065 Views
21 Pages

Comparative Analysis of BERT and GPT for Classifying Crisis News with Sudan Conflict as an Example

  • Yahya Masri,
  • Zifu Wang,
  • Anusha Srirenganathan Malarvizhi,
  • Samir Ahmed and ,
  • Tayven Stover,
  • David W. S. Wong,
  • Yongyao Jiang,
  • Yun Li,
  • Qian Liu and
  • Chaowei Yang
  • + 8 authors+ 3 authors

8 July 2025

To obtain actionable information for humanitarian and other emergency responses, an accurate classification of news or events is critical. Daily news and social media are hard to classify based on conveyed information, especially when multiple catego...

(This article belongs to the Special Issue Evolution of Algorithms in the Era of Generative AI)
  • Article
  • Open Access
7 Citations
3,517 Views
26 Pages

Symmetry and Asymmetry in Pre-Trained Transformer Models: A Comparative Study of TinyBERT, BERT, and RoBERTa for Chinese Educational Text Classification

  • Munire Muhetaer,
  • Xiaoyan Meng,
  • Jing Zhu,
  • Aixiding Aikebaier and ,
  • Liyaer Zu and
  • Yawen Bai
  • + 1 author+ 0 author

27 October 2025

With the advancement of educational informatization, vast amounts of Chinese text are generated across online platforms and digital textbooks. Effectively classifying such text is essential for intelligent education systems. This study conducts a sys...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
19 Citations
6,449 Views
13 Pages

Bert-Based Latent Semantic Analysis (Bert-LSA): A Case Study on Geospatial Data Technology and Application Trend Analysis

  • Quanying Cheng,
  • Yunqiang Zhu,
  • Jia Song,
  • Hongyun Zeng and ,
  • Shu Wang,
  • Kai Sun and
  • Jinqu Zhang
  • + 2 authors+ 0 author

14 December 2021

Geospatial data is an indispensable data resource for research and applications in many fields. The technologies and applications related to geospatial data are constantly advancing and updating, so identifying the technologies and applications among...

(This article belongs to the Special Issue Current Approaches and Applications in Natural Language Processing)
  • Article
  • Open Access
19 Citations
5,154 Views
14 Pages

Attention-Enriched Mini-BERT Fake News Analyzer Using the Arabic Language

  • Husam M. Alawadh,
  • Amerah Alabrah,
  • Talha Meraj and
  • Hafiz Tayyab Rauf

22 January 2023

Internet use resulted in people becoming more reliant on social media. Social media have become the main source of fake news or rumors. They spread uncertainty in each sector of the real world, whether in politics, sports, or celebrities’ lives...

(This article belongs to the Special Issue Deep Learning and Natural Language Processing)
  • Article
  • Open Access
26 Citations
7,816 Views
16 Pages

Research on Log Anomaly Detection Based on Sentence-BERT

  • Caiping Hu,
  • Xuekui Sun,
  • Hua Dai,
  • Hangchuan Zhang and
  • Haiqiang Liu

24 August 2023

Log anomaly detection is crucial for computer systems. By analyzing and processing the logs generated by a system, abnormal events or potential problems in the system can be identified, which is helpful for its stability and reliability. At present,...

(This article belongs to the Special Issue Computational Intelligence and Machine Learning: Models and Applications)
  • Article
  • Open Access
17 Citations
4,846 Views
15 Pages

Boosting the Transformer with the BERT Supervision in Low-Resource Machine Translation

  • Rong Yan,
  • Jiang Li,
  • Xiangdong Su,
  • Xiaoming Wang and
  • Guanglai Gao

17 July 2022

Previous works trained the Transformer and its variants end-to-end and achieved remarkable translation performance when there are huge parallel sentences available. However, these models suffer from the data scarcity problem in low-resource machine t...

(This article belongs to the Special Issue Natural Language Processing (NLP) and Applications)
  • Article
  • Open Access
162 Citations
17,904 Views
14 Pages

21 January 2023

Sentiment analysis has become an important area of research in natural language processing. This technique has a wide range of applications, such as comprehending user preferences in ecommerce feedback portals, politics, and in governance. However, a...

(This article belongs to the Special Issue AI Empowered Sentiment Analysis)
  • Article
  • Open Access
27 Citations
4,922 Views
17 Pages

Automated Arabic Long-Tweet Classification Using Transfer Learning with BERT

  • Meshrif Alruily,
  • Abdul Manaf Fazal,
  • Ayman Mohamed Mostafa and
  • Mohamed Ezz

9 March 2023

Social media platforms like Twitter are commonly used by people interested in various activities, interests, and subjects that may cover their everyday activities and plans, as well as their thoughts on religion, technology, or the products they use....

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
35 Citations
7,228 Views
19 Pages

Radiology reports are one of the main forms of communication between radiologists and other clinicians, and contain important information for patient care. In order to use this information for research and automated patient care programs, it is neces...

(This article belongs to the Special Issue Advances in IoMT, Deep Learning and Computer Vision for Mammographic Image Analysis)
  • Article
  • Open Access
5 Citations
5,408 Views
11 Pages

Web Interface of NER and RE with BERT for Biomedical Text Mining

  • Yeon-Ji Park,
  • Min-a Lee,
  • Geun-Je Yang,
  • Soo Jun Park and
  • Chae-Bong Sohn

21 April 2023

The BioBERT Named Entity Recognition (NER) model is a high-performance model designed to identify both known and unknown entities. It surpasses previous NER models utilized by text-mining tools, such as tmTool and ezTag, in effectively discovering no...

(This article belongs to the Special Issue Applications of Artificial Intelligence in Biomedical Data Analysis)
  • Article
  • Open Access
38 Citations
9,609 Views
13 Pages

18 November 2021

Text classification is a fundamental research direction, aims to assign tags to text units. Recently, graph neural networks (GNN) have exhibited some excellent properties in textual information processing. Furthermore, the pre-trained language model...

  • Article
  • Open Access
91 Citations
13,122 Views
19 Pages

Survey of BERT-Base Models for Scientific Text Classification: COVID-19 Case Study

  • Mayara Khadhraoui,
  • Hatem Bellaaj,
  • Mehdi Ben Ammar,
  • Habib Hamam and
  • Mohamed Jmaiel

11 March 2022

On 30 January 2020, the World Health Organization announced a new coronavirus, which later turned out to be very dangerous. Since that date, COVID-19 has spread to become a pandemic that has now affected practically all regions in the world. Since th...

(This article belongs to the Special Issue Big Data for eHealth Applications)
  • Article
  • Open Access
6 Citations
2,940 Views
19 Pages

16 October 2022

Peptide detectability is defined as the probability of identifying a peptide from a mixture of standard samples, which is a key step in protein identification and analysis. Exploring effective methods for predicting peptide detectability is helpful f...

(This article belongs to the Collection Computational Studies of Biomolecules)
  • Article
  • Open Access
22 Citations
10,783 Views
20 Pages

Leveraging Large Language Models and BERT for Log Parsing and Anomaly Detection

  • Yihan Zhou,
  • Yan Chen,
  • Xuanming Rao,
  • Yukang Zhou and ,
  • Yuxin Li and
  • Chao Hu
  • + 1 author+ 0 author

5 September 2024

Computer systems and applications generate large amounts of logs to measure and record information, which is vital to protect the systems from malicious attacks and useful for repairing faults, especially with the rapid development of distributed com...

  • Article
  • Open Access
3 Citations
3,672 Views
22 Pages

Category Mapping of Emergency Supplies Classification Standard Based on BERT-TextCNN

  • Qiuxia Zhang,
  • Hanping Hou,
  • Yingjie Ju,
  • Jiandong Yuan and ,
  • Kun Zhang,
  • Huanhuan Wang and
  • Junhe Chen
  • + 2 authors+ 0 author

10 September 2024

In recent years, the escalation in emergency occurrences has underscored the pressing need for expedient responses in delivering essential supplies. Efficient integration and precise allocation of emergency resources under joint government–ente...

(This article belongs to the Section Supply Chain Management)
  • Article
  • Open Access
6 Citations
5,773 Views
16 Pages

SVM, BERT, or LLM? A Comparative Study on Multilingual Instructed Deception Detection

  • Daichi Azuma,
  • René Meléndez,
  • Michal Ptaszynski,
  • Fumito Masui and ,
  • Lara Aslan and
  • Juuso Eronen
  • + 1 author+ 0 author

22 September 2025

The automated detection of deceptive language is a crucial challenge in computational linguistics. This study provides a rigorous comparative analysis of three tiers of machine learning models for detecting instructed deception: traditional machine l...

(This article belongs to the Special Issue The Digital Immune System: AI-Driven Detection and Mitigation of Online Harms)
  • Article
  • Open Access
12 Citations
4,395 Views
18 Pages

1 February 2023

BERT, the most popular deep learning language model, has yielded breakthrough results in various NLP tasks. However, the semantic representation space learned by BERT has the property of anisotropy. Therefore, BERT needs to be fine-tuned for certain...

(This article belongs to the Special Issue New Technologies and Applications of Natural Language Processing)

of 52