Next Article in Journal
A Survey of Fuzzing for ROS-Based Robotic Systems
Previous Article in Journal
Class-Dependent Attribution of Optical and SAR Sensor Contributions in Land Cover Classification with SHAP and ROAR
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multilingual AI-Generated Text Detection in Arabic, English, and Turkish Using a Hybrid Transformer–Graph Convolutional Network

1
Department of Software Engineering, Faculty of Technology, Firat University, 23119 Elazig, Türkiye
2
Department of Instructional Technologies, Faculty of Education, Firat University, 23119 Elazig, Türkiye
*
Author to whom correspondence should be addressed.
Appl. Sci. 2026, 16(14), 7249; https://doi.org/10.3390/app16147249
Submission received: 15 June 2026 / Revised: 9 July 2026 / Accepted: 16 July 2026 / Published: 20 July 2026

Abstract

Detecting AI-generated text has become a critical task as artificial intelligence systems are increasingly used in content creation. Current detection methods often suffer from limited accuracy and weak multilingual performance. This problem is especially challenging in Turkish, Arabic, and English due to their distinct linguistic structures, including agglutinative morphology in Turkish, root-based morphology in Arabic, and semantic ambiguity in English. To address these challenges, this study proposes a hybrid architecture that combines a Transformer-based DistilBERT model with a Graph Convolutional Network (GCN). While DistilBERT captures rich contextual and semantic information, GCN enhances detection by modeling structural relationships within text data. The proposed model is evaluated against other well-known approaches. Experimental results show that the hybrid DistilBERTGCN framework achieves high detection accuracy, reaching 99% for English and 98% for Turkish and Arabic. In addition, this study introduces new multilingual datasets, contributing to the advancement of the literature research.

1. Introduction

In recent years, advancements in artificial intelligence (AI) have brought significant attention to detecting fake content, a critical area addressing the challenges posed by AI-generated texts. The increasing prevalence of Generative Pre-trained Transformer (GPT) models exemplifies the potential of AI to produce human-like textual content, blurring the lines between authentic and machine-generated texts. GPT models are a revolution in the field of Natural Language Processing (NLP) with their ability to produce human-like texts [1,2]. Training the GPT models requires huge data sets and high processing power. During the pre-training stage, the language model is run through a large data set and learns the language’s general rules, patterns, and relationships. This gives the model a huge knowledge base and, therefore, its success in carrying out the assigned tasks [3]. In contrast to merely using word frequency, GPT models rely on contextual meanings in the language. These uses encompass understanding the different meanings of particular words and the grammatical structure of the language [4].
Transformer-based language models can analyze syntactic and semantic features powerfully [5]. This cognitive capacity helps in acquiring the natural fluency of language to produce texts closer to the natural flair of writing. The recent versions of GPT are even better able to offer texts that appear to be more naturally flowing, making it harder to distinguish between those written by human authors. Such situations may lead to new challenges regarding the reliability and accuracy of information [6]. Circulation of fake texts or information pollution may further mislead decisions taken on incorrect information, unfavorably affecting individuals and organizations [7,8]. However, verifying all such information based on human assessment and expert judgment can be both time-consuming and costly. However, textual authenticity and expert confirmation of authenticity by way of manual inspection bear the high risk of an error rate ranging from 0.7 to 0.9, and they call for an average of 20 h of evaluation. Therefore, there is an urgent need for the development of effective methods for automatic detection of artificial intelligence-generated texts in both industry and academia [9]. This creates a reliability problem, especially in information-based platforms such as news, academic studies, and social media, and facilitates the spreading of fake or manipulative content [10,11]. Reliable methods need to be developed that can successfully detect artificially written texts through the use of language and style analysis [12,13]. In the development of such models, studies are being conducted that combine natural language processing with machine learning algorithms and show highly effective results in fake text detection, particularly in feature sets based on different languages and styles. The models developed utilize a wide range of metrics, including style, language structure, grammatical complexity, word frequency, sentence length, and semantic connections within texts, resulting in improved performance in identifying both human and AI texts. Fake content detection having high accuracy could be achieved by algorithms through the separation of stylistics and semantic features in texting, the most prominent when combined with language processing techniques like Latent Semantic Analysis (LSA), Term Frequency-Inverse Document Frequency (TF-IDF), and word embedding [14].

Problem Statement

A significant risk to information security arises from the similarities between AI-generated texts and real human texts, which makes it very difficult to detect AI-written text. With the rapid proliferation of false or misleading information on the internet, especially with the emergence of advanced language models such as GPT, rapid and accurate manual checking of such content becomes an enormous challenge [15]. Detection of these texts with traditional methods can be time-consuming and prone to errors. Therefore, more advanced, reliable, and efficient methods are needed to automatically detect fake texts. While the high similarity of texts generated by artificial intelligence to real human texts makes this detection difficult [12], the rapid spread of content containing false information with the development of models such as GPT threatens information security. It is known that manual fact-checking incurs problems in speed and difficulty because of the amount of online content, while detection processes using conventional means bring forth limitations and are definitely not reliable in terms of accuracy. Further, some widely used online detectors such as GPTZero and ZeroGPT have reported limited multilingual consistency [16].
The present study addresses critical limitations and challenges in the detection of AI-generated fake texts by introducing an innovative hybrid model that combines a Transformer-based architecture with a graph-based model. Existing methods struggle with the high degree of similarity between AI-generated texts and human-written texts, making it difficult to reliably distinguish between the two. This issue is compounded by the lack of multilingual support and inconsistencies in existing tools, which limit their applicability across diverse linguistic contexts. Language modeling, stylometry, syntactic analysis, semantic parsing, and deep learning techniques are utilized to assess the structural differences between fake and real texts [17]. The model thus developed is fitted together with Transformer-based structures, and the semantic depth of the language is analyzed through attention mechanisms and vector representations. In addition, advanced methodologies such as hyperparameter optimization, model adjustment methods, and k-fold cross-validation are applied to boost classification accuracy [18]. The generalization ability of the model and its performance in fake text detection are statistically tested with datasets from different languages. The main contributions of this paper are summarized as follows:
  • The proposed model leverages advanced Natural Language Processing (NLP) techniques such as language modeling, stylometry, syntactic analysis, and semantic parsing to address the structural and semantic intricacies of fake and real texts. By incorporating these techniques into a unified framework, the model effectively evaluates subtle textual features that are often overlooked by traditional methods. The hybrid model of transformer models and Graph Convolutional Networks enables the analysis of semantic depth through attention mechanisms and vector representations, offering a more nuanced understanding of text authenticity.
  • The proposed model presents high accuracy in Turkish, English, and Arabic languages, and can successfully detect fake texts of different languages.
  • One of the significant innovations of this study is its focus on multilingual applicability. The model has been tested on datasets in Turkish, English, and Arabic, which are strategically selected to represent languages with varying levels of resources in NLP. This direction is motivated in part by the limited multilingual coverage reported for some existing online detectors, underscoring the relevance of the proposed framework in linguistically diverse contexts.
  • Three new datasets have been introduced, specifically for Turkish, English, and Arabic, including data with limited availability such as Turkish and Arabic.
As shown in Figure 1, this study is composed of four main sections, including the introduction. Following the introduction, the second section presents related studies, the third section focuses on the materials and methods comprising the proposed model, and the final section concludes the study.

2. Literature Review

The literature studies primarily deal with the use and effectiveness of various techniques in AI and NLP for detecting fake texts. Deep learning models and algorithms generally go a long way toward reliable automatic detection of fake texts. These techniques analyze language structure, content, and images found in texts for signs of fakeness. A brief summary of the literature related to this study is presented in Table 1. The scientific value of the research proposal is being justified by superior AI-based systems that can comprehend and discover, indeed, true fakes in a fraction of the time and without human assistance, compared to traditional methods. Subsequently, studies have tackled how these fake texts propagate through many platforms (e.g., the internet, academic articles, product reviews) and how they may be countered effectively. Such studies will further provide critical information geared toward developing strategies for achieving social good through fake texts, information security, and reliability.
Celikten et al. proposed a new model that improves the text classification architecture [27]. The model was tested on a custom dataset using LSTM, Bi-LSTM, Attention mechanism, Bi-GRU, and fully connected networks. The results obtained indicate that the model achieves 90% accuracy on the test set. Further studies are needed to know how the performance of the model will change as the input data increases in size. Mitchell et al. propose a new method for detecting texts generated by large language models [19]. In the present study, a curvature-based criterion termed as DetectGPT is defined, followed by text detection using random perturbations. The experiments show that DetectGPT is more discriminative than existing zero-shot methods, allowing an increase in AUROC from 0.81 to 0.95 for the detection of fake news articles. However, the approach warrants testing on a larger and more diverse dataset, and the generality across different text types needs to be explored. Verma et al. developed the “Ghostbuster” model to detect AI-generated texts [28]. The model has achieved high accuracies on datasets such as creative writing, news, and student essays. However, its effectiveness on a wide variety of text types has not yet been fully tested. Cingillioglu et al. developed a successful model for detecting AI-generated essays using SVM and the n-gram Discrepancy Bag-of-Words model on 230 trials of a student essay dataset [29]. The 92.7% accuracy rate obtained suggests that the model is effective, but it is not yet clear how it will perform on larger datasets. Gaggar et al. developed models that use RoBERTa and SVM to detect machine-generated texts in various domains [30]. High accuracies were achieved in tests on multiple datasets. However, it was noted that further optimization is needed to correctly classify texts from very different domains. Wang et al. They developed the SeqXGPT model using convolutional and self-attention networks to detect AI-generated text at the sentence level [31]. The SeqXGPT-Bench dataset appeared to have achieved very high accuracy rates. However, the work should also consider the generalization ability of the model on texts in languages other than English. Jawahar et al. addressed the problem of the distinction between texts generated by text generative models and those written by humans [20]. In this paper, TGMs were shown to be misused for propagating fake news and fake product reviews on various datasets like WebText, Amazon Product Reviews, RealNews, and Common Crawl. The paper has, however, suggested the development of a detector which may discriminate between a Text Generator Model (TGM)-generated text and one authored by a human. However, it is emphasised that the performance of these detectors needs to be evaluated on texts written in different languages, and future studies have to turn their attention towards more general usage scenarios. Desaire et al. developed a classifier that classifies ChatGPT- and other major language model-generated texts against the texts of 10 chemistry journals for discrimination [21]. The investigation developed a method for the detection of AI-generated texts based on the XGBoost classifier using texts generated by both GPT-3.5 and GPT-4. The results obtained demonstrate that the proposed method can distinguish between human and AI-written texts with an accuracy of 99%, therefore allowing for tracking of AI usage in the scientific literature. However, according to this investigation, this method is restricted to chemistry texts, and it is recommended to develop broader applicability by validating it on texts of many areas. A recent systematic review on machine learning for detecting deceptive activities on social media highlighted common methodological challenges, including class imbalance, evaluation practices, and multilingual validation, which were considered when designing and evaluating the proposed framework [32].
Related work also includes LLM watermarking and watermark-robustness methods, which provide a complementary, generator-side approach to AI-text identification rather than post hoc supervised authorship classification; such methods were not benchmarked in our experiments but are noted as an important adjacent research direction.

3. Materials and Methods

This study aims to develop an innovative system that combines language modeling and stylometric analysis techniques for the detection of fake texts generated by artificial intelligence. Categorical distribution of human and AI-generated text data sources in Figure 2. Initially, three large-scale datasets with different languages were constructed using a diverse range of sources, including social media platforms, academic journals, news websites, and AI-generated texts. The dataset underwent preprocessing to preserve the natural structural and linguistic features inherent to each language. This step ensured that the data retained its authenticity for effective analysis. The proposed system incorporates a Transformer-based language model, which was integrated with a graph-based model to analyze both the contextual meaning and stylistic nuances of texts. This hybrid architecture leverages the strengths of both models to enhance the accuracy and reliability of text classification. To evaluate the model’s multilingual capability, extensive testing was conducted using datasets in Turkish, English, and Arabic. The system’s performance in distinguishing AI-generated texts from human-authored texts was statistically analyzed to validate its effectiveness in a multilingual context.

3.1. Data Collection

The dataset used in this study was collected in three different languages, Turkish, English, and Arabic, to provide multilingual support. During the data collection process, certain categories were created to distinguish between human and AI-generated texts [33]. Human data were collected from forum sites, academic papers, theses, and news websites. While AI data were compiled from AI chatbots, namely ChatGPT (OpenAI, San Francisco, CA, USA), Gemini (Google LLC, Mountain View, CA, USA), and Copilot (Microsoft Corporation, Redmond, WA, USA) [34]. The human data were labeled as “0.0” in the dataset, while all AI-generated texts were labeled as “1.0.”
The dataset, created and written in Microsoft Excel (Microsoft Corporation, Redmond, WA, USA) format, enabled a Python (Python Software Foundation, Wilmington, DE, USA) script to automatically partition the data, with the aim of enhancing the model’s performance using specified sentence lengths. The script further divides the text into sentences of certain lengths before bringing each piece into the Excel file.
As seen in the Algorithm 1, the Python script (Python 3.14) allows the texts generated by artificial intelligence to be divided into pieces of various lengths. The “split_into_chunks” function used here groups the sentences by separating the text with dots and spaces, and each group creates pieces of a certain length. The pieces can be 5, 6, 7, or 8 sentences long, and each piece is written in the lines of the Excel file. All chunks derived from the same source document were subsequently assigned to the same train, validation, or test partition to prevent cross-split leakage. This process allows the data to be divided into smaller and more manageable pieces, thus optimizing the learning process of the model [35]. This script plays an important role in training the model by automating the data collection and processing process. The datasets generated in this study were organized to include text and generated columns by labeling human data as “0.0” and AI-generated text as “1.0”, and examples from datasets in different languages are shown in Figure 3.
Algorithm 1 AI text splitting and Excel writing algorithm
  1:
Input: text: Original text; chunk_length: Sentences per chunk (default 6, allowed 5–8); label: Class label (0.0 human, 1.0 AI)
  2:
Output: Excel file with text chunks and class labels
  3:
Begin
  4:
Split text by ". " into sentences
  5:
Group sentences into chunks of chunk_length, ending with a period
  6:
Try loading the language-specific workbook (e.g., data-arabic.xlsx)
  7:
if not found then
  8:
      Create new workbook and add headers ["text", "generated"]
  9:
end if
10:
for each chunk in chunks do
11:
      Write chunk to column 1 and label to column 2
12:
end for
13:
During subsequent train–test splitting, assign all chunks from the same source document to the same partition
14:
Save workbook
15:
End
To ensure topic consistency while preserving linguistic diversity, human-written texts were collected from multiple domains, and the prompts used to generate AI-written texts were derived from the titles and subject matter of the corresponding human-written documents. Consequently, both classes covered comparable topics across diverse domains, reducing the likelihood that the model relied solely on domain- or topic-specific characteristics rather than authorship-related patterns.
To ensure the reproducibility and broader accessibility of our study, the complete dataset used for the GCN-DistilBERT hybrid model has been shared on Hugging Face (Hugging Face, Inc., New York, NY, USA). The dataset files in Arabic, English, and Turkish are provided in Excel format for ease of use. The dataset can be accessed at https://huggingface.co/datasets/aycabostancioglu/Arabic-English-Turkish-AI-Human-Text (accessed on 15 July 2026). The repository includes detailed explanations and examples in the README.md file to guide researchers and practitioners in exploring and utilizing the data effectively.

3.2. Data Preprocessing

In this section, the cleaning and augmentation techniques applied for the preparation of the dataset are discussed in detail. Preprocessing steps, lemmatization, character cleaning, data augmentation strategies, and graph feature extraction are explained in order to make the texts suitable for the language model and graph-based structure [36].
Approximately 3000 text samples were collected for each language (English, Turkish, and Arabic). An 80/20 train–test split was applied before augmentation. Then, 10% of the training partition was held out as a validation set for early stopping; data augmentation was applied only to the remaining training samples, while the validation and test sets were held out unchanged. Final metrics were computed on held-out test sets of 1765 (English), 1995 (Turkish), and 1691 (Arabic) samples. The slight variation in test set sizes across languages reflects differences in the number of samples collected and chunked per language.
On the training set only, data augmentation techniques were applied to increase the generalization ability of the model and to prevent over-learning [37]. In this context, various strategies were applied to diversify the training dataset. The “Word Replacement” method randomly swaps the places of the two chosen words in the text and diversifies the structure of the text without damaging it [38]. The “Word Deletion” technique deletes random words in a way that maintains semantic integrity in the text, helping the model focus on important words. The “Synonym Replacement” technique created variants without damaging the semantic structure of the text by replacing certain words with their synonyms. These processes, in conjunction with the original dataset, helped in building a wider and balanced training set, thus augmenting the model’s learning capacity based on data. The data augmentation enabled the model to become flexible toward various types of data while also reducing bias and variance during the learning process.
In data cleaning, processes are carefully laid out on raw data to render them suitable for easy portability into the model to avoid wrong predictions or outcomes. This process forms a very important step towards enhancing the quality of data with which the model would be trained to derive valid information out of it [39]. The basic operations applied in the data cleaning program are explained below:
Removal of Non-Alphanumeric Characters: Unnecessary symbols are removed from the texts, retaining only letters, numbers, and spaces.
Reducing Repeated Characters: Repeated character sequences are written down just once by reducing the number of characters in repetitive instances.
Deletion of Single Characters: Words consisting of a single character that are void of meaning are removed from the texts.
Convert to Lowercase: Everything has been converted to lowercase for some uniformity.
Cleaning Unnecessary Spaces: Excessive spaces have been merged and the texts have been brought into a more compact form.
Removal of HTML Tags and Punctuation: The special characters and HTML tags are cleaned.
Lemmatization: Morphological variation is minimized by putting words to their roots.
The functions mentioned above (e.g., remove_non_alphanumeric, remove_single_characters, etc.) are used to clean unnecessary symbols and incorrect characters from the text. These functions contribute to the learning process of the model by purifying the data. In particular, the remove_non_alphanumeric function prevents the model from encountering meaningless symbols by keeping only alphanumeric characters in the text [40]. The remove_single_characters function eliminates single-character words (e.g., “a”, “I”), allowing meaningful words to stand out. As a result, these preprocessing steps optimize the learning process of the model, reduce noise, and provide more accurate predictions. These steps increase the cleanliness level of the text, significantly improving the overall accuracy and efficiency of the model.

3.3. Feature Extraction

It offers a hybrid combination of Graph Convolutional Networks (GCNs) and transformer-based models, where feature extraction plays a critical role in capturing both the structural relationships found in graph data and the contextual information found in text sequences. DistilBERT is particularly useful for extracting meaningful features, enabling the model to effectively combine graph-based relational features with sequential contextual information. Figure 4 shows how this approach leverages the strengths of both types of models, effectively combining graph-based relational features with sequential contextual information in text to capture complex dependencies in data and improve overall performance.
In our experiments, text is represented as a sequential chain graph: each preprocessed text chunk is one node, and undirected edges connect consecutive chunks in reading order within each train, validation, or test partition. In the proposed architecture, each text chunk constitutes one node v i V , and undirected sequential edges connect consecutive chunks ( v i , v i + 1 ) , yielding a sparse adjacency matrix A R N × N with A i , i + 1 = A i + 1 , i = 1 . Each node is associated with a feature vector x i R F derived from the corresponding chunk. That graph-based representation gives this model both local and global dependencies with operational ease.
For reproducibility, the experiments follow a fixed graph protocol. In each train, validation, or test partition, one node corresponds to one preprocessed text instance (chunk row). Nodes are linked only along the document order in that partition, forming an undirected chain graph with binary, unweighted edges ( A i j { 0 , 1 } ), and no separate edge-weighting scheme is applied. Message passing uses symmetric degree normalization through the standard GCN formulation in Equation (1), where c i j balances contributions from neighboring nodes. Each node is initialized with a 16-dimensional feature vector, passed through a two-layer GCN ( 16 32 8 ) trained on the training graph, and the resulting 8-dimensional node embedding h G is concatenated with the DistilBERT CLS representation before classification. For morphologically rich Turkish (agglutinative suffixation) and Arabic (root-and-pattern structure), DistilBERT encodes local contextual cues within each chunk, while the sequential GCN propagates document-level dependencies across consecutive chunks via message passing, complementing transformer representations without language-specific syntactic parsers.
Graph Convolutional Network (GCN) is the central element of the graph-related component [41]. It intelligently aggregates information from neighboring nodes, ensuring an accurate representation of the graph while reducing the computational burden typically associated with classical GNN models. The GCN updates the node representations via a propagation process, in which the graph structure is preserved. This process is implemented through multiple layers, such as GCNCon1 and GCNCon2, each performing a step of graph convolution. At each layer k, each node v i aggregates information from its neighbors N ( i ) , as shown in Equation  (1):
h i ( k + 1 ) = σ j N ( i ) 1 c i j A i j h j ( k ) W ( k )
where h i ( k ) is the hidden state of node i at layer k, A i j is the adjacency matrix entry indicating the relationship between nodes i and j, W ( k ) is the learnable weight matrix for layer k, and σ ( · ) is a non-linear activation function, such as Rectified Linear Unit (ReLU). As seen in Figure 4, for Feature Extraction, the GCNCon1 layer performs the initial graph convolution operation by transforming the raw node features into an intermediate representation. The GCNCon2 layer then further refines these embeddings, capturing higher-order relationships and improving the quality of graph-level representations. The normalization constant c i j is typically calculated to account for the degree of the nodes to ensure that each node aggregates information in a balanced manner. This iterative message-passing process allows each node to capture global structural information as the number of layers increases.
After K layers of graph convolutions, the node embeddings { h i ( K ) } i = 1 N are aggregated to form a graph-level representation h G . Various aggregation methods can be applied, such as the following:
Max Pooling: This selects the maximum value across nodes for all feature dimensions.
Mean Pooling: This computes the average across all the node embeddings.
Graph-level embedding h G is a rich approach where the structural features of the graph are combined with the sequential features of the transformer. The model leverages a hybrid architecture that combines DistilBERT, a compact and efficient version of Bidirectional Encoder Representation from Transformers (BERT) [42], with a Graph Convolutional Network to efficiently handle sequential text data and graph structured data. In the proposed architecture, transformer-based DistilBERT takes sequential data as input, x = ( x 1 , x 2 , , x T ) , where T denotes the length of the sequence. It also processes graph data with a GCN. This hybrid model offers great performance as it captures both contextual information from text and structural relationships from a graph.

3.4. Classification Process

DistilBERT works on the input sequence by first expressing each token x i as a dense vector e i , utilizing a pre-trained embedding layer. These embeddings are then enriched with positional encodings to preserve the token order of the sequence, as shown in Equation (2):
e i = e i + PE ( i )
where PE ( i ) is the positional encoding for the i-th position, which is crucial for the model to determine and preserve the sequence order, which is a mandatory requirement for text classification operations. The transformer architecture uses self-attention to extract relationships between tokens of the sequence, regardless of their being in positions of either. The attention mechanism computes attention scores for words, as shown in Equation (3):
Attention ( Q , K , V ) = softmax Q K T d k V
where Q, K, and V are query, key, and value matrices, respectively, and d k is the dimension of the key vectors. This mechanism of attention enables the model to weigh the significance of one word in relation to others and, thus, permits long-distance dependencies that are a part of the sequence to be learned as well.
The self-attention mechanism is deployed in multiple layers of the transformer to produce contextual embeddings H = ( h 1 , h 2 , , h T ) , where each h i contains information about the token x i as well as its contextual relationship to the other tokens in the sequence. The final sequence representation, h T , is usually found either through the embedding of the last token x T or by a mechanism of mean pooling or using the [CLS] token, which aggregates information from the whole sequence.
The hyperparameters are the most important factors influencing the performance of the hybrid model. Hyperparameters are determined and adjusted to optimize the training efficiency and accuracy of the model. This includes training speed, the number and size of sessions, and various optimizations to improve model performance. Table 2 provides a detailed explanation of all the fundamental hyperparameters and their corresponding values. These parameters govern the various stages of the model’s training process. In fact, the learning cost ( η ) controls the size of each iteration when moving to the minimum performance. A small initial value η = 2 × 10−5 was chosen to allow for tuning of the model parameters at the beginning of the training phase. The batch size of 64 indicates that this is the number of samples the classifier needs to calculate the gradients and update the model [43]. Smaller batch sizes introduce more noise and variation in the gradient adjustment, which can improve accuracy, but larger batch sizes provide greater stability. The number of iterations indicates how often the model is fed the data. This was considered 25 times, which gives the model enough time to learn the correct patterns of the material.
Optimization algorithms are an important part of tuning model parameters to reduce the loss function [44]. This study uses the Adam optimization algorithm that analyzes each parameter based on the gradient of the first and second terms. This approach successfully solves deep learning problems and simplifies learning rate adjustments. The numerical expression of Adam optimization is given in Equation (4):
θ t = θ t 1 η · m ^ t v ^ t + ϵ
where θ t represents the model’s parameters at step t, η is the learning rate, m ^ t is the first moment (the mean of the gradients), v ^ t is the second moment (the variance of the gradients), and ϵ is a small constant (typically 10 8 ) to prevent division by zero. At each stage, Adam continuously adjusts the moments for faster and efficient learning. Assorted techniques include learning rate schedulers and gradient clamps. This one here is a linear scheduler, decreasing the learning rate over time while allowing fine-tuning of model parameters as training progresses. Gradient clipping is adopted to avoid the explosion of gradients by limiting them to some predefined value [45]. This technique provides more stable training while avoiding instability due to excessively large updates. So, all parameters of training, together with optimization procedures, are put in place for the model to learn while the risk of overfitting is minimized. Using gradient accumulation enhances the memory efficiency of the training because the gradients are accumulated over several smaller batches before updating the parameters. Mixed-precision FP16 training was put to good use to speed up the process and reduce memory requirements, thus making efficient use of resources.
Table 2 shows the technical configuration and training parameters. The table gives pertinent details that allow a person to comprehend what specific settings were used throughout training and reproducing the experiments more easily.
The hybrid GCN-Distilled Bidirectional Encoder Representations from Transformers (DistilBERT) model combining GCNs and transformer-based models for text classification tasks is shown in Algorithm 2. Simultaneously, a Graph Convolutional Network (GCN) processes graph-structured data to produce node-level embeddings h G . DistilBERT encodes each text chunk independently and produces a sequence-level representation h T from the [CLS] token; h G is not injected into the transformer encoder but is concatenated with h T before the final classification layer, as specified in Equations (5) and (6). The final output of the GCN, h G , captures structural relationships among sequentially connected chunks, while the DistilBERT component captures the contextual information of each chunk.
The hybrid model, as seen in Equation (5), integrates both representations to establish a single feature vector:
h concat = concat ( h G , h T )
The neural network concatenates the vector h concat as described in Equation (6), it is then transferred into the single dense layer next which culminates with the application of a softmax activation function leading to the final predictions:
y ^ = softmax ( W output h concat + b output )
where W output and b output signify the parameters of the output layer, being the learnable weights and biases.
Apart from the cross-entropy loss, which one may see in Equation (7), the model is conditioned on finding the true labels y i and the predicted probabilities y ^ i :
L = i = 1 N y i log ( y ^ i )
where N is the number of samples, y i is the true label, and y ^ i is the predicted probability for the i-th sample.
Algorithm 2 Algorithm describing the hybrid GCN-DistilBERT model.
  • Require: Train set X t r a i n , Y t r a i n , Validation set X v a l , Y v a l , Test set X t e s t , Y t e s t , GCN parameters ( i n p u t _ d i m , h i d d e n _ d i m , o u t p u t _ d i m ) , tokenizer, DistilBERT model, number of epochs E, batch size B, learning rate η
  1:
Step 0: Dataset Partition and Augmentation
  2:
Apply an 80/20 split to obtain X t r a i n and X t e s t
  3:
Hold out 10% of X t r a i n as validation subset X v a l for early stopping
  4:
Apply data augmentation to the remaining training samples only
  5:
Step 1: Graph Construction
  6:
for each dataset X { X t r a i n , X v a l , X t e s t }  do
  7:
      Define each preprocessed text instance (chunk) as one node v i
  8:
      Construct undirected chain edges ( v i , v i + 1 ) with binary adjacency A i , i + 1 = A i + 1 , i = 1
  9:
      Initialize a 16-dimensional feature vector for each node and store the graph
10:
end for
11:
Step 2: Feature Extraction
12:
Initialize GCN model with parameters ( i n p u t _ d i m , h i d d e n _ d i m , o u t p u t _ d i m )
13:
Train GCN on X t r a i n for E epochs:
14:
for epoch = 1 to E do
15:
      for each batch ( g r a p h ) in train loader do
16:
            Forward pass: o u t p u t = G C N ( g r a p h )
17:
            Compute loss and update parameters
18:
      end for
19:
end for
20:
Extract GCN features for X t r a i n , X v a l , and X t e s t
21:
Step 3: DistilBERT Encoding and Fusion
22:
for each dataset X { X t r a i n , X v a l , X t e s t }  do
23:
      Tokenize texts and obtain [CLS] representation h T
24:
      Concatenate h G with h T before classification
25:
end for
26:
Step 4: Dataset Preparation
27:
Define a custom dataset to handle tokenized data, GCN features, and labels
28:
Create train, validation, and test datasets
29:
Step 5: Model Training
30:
Initialize DistilBERT model for sequence classification
31:
Define training arguments and initialize Trainer
32:
Train model on t r a i n _ d a t a s e t for E epochs
33:
Use early stopping on v a l _ d a t a s e t and save the best model
To optimize model parameters, as seen in Equation (8), an adaptive learning rate, namely, the Adam optimizer, is used that guides the learning rate to be based on each parameter:
θ t = θ t 1 η θ L ( θ t 1 )
where θ represents the model parameters, η is the learning rate, and θ L is the gradient of the loss function with respect to the parameters.
This hybrid architecture combines the strengths of transformers for sequential data, such as DistilBERT, with the relational modeling capabilities of GCNs for graph-structured data. Applications such as sentiment analysis, question answering, and relational text classification can benefit from this approach because the model can account for both the text sequence and the structural relationships presented in the underlying graph. The model is flexible enough for a variety of domains and input data types. With simultaneous use of sequential and graph-based input, it is suitable for complex multimodal learning tasks such as social network analysis, recommender systems, and biological data processing, where text and graph-structured data are abundant.

4. Experimental Results and Discussion

In this section, the results of the experiments conducted to evaluate the performance of the model are presented and these results are analyzed. As shown in Table 3, various models have been proposed in the literature for text classification and the detection of content generated by artificial intelligence. A hybrid model developed has achieved text classification success with 90% accuracy by using network structures such as Long Short- Term Memory (LSTM), Bi-LSTM, Attention mechanisms and Bi-GRU [27]. The model called Ghostbuster aimed to detect texts generated by artificial intelligence and this model achieved significant success with 97.5% accuracy [28]. Similarly, 92.7% accuracy rate was achieved on student essays written with Support Vector Machine (SVM) and n-gram based models proposed by Cingillioglu et al. (2023) [29]. With RoBERTa-based models, successful results such as 97.11% Area Under Curve (AUC)–Receiver Operating Characteristic (ROC) and 99% F1-score have been achieved on multiple datasets [30]. On the other hand, with the model called SeqXGPT, it has achieved significant success with 97.6% Macro-F1 and 99.2% precision using convolutional and self-attention networks to detect AI-generated sentences [31].
Our proposed model uses a hybrid DistilBERT and GCN (Graph Convolutional Network) model to detect fake content based on language in multilingual datasets. This model achieved 99% accuracy for English and 98% accuracy for Turkish and Arabic. These results are quite competitive when compared to existing models in the literature. Particularly, it combines linguistic and stylometric analyses and achieves strong and consistent performance across the three evaluated languages, yielding accuracy comparable to or better than most literature baselines tested under the same multilingual protocol.
To understand the results of the experiments conducted on English, Turkish, and Arabic datasets in more detail, loss graphs, accuracy curves, confusion matrices and ROC curves are presented in Figure 5. Final evaluation was performed on held-out test sets comprising 1765 (English), 1995 (Turkish), and 1691 (Arabic) samples, as shown in the confusion matrices. The experiments were performed using a hybrid model, consisting of Graph Convolutional Networks and DistilBERT, which can efficiently process text data and learn contextual representations. The performance of this model on each of the languages is provided in Table 4. To address uncertainty in the reported point estimates, Table 5 reports Wilson 95% confidence intervals for test-set accuracy and two-proportion z-tests comparing GCN+DistilBERT with the BERT baseline evaluated on the same held-out partitions.
As seen in Table 4, high accuracy rates (98 percent and above) were achieved on all language datasets. In particular, the English dataset exhibited excellent performance with a sensitivity value of 1.0, meaning zero false negatives. Slightly lower precision values were observed on the Turkish and Arabic datasets, but these decreases were minimal and did not affect the overall performance of the model.
The loss and accuracy curves show how the model performed whilst being trained on the datasets, determining its generalization ability. This shows that the model converged properly during training, indicating that overfitting can be avoided. The analysis of the curves also proved that the model performed evenly on both training and validation data without creating problems of underfitting or overfitting. The confusion matrices of English, Turkish, and Arabic show the prediction abilities of the models in detail. These confusion matrices have a high number of true positives (TPs) and true negatives (TNs) and only a small quantity of misclassifications (i.e., contracting false positives and false negatives). The Receiver Operator Characteristic (ROC) curve was used to measure each model’s discriminative ability for each class. This determined the area under the ROC curve (AUC), which illustrates how much the model can correctly classify; the closer the AUC is to 1.0, the better would be the model. All models’ AUC values are high and close to 1.0, meaning they maintained good sensitivity and specificity.
The experimental results highlight the overall performance of the model and its effective learning ability. Data augmentation methods for growing datasets further strengthened learning abilities, with model accuracy still above 98 percent; the balance between sensitivity and precision was kept quite well. The GCN and DistilBERT combination provided a very powerful model able to sequence linguistic structures through graph-based and transformer-based embedding techniques. In summary, it was observed that the proposed hybrid model approach provides high accuracy rates by effectively generalizing on multilingual datasets and achieves successful results in modern natural language processing tasks.
The results in Table 6 show how well the proposed model performs for the binary classification task of AI-generated texts compared to human-written texts across Turkish, English, and Arabic datasets. The GCN+DistilBERT model, where graph-based learning is used with transformative embeddings, is found to be the superior model in terms of optimal solution across all datasets. The results obtained for the Turkish dataset are a remarkable accuracy of 98.8%, while the precision, recall, and F1 score metrics for this model are 98.7%, 99%, and 98.9%, respectively. These scores prove that it can find a middle ground between classifying one text as AI-generated and the other as human-written. The time taken for this model to learn is only a few minutes, which shows its efficiency in computational power compared to many other models.
In the English dataset, since the structural behavior of the language and the quality of the datasets really render high performance to the model, GCN+DistilBERT stood its ground. While GCN+BERT achieved a slightly higher accuracy on the English (99.8% vs. 99.6%) and Arabic (98.1% vs. 98.0%) datasets, GCN+DistilBERT reduced total training time by approximately 45% and 40%, respectively (1.32 vs. 2.41 min for English; 2.58 vs. 4.29 min for Arabic), offering a favorable accuracy–efficiency trade-off. This efficiency is particularly crucial in large-scale or real-time text classification tasks.
To isolate the contribution of individual components, an ablation study was conducted on the English, Turkish, and Arabic datasets (Table 7). The full configuration corresponds to the proposed GCN+DistilBERT model. Removing the GCN branch (DistilBERT only), disabling feature fusion, or omitting preprocessing and augmentation consistently reduced accuracy relative to the full model, with data augmentation showing the largest impact on the English dataset (accuracy dropping from 0.996 to 0.910). Varying GCN depth confirmed that the default two-layer configuration used in the full model achieved the best trade-off among the tested settings. These results indicate that graph-based features, preprocessing, and augmentation each contribute to the overall performance of the hybrid architecture.
To assess robustness beyond the in-house multilingual corpora, we conducted a cross-dataset evaluation on an external English AI/human text collection (Kaggle; n = 29 , 131 ). A stratified sample of 2500 instances (30–250 words per document) was drawn; 500 were used for domain-adaptation fine-tuning and 2000 were held out for testing. The GCN+DistilBERT model was first trained on data-eng.xlsx, then lightly fine-tuned on the Kaggle adaptation split (2 epochs, max sequence length 128). On the held-out cross-dataset test set, the model achieved 92.2% accuracy, 89.0% precision, 95.0% recall, and 92.4% F1 (Figure 6). Although this is lower than the 99.6% in-distribution English accuracy, it demonstrates that the hybrid architecture retains strong discriminative ability on unseen writing styles and an external data source after modest domain adaptation.
Human-edited, heavily paraphrased, or complex-prompt AI outputs were not collected as a separate class; our labels compare unedited human texts with direct chatbot responses under topic-aligned prompts. Training-only augmentation (word replacement, deletion, synonym replacement) and cross-dataset evaluation on Kaggle (Figure 6) provide partial robustness to surface perturbations and style shift, but dedicated benchmarks on adversarially edited or paraphrased AI text remain future work.
One of the biggest advantages of the GCN+DistilBERT model is its potential to process large datasets much more efficiently than other transformer models. Increasing dataset sizes greatly increases the computational costs of using models such as BERT, Robustly Optimized BERT Approach (RoBERTa), or Efficiently Learning an Encoder that Classifies Token Replacements Accurately (ELECTRA), making them doubly impractical for online or large-scale applications. In contrast, using a more lightweight yet efficient transformer model such as DistilBERT will provide significant reductions in processing times without sacrificing model accuracy. In big data analysis scenarios where time efficiency becomes as important as classification performance, the hybrid model may become more promising. Moreover, the addition of GCN provides this potential advantage in advancing the process and leads to structural insights that increase the efficiency of the semantics from DistilBERT.
The findings highlight the benefits of combining GCN with transformer models for text classification tasks. The optimal architecture combines the ability of GCN to represent syntactic relationships with the semantic depth of transformer embeddings, creating a model that effectively distinguishes AI-generated from human-written text. In the future, accessible combinations may evoke such approaches for other languages or domains, ranging from journalism to academic writing or creative literature, especially as the depiction of AI-generated materials becomes more urgent. Moreover, as dataset sizes continue to grow, the efficiency of GCN+DistilBERT compared to heavier transformer models will become clear. This will solidify GCN+DistilBERT as a practical and robust model for dealing with today’s challenges in NLP. This synergy of structural and semantic learning paves the way for more interpretable and scalable NLP solutions, ensuring adaptability in an ever-evolving AI landscape.
Despite strong in-distribution results, this study has several limitations: AI outputs were stored as a single mixed class without per-generator labels; heavily human-edited or paraphrased AI text was not benchmarked; cross-dataset validation was limited to an external English corpus; detector-specific and watermarking baselines were not evaluated; and the model addresses authorship rather than factual veracity.

5. Conclusions

This study presents a new hybrid model using DistilBERT and GCN in order to deal with issues in detecting AI-generated texts, especially in multilingual contexts. Existing methods lack accuracy and linguistic diversity. For this reason, the approach presented here combines DistilBERT’s semantic capabilities with the structural relationships offered by GCN to provide a model that achieves high performance with computational efficiency. This model performs impressively across datasets, achieving 99% accuracy for English, as well as 98% for Turkish and Arabic, and overtaking state-of-the-art models such as BERT, RoBERTa, and ELECTRA in terms of accuracy–speed ratio. Additionally, graph-based approaches can be applied to other transformer-based models to achieve further accuracy improvements. Based on a lightweight architecture, the model handles comparatively huge datasets with ease and is particularly suited for real-time and large-scale text classification applications. The multilingual nature of the present work fills an important gap in the literature while propagating strong performance across languages with different types of syntactic and morphological complexities and giving rise to new datasets for Turkish and Arabic. Comparative experiments highlight the model’s consistent performance across Turkish, English, and Arabic while achieving a balance between precision and recall. Various advanced techniques for performing data augmentation and comprehensive analyses through loss and accuracy curves, confusion matrices, and ROC curves validate the model’s efficiency and learning capacity. These results demonstrate the potential of combining GCN with transformer-based models for distinguishing AI-generated from human-written text in NLP. This hybrid architecture achieves improved classification performance with reduced computational costs, which can find applications in domains like journalism, academic writing, and content verification.

Author Contributions

Conceptualization, A.B., B.D. and M.B.O.; Methodology, A.B. and B.D.; Software, A.B. and B.D.; Writing—review & editing, B.D. and M.B.O.; Supervision, B.D. All authors have read and agreed to the published version of the manuscript.

Funding

This study is supported by the FÜBAP project named “Analysis and visualization of subject relationships in texts using natural language processing techniques and infographics” and project code EF.26.02.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the findings of this study are available at https://huggingface.co/datasets/aycabostancioglu/Arabic-English-Turkish-AI-Human-Text (accessed on 15 July 2026). Additional data are available from the corresponding author upon reasonable request.

Acknowledgments

The authors thank Firat University for supporting this research through the FÜBAP project (EF.26.02).

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
BERTBidirectional Encoder Representation from Transformers
DistilBERTDistilled Bidirectional Encoder Representations from Transformers
AUCArea Under Curve
GPTGenerative Pre-trained Transformer
NLPNatural Language Processing
LSALatent Semantic Analysis
TF-IDFTerm Frequency–Inverse Document Frequency
GCNGraph Convolutional Network
ELMoEmbeddings from Language Models
VGGNetVisual Geometry Group Network
ReLURectified Linear Unit
LSTMLong Short-Term Memory
SVMSupport Vector Machine
ROCReceiver Operating Characteristic
RoBERTaRobustly Optimized BERT Approach
ELECTRAEfficiently Learning an Encoder that Classifies Token Replacements Accurately
TGMText Generator Model

References

  1. Adhikari, S.; Dhakal, B. Revolutionizing Natural Language Processing with GPT-based Chatbots: A Review. Tech. J. 2023, 3, 109–120. [Google Scholar] [CrossRef]
  2. Hadi, M.U.; Tashi, Q.A.; Qureshi, R.; Shah, A.; Muneer, A.; Irfan, M.; Zafar, A.; Shaikh, M.B.; Akhtar, N.; Hassan, S.Z.; et al. A survey on large language models: Applications, challenges, limitations, and practical usage. TechRxiv 2023. [Google Scholar] [CrossRef]
  3. Azunre, P. Transfer Learning for Natural Language Processing; Simon and Schuster: New York, NY, USA, 2021. [Google Scholar]
  4. Oralbekova, D.; Mamyrbayev, O.; Othman, M.; Kassymova, D.; Mukhsina, K. Contemporary approaches in evolving language models. Appl. Sci. 2023, 13, 12901. [Google Scholar] [CrossRef]
  5. Vig, J.; Belinkov, Y. Analyzing the structure of attention in a transformer language model. arXiv 2019, arXiv:1906.04284. [Google Scholar]
  6. Maurya, R.K.; Maurya, S.R. Content Reliability in the Age of AI: A Comparative Study of Human vs. GPT-Generated Scholarly Articles. Libr. Prog. Int. 2024, 44, 1932–1943. [Google Scholar]
  7. Sha, Z.; Li, Z.; Yu, N.; Zhang, Y. De-fake: Detection and attribution of fake images generated by text-to-image generation models. In Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, Copenhagen, Denmark, 26–30 November 2023; pp. 3418–3432. [Google Scholar]
  8. Puraivan, E.; Venegas, R.; Riquelme, F. An empiric validation of linguistic features in machine learning models for fake news detection. Data Knowl. Eng. 2023, 147, 102207. [Google Scholar] [CrossRef]
  9. Fröhling, L.; Zubiaga, A. Feature-based detection of automated language models: Tackling GPT-2, GPT-3 and Grover. PeerJ Comput. Sci. 2021, 7, e443. [Google Scholar] [CrossRef] [PubMed]
  10. Guo, B.; Ding, Y.; Yao, L.; Liang, Y.; Yu, Z. The future of false information detection on social media: New perspectives and trends. ACM Comput. Surv. (CSUR) 2020, 53, 68. [Google Scholar] [CrossRef]
  11. Dal Forno, A.J.; Richetti, G.P.; Knaesel, V.H. Fake news detection algorithms—A systematic literature review. Data Knowl. Eng. 2025, 158, 102441. [Google Scholar] [CrossRef]
  12. Chaka, C. Reviewing the performance of AI detection tools in differentiating between AI-generated and human-written texts: A literature and integrative hybrid review. J. Appl. Learn. Teach. 2024, 7, 1–12. [Google Scholar]
  13. Rane, R.; Subhashini, R. Multi-Feature Classification for Fake News Detection using Multiscale and Atrous Convolution-based Adaptive Temporal Convolution Network. Data Knowl. Eng. 2025, 160, 102469. [Google Scholar] [CrossRef]
  14. Alghamdi, J.; Lin, Y.; Luo, S. A comparative study of machine learning and deep learning techniques for fake news detection. Information 2022, 13, 576. [Google Scholar] [CrossRef]
  15. Crothers, E.N.; Japkowicz, N.; Viktor, H.L. Machine-generated text: A comprehensive survey of threat models and detection methods. IEEE Access 2023, 11, 70977–71002. [Google Scholar] [CrossRef]
  16. Kar, S.K.; Bansal, T.; Modi, S.; Singh, A. How Sensitive Are the Free AI-detector Tools in Detecting AI-generated Texts? A Comparison of Popular AI-detector Tools. Indian J. Psychol. Med. 2024, 47, 275–278. [Google Scholar] [CrossRef] [PubMed]
  17. Valiaiev, D. Detection of Machine-Generated Text: Literature Survey. arXiv 2024, arXiv:2402.01642. [Google Scholar]
  18. Yan, T.; Shen, S.L.; Zhou, A.; Chen, X. Prediction of geological characteristics from shield operational parameters by integrating grid search and K-fold cross validation into stacking classification algorithm. J. Rock Mech. Geotech. Eng. 2022, 14, 1292–1303. [Google Scholar] [CrossRef]
  19. Mitchell, E.; Lee, Y.; Khazatsky, A.; Manning, C.D.; Finn, C. Detectgpt: Zero-shot machine-generated text detection using probability curvature. In Proceedings of the International Conference on Machine Learning; PMLR: Breckenridge, CO, USA, 2023. [Google Scholar]
  20. Jawahar, G.; Abdul-Mageed, M.; Lakshmanan, L.V. Automatic detection of machine generated text: A critical survey. arXiv 2020, arXiv:2011.01314. [Google Scholar]
  21. Desaire, H.; Chua, A.E.; Kim, M.G.; Hua, D. Accurately detecting AI text when ChatGPT is told to write like a chemist. Cell Rep. Phys. Sci. 2023, 4, 101672. [Google Scholar] [CrossRef] [PubMed]
  22. Bellini, V.; Semeraro, F.; Montomoli, J.; Cascella, M.; Bignami, E. Between human and AI: Assessing the reliability of AI text detection tools. Curr. Med. Res. Opin. 2024, 40, 353–358. [Google Scholar] [CrossRef] [PubMed]
  23. Bakhtin, A.; Gross, S.; Ott, M.; Deng, Y.; Ranzato, M.; Szlam, A. Real or fake? learning to discriminate machine from human generated text. arXiv 2019, arXiv:1906.03351. [Google Scholar]
  24. Safi, R.; Jalali Naini, A. The Work of Students and ChatGPT Compared: Using Machine Learning to Detect and Characterize AI-Generated Text. In Proceedings of the Americas Conference on Information Systems (AMCIS), Panama City, Panama, 10–12 August 2023. [Google Scholar]
  25. Paustian, T.; Slinger, B. Students are using large language models and AI detectors can often detect their use. Front. Educ. 2024, 9, 1374889. [Google Scholar] [CrossRef]
  26. Greco, F.; Desolda, G.; Esposito, A.; Carelli, A. David versus Goliath: Can Machine Learning Detect LLM-Generated Text? A Case Study in the Detection of Phishing Emails. In Proceedings of the Italian Conference on CyberSecurity, Salerno, Italy, 8–12 April 2024. [Google Scholar]
  27. Çelikten, T.; Onan, A. HybridGAD: Identification of AI-Generated Radiology Abstracts Based on a Novel Hybrid Model with Attention Mechanism. Comput. Mater. Contin. 2024, 80, 3351–3377. [Google Scholar] [CrossRef]
  28. Verma, V.; Fleisig, E.; Tomlin, N.; Klein, D. Ghostbuster: Detecting text ghostwritten by large language models. arXiv 2023, arXiv:2305.15047. [Google Scholar]
  29. Cingillioglu, I. Detecting AI-generated essays: The ChatGPT challenge. Int. J. Inf. Learn. Technol. 2023, 40, 259–268. [Google Scholar] [CrossRef]
  30. Gaggar, R.; Bhagchandani, A.; Oza, H. Machine-generated text detection using deep learning. arXiv 2023, arXiv:2311.15425. [Google Scholar]
  31. Wang, P.; Li, L.; Ren, K.; Jiang, B.; Zhang, D.; Qiu, X. SeqXGPT: Sentence-level AI-generated text detection. arXiv 2023, arXiv:2310.08903. [Google Scholar]
  32. Liu, Y.; Shen, X.; Zhang, Y.; Wang, Z.; Tian, Y.; Dai, J.; Cao, Y. A systematic review of machine learning approaches for detecting deceptive activities on social media: Methods, challenges, and biases. Int. J. Data Sci. Anal. 2025, 20, 6157–6182. [Google Scholar] [CrossRef]
  33. Mindner, L.; Schlippe, T.; Schaaff, K. Classification of human-and ai-generated texts: Investigating features for chatgpt. In Proceedings of the International Conference on Artificial Intelligence in Education Technology; Springer: Berlin/Heidelberg, Germany, 2023; pp. 152–170. [Google Scholar]
  34. Alabduljabbar, R. User-centric AI: Evaluating the usability of generative AI applications through user reviews on app stores. PeerJ Comput. Sci. 2024, 10, e2421. [Google Scholar] [CrossRef] [PubMed]
  35. Najafabadi, M.M.; Villanustre, F.; Khoshgoftaar, T.M.; Seliya, N.; Wald, R.; Muharemagic, E. Deep learning applications and challenges in big data analytics. J. Big Data 2015, 2, 1–21. [Google Scholar] [CrossRef]
  36. Jalil, Z.; Nasir, M.; Alazab, M.; Nasir, J.; Amjad, T.; Alqammaz, A. Grapharizer: A graph-based technique for extractive multi-document summarization. Electronics 2023, 12, 1895. [Google Scholar] [CrossRef]
  37. Bayer, M.; Kaufhold, M.A.; Reuter, C. A survey on data augmentation for text classification. ACM Comput. Surv. 2022, 55, 146. [Google Scholar] [CrossRef]
  38. Ahmed, H.; Traore, I.; Mamun, M.; Saad, S. Text augmentation using a graph-based approach and clonal selection algorithm. Mach. Learn. Appl. 2023, 11, 100452. [Google Scholar] [CrossRef]
  39. Pilowsky, J.K.; Elliott, R.; Roche, M.A. Data cleaning for clinician researchers: Application and explanation of a data-quality framework. Aust. Crit. Care 2024, 37, 827–833. [Google Scholar] [CrossRef] [PubMed]
  40. Bhaumik, A.B.; Das, M. Sarcasm Detection in Dravidian Code-Mixed Text Using Transformer-Based Models. In Proceedings of the FIRE (Working Notes), Goa, India, 15–18 December 2023; pp. 249–258. [Google Scholar]
  41. Liu, B.; Chen, C.H.; Wang, Z. A multi-hierarchical aggregation-based Graph Convolutional Network for industrial knowledge graph embedding towards cognitive intelligent manufacturing. J. Manuf. Syst. 2024, 76, 320–332. [Google Scholar] [CrossRef]
  42. Lefort, B.; Benhamou, E.; Ohana, J.J.; Saltiel, D.; Guez, B. Optimizing Performance: How Compact Models Match or Exceed GPT’s Classification Capabilities through Fine-Tuning. arXiv 2024, arXiv:2409.11408. [Google Scholar]
  43. Kandel, I.; Castelli, M. The effect of batch size on the generalizability of the convolutional neural networks on a histopathology dataset. ICT Express 2020, 6, 312–315. [Google Scholar] [CrossRef]
  44. Liao, L.; Li, H.; Shang, W.; Ma, L. An empirical study of the impact of hyperparameter tuning and model optimization on the performance properties of deep neural networks. ACM Trans. Softw. Eng. Methodol. (TOSEM) 2022, 31, 53. [Google Scholar] [CrossRef]
  45. Reverter Lopez, E. Evaluation of Interpretability Methods in Extractive NLP. Master’s Thesis, Universitat Politècnica de Catalunya, Barcelona, Spain, 2023. [Google Scholar]
Figure 1. Organization of the paper.
Figure 1. Organization of the paper.
Applsci 16 07249 g001
Figure 2. Distribution of human and AI-generated text data sources.
Figure 2. Distribution of human and AI-generated text data sources.
Applsci 16 07249 g002
Figure 3. Examples of data collected from different languages.
Figure 3. Examples of data collected from different languages.
Applsci 16 07249 g003
Figure 4. Flowchart for the proposed hybrid model.
Figure 4. Flowchart for the proposed hybrid model.
Applsci 16 07249 g004
Figure 5. Performance evaluation for the proposed model on English, Turkish, and Arabic datasets.
Figure 5. Performance evaluation for the proposed model on English, Turkish, and Arabic datasets.
Applsci 16 07249 g005
Figure 6. Confusion matrix for cross-dataset evaluation on 2000 held-out Kaggle samples after domain-adaptation fine-tuning (accuracy = 92.2%).
Figure 6. Confusion matrix for cross-dataset evaluation on 2000 held-out Kaggle samples after domain-adaptation fine-tuning (accuracy = 92.2%).
Applsci 16 07249 g006
Table 1. Related works and comparison with our work.
Table 1. Related works and comparison with our work.
Ref.Dataset LanguageDatasetPurposeMethodAnalysis and Findings
[19]EnglishXSum, SQuAD, PubMedQADetection of texts generated by large language models (LLM).A new skew standard criterion called DetectGPT was defined. Text detection was performed with random perturbations.DetectGPT was found to be more discrete than existing zero-shot methods, and its AUROC in detecting fake news articles ranged from 0.81 to 0.95.
[20]EnglishDatasets like WebText, Amazon Product Reviews, RealNews, and Common Crawl were used. (English Dataset)Separation of texts generated by text generator models (TGMs) from human-written texts.TGMs exist with bad conditions such as fake news and fake product reviews.Existing TGMs, text generation methods and social effects are discussed; AI detectors that can distinguish TGM texts from human-written texts.
[21]EnglishThis paper uses texts from 10 chemistry journals and AI-generated texts from ChatGPT-3.5 and GPT-4 to build a classifier.Comparison of texts generated by ChatGPT and other major language models with chemical texts.Developed a method to detect AI texts using an XGBoost classifier on texts generated by GPT-3.5 and GPT-4 from 13 chemistry journals.The method is capable of distinguishing human and AI texts with 99% accuracy, allowing tracking of AI usage in the scientific literature..
[22]EnglishIn this paper, texts generated by ChatGPT-4 and texts written by a human author were compared.Large Language Models (LLMs) like ChatGPT-4 are able to distinguish human-generated content.Two texts generated with different instructions via ChatGPT-4 and one human text were analyzed.The detection tools were found to have different levels of variety and specificity, showing significant differences in their accuracy.
[23]EnglishIn the paper, the Books Corpus, CCNews, and Wikitext-103 datasets are used.Discrimination of human and machine-generated texts using energy-based models (EBM).Negative examples were generated using pre-trained autoregressive language models and EBM was trained to discriminate between the texts.EBM was able to generalize to changes in the architecture of the generated negatives, but was sensitive to the training set.
[24]EnglishTexts were collected from 85 graduate students and ChatGPT-4 during a Business Analytics course at a U.S. university.To improve ChatGPT’s text generation.In the experiment, real student responses were tested with ChatGPT-generated responses.It was seen that a clear distinction could be made between student and AI responses, with AI texts generally using more formal language.
[25]EnglishCollected from students in the Microbiology 303 course at the University of Wisconsin-Madison.To examine students’ use of large language models (LLMs) and their ability to detect AI-authored text.153 students were asked to write a paper on microbiology.It was found that AI detectors could generally distinguish between human and AI text, but the margin of error was significant.
[26]EnglishNazario Nigerian Fraud DatasetTo detect whether developer phishing emails titled “David vs Goliath” were generated by LLM.Analysis of phishing emails was performed using traditional machine learning models such as logistic regression.The model achieved high accuracy rates in detecting LLM-generated emails and was able to provide explanations that would help hide the exploits that users were hiding.
The proposed modelTurkish, English, ArabicIt is composed of human (forum, article, news) and artificial intelligence (ChatGPT, Gemini, Copilot) texts in Turkish, English, and Arabic languages.Contributing to reducing the spread of fake information by providing an innovative, fast and multilingual model for the detection of artificial intelligence-based content.A hybrid integration of a Transformer-based language model (DistilBERT) with a graph-based model. Utilization of a multi-language dataset, stylometric analysis, and contextual semantic analysis.A fast and multilingual model has been presented, capable of detecting fake texts with 98% accuracy for Turkish and Arabic and 99% accuracy for English.
Table 2. Model parameter description.
Table 2. Model parameter description.
ParameterDescriptionValue
Output DirectoryDirectory to save the training results../results
Number of EpochsTotal number of training epochs.25
Learning RateInitial learning rate for updating model parameters. 2 × 10 5
Train Batch SizeBatch size per device during training.64
Evaluation Batch SizeBatch size per device during evaluation.64
Weight DecayWeight decay rate used for regularization.0.3
Logging DirectoryDirectory for saving logs../logs
Warmup StepsNumber of steps for learning rate warmup.100
Mixed Precision (FP16)Whether to use FP16 (if CUDA is available).True
Gradient Accumulation StepsNumber of steps for gradient accumulation.1
Gradient Clipping NormMaximum norm for gradient clipping.0.5
Best Model SavingLoad the best model at the end of training.True
Saving StrategyWhen to save the model checkpoints.steps
Evaluation StrategyWhen to run evaluation.steps
Save Total LimitMaximum number of saved checkpoints.2
Learning Rate SchedulerStrategy for adjusting the learning rate.linear
Gradient CheckpointingWhether to use gradient checkpointing to save memory.True
Log First StepLog the first training step.True
Table 3. Performance comparison of the proposed model with the methods in the literature.
Table 3. Performance comparison of the proposed model with the methods in the literature.
ReferenceContributionsMethodsDataset LanguageDatasetPerformanceClassification
[27]Improved text classification architectureLSTM, Bi-LSTM, Attention mechanism, Bi-GRU, Fully Connected NetworkEnglishRadiology abstracts: AI-generated, paraphrased, and human-written.(Accuracy: 90%, Precision: 0.85, Recall: 0.84, F1-Score: 0.84)Multiclass
[28]A model for detecting AI-generated textGhostbusterEnglishCreative Writing, News, Student Essays datasets(Accuracy: 97.5%, F1-Score: 99%, Diversity General Performance: 96.5%)Binaryclass
[29]Proposed a machine learning model to detect AI-generated essaysSVM, n-gram Discrepancy Bag-of-Words modelEnglishStudent Essays dataset (230 essays)(Accuracy: 92.7%, F2-Score: 97.2%)Binaryclass
[30]Developed models to detect machine-generated text across domains using RoBERTa and SVMRoBERTa-base, RoBERTa-large, SVMEnglishMultiple datasets: Twitter Sentiment, Football Commentary, PubMedQA, SQuAD, Project Gutenberg(AUC-ROC: 97.11%, F1-Score: 99%)Binaryclass
[31]Introduced SeqXGPT for sentence-level AI-generated text detectionSeqXGPT with Convolution and Self-Attention NetworksEnglishSeqXGPT-Bench dataset with mixed human and AI-generated sentences(Macro-F1: 97.6%, Precision: 99.2%, Recall: 98.2%)Binaryclass
Proposed ModelLanguage-based Fake Content DetectionHybrid DistilBERT+Graph ModelMulti-lingual (Turkish, Arabic, English)Multi-lingual Dataset, Stylometric and Contextual AnalysisAccuracy: 98% (Turkish, Arabic), 99% (English)Binaryclass
Table 4. Performance metrics of datasets in three different languages.
Table 4. Performance metrics of datasets in three different languages.
DatasetAccuracyPrecisionRecallF1-Score
English0.990.991.00.99
Turkish0.980.980.990.98
Arabic0.980.960.990.98
Table 5. Wilson 95% confidence intervals for held-out test accuracy and two-proportion z-tests against the BERT baseline (Table 6) on the same test partitions.
Table 5. Wilson 95% confidence intervals for held-out test accuracy and two-proportion z-tests against the BERT baseline (Table 6) on the same test partitions.
LanguagentestAccuracy95% CIp-Value vs. BERT
English17650.996[0.992, 0.998]<0.001
Turkish19950.988[0.982, 0.992]<0.001
Arabic16910.980[0.972, 0.986]0.98
Table 6. Performance metrics of various models on Turkish, English, and Arabic datasets.
Table 6. Performance metrics of various models on Turkish, English, and Arabic datasets.
DatasetModelsAccuracyPrecisionRecallSpecificityF1-ScoreTotal Time (min)
TurkishBERT0.950.960.980.950.973.54
RoBERTa0.920.900.960.870.933.46
ELECTRA0.950.920.990.900.964.37
LSTM0.950.970.940.970.950.32
Random Forest0.910.910.900.910.910.07
SVM0.940.950.930.950.940.07
GCN+BERT0.960.960.980.950.974.49
GCN+DistilBERT0.9880.9870.990.9860.9892.51
EnglishBERT0.980.980.970.980.982.28
RoBERTa0.990.980.990.980.992.23
ELECTRA0.990.990.980.990.992.21
LSTM0.970.970.970.960.970.31
Random Forest0.970.950.990.940.970.07
SVM0.990.990.990.990.990.07
GCN+BERT0.9980.9971.00.9960.9982.41
GCN+DistilBERT0.9960.9931.00.9930.9961.32
ArabicBERT0.980.970.990.970.983.56
RoBERTa0.910.870.970.850.924.13
ELECTRA0.49 (No Learning)
LSTM0.970.970.970.970.970.32
Random Forest0.960.950.980.950.960.07
SVM0.970.970.980.970.970.07
GCN+BERT0.9810.9740.9880.9730.9814.29
GCN+DistilBERT0.980.9670.9940.9660.982.58
Table 7. Ablation study isolating the GCN, preprocessing, and augmentation components across languages.
Table 7. Ablation study isolating the GCN, preprocessing, and augmentation components across languages.
LanguageVariantAcc.Prec.Rec.Spec.F1
EnglishGCN+DistilBERT (full)0.9960.9931.0000.9930.996
EnglishDistilBERT only0.9600.9510.9700.9490.961
EnglishGCN features without fusion0.9550.9340.9800.9290.957
EnglishWithout preprocessing0.9750.9800.9700.9800.975
EnglishWithout data augmentation0.9100.9470.8740.9480.909
EnglishGCN 1-layer0.9800.9621.0000.9600.981
EnglishGCN 3-layer0.9700.9520.9900.9490.971
TurkishGCN+DistilBERT (full)0.9880.9870.9900.9860.989
TurkishDistilBERT only0.7800.7500.8650.6880.804
TurkishGCN features without fusion0.7300.6810.9040.5420.777
TurkishWithout preprocessing0.8150.7680.9230.6980.838
TurkishWithout data augmentation0.7250.6940.8350.6080.758
TurkishGCN 1-layer0.7550.7270.8460.6560.782
TurkishGCN 3-layer0.7650.7360.8560.6670.791
ArabicGCN+DistilBERT (full)0.9800.9670.9940.9660.980
ArabicDistilBERT only0.7450.6870.9000.5900.779
ArabicGCN features without fusion0.7100.6440.9400.4800.764
ArabicWithout preprocessing0.8250.7600.9500.7000.844
ArabicWithout data augmentation0.8150.7640.9220.7040.836
ArabicGCN 1-layer0.8150.7600.9200.7100.833
ArabicGCN 3-layer0.7850.7710.8100.7600.790
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Bostancioglu, A.; Das, B.; Bulut Ozek, M. Multilingual AI-Generated Text Detection in Arabic, English, and Turkish Using a Hybrid Transformer–Graph Convolutional Network. Appl. Sci. 2026, 16, 7249. https://doi.org/10.3390/app16147249

AMA Style

Bostancioglu A, Das B, Bulut Ozek M. Multilingual AI-Generated Text Detection in Arabic, English, and Turkish Using a Hybrid Transformer–Graph Convolutional Network. Applied Sciences. 2026; 16(14):7249. https://doi.org/10.3390/app16147249

Chicago/Turabian Style

Bostancioglu, Ayca, Bihter Das, and Muzeyyen Bulut Ozek. 2026. "Multilingual AI-Generated Text Detection in Arabic, English, and Turkish Using a Hybrid Transformer–Graph Convolutional Network" Applied Sciences 16, no. 14: 7249. https://doi.org/10.3390/app16147249

APA Style

Bostancioglu, A., Das, B., & Bulut Ozek, M. (2026). Multilingual AI-Generated Text Detection in Arabic, English, and Turkish Using a Hybrid Transformer–Graph Convolutional Network. Applied Sciences, 16(14), 7249. https://doi.org/10.3390/app16147249

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop