Abstract
Terms are specialized words and expressions used in particular disciplines, cultures, or fields. They usually carry precise meanings and aim to describe referents accurately and clearly. Due to differences in culture, history, and other factors across countries, the development of indigenous Chinese linguistic terms plays a vital role in bridging cultural gaps and promoting the dissemination of Chinese culture. These terms not only explain specific words in Chinese and describe unique linguistic phenomena, but also embody the core concepts and academic traditions of Chinese linguistics, thereby contributing to the global spread and development of Chinese civilization. In order to achieve cross-linguistic dissemination of indigenous terms, we construct a linguistically informed bilingual corpus encompassing a broad spectrum of linguistic subfields, together with novel methods for the automatic extraction and cross-linguistic alignment of terminologies. The resulting corpus contains over 22,000 aligned sentence pairs across nine linguistic domains, providing a robust foundation for bilingual term mining. Building upon this resource, we further propose a multi-channel graph neural network (MCGNN) that jointly models semantic, syntactic, sequential, and co-occurrence relations, thereby enabling multi-perspective reasoning and achieving more accurate bilingual term extraction and alignment. Experimental results demonstrate that our approach substantially improves the accuracy and consistency of bilingual term extraction, alleviates the resource scarcity in the linguistic domain, and provides a solid foundation for future research and applications in cross-linguistic knowledge sharing and academic communication.
1. Introduction
As global exchanges between civilizations become increasingly frequent, language serves as the core vehicle for cultural communication. In this context, the accurate transmission and comprehension of indigenous linguistic terms have become ever more crucial. Terms are essential linguistic units for building professional knowledge systems, acting as key vehicles for expressing domain-specific concepts and ideas. Given the importance of terminology in various disciplines such as translation studies, information retrieval, and semantic modeling, term extraction is gradually becoming one of the core tasks in both linguistic and interdisciplinary research in computational linguistics. Traditional terminology research has largely relied on linguists manually annotating corpora and building structured databases. Although this approach ensures high quality, it encounters significant challenges in efficiency and consistency when applied to cross-lingual, large-scale, and multi-domain scenarios. Term extraction [1] refers to the process of identifying and retrieving indigenous terms from Chinese-language literature using techniques such as natural language processing. Its core resides in the precise demarcation and identification of specialized terminologies. Term alignment [2] signifies the process of systematically correlating indigenous Chinese terms with their counterparts in other languages. It entails transcending cultural disparities and achieving accurate semantic mapping through semantic association modeling. In this paper, we construct a linguistically informed bilingual corpus of indigenous terms to support automatic term extraction and alignment across languages, covering a wide range of linguistic subfields. Additionally, we propose a novel multi-channel graph neural network (MCGNN) that integrates four complementary perspectives—co-occurrence patterns, syntactic structures, semantic relations, and sequential dependencies—via dedicated graph encoders (GCN, GAT, GraphSAGE, and a BiLSTM with relative position embeddings). This design enables the model to capture both local and global contextual signals, thereby enhancing the robustness and accuracy of term identification and alignment. To the best of our knowledge, this is the first work that jointly models these four linguistic views within a unified graph-based framework for bilingual terminology processing, going beyond simple multi-view concatenation by using specialized aggregation mechanisms tailored to each relation type. The entire model is trained end-to-end with a CRF decoder, treating term extraction and alignment as a unified sequence labeling problem. The joint modeling of term extraction and bilingual alignment contributes to model performance in several ways. First, unlike pipelined systems that perform extraction and alignment in separate stages, our unified sequence labeling approach encodes each Chinese–English sentence pair as a single contiguous sequence with a separator token, allowing the graph neural network to propagate information across language boundaries during message passing. This cross-lingual information flow means that extraction in one language can benefit from the alignment signal in the other: when the model identifies a term on the English side, the shared representation space and graph structure help constrain and refine term boundaries on the Chinese side, and vice versa. Second, alignment quality depends critically on correct extraction, since aligned term types are derived from the predicted BIO labels on both sides. By jointly optimizing both objectives in one forward pass, the model learns to balance boundary precision and cross-lingual consistency, rather than suffering from error propagation that plagues pipelined approaches. Third, the experimental results reflect this synergy: MCGNN achieves the highest aligned accuracy and align F1 among all baselines, while also attaining the best monolingual term extraction F1-scores for both Chinese and English. In contrast, models that perform well on extraction alone do not necessarily excel on alignment metrics, indicating that the integrated design captures cross-lingual correspondences that isolated extraction or post hoc alignment cannot. Moreover, we also introduce a new term-level alignment strategy to complement the category-level alignment scheme in conventional sequence labeling-based alignment tasks, providing a more fine-grained evaluation. These findings demonstrate the potential of combining linguistically informed resources with advanced neural architectures for scalable and effective terminology processing.
2. Related Work
2.1. Monolingual Term Extraction
Automatic term extraction (ATE) refers to the task of automatically identifying domain-specific terms from large-scale text corpora, and it has long been regarded as a fundamental problem in ontology construction, text summarization, and knowledge graph development [3]. Previous studies have also highlighted its importance in downstream applications such as information retrieval and machine translation [4]. According to the techniques and principles of monolingual term extraction, existing approaches can generally be categorized into five types: rule-based methods, statistical methods, machine learning-based methods, traditional deep learning-based methods, and, more recently, large language model (LLM)-based methods [3,4]. Each of these approaches has its own advantages, and integrating multiple methods has been shown to further improve overall performance [5].
2.2. Bilingual Term Extraction and Alignment
According to the type of corpora used, bilingual term extraction can generally be divided into two main approaches: methods based on parallel corpora and methods based on comparable corpora. Parallel corpora consist of pairs of source- and target-language texts that are mutual translations, exhibiting a high degree of alignment. This property allows parallel corpora to provide direct and reliable contrastive information, making them particularly suitable for identifying bilingual term correspondences [6]. In contrast, comparable corpora are not mutual translations but consist of monolingual texts in different languages covering the same or similar topics. Compared with parallel corpora, comparable corpora are easier to obtain and offer broader coverage, but they pose greater challenges for alignment [7].
Bilingual term extraction has evolved through various methodological perspectives, depending on the availability and quality of linguistic resources. While some studies exploit comparable corpora to broaden domain coverage, others rely on parallel corpora to achieve more precise alignment. The choice of corpus type often reflects a trade-off between data accessibility and alignment accuracy. In this work, we focus on bilingual linguistic parallel corpora, as they offer stronger contextual correspondence and higher reliability for identifying translation equivalents.
Lefever et al. [8] present a language-pair-independent approach that uses sub-sentential alignment and statistical filtering to extract high-quality term pairs across multiple languages, demonstrating strong performance for cross-language information processing. Vintar [9] proposes a Slovene–English term mapping method combining statistical and syntactic extraction from word-aligned parallel texts, noting that the syntactic method captures high-value multi-word terms but requires labeled corpora. Zhang et al. [10] introduce a multi-level termhood measure derived from domain-general corpus comparisons to constrain bilingual alignment, effectively improving extraction accuracy. Almeida et al. [11] demonstrate the feasibility of building large-scale bilingual terminology databases by first constructing parallel corpora from websites, offering a practical solution for resource-poor languages. Ideue et al. [12] compare three unsupervised statistical measures (Score_F, Score_L, Score_C) for ranking candidate term pairs, showing that their combination significantly enhances the identification of correct pairs. Macken et al. [13] present the TExSIS system, which uses chunk-based alignment with statistical filtering and highlights the value of multilingual evidence in improving term unithood reliability. Guo et al. [14] train a Siamese network with hard negatives to map sentences into a shared embedding space, achieving competitive parallel corpus reconstruction at both sentence and document levels. Repar et al. [15] integrate embedding, character, and cognate features for high-precision term alignment, retrieving top candidates via cosine similarity before classification. Liu et al. [16] introduce GIST, a large-scale multilingual terminology dataset using a hybrid LLM–human framework, which informs our corpus construction and evaluation framework by validating the effectiveness of hybrid methodologies for terminology collection. Zaratiana et al. [17] propose GraphER, which formulates entity and relation extraction as graph structure learning, enabling dynamic refinement of graph structure during extraction and joint prediction rather than separate pipelines—an approach that resonates with our multi-channel graph design. Hu and Xu [18] present DM-BLI, applying dynamic multi-subspace alignment to bilingual lexicon induction, which aligns with our alignment supervision strategy by highlighting the importance of fine-grained, subspace-level cross-lingual correspondence. Latouche et al. [19] propose BinaryAlign, modeling word alignment as binary sequence labeling, which parallels our task formalization and evaluation approach, though our framework extends this to multi-category terminology with composite label structures.
Despite notable advancements in prior work on term extraction and alignment, existing methods still face several limitations that our work aims to address: (1) Existing methods often depend on manually constructed lexicons, heuristic rules, or pre-trained models. As a result, they tend to perform poorly in emerging domains or when encountering novel terms, revealing limited adaptability. (2) Most existing approaches struggle to adequately capture terms within their contextual relationships across semantic, syntactic, and document-level layers, particularly leading to errors in multi-word terms or semantically ambiguous cases. (3) In terms of bilingual term alignment, existing methods often rely on word- or phrase-level correspondences and neglect higher-level semantic consistency, which may result in inaccurate alignment of term pairs. To overcome these issues, we propose a novel neural network approach that integrates a multi-channel graph neural network framework from four complementary perspectives: co-occurrence patterns, syntactic structures, semantic relations, and sequential dependencies. This design enables our model to capture both local and global contextual signals, thereby enhancing the robustness and accuracy of term extraction and alignment in diverse domains.
In summary, the main contributions of this work are as follows:
- 1.
- We presented a hierarchical indigenous terminology system of Chinese linguistics and constructed the corresponding bilingual parallel corpus of indigenous terms. This taxonomy provides a systematic framework for organizing linguistic knowledge across multiple subfields, including nine major categories such as phonetics, morphology, semantics, and pragmatics. The resulting bilingual corpus, annotated under this unified framework, serves as a valuable resource for research in linguistic knowledge representation, terminology extraction, and cross-lingual language processing.
- 2.
- We proposed a multi-channel graph neural network (MCGNN) that jointly addresses term extraction and alignment by treating them as a unified sequence labeling problem. This is achieved through the integration of four distinct channels: syntax, semantics, sequence, and co-occurrence graphs, each employing a dedicated graph encoder (GAT, GraphSAGE, BiLSTM with relative position embeddings, and GCN). This integration allows the model to capture complementary linguistic and structural information, leading to more accurate term extraction and alignment.
- 3.
- We validate the effectiveness of the proposed MCGNN framework and the utility of the newly constructed bilingual linguistic corpus. Through systematic comparisons against a wide range of baselines, we demonstrate that MCGNN achieves consistent and statistically significant improvements in both term extraction and alignment tasks. Ablation studies, significance testing, and error analysis further corroborate the robustness of our model. In addition, we introduce a term-level evaluation paradigm based on a composite labeling strategy, providing a new benchmark for future research in fine-grained terminology alignment.
3. Bilingual Corpus for Chinese Linguistic Indigenous Terminology
3.1. Construction of Terminological Type System
In this paper, to ensure comprehensive coverage and terminological accuracy, we systematically reviewed a large number of representative works in the field of Chinese linguistics, including textbooks, monographs, and journal articles. Based on this extensive review, we established a hierarchical terminology system comprising nine fundamental categories. This classification not only incorporates commonly used categories in traditional linguistics, but also covers representative categories of mainstream modern linguistics. Such a design ensures that the system inherits classical theoretical foundations while accommodating the applicability and coverage of modern linguistic research. These nine categories are essential for organizing linguistic knowledge and serve as the backbone for constructing domain-specific corpora, as well as facilitating terminology extraction, alignment, and knowledge mapping in the field.
Table 1 presents the complete bilingual classification system for Chinese linguistic terminology, listing the nine categories both in Chinese and their corresponding English equivalents. This structured classification provides a clear framework to standardize terminology usage and supports further research and application in Chinese linguistics.
Table 1.
Term Classification System for Chinese Linguistic Terminology (Bilingual Version).
To provide a clearer view of the linguistic terminology system, we also present a hierarchical graph illustrating the organization and relationships among the main categories and their representative example. The graph is shown in Figure 1.
Figure 1.
Hierarchical Structure of Linguistic Terminology.
3.2. Terminology Labeling
In this paper, term extraction and alignment are essentially a sequence labeling task, which requires proper annotation of raw data to enable effective model training. We adopt the widely used BIO (Begin–Inside–Outside) labeling scheme, where “B” marks the beginning of a term, “I” indicates the continuation inside the term, and “O” denotes tokens outside any term. Each sentence pair, consisting of Chinese text followed by its English translation, is separated by a <sep> marker, and each word/token is annotated with its corresponding BIO label, indicating different terminology types. In addition, we have annotated “align_id” to represent the fine-grained alignment link relationship between Chinese and English terms. The same Chinese and English IDs in a sentence represent a set of term pairs.
Building upon the nine major categories defined in the Chinese Linguistic Classification System introduced earlier, we generate a total of 19 distinct label classes to cover the different types of terms. When performing term-level alignment tasks, merge BIO labels with alignment IDs to generate composite labels. The maximum number of fine-grained term alignment type labels has been expanded from 19 to 18 × n + 1, where “n” is the maximum value of the same term type label in a sentence of the bilingual corpus. To illustrate this annotation approach, Table 2 presents an example of a labeled sequence from “Syntax” text samples. For instance, the sentence “Understanding the structure of subject is the basis for reading and writing” is annotated such that each token receives a corresponding BIO label reflecting its role and category in the term sequence. This example demonstrates how terms belonging to specific classes are precisely marked, facilitating accurate term extraction and alignment in subsequent processing.
Table 2.
Example of annotating Bilingual Linguistics Parallel Corpus in Chinese and English.
3.3. The Static Analysis of Bilingual Corpus
Through a combination of automated annotation and manual verification, a bilingual Chinese linguistic corpus of indigenous terms was constructed. The detailed distribution of terms across different linguistic categories is presented in Table 3. Overall, the corpus contains 22,828 sentence pairs with a total of 136,872 annotated terms. Among these, phonetic terms (Pho) and morphological terms (Mor) account for the largest proportions, reflecting the richness of phonetic and morphological variation in the dataset. The number of “B” and “I” labels varies across categories, indicating differences in term length and complexity among the various linguistic types.
Table 3.
Statistics of Terms and Labels by Category.
4. Multi-Channel Graph Neural Network
4.1. Model Framework
Based on the architecture of Multi-Channel Graph Neural Networks, our framework for linguistic term extraction integrates four types of graphs—semantic graph, syntactic graph, sequence graph, and co-occurrence graph—as illustrated in Figure 2. The entire model consists of three main components: the embedding layer, the graph fusion layer, and the CRF layer. In the embedding layer, we integrate position embeddings and fused semantic embeddings, which are obtained by concatenating static word embeddings with contextualized dynamic embeddings, to comprehensively capture sequential dependencies, contextual relationships, and lexical features of the input text. The graph fusion layer aggregates multi-view information from the four heterogeneous graphs, each representing the input from a distinct linguistic perspective. Specifically, the semantic graph captures global contextual relationships derived from deep semantic similarity. The sequence graph encodes local word dependencies using BiLSTM and relative positional encoding to preserve sequential order. The syntactic graph incorporates grammatical structure through dependency parsing, while the co-occurrence graph reflects statistical co-appearance patterns among terms. By jointly modeling these complementary sources of linguistic knowledge, the graph fusion layer generates enriched, structure-aware node representations. These representations are then passed to a CRF decoding layer, which performs structured prediction to identify and label term boundaries with high precision.
Figure 2.
Model Architecture of Our Proposed Framework.
4.2. The Embedding Layer
4.2.1. Positional Embedding
Context information is a crucial factor influencing the model’s performance. We introduce a positional embedding mechanism to encode the relative or absolute position of tokens within a sentence, enabling the model to better capture local and global dependencies. Specifically, for an input sequence of length n, the positional embedding matrix is added to the input word embeddings :
Here, d denotes the embedding dimension. Each position i in P is assigned a fixed vector, which can be either learned or constructed using deterministic functions such as sine and cosine:
This design ensures that the model is aware of the order of the tokens, which is essential for downstream tasks such as linguistic terminology extraction. In our graph convolutional setup, these position-aware features are further propagated through the graph to enhance the representation of syntactic and semantic relations.
4.2.2. Fused Semantic Embedding
The input to our model consists of bilingual Chinese–English sentence pairs, where each word/token is annotated with its corresponding BIO label, indicating terminology types. Each sentence pair is concatenated using a <sep> marker, with Chinese text appearing first, followed by its English translation. This sequential format ensures that the model can simultaneously leverage both local context within each language and cross-lingual correspondences between languages.
Traditional static word embeddings are often insufficient for bilingual term extraction due to their inability to capture contextual variations and cross-lingual semantic alignment. To address this, we propose a multi-vector fusion approach that integrates static word embeddings, contextualized embeddings from XLM-RoBERTa-base, and positional encodings. By concatenating these three complementary representations, the model can leverage both the semantic generality of static embeddings and the contextual sensitivity of dynamic embeddings, while positional information further enhances structural awareness. This combined representation improves semantic alignment between Chinese and English terms, leading to more accurate and robust domain-specific terminology extraction, especially in low-resource or noisy environments.
4.3. The Graph Fusion Layer
4.3.1. Semantic Extraction Graph
The semantic graph is constructed based on the semantic similarity between words, where edges are formed by computing cosine similarities between word embeddings. To model the semantic relationships effectively, we adopt the GraphSAGE framework, which is well-suited for large-scale graph-structured data. Our semantic graph incorporates two key components: a Mean Aggregation layer and a Transformer layer. The Mean Aggregation layer aggregates information by computing the average features of a node’s neighbors, which ensures high computational efficiency and memory friendliness. This enables scalable and efficient learning over massive semantic graphs. To enhancing the ability of expressing node, model also assembling Tranformer layer, optimizing node features by attention mechanism. The whole network uses multi-layer architecture, including batch normalization and dropout regularization, to guarantee the stability of training and enhance the model’s generalization capability. The advantages of semantic graph is having ability to capture deep semantic relationships across words, providing semantic-level support for term recognition, maintaining high computing efficiency in the meantime.
The semantic graph framework begins by constructing a graph where each node represents a word with embedding vector .
Edges are established based on the cosine similarity between normalized embeddings , and the adjacency matrix is determined by a similarity threshold .
To efficiently capture and propagate semantic information, the model employs a multi-layer architecture that integrates both a Mean Aggregation layer and a Transformer layer.
In the Mean Aggregation layer, each node’s representation is updated by aggregating the average features of its neighbors , ensuring scalability and computational efficiency.
The subsequent Transformer layer leverages the self-attention mechanism Attention to further enhance node features, enabling the model to capture complex and long-range semantic dependencies.
Additional techniques such as batch normalization and dropout are utilized throughout the network to stabilize training and improve generalization. This design allows the semantic graph to effectively support term recognition by modeling deep semantic relationships while maintaining high performance and efficiency. The threshold for the semantic similarity graph was set to 0.6, which provided a good trade-off between graph sparsity and connectivity.
4.3.2. Syntax Extraction Graph
The syntax graph is constructed based on dependency syntax analysis, where syntactic dependency relations between words are extracted using the spaCy library for both Chinese and English texts. This graph captures deep structural relationships at the syntactic level and provides structural support for term recognition. The syntax graph leverages a Graph Attention Network (GAT) for feature learning, where an attention mechanism is employed to adaptively learn the importance of different syntactic dependencies. Each GAT layer contains learnable attention weights that dynamically adjust the strength of information propagation based on the type and intensity of the syntactic relations. In addition, the model incorporates dependency relation type encoding, which maps various syntactic relations (e.g., subject–verb, verb–object) into numerical representations. This provides the graph neural network with richer structural information. Through multi-head attention, the model is capable of simultaneously focusing on multiple syntactic patterns. The strength of the syntax graph lies in its ability to capture syntactic dependencies between words, making it particularly effective in identifying domain-specific terms with complex grammatical structures. It offers fine-grained syntactic guidance for accurate term recognition.
Figure 3 illustrates the structure of the Graph Attention Network (GAT) applied to the Syntax Extraction Graph.
Figure 3.
Graph Attention Network.
To construct the syntax graph, the adjacency matrix is determined by the existence of a syntactic dependency relation between word i and word j.
Each edge in the graph is assigned a dependency relation type encoding , where the dependency type between word i and j is converted into a numerical identifier using a mapping function .
Within each GAT layer, the unnormalized attention coefficient between node i and its neighbor j is computed through a shared linear transformation followed by a LeakyReLU activation.
The attention weights are obtained by normalizing across all neighbors of node i using a softmax function, ensuring the relative importance of each neighbor is preserved.
Each node’s feature representation is updated by aggregating its neighbors’ transformed features, weighted by the learned attention coefficients , followed by a non-linear activation .
To enhance learning capacity, multi-head attention is applied. Representations from multiple independent attention heads (M in total) are concatenated to form the final output, allowing the model to capture diverse syntactic patterns.
4.3.3. Sequence Extraction Graph
To capture sequential dependencies and fine-grained positional relationships among words, we construct a local sequence graph based on relative positions. While traditional sequence models like BiLSTM are not graph-based in nature, we integrate graph-inspired structural design by explicitly modeling relative positional relations between words in the sequence. Specifically, we treat each word as a node and connect it to other words within a fixed-size contextual window, forming a local neighborhood akin to a graph structure. The key innovation lies in the use of learnable relative position embeddings to represent edge relations between word nodes.
The overall architecture integrates BiLSTM for contextual encoding and a relative position module for position-aware representation. The BiLSTM provides rich semantic features, while the relative position embeddings introduce structural bias that mimics graph edge weights. Together, they form a hybrid structure that combines sequence modeling with local graph connectivity.
The input word embeddings X are first passed through a BiLSTM to obtain context-aware representations H. This captures sequential semantics in both forward and backward directions.
To encode the relative structural relations between word i and word j, we introduce a learnable embedding function , which generates a position embedding matrix based on the distance .
For each word node i, its final position representation is obtained by averaging its relative embeddings with all other nodes. This implicitly encodes the word’s position in the local sequence graph.
Finally, the semantic and structural representations are fused via element-wise addition, followed by dropout. The output captures both sequential semantics and local graph-inspired positional information.
4.3.4. Co-Occurrence Extraction Graph
The co-occurrence graph is constructed based on the co-occurrence relations of words within the text, aiming to capture local contextual dependencies between words. A sliding window mechanism is applied to count co-occurrence frequencies and build the co-occurrence matrix. Specifically, given a predefined window size (set to 5 by default), the graph computes how frequently each word co-occurs with surrounding words within the window, which is used to determine the edge weights between word nodes. The graph adopts a Graph Convolutional Network (GCN) for feature learning, where multiple layers of graph convolutions are employed to aggregate information from neighboring nodes. The architecture consists of an input layer and multiple hidden layers, each incorporating graph convolution, linear transformation, non-linear activation, and dropout regularization. To enhance the model’s effectiveness, a TF-IDF weighting scheme is also introduced to reweight the co-occurrence matrix, emphasizing the contribution of more informative word pairs. The key advantage of the co-occurrence graph lies in its ability to effectively capture local semantic associations between words, thereby providing rich contextual information for term recognition.
The co-occurrence matrix is computed by sliding a fixed-size window (width w) over all sentences and counting how often word i co-occurs with word j within the window. This forms the basis of edge weights in the graph.
To emphasize the importance of informative word pairs, the co-occurrence matrix C is transformed using a TF-IDF weighting scheme, producing a reweighted matrix that reduces the impact of frequent but uninformative co-occurrences.
Edges in the graph are determined by applying a threshold to the TF-IDF weighted co-occurrence matrix. Only pairs with values exceeding the threshold are retained in the adjacency matrix A.
To stabilize training and ensure numerical consistency, the adjacency matrix A is symmetrically normalized with degree matrix D, and self-loops are added via the identity matrix I.
Feature propagation in the GCN is performed by repeatedly applying graph convolution layers. At each layer l, the hidden features are updated via a linear transformation , followed by aggregation using the normalized adjacency matrix and a non-linear activation function . For the co-occurrence graph, we applied TF-IDF weighting and retained edges with weight > 0.3 (after normalization) to filter out noisy co-occurrences.
4.4. The CRF Layer
To enhance the accuracy of sequence labeling and ensure global consistency, we incorporate a Conditional Random Field (CRF) layer on top of the fused feature representations. The CRF models the conditional probability of the entire output label sequence given the input features, capturing the dependencies between adjacent tags and effectively reducing invalid tag transitions.
Let denote the input sequence and the corresponding predicted label sequence. The CRF defines the score of the sequence Y as
where is the emission score of assigning label to position i, produced by the previous encoder layers, and is the transition score from label to , representing the learnable transition probability matrix.
The CRF computes the conditional probability of a label sequence Y given the input X as
where denotes the set of all possible label sequences for X. During training, the objective is to maximize the log-likelihood of the correct label sequence. In inference, the optimal label sequence is obtained by maximizing the score:
This decoding is efficiently performed using the Viterbi algorithm.
By modeling both local (emission) and global (transition) interactions, the CRF layer effectively addresses label inconsistency issues, such as illegal transitions (e.g., ‘I-term’ without a preceding ‘B-term’), thereby improving the structural integrity and overall precision of term boundary predictions.
5. Experiment
5.1. Hardware Configuration
To evaluate the predictive performance of the proposed model, both our approach and several baseline methods were implemented and tested on a Windows 10 platform using Python 3.10. The model was developed using the PyTorch 2.1 framework, with training conducted on an NVIDIA RTX 4090 GPU under CUDA 11.1. All experiments were run with a batch size of 64 and an initial learning rate of 2 × 10−5, optimized using the Adam optimizer. For reproducibility, random seeds were set for Python, NumPy, and PyTorch. The GPU utilization was monitored to ensure efficient memory usage and computation during training. In addition, data preprocessing and augmentation procedures were applied consistently across all methods to ensure fair comparison. The experimental setup allows replication of the results and provides a benchmark for evaluating the effectiveness of the proposed model against baseline approaches, as shown in Table 4.
Table 4.
Experimental Platform Configuration.
5.2. Parameter Settings
In this paper, we employ a multi-graph fusion approach for bilingual terminology recognition. The model integrates four different types of graph neural networks: co-occurrence graph (CoGCN) for local word patterns, semantic graph (GraphSAGE) for semantic relationships, syntax graph (GAT) for grammatical dependencies, and sequence graph (BiLSTM) for sequential information. For dependency analysis, we employ spaCy’s pre-trained models: zh_core_web_sm for Chinese and en_core_web_sm for English, which provide accurate syntactic dependency trees for both languages. The entire corpus of 22,828 sentence pairs was randomly divided into training (80%, 18,262 pairs) and test (20%, 4566 pairs) sets. The split was stratified by term category to ensure similar distributions across all subsets. To avoid data leakage, the semantic graph and co-occurrence graph are constructed exclusively on the training set. For test sentences, we treat each sentence as an isolated graph: nodes are the tokens of that sentence, and edges are determined solely by within-sentence relations (co-occurrence within a window) or by connecting to training-set nodes only if the token appears in the training vocabulary (using pre-computed similarities). The syntactic graph and sequence graph are built on-the-fly for each sentence independently, using the dependency parser and relative position encoding, so no leakage occurs. The specific details are shown in Table 5.
Table 5.
Parameter Settings.
5.3. Comparision Model
To further demonstrate the advantages of our model, we conduct a comprehensive comparison with traditional neural networks and large language models (LLMs). In addition, we introduce two new model combinations—XLM-RoBERTa + BiLSTM + CRF (XRBC) and XLM-RoBERTa + Transformer + CRF (XRTC)—which use the same XLM-RoBERTa embedding followed by BiLSTM or Transformer encoder and CRF layer, but without any graph module. These two new combination baselines directly measure the contribution of multi-graph fusion. The detailed comparison is presented as follows:
- 1.
- RNN [20]: RNN is a classical sequence modeling method for time-series data, using an updated hidden state to remember past info and handle variable-length sequences. However, it is hard to parallelize and prone to vanishing or exploding gradients.
- 2.
- LSTM [21]: LSTM is an enhanced RNN for capturing long-term dependencies in sequential data, using memory cells and three gates to selectively manage information and avoid vanishing gradients. However, its complex structure causes higher computational cost and slower training than simpler models like GRU.
- 3.
- BiLSTM [22]: BiLSTM captures context bidirectionally for complex semantic dependencies but has high computational cost and limited parallelism, especially with long sequences.
- 4.
- BiGRU [23]: BiGRU is a simplified LSTM variant using gates for information flow, boosting efficiency while keeping core sequence modeling abilities—though it is slightly less expressive than LSTM.
- 5.
- TextGRU [24]: TextGRU is a lightweight GRU-based recurrent model for text representation, which handles variable-length sequences by controlling information flow via update and reset gates. Compared to LSTM, it is more computationally efficient while keeping most sequence modeling capabilities, and fits tasks like sentiment analysis and text classification.
- 6.
- BERT [25]: BERT is a Transformer-based pre-trained model that captures deep bidirectional context, excelling at NLP tasks via fine-tuning.
- 7.
- ERNIE [26]: ERNIE extends BERT by integrating structured knowledge from knowledge graphs/entities, enhancing semantic capture and performance on tasks needing world knowledge or entity understanding.
- 8.
- RoBERTa [27]: RoBERTa is a BERT improvement that optimizes pre-training (more data, longer training, no next-sentence prediction, dynamic masking) for stronger, more robust representations in downstream NLP tasks.
5.4. Evaluation Metrics
An essential step to evaluate performance on different models is to select appropriate metrics. We employ two primary types of evaluation. First, for the standard sequence labeling task within each language, we adopt the widely used metrics of Precision (P), Recall (R), and F1-score. These are calculated based on a strict matching criterion, where a predicted entity is considered a true positive (TP) only if both its boundaries and its type exactly match a ground-truth entity. Precision and Recall are formally defined as
where TP, FP, and FN denote the number of true positives, false positives, and false negatives, respectively. The F1-score, representing the harmonic mean of Precision and Recall, is defined as
Second, to specifically measure the model’s capability in identifying corresponding terms across bilingual sentence pairs, we introduce the Term Alignment metrics (which measure category-level and term-level consistency) for comparison. For each sentence pair s, let be the set of ground-truth-aligned term types (i.e., types that appear in both the Chinese and English sentences), and be the set of predicted aligned types. The term-level alignment metrics use the same calculation method as the category-level, but the labels are matched based on composite labels (a combination of BIO labels and align_id). We define the following:
- Term Alignment Accuracy (): The proportion of sentence pairs where the predicted aligned type set exactly matches the ground-truth set, among all pairs with at least one aligned type:where is the set of sentence pairs with non-empty , and is the indicator function.
- Term Alignment Precision, Recall, and F1: These metrics are computed by micro-averaging over all sentence pairs with at least one aligned type:
Together, these metrics provide a comprehensive view of both term extraction performance and the model’s ability to learn cross-lingual semantic alignments.
6. Results and Discussion
6.1. Performance Comparison with Existing Models
The proposed term extraction model and evaluation metrics are introduced above. Each model underwent at least five training sessions, and the average results obtained during the training period were reported. Table 6 presents the results.
Table 6.
Comparison of Extraction and Alignment Results on Bilingual Term Corpus.
The comparison results demonstrate that our proposed model outperforms various baseline models (such as RNN, BiGRU, BiLSTM, BERT, etc.) in both Chinese- and English-term extraction tasks. Among traditional neural networks, TextGRU achieves the best performance, with F1 scores of 71.74% and 68.99% for Chinese and English, respectively, highlighting its strength in capturing contextual information and long-distance dependencies. For large-scale pre-trained models, BERT, ERNIE, and RoBERTa all surpass traditional neural networks. XLM-RoBERTa + BiLSTM + CRF and XLM-RoBERTa + Transformer + CRF have also achieved competitive results. In comparison, our Full Model achieves F1 scores of 92.93% for Chinese and 83.38% for English, corresponding to improvements of approximately 0.92% and 1.02% percentage points over the strongest baseline. Furthermore, it achieves the highest category-level alignment metrics (Aligned Accuracy 92.24%, Align F1 98.39%), underscoring the advantages of the integrated multi-channel graph neural network. Table 7 reports the introduced term-level alignment results for representative baseline models. This experiment uses fine-grained composite labels with a larger number of categories and an imbalanced distribution. The full model achieves an F1 of 91.22%, which is lower than the category-level AliF1 (98.39%) but still significantly higher than the baselines, demonstrating its ability to capture fine-grained term correspondences. It is also evident that the model generally performs better on the Chinese corpus. Several factors may contribute to this observation. First, from a linguistic perspective, Chinese sentences tend to have more rigid word order and shorter average sentence lengths compared to English, facilitating the model’s ability to capture contextual dependencies and term boundaries. Second, Chinese terminology often consists of fixed multi-character words or compounds, which are more consistent across contexts, whereas English terms exhibit greater morphological variation and flexible phrasal structures, increasing extraction difficulty. Third, the Chinese segmentation process is relatively standardized, reducing tokenization ambiguity, while English tokenization must handle spaces, punctuation, and compound words, potentially introducing errors. Finally, the training corpus may contain more balanced or abundant Chinese examples for certain term categories, providing stronger exposure for the model and contributing to higher F1 scores. Taken together, these linguistic and data-related factors explain why the model generally achieves better performance on the Chinese corpus than on the English one.
Table 7.
Term-level Alignment Results (Selected Models).
To further validate the generalization ability of our model, we evaluate it under a fully inductive setting where the semantic and co-occurrence graphs are constructed solely from each test sentence, without any connections to the training set. Specifically, for the semantic graph, we compute cosine similarities between the embeddings of tokens within the same sentence and connect pairs exceeding the same threshold; for the co-occurrence graph, we use the same window size to count intra-sentence co-occurrences, without any TF-IDF weighting derived from the training set. Baseline models are inherently inductive and their performance remains unchanged from Table 6; thus, we focus on the relative performance drop of our model. Under the inductive setting, MCGNN* achieves an F1 (CN) of 92.31%, an F1 (EN) of 82.41%, and an Align F1 of 98.19%. Compared to the original Full Model results (92.93%, 83.38%, and 98.39%, respectively), the relative performance drops are only 0.62, 0.97, and 0.20 percentage points. These marginal declines indicate that our model does not heavily rely on global corpus statistics; instead, the sentence-level syntactic, sequential, semantic, and co-occurrence information captured by the multi-channel graphs suffices to maintain high performance. Notably, while ablation experiments (Section 6.2) showed that removing the entire semantic graph causes a substantial drop, the much smaller declines under the fully inductive setting demonstrate that the sentence-level semantic relations captured by the intra-sentence graph already supply most of the semantic cues. Moreover, even in this purely inductive setting, our model maintains competitive performance, indicating that its multi-channel graph design effectively leverages local sentence structures to compensate for the absence of global priors.
Additionally, in terms of model training costs, compared to the baseline RoBERTa that achieved competitive results, MCGNN introduces four additional graph modules, increasing total trainable parameters by about 10%. Training time per epoch grows from 5 min to 6.2 min on the existing hardware configuration, which is acceptable given the substantial performance gains.
6.2. Ablation Experiment
Given the complex structure of our model, it is essential to validate the effectiveness of each component. To this end, we performed ablation studies by removing each component individually and evaluating its contribution to the overall performance. The detailed results and metrics for each dataset are summarized in Table 8.
Table 8.
Experimental Results of Ablation on Bilingual Term Corpus.
We present an ablation study evaluating the contribution of each component of our model on both Chinese and English datasets. Removing any component—Syntax Graph (SyG), Semantic Graph (SemG), Sequence Graph (SeqG), or Co-occurrence Graph (CoG)—leads to a decrease in performance across all metrics, demonstrating the importance of each module. Among these, removing the Semantic Graph causes the largest drop in F1 scores, from 92.93% to 86.85% for Chinese and from 83.38% to 69.97% for English, indicating its critical role in capturing hierarchical semantic relationships and domain-specific knowledge that are essential for accurate term extraction. The Syntax Graph contributes significantly by modeling structural dependencies between words; its removal reduces F1 to 91.91% for Chinese and 82.21% for English, showing that syntactic information helps the model delineate term boundaries and interpret complex sentence structures. The Co-occurrence Graph provides valuable statistical context on term co-occurrence patterns, leading to an F1 drop to 92.83% (Chinese) and 82.71% (English) when removed, which highlights its role in reinforcing frequent or related term relationships. The Sequence Graph, which encodes sequential dependencies, also plays an important role, with F1 decreasing to 88.60% for Chinese and 81.53% for English when omitted, suggesting that capturing local sequential patterns helps the model handle contiguous multi-word terms effectively. Overall, these results confirm that each graph module provides complementary information—semantic, syntactic, sequential, and co-occurrence-based—which collectively enhances both term extraction and alignment performance. The ablation study also explains why the model maintains robust performance in noisy or complex datasets: the combination of multiple perspectives allows it to compensate for missing information in any single view. Figure 4 provides a visual comparison of the performance drops under different ablation settings, clearly showing that the Semantic Graph contributes the most, followed by Co-occurrence, Syntax, and Sequence Graphs, respectively.
Figure 4.
Visualization of performance comparison across different ablation settings.
6.3. Statistical Significance Test
To rigorously assess whether the performance gains of our full model are statistically significant, we conducted a paired bootstrap test with 10,000 resamples on the test set. For each resample, we computed the F1-scores of our model and a baseline on the same set of sentence pairs, and recorded the difference. As shown in Table 9, all improvements are significant at , confirming that the multi-channel graph fusion consistently yields better results.
Table 9.
Statistical significance of performance differences between our full model and baselines.
Among the pre-trained baselines, RoBERTa achieves the highest Chinese F1 (92.01%), while XLM-RoBERTa + Transformer + CRF attains the best English F1 (82.36%) among non-graph models. This reflects a known trade-off: single-language models like RoBERTa excel in their target language, whereas multilingual models like XLM-RoBERTa provide stronger cross-lingual transfer, benefiting the English side of our bilingual task. The Transformer-based encoder (XLM-RoBERTa + Transformer + CRF) outperforms its BiLSTM counterpart (XLM-RoBERTa + BiLSTM + CRF) by 0.74% (Chinese) and 0.84% (English), demonstrating the advantage of self-attention in modeling long-range dependencies crucial for term boundary detection.
Despite these strong baselines, our full model surpasses them by a clear margin. The bootstrap tests confirm that these differences are not due to chance. This underscores the value of integrating multiple linguistic perspectives (syntax, semantics, sequence, co-occurrence) through graph neural networks, which capture complementary information that even powerful Transformer-based models cannot fully exploit.
6.4. Error Analysis
In this section, we summarize and analyze the erroneous samples, selecting four main error types for quantitative and qualitative error analysis. First, we validate the effectiveness of our model by quantifying the proportions of error types in MCGNN and the RoBERTa baseline. Using the total number of errors made by RoBERTa across the four categories as the baseline (100%), Table 10 presents the error distribution on the test set. Thanks to multi-channel graph fusion, MCGNN reduces errors across all types, particularly boundary and type errors in term extraction. Cross-language misalignment is also reduced by 2.7 percentage points, indicating improved bilingual consistency.
Table 10.
Quantitative Error Distribution (Percentage of Total Errors).
Second, we conduct a qualitative analysis of several typical cases of prediction errors in MCGNN, thus further evaluating the directions for future improvement of our model. Upon examining the results, we find that the main sources of errors in bilingual terminology extraction arise from fundamental differences in how Chinese and English organize and express linguistic information. As shown in Table 11, several representative cases demonstrate how these cross-linguistic structural differences lead to boundary inconsistencies, category confusion, and partial alignment failures between the two languages.
Table 11.
Example of Error Analysis.
In the first example, “音位变体/ allophones,” the model successfully identifies the Chinese term but fails to accurately map it to the corresponding English counterpart. Although both represent the same phonological concept, the Chinese term is a compact compound noun, while the English equivalent is a single lexical unit embedded within a larger syntactic structure. This discrepancy highlights the model’s difficulty in establishing fine-grained semantic correspondence when the morphological density of Chinese contrasts with the lexical simplicity of English.
In the second case, “语用意义/ pragmatic meaning,” the model predicts the correct term span but assigns it to an incorrect category (“semantic” instead of “pragmatic”). Such misclassification occurs because both semantic and pragmatic terms often co-occur in overlapping contexts, making it challenging for the model to separate contextual meaning from pragmatic usage.
In the third example, “句法依存关系/ syntactic dependencies,” the model fails to correctly identify the core term on both sides. Although the phrase occurs in a clearly defined syntactic position, the internal dependency structure and surrounding modifiers in the sentence increase the model’s difficulty in boundary detection. This error reflects the model’s sensitivity to complex clause structures, where embedded modifiers and relational terms often obscure the precise span of linguistic concepts.
Finally, “文本处理模块/ text processing modules,” demonstrates a partial omission where the model captures the beginning of the compound but misses its full extent in both languages. This shows the model’s limitations in handling long compound terms that involve nested modification or technical expressions spanning several tokens.
Overall, these cases indicate that the main challenges in bilingual terminology extraction lie not in annotation inconsistencies, but in the intrinsic divergence of linguistic structures, lexical compounding, and semantic layering between Chinese and English. Future research will focus on designing more fine-grained cross-linguistic alignment mechanisms and enhancing the robustness of category-level discrimination to better capture such subtle but systematic discrepancies.
7. Conclusions
To promote the dissemination of Chinese linguistic knowledge, this paper proposes a novel term extraction and alignment framework that integrates multiple graph-based models to comprehensively capture linguistic features from diverse perspectives, thereby enhancing the accuracy and robustness of indigenous Chinese linguistic terms identification. The graph fusion model effectively integrates syntactic, semantic, and lexical information through a multi-view graph structure, capturing complementary linguistic features across different levels of language representation. This multi-faceted approach enables the model to robustly identify terms by simultaneously considering local contextual cues, syntactic dependencies, semantic relations, and domain-specific knowledge, thereby significantly improving precision and recall in terminology extraction tasks. Furthermore, we constructed a comprehensive category system for indigenous Chinese linguistic terminology and developed a bilingual parallel corpus annotated under this taxonomy, providing valuable resources for future research in linguistic knowledge representation and computational linguistics. Experimental results validate the effectiveness of our proposed model and confirm its applicability to diverse linguistic scenarios. Overall, our work not only advances the development of term extraction and alignment techniques, but also contributes to the systematic construction of Chinese linguistic resources and the broader goal of automated language understanding.
Although we achieve promising results with the proposed term extraction framework on our linguistic dataset and validate the effectiveness of multi-graph fusion, there remain several directions worth exploring. First, MCGNN shows limited domain transferability, it is trained and evaluated solely on the Chinese linguistic terminology corpus, and its performance in cross-domain scenarios (e.g., medical, legal, or technical terminology) remains unverified. Second, the construction of multi-graph structures relies on sufficient linguistic resources and prior knowledge. In low-resource settings where parallel data or high-quality parsers are scarce, the applicability of our approach may be constrained. Third, the error analysis reveals that the model occasionally fails to capture fine-grained or implicit terms, particularly those involving complex cross-lingual correspondences, morphologically dense Chinese compounds versus lexically simple English equivalents, category confusion between semantically proximate labels, and partial omission of long compound terms with nested modification.
In future work, we plan to enhance the framework by incorporating more fine-grained cross-linguistic feature alignment mechanisms, potentially leveraging bilingual word embeddings trained on large-scale parallel corpora to better capture semantic correspondences between Chinese and English terms. We also aim to design specialized modules to handle structural differences in term expression across languages, further improving the model’s robustness and interpretability in real-world linguistic applications. Additionally, we will continue to refine and expand the taxonomy of indigenous Chinese linguistic terminology by incorporating more linguistic subfields and categories, thereby enhancing the comprehensiveness and systematicity of the classification framework.
Author Contributions
Conceptualization, H.D. and Z.Z.; methodology, H.W.; software, S.J. and Z.Z.; validation, S.J. and Z.Z.; formal analysis, H.D.; investigation, S.J. and Z.Z.; resources, H.W.; data curation, Z.Z.; writing—original draft preparation, H.D.; writing—review and editing, H.D. and H.W.; visualization, H.D.; supervision, H.W.; project administration, H.D. and H.W.; funding acquisition, H.W. All authors have read and agreed to the published version of the manuscript.
Funding
This work was supported by the General Projects of the 14th Five-Year Plan of the National Language Commission (Grant No. YB145-82); Liaoning Provincial Department of Education project (Grant No. LJKQZ20222451 and JYTQN2023149); and the Natural Science Foundation of Liaoning Province of China (Grant No. 2024-BS-203).
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data presented in this study are available on request from the corresponding author.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- Maynard, D.; Li, Y.; Peters, W. NLP Techniques for Term Extraction and Ontology Population. In Ontology Learning and Population: Bridging the Gap Between Text and Knowledge; IOS Press: Amsterdam, The Netherlands, 2008. [Google Scholar]
- Ruder, S.; Vulić, I.; Søgaard, A. A survey of cross-lingual word embedding models. J. Artif. Intell. Res. 2019, 65, 569–631. [Google Scholar] [CrossRef] [Scilit]
- Tran, H.T.H.; Martinc, M.; Caporusso, J.; Doucet, A.; Pollak, S. The recent advances in automatic term extraction: A survey. arXiv 2023, arXiv:2301.06767. [Google Scholar] [CrossRef] [Scilit]
- Xu, K.; Feng, Y.; Li, Q.; Dong, Z.; Wei, J. Survey on terminology extraction from texts. J. Big Data 2025, 12, 1–40. [Google Scholar] [CrossRef] [Scilit]
- Chun, Y.; Kim, M.; Kim, D.; Park, C.; Lim, H. Enhancing Automatic Term Extraction with Large Language Models via Syntactic Retrieval. arXiv 2025, arXiv:2506.21222. [Google Scholar] [CrossRef] [Scilit]
- Zhang, M.; Wu, Q. Bilingual terminology extraction using multi-level termhood. arXiv 2013, arXiv:1302.4492. [Google Scholar]
- Jia, H.; Li, C.; Wang, T. Bilingual terminology extraction from comparable e-commerce corpora. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic, 7–11 November 2021. [Google Scholar]
- Lefever, E.; Macken, L.; Hoste, V. Language-independent bilingual terminology extraction from a multilingual parallel corpus. In Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009), Athens, Greece, 30 March–3 April 2009; pp. 496–504. [Google Scholar]
- Vintar, S. Using parallel corpora for translation-oriented term extraction. Babel 2001, 47, 121–132. [Google Scholar] [CrossRef] [Scilit]
- Zhang, C.; Wu, D. Bilingual terminology extraction using multi-level termhood. Electron. Libr. 2012, 30, 295–309. [Google Scholar] [CrossRef] [Scilit]
- Almeida, J.J.; Simões, A. Automatic parallel corpora and bilingual terminology extraction from parallel websites. In Proceedings of the 3rd Workshop on Building and Using Comparable Corpora, Valletta, Malta, 22 May 2010. [Google Scholar]
- Ideue, M.; Yamamoto, K.; Utiyama, M.; Sumita, E. A comparison of unsupervised bilingual term extraction methods using phrase-tables. In Proceedings of the Machine Translation Summit XIII: Papers, Xiamen, China, 19–23 September 2011. [Google Scholar]
- Macken, L.; Lefever, E.; Hoste, V. Texsis: Bilingual terminology extraction from parallel corpora using chunk-based alignment. Terminol. Int. J. Theor. Appl. Issues Spec. Commun. 2013, 19, 1–30. [Google Scholar] [CrossRef] [Scilit]
- Guo, M.; Shen, Q.; Yang, Y.; Ge, H.; Cer, D.; Abrego, G.H.; Stevens, K.; Constant, N.; Sung, Y.H.; Strope, B.; et al. Effective parallel corpus mining using bilingual sentence embeddings. arXiv 2018, arXiv:1807.11906. [Google Scholar] [CrossRef] [Scilit]
- Repar, A.; Martinc, M.; Ulcar, M.; Pollak, S. Word-embedding based bilingual terminology alignment. In Proceedings of the Electronic Lexicography in the 21st Century (eLex 2021) Post-Editing Lexicography, Virtual, 5–7 July 2021; p. 98. [Google Scholar]
- Liu, J.; Ouzzani, I.; Li, W.; Zhang, L.; Ou, T.; Bouamor, H.; Jin, Z.; Diab, M.T. Toward Global AI Inclusivity: A Large-Scale Multilingual Terminology Dataset (GIST). In Proceedings of the Findings of the Association for Computational Linguistics: ACL 2025, Vienna, Austria, 27 July–1 August 2025. [Google Scholar]
- Zaratiana, U.; Tomeh, N.; El Khbir, N.; Holat, P.; Charnois, T. GraphER: A Structure-aware Text-to-Graph Model for Entity and Relation Extraction. arXiv 2024, arXiv:2404.12491. [Google Scholar]
- Hu, L.; Xu, Y. DM-BLI: Dynamic Multiple Subspaces Alignment for Unsupervised Bilingual Lexicon Induction. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Bangkok, Thailand, 11–16 August 2024. [Google Scholar] [CrossRef] [Scilit]
- Latouche, G.; Carbonneau, M.A.; Swanson, B. BinaryAlign: Word Alignment as Binary Sequence Labeling. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Bangkok, Thailand, 11–16 August 2024. [Google Scholar] [CrossRef] [Scilit]
- Williams, R.J.; Zipser, D. A learning algorithm for continually running fully recurrent neural networks. Neural Comput. 1989, 1, 270–280. [Google Scholar] [CrossRef] [Scilit]
- Hochreiter, S.; Schmidhuber, J. Long short-term memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef] [Scilit]
- Schuster, M.; Paliwal, K.K. Bidirectional recurrent neural networks. IEEE Trans. Signal Process. 1997, 45, 2673–2681. [Google Scholar] [CrossRef] [Scilit]
- Chung, J.; Gulcehre, C.; Cho, K.; Bengio, Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv 2014, arXiv:1412.3555. [Google Scholar] [CrossRef] [Scilit]
- He, G.; Lu, W. Entire information attentive GRU for text representation. In Proceedings of the 2018 ACM SIGIR International Conference on Theory of Information Retrieval, Tianjin, China, 14–17 September 2018. [Google Scholar]
- Devlin, J.; Chang, M.W.; Lee, K.; Toutanova, K. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA, 2–7 June 2019. [Google Scholar]
- Zhang, Z.; Han, X.; Liu, Z.; Jiang, X.; Sun, M.; Liu, Q. ERNIE: Enhanced language representation with informative entities. arXiv 2019, arXiv:1905.07129. [Google Scholar] [CrossRef] [Scilit]
- Liu, Y.; Ott, M.; Goyal, N.; Du, J.; Joshi, M.; Chen, D.; Levy, O.; Lewis, M.; Zettlemoyer, L.; Stoyanov, V. Roberta: A robustly optimized bert pretraining approach. arXiv 2019, arXiv:1907.11692. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.



