Abstract
Multimodal knowledge graph completion (MMKGC) aims to predict missing entities by exploiting structural, visual, and textual information and is important for semantic retrieval, recommendation, and intelligent question answering. Existing relation-aware methods usually use relational context to adjust modality weights or fuse multimodal scores but rarely exploit the historical answer distribution of each directed relation as explicit ranking evidence. To address this limitation, we propose RAPC, a Relation Answer Space Prototype Calibration framework. For each query, RAPC obtains multimodal prior scores from structural, visual, textual, and image–text cross-modal branches, retrieves the top-k query-relevant anchors from the historical answer space of the corresponding directed relation, and aggregates them into prototype evidence. This evidence is injected through a prior-preserving selective calibration mechanism, while relation-aware hard negative training improves discrimination between true answers and similar false candidates. Experiments on DB15K, MKG-W, and MKG-Y show that RAPC achieves clear gains on DB15K and MKG-W and obtains the best MRR and Hits@1 on MKG-Y. Compared with the best external results, RAPC improves MRR and Hits@1 by 2.64 and 3.57 percentage points on DB15K and by 3.02 and 3.72 percentage points on MKG-W. These results show that relation-level historical answer distributions provide useful explicit evidence for top-ranked entity prediction.
1. Introduction
Knowledge graphs (KGs) usually represent entities and their relations in the form of triples and have been widely used in semantic retrieval, intelligent question answering, recommender systems, and other tasks [1]. However, conventional KGs mainly rely on structured relations and are limited in capturing the visual and textual semantics associated with entities. Multimodal knowledge graphs (MMKGs) further incorporate external information such as images and text, providing richer semantic sources for entity representation [2]. Since missing entities are common in real-world graphs, multimodal knowledge graph completion (MMKGC) has become an important task for improving graph completeness. Given a query or , MMKGC aims to predict the missing entity [3].
Accurate MMKGC is important not only for improving the completeness of multimodal knowledge graphs but also for supporting practical applications that require reliable entity ranking. For example, in semantic retrieval, recommendation, and intelligent question answering, a system often needs to rank a large number of candidate entities and return a small set of reliable top-ranked answers. Therefore, improving top-rank precision is practically meaningful, especially when structural triples alone are insufficient and multimodal information is needed to distinguish visually or semantically similar entities. From a theoretical perspective, this task also raises the question of how relation-level historical evidence in the training graph can be used together with multimodal representations for more reliable candidate ranking.
Existing MMKGC methods mainly focus on multimodal representation learning and modality fusion. Early methods used visual or textual features as supplements to structural embeddings, while later studies explored adaptive fusion, cross-modal alignment, modality interaction, and relation-aware modeling. In these methods, relational context is often used to adjust modality weights, select modality experts, or fuse prediction scores. However, most of them focus on modality utilization under the current relation and pay less attention to the historical answer distribution encoded by the relation in the training graph. For each directed relation, its historical answer entities form a relation-specific answer space, which indicates where plausible answers usually appear. Thus, relations can provide not only modality guidance but also answer region-level prior evidence for candidate ranking.
To address this problem, we propose RAPC, a Relation Answer Space Prototype Calibration framework. RAPC treats the historical answer entities of a directed relation as a searchable answer space and selects answer anchors that are consistent with the multimodal prior ranking of the current query. The resulting prototype evidence provides relation-specific answer region information for candidate ranking. To avoid disturbing the original multimodal ranking, RAPC uses a prior-preserving selective calibration strategy to inject prototype information only into key local candidate regions. Relation-aware hard negative training is also introduced to distinguish similar false candidates.
The main contributions of this paper are summarized as follows:
- 1.
- We propose a relation answer space-driven view for multimodal knowledge graph completion. Different from existing relation-aware MMKGC methods that mainly use relations to guide modality fusion or score aggregation, we show that each directed relation also encodes a historical answer distribution in the training graph. RAPC explicitly organizes such historical answer entities as a relation answer space, which provides answer region-level evidence for candidate ranking.
- 2.
- We design a query-relevant prototype calibration mechanism to exploit the relation answer space. Instead of directly using the whole answer space as a static prior or a candidate constraint, RAPC retrieves the top-k answer anchors according to the multimodal prior ranking of the current query and aggregates them into query-specific prototype evidence. A prior-preserving selective calibration strategy is then used to inject this evidence into local ranking regions without fully replacing the original multimodal ranking.
- 3.
- Experiments are conducted on three public MMKGC benchmark datasets, namely DB15K, MKG-W, and MKG-Y. These datasets contain structured triples together with entity-associated visual and textual features and are commonly used to evaluate models that combine structural, visual, and textual information. The results show that RAPC achieves strong performance on DB15K and MKG-W. On MKG-Y, RAPC achieves the best MRR and Hits@1, while its advantage is mainly reflected in top-rank precision. Further analyses examine simple answer space priors, anchor selection, seen and unseen answers, relation frequency, and calibration behavior.
Conceptually, RAPC reflects a data-centric rather than a purely model-centric view of MMKGC. Instead of repeatedly upgrading the modality fusion architecture while keeping the use of the training graph unchanged, RAPC extracts a higher-quality, relation-conditioned slice of the available training data, namely the historical relation answer space, and uses it as explicit ranking evidence. This view complements model-centric improvements and is consistent with the argument that both data-centric and model-centric strategies are important for building compact and robust AI solutions [4].
2. Related Work
2.1. Knowledge Graph Completion
Knowledge graph completion (KGC) aims to infer missing facts from observed triples. Existing methods usually map entities and relations into continuous vector spaces and use scoring functions to evaluate candidate triples [5]. Conventional KGC methods include distance- or transformation-based models, such as TransE [6], TransD [7], RotatE [8], and PairRE [9], as well as semantic matching-based models, such as DistMult [10], ComplEx [11], and TuckER [12]. These methods effectively exploit graph structure and are commonly used as structural baselines in MMKGC. However, they mainly rely on triples and cannot fully use entity-associated visual and textual information.
2.2. Multimodal Knowledge Graph Completion
MMKGC introduces entity-associated modalities, such as images and text, into structured triples. Early methods, including IKRL [3], TBKGC [13], TransAE [14], and RSME [15], mainly used visual or textual information as supplements to structural embeddings. Recent surveys have summarized the development of multimodal knowledge graphs and MMKGC from the perspectives of multimodal construction, representation learning, completion tasks, benchmarks, and application scenarios [16,17,18].
Recent studies further explore modality fusion, relation-aware modeling, missing-modality robustness, and training strategy optimization. For example, MKGformer introduces a hybrid transformer with multi-level visual–textual fusion [19]; VISTA learns visual–textual knowledge graph representations with stronger cross-modal interaction [20]; LAFA uses link-aware fusion and aggregation to reduce the influence of irrelevant visual information [21]; NativE and MACO address modality diversity, imbalance, and missing-modality problems in more realistic MMKG settings [22,23]; and SNAG improves robust multimodal representation learning by using noise-powered training [24]. In addition, several works focus on training strategies, such as MMRNS [25] and diffusion-based hierarchical negative sampling [26], while generative perspectives, such as DiffusionCom, have also been explored for MMKGC [27]. AdaMF-MAT addresses modality imbalance through adaptive fusion and modality adversarial training [28]; MyGO improves fine-grained multimodal entity representation [29]; and MoMoK uses relation-guided modality experts [30].
Although these methods improve MMKGC from different perspectives, most of them still focus on representation learning, modality fusion, or training strategy design. In contrast, RAPC explicitly models the historical answer distribution of each directed relation as a searchable relation answer space and uses it as query-conditioned ranking evidence.
2.3. Difference from Relation Priors and Candidate Constraints
Although RAPC uses the historical answer entities of each directed relation, it is different from relation-specific candidate priors, type-constrained ranking, and conventional prototype-based reranking. First, RAPC does not use the relation answer space as a hard candidate mask. All entities in the candidate set are still scored and ranked, and entities outside the relation answer space are not removed during inference. Therefore, the relation answer space is used as an evidence source rather than a candidate constraint. Second, RAPC is not a simple relation-specific prior. A static prior or bias assigns similar preference to entities that appear in the historical answer space of a relation. In contrast, RAPC first obtains a multimodal prior ranking for the current query and then dynamically retrieves query-relevant anchors from the relation answer space. Thus, different queries under the same directed relation may select different anchors and construct different prototype evidence. Third, RAPC is different from conventional prototype-based classification or reranking. It does not directly replace the multimodal score with a prototype score. Instead, the prototype score is used as complementary evidence and is injected through a prior-preserving selective calibration mechanism. This design keeps the basic ranking structure produced by multimodal representations while allowing reliable local regions to absorb relation answer space evidence. In summary, RAPC uses the relation answer space as query-conditioned ranking evidence. Its key idea is not to constrain the candidate set but to dynamically retrieve answer region prototypes and selectively calibrate the multimodal prior ranking. The empirical comparisons in Table 1 further distinguish RAPC from simple relation priors, hard answer space constraints, and static prototype reranking.
Table 1.
Sanity checks against simple relation answer space priors. All metric values are reported in percentage form. Bold values indicate the best results.
3. Problem Definition
Let be a multimodal knowledge graph, where denotes the entity set, denotes the relation set, denotes the set of observed triples, and denotes the set of modalities associated with entities. For an entity , its pre-extracted feature under modality is denoted as . This study considers four types of information: structural, visual, textual, and image–text cross-modal information.
The goal of multimodal knowledge graph completion is to predict the missing entity from the candidate entity set given a query or . To handle head entity prediction and tail entity prediction in a unified manner, we introduce an inverse relation for each original relation and convert head entity prediction into the tail prediction form . Therefore, all queries can be uniformly represented as , where is the known entity and is a directed relation. The model computes a query-specific score for each candidate entity so that the true answer y is ranked as high as possible among all candidates.
Based on this formulation, we define the relation answer space for each directed relation . For tail entity prediction, the answer space consists of all entities that appear as tail entities of the relation in the training set. For head entity prediction, the answer space consists of all entities that appear as head entities of the relation in the training set:
It should be noted that is not the set of true answers for the current query but a candidate region formed by the historical answer entities of the directed relation in the training graph. This paper studies how to jointly exploit multimodal entity representations and the relation answer space to learn the final scoring function so that the true answer entity obtains a higher rank in the candidate entity set.
4. Method
This section introduces the proposed Relation Answer Space Prototype Calibration framework, namely RAPC. Given a query , where u denotes the known entity and denotes a directed relation, RAPC first obtains a multimodal prior ranking based on structural, visual, textual, and image–text cross-modal information. It then selects query-relevant answer anchors from the answer space of the current directed relation and constructs prototype evidence. Finally, a prior-preserving selective calibration mechanism is used to generate the final ranking. The overall framework is shown in Figure 1.
Figure 1.
Overall framework of RAPC. The model first obtains a multimodal prior ranking, then selects query-relevant answer anchors from the directed relation answer space to construct prototype evidence, and finally injects this evidence into the final candidate ranking through a selective calibration mechanism. Colors are used to distinguish different modules and processing stages, while the ellipses indicate omitted intermediate candidates rather than missing content.
4.1. Multimodal Prior Ranking
For each entity , RAPC constructs entity representations from four branches, namely the structural, visual, textual, and image–text cross-modal branches:
where S, I, T, and X denote the structural branch, visual branch, textual branch, and image–text cross-modal branch (X branch), respectively. The structural branch is obtained from learnable entity embeddings. The visual and textual branches are obtained by mapping pre-extracted features through projection layers. The image–text cross-modal branch is used to model the joint semantics between visual and textual representations. RAPC also learns relation representations for each directed relation in the four branches:
Given a query , the model computes the matching score of each candidate entity e in each branch. Following previous complex-valued embedding methods [8,11], we adopt a complex-valued scoring form. For branch , the entity and relation representations are written as
The candidate score of the m-th branch is defined as
RAPC then fuses the scores from the four branches with weighted summation to obtain the multimodal prior score of the current query:
where denotes the fusion weight of the m-th branch. represents the basic ranking result obtained only from multimodal representations. The relation answer space evidence introduced later is calibrated based on this prior ranking.
4.2. Query-Relevant Relation Answer Space Prototype
Based on the directed relation answer space defined above, RAPC pre-constructs an answer entity bank for each directed relation . Instead of directly using the mean representation of the entire answer space, RAPC dynamically selects query-relevant answer anchors from according to the multimodal prior ranking of the current query, thereby constructing a query-specific relation answer space prototype.
Given a query , RAPC first uses the multimodal prior score to select the top-k entities from the current relation answer space as answer anchors:
where denotes the anchor set corresponding to the current query. These anchors come from the historical answer region of the current directed relation and are also consistent with the multimodal prior ranking of the current query. Therefore, they can provide query-relevant candidate region evidence.
To distinguish the importance of different anchors, RAPC computes normalized weights according to their prior scores:
where is the temperature coefficient.
For each modality branch , the selected answer anchors are aggregated into a query-relevant prototype:
where denotes the representation of anchor entity in the m-th branch.
After obtaining the prototype representation, RAPC combines the known entity, relation, and query-relevant prototype to form a prototype-enhanced query representation:
where denotes vector concatenation, and is the nonlinear mapping function of the m-th branch. Based on this representation, the prototype branch score of candidate entity e is defined as
Finally, the prototype scores from different branches are fused through relation-conditioned weights to obtain the overall prototype evidence score:
where denotes the prototype evidence weight of the m-th branch under the current directed relation. Through the above process, RAPC transforms the historical answer distribution in the relation answer space into prototype evidence that can be used for the current query, providing complementary information for subsequent ranking calibration.
Score Normalization
Since and are produced by different scoring paths, their numerical scales may differ. To reduce scale mismatch before calibration, we apply query-wise score normalization to each score vector over all candidate entities:
where and denote the mean and standard deviation of the candidate scores for query q, and is a small constant for numerical stability. In implementation, branch scores are normalized before score fusion and then rescaled by a validation-selected factor. This operation makes the prior and prototype scores more comparable and stabilizes the residual term used in selective calibration.
4.3. Prior-Preserving Selective Calibration
The relation answer space prototype provides complementary evidence for candidate entity ranking. However, its reliability can be affected by the size of the relation answer space, the quality of selected anchors, and the candidate distribution. If is directly used to replace , the relatively stable multimodal prior ranking may be disrupted. Therefore, RAPC adopts a prior-preserving selective relation calibration strategy, denoted as SRC, which injects prototype evidence while preserving the structure of the prior ranking.
In candidate ranking, a learned scoring function may assign high scores to candidates that are semantically plausible but factually incorrect. This failure mode is the ranking-level counterpart of plausible-but-incorrect outputs observed in probabilistic AI models more generally [31]. In MMKGC, such candidates often appear in local ranking regions where entities have similar structural or multimodal scores. SRC is therefore designed to control how prototype evidence is injected into these local regions so that useful relation answer space evidence can correct the ranking without aggressively disturbing the multimodal prior.
First, RAPC estimates the reliability of prototype evidence at the query level and obtains a calibration coefficient . The basic calibrated score is defined as
For reproducibility, we provide the functional form of the query-level gate . For each query q, RAPC constructs a 10-dimensional feature vector
Here, denotes the normalized size of the current directed relation answer space. Let be the selected anchor set, and let be the normalized weight of anchor . The anchor weight entropy is computed as
where is a small numerical constant. The features and denote the largest anchor weight and the difference between the largest anchor weight and the mean anchor weight, respectively.
For score statistics and top-overlap calculation, RAPC uses the top- candidates, where in implementation. Let and . The terms and are the standard deviations of the prior and prototype scores over and , respectively. The residual statistics and are computed over using . The overlap feature is defined as
and denotes the difference between the highest prototype score and the highest prior score.
The gate network is a two-layer MLP:
where LN denotes LayerNorm. The hidden dimension is 16 in the reported experiments. Let denote the prototype warm-up factor at epoch t:
where is the prototype start epoch and is the number of prototype warm-up epochs. The final query-level gate is computed as
where is the base gate strength and controls the adaptive gate range. The parameters of the gate network are optimized jointly with the other trainable parameters of RAPC under the overall training objective. The resulting is expanded to all candidates of the current query and then adjusted by the candidate-level SRC rule below.
RAPC then performs selective correction only within local candidate regions. The motivation is that different ranking regions have different reliability. Top-ranked candidates usually receive stronger structural and multimodal support and therefore can receive prototype-based calibration with a relatively larger strength. In contrast, middle-ranking candidates are less stable because their prior scores are often close to each other; a small prototype-induced perturbation may change their relative order and push similar false candidates upward. Therefore, RAPC applies conservative correction to this region. For candidates jointly supported by the prior ranking, prototype ranking, and relation answer space, the prototype evidence is regarded as more reliable, and a larger calibration strength is allowed. Let denote the high-confidence candidate set in the multimodal prior ranking, and let denote the easily disturbed middle-ranking candidate set, where . Meanwhile, the candidate set jointly supported by the prior ranking, prototype ranking, and relation answer space is defined as
For each candidate entity e, RAPC constructs a candidate-level calibration coefficient:
where , , and control the calibration strength for prior high-confidence candidates, the conservative suppression strength for middle-ranking candidates, and the calibration strength for jointly supported candidates, respectively. and are used to limit the calibration range. The final score is defined as
In this process, candidates in retain relatively high calibration strength, candidates in receive more conservative correction, and candidates in receive a larger calibration weight because they are jointly supported by the prior ranking, prototype ranking, and relation answer space. Therefore, SRC does not perform unconstrained reranking over all candidates. Instead, it controls the injection strength of prototype evidence within selected local ranking regions.
4.4. Training Objective
The training objective of RAPC consists of the final ranking loss, the multimodal prior auxiliary loss, the prototype evidence auxiliary loss, the relation-aware hard negative loss, and a regularization term. For a query q, let denote the set of true answers. We adopt the multi-positive cross-entropy loss for the final score, prior score, and prototype score. Taking the final score as an example, the loss is defined as
and are computed in the same form based on and , respectively. They are used to maintain the stability of the multimodal prior ranking and enhance the independent discriminative ability of the prototype branch.
To improve the model’s ability to distinguish similar false candidates, RAPC introduces relation-aware hard negatives. For a query , during training, the true answer set is first excluded, and hard negatives are then mined according to the current final score . The hard negatives consist of relation answer space negatives and global high-scoring negatives:
where
In the experiments, we adopt a hybrid mining strategy. High-scoring negative samples are selected from both the relation answer space and the global candidate set, and duplicated candidates are removed. These candidates are close to the true answers either within the relation answer region or in the final ranking, making them more suitable than random negatives for training the model’s local discriminative ability.
Based on the above hard negatives, the relation-aware hard negative loss is defined as
where is the temperature coefficient. This objective encourages true answers to be ranked higher than relation-related hard negatives in the final ranking.
Finally, the overall optimization objective of RAPC is
where is the regularization term, and are the corresponding loss weights.
By jointly optimizing the above objectives, RAPC can improve the effectiveness of relation answer space prototype evidence while preserving the stability of the multimodal prior ranking and further enhance the model’s ability to distinguish hard candidates.
5. Experiments
To evaluate the effectiveness of RAPC, we conduct experiments on three public multimodal knowledge graph completion datasets, namely DB15K, MKG-W, and MKG-Y. The experiments are designed to answer the following questions: whether RAPC outperforms existing structure-only unimodal and multimodal KGC methods, whether relation answer space evidence and query-relevant anchors bring the main performance gains, and whether selective calibration and relation-aware hard negatives can further improve the ranking results.
5.1. Experimental Settings
5.1.1. Datasets
We use DB15K, MKG-W, and MKG-Y as the experimental datasets. DB15K is derived from DBpedia [32], while MKG-W and MKG-Y are derived from Wikidata [33] and YAGO [34], respectively. All three datasets contain structured triples as well as entity-associated visual and textual features and are commonly used public benchmark datasets for MMKGC.
As shown in Table 2, the three datasets differ in both relation scale and split size. DB15K contains more relation types, while MKG-Y contains fewer relations, which is further related to the broader relation answer spaces reported in Table 3.
Table 2.
Statistics of the experimental datasets.
Table 3.
Statistics of directed relation answer spaces. Coverage denotes the proportion of test answers covered by the training relation answer space. Entropy denotes the average normalized entropy of relation-specific answer distributions, normalized by .
5.1.2. Baselines
We compare RAPC with three categories of methods. The first category includes structure-only unimodal KGC methods, including TransE [6], TransD [7], DistMult [10], ComplEx [11], RotatE [8], PairRE [9], and GC-OTE [35]. The second category includes classical multimodal KGC methods, including IKRL [3], TBKGC [13], TransAE [14], MMKRL [36], RSME [15], VBKGC [37], and OTKGE [38]. The third category includes recent strong MMKGC methods, including AdaMF [28], MMRNS [25], MyGO [29], and MoMoK [30]. These methods cover major technical directions such as structural modeling, modality fusion, relation-aware modeling, and negative sampling enhancement. We only include baselines whose results are publicly reported or reproducible under the same benchmark datasets and filtered evaluation protocol. Therefore, the comparison focuses on methods with directly comparable results rather than on methods whose complete results under the same setting are unavailable.
For external baselines, we report the results available in the original publications or official released results under the same benchmark splits and filtered evaluation protocol, unless otherwise stated. These baselines were not uniformly re-implemented within the RAPC codebase, and they were not forced to use RAPC’s ComplEx-style scoring backbone, inverse relation augmentation, embedding dimension, or hyperparameter schedule. Therefore, Table 4 should be interpreted as a benchmark-level comparison under the same dataset splits and filtered evaluation protocol rather than as a fully controlled architectural ablation.
Table 4.
Main results of RAPC and comparable baselines on DB15K, MKG-W, and MKG-Y. Bold values indicate the best results, and underlined values indicate the second-best results.
To isolate the contribution of the proposed relation answer space mechanism under controlled conditions, we additionally report the internal prior score reference in Table 1. This reference uses the same RAPC backbone, multimodal inputs, inverse relation augmentation, embedding dimension, training protocol, and evaluation protocol as the full RAPC model but removes relation answer space evidence, query-relevant anchor retrieval, prototype aggregation, and selective calibration.
5.1.3. Overfitting Control
To reduce overfitting, RAPC uses several regularization and validation-based strategies. First, dropout and L2 weight decay are applied to the projection, prototype mapping, and scoring modules. Second, all main hyperparameters, including fusion weights, SRC parameters, and training schedule settings, are selected using the validation set. Third, the best checkpoint is selected according to validation MRR, and the test set is used only for final evaluation, not for model selection or hyperparameter tuning. Fourth, learning-rate warm-up and cosine decay are used to stabilize optimization. In addition, we report results over multiple random seeds in Table 5 to characterize the stability of the final model rather than to claim that multi-seed stability itself eliminates overfitting.
Table 5.
Stability analysis over multiple random seeds. All metric values are reported in percentage form as mean ± standard deviation.
5.1.4. Evaluation Metrics and Implementation Details
We evaluate all methods under the filtered setting and report MRR, Hits@1, Hits@3, and Hits@10. In filtered evaluation, for each query, other entities that form known true triples with the same query in the training, validation, or test set are removed from the candidate ranking, except for the target answer being evaluated. This prevents other correct entities from being incorrectly treated as negative candidates.
Let denote the set of evaluation queries, and let denote the filtered rank of the true answer for query q. MRR is defined as
Hits@N measures the proportion of queries whose true answer is ranked within the top N positions:
where . MRR is the mean reciprocal rank of the correct entity. It assigns greater weight to correct answers ranked near the top and is therefore sensitive to improvements in top-ranked predictions. Hits@1 measures exact top-ranked prediction accuracy, whereas Hits@3 and Hits@10 measure whether the correct entity appears within the top three and top ten candidates, respectively. All reported metric values are multiplied by 100 and shown in percentage form.
RAPC is implemented in PyTorch 2.1.0 with structural, visual, textual, and image–text cross-modal branches. Visual and textual features are pre-extracted features provided by the datasets and projected into a unified space. For each relation, we build both forward and inverse relation answer spaces to unify head and tail prediction. Unless otherwise specified, the number of answer anchors is set to . The best checkpoint is selected on the validation set and evaluated on the test set. For relation-aware hard negatives, we construct a candidate pool from both the relation answer space and global candidates and select up to 32 hard negatives according to after removing duplicates.
These settings are used for all reported RAPC results unless otherwise specified. The number of answer anchors is set to by default because it provides a balance between prototype representativeness and noise control. A very small k may fail to cover the local answer region of the current directed relation, whereas a very large k may introduce weakly related historical answers and reduce prototype discriminability. This choice is further supported by the top-k sensitivity analysis in Figure 2, where gives stable and competitive performance across the evaluated settings. The candidate region parameters , , , and are used to define local ranking regions for selective calibration rather than to remove candidates from the ranking list. The SRC parameters and fusion weights are selected on the validation set and then kept fixed during test evaluation. The main implementation details and hyperparameters are summarized in Table 6.
Figure 2.
Parameter sensitivity and inference efficiency analysis of RAPC on DB15K, MKG-W, and MKG-Y. (a) shows the MRR results under different numbers of answer anchors k, and (b) compares the inference time of the prior-only model and RAPC on the full test set.
Table 6.
Implementation details and main hyperparameters of RAPC.
5.2. Main Results
Table 4 presents the main comparison results. For clarity, the strongest comparable baseline is selected separately for each dataset and each metric as the best external result reported in Table 4 under the same benchmark setting. On DB15K, MoMoK gives the strongest previous MRR and Hits@1, so RAPC improves MRR and Hits@1 by 2.64 and 3.57 percentage points, respectively. On MKG-W, MyGO gives the strongest previous MRR, while MoMoK gives the strongest previous Hits@1; therefore, RAPC improves MRR and Hits@1 by 3.02 and 3.72 percentage points, respectively. These gains suggest that relation answer space evidence is most useful when the historical answer region is sufficiently informative for ranking.
The results on MKG-Y show a different pattern. RAPC obtains the best MRR and Hits@1, whereas AdaMF gives slightly higher Hits@3 and Hits@10. This pattern is consistent with the answer space statistics reported in Table 3: MKG-Y has broader and more diffuse relation answer spaces, which can make the selected anchors less discriminative. Therefore, RAPC mainly improves top-rank precision, while its advantage becomes weaker for wider ranking ranges on this dataset.
5.2.1. Stability over Random Seeds
To further examine the stability of RAPC, we retrain the model with multiple random seeds and report the mean and standard deviation on the test set. The results are shown in Table 5. The mean performance is close to the single-run results in Table 4, and the standard deviations are small on all three datasets, showing that RAPC is stable under different random initializations.
5.2.2. Significance Test
Since most published baselines only provide aggregate results and do not release query-level ranks under the same setting, paired significance tests against all external baselines are not available. We therefore conduct a bootstrap significance test between RAPC and the internal prior baseline using query-level reciprocal ranks. For each dataset, we resample test queries 1000 times and compute the MRR difference between RAPC and the prior baseline. The improvement of RAPC over the prior baseline is significant on all three datasets, with .
5.2.3. Sanity Checks Against Simple Relation Answer Space Priors
To examine whether RAPC can be reduced to simple relation answer space priors, we conduct several sanity check baselines in Table 1. These baselines do not remove modules from the full RAPC training pipeline. Instead, they test simple ways of using the relation answer space, including using only the prior score, adding a constant answer space bias, applying a hard answer space constraint, and using a static relation-level prototype. The prior score reference is included only to show the ranking performance before any answer space operation.
The results in Table 1 show that simple uses of the relation answer space cannot explain the gains of RAPC. Adding a constant relation answer space bias brings little or even negative improvement over the prior score reference, and the hard answer space constraint performs much worse because true answers may appear outside the historical answer space. The static relation answer space mean prototype is also clearly inferior to full RAPC, showing that a relation-level prototype alone is not sufficient. These results indicate that RAPC does not rely on a simple relation answer space prior, a hard answer space constraint, or a static prototype. Instead, its gains come from query-relevant anchor retrieval and selective calibration.
5.2.4. Anchor Selection Diagnostics
To further examine whether the gains come from query-relevant relation answer space anchors, we compare the default relation top-k anchor selection with two diagnostic variants. Global top-k anchors select anchors from the whole entity set according to the prior score, while random RAS anchors randomly sample anchors from the directed relation answer space with uniform weights.
As shown in Table 7, random RAS anchors perform clearly worse than relation top-k anchors on all three datasets. This result shows that simply sampling historical answers from the directed relation answer space is not sufficient. Global top-k anchors obtain competitive results, but they are still consistently lower than relation top-k anchors. This suggests that high-prior entities alone cannot fully replace relation-aware anchor retrieval. Overall, the results support that RAPC benefits from selecting query-relevant anchors within the directed relation answer space.
Table 7.
Anchor selection diagnostics under the same trained checkpoint. MRR values are reported in percentage form. Bold values indicate the best results.
5.3. Ablation Study
To analyze the role of each core component in RAPC, we design four ablation settings.
w/o RAS Evidence: This setting removes relation answer space evidence and does not select answer anchors from the directed relation answer space. It is used to verify whether the relation answer space serves as the core evidence source of RAPC.
w/o Query-Specific Anchors: This setting is a trained RAPC ablation. It keeps the relation answer space, the RAPC training objectives, and the selective calibration module but replaces query-specific top-k anchors with a relation-level mean prototype. It is different from the static mean prototype sanity check in Table 1 because this variant is trained and evaluated within the full RAPC framework.
w/o SRC: This setting keeps the prototype evidence but removes selective relation-aware calibration, using only ordinary query-level calibration. It is used to verify whether prior-preserving selective calibration helps stably absorb prototype evidence.
w/o Relation-Aware Hard Negatives: This setting removes the relation-aware hard negative training objective. It is used to verify whether hard negatives mined from the relation answer space and the global candidate set can enhance the discriminative ability of the model during training. RAHN denotes relation-aware hard negatives. The corresponding ablation results are summarized in Table 8.
Table 8.
Ablation results of RAPC on the three datasets. Bold values indicate the best results.
The w/o RAS Evidence result is identical to the prior score reference in Table 1 and is repeated here to provide a component-level ablation comparison.
Removing RAS Evidence leads to the largest performance drop, reducing MRR by 4.84, 4.03, and 3.25 points on DB15K, MKG-W, and MKG-Y, respectively. This confirms that the main source of improvement is the relation answer space rather than the multimodal prior alone. Replacing query-specific anchors with a relation-level mean prototype also hurts performance, especially on MKG-W, where MRR drops by 2.00 points. Therefore, the model benefits not only from using historical answer entities but also from selecting anchors conditioned on the current query. Removing SRC and RAHN causes smaller but consistent degradation, suggesting that these two modules mainly stabilize calibration and improve local discrimination among hard candidates.
5.3.1. Fine-Grained Analysis of SRC
We further perform a fine-grained analysis of SRC by removing each local calibration component during inference. The results are shown in Table 9.
Table 9.
Fine-grained ablation results of selective relation calibration. All metric values are reported in percentage form.
Overall, these results suggest that SRC should be interpreted as a bounded calibration module rather than an aggressive reranking strategy. Some local rules have dataset-dependent effects, but the complete SRC design provides a stable trade-off between absorbing prototype evidence and preserving the multimodal prior ranking.
5.3.2. Score and Calibration Distribution
To examine whether prototype calibration causes unstable score shifts, we visualize the distributions of , , , and the calibration coefficient. As shown in Figure 3, the prototype score generally has a wider distribution, while the final score remains close to the prior score after selective calibration. The calibration coefficient is also bounded within a moderate range across the three datasets. This indicates that RAPC injects prototype evidence conservatively rather than replacing the multimodal prior ranking.
Figure 3.
Score and calibration distribution analysis on DB15K, MKG-W, and MKG-Y.
To further analyze the working mechanism of RAPC, we conduct additional analyses from seven perspectives: seen-answer and unseen-answer generalization, relation answer space statistics, answer space size, relation frequency, the number of answer anchors, hyperparameter sensitivity, and a case study.
5.3.3. Seen-Answer and Unseen-Answer Analysis
Since RAPC uses the historical answer entities of each directed relation, we further analyze whether its improvement simply comes from memorizing answers that have appeared in the training graph. We divide test queries into seen-answer and unseen-answer groups according to whether the target entity belongs to the training relation answer space .
As shown in Table 10, RAPC obtains larger gains on seen-answer queries than on unseen-answer queries. This is expected because seen answers are covered by the historical answer region and can receive more direct prototype support. More importantly, RAPC still improves over the multimodal prior on unseen-answer queries across all three datasets, showing that it does not work as a hard answer space memorization mechanism. Instead, the relation answer space provides complementary evidence for calibration, while candidates outside can still be ranked by the multimodal prior. These results also reveal a limitation of RAPC: its advantage is stronger when the relation answer space has partial but meaningful coverage and becomes weaker when the true answer is outside the historical answer region.
Table 10.
Seen-answer and unseen-answer analysis. All metric values are reported in percentage form, and gains are reported in percentage points.
5.3.4. Statistics of Relation Answer Spaces
To better understand the dataset-level behavior of RAPC, we summarize the statistics of directed relation answer spaces in Table 3.
For each directed relation , we compute the normalized entropy of its empirical answer distribution as
where denotes the empirical frequency of entity e appearing as an answer of directed relation in the training set. When , the entropy is set to 0. The entropy reported in Table 3 is averaged over the directed relations in each dataset.
As shown in Table 3, MKG-Y contains far fewer relations than DB15K and MKG-W but has the largest average and median answer space sizes. It also has the highest normalized answer space entropy, indicating that its relation-specific answer distributions are more diffuse. This helps explain why RAPC obtains smaller gains on some MKG-Y metrics: when the answer space is broad and less concentrated, selected anchors may contain more weakly related historical answers and provide less discriminative prototype evidence.
5.3.5. Analysis of Relation Answer Space Size
We divide test queries into four quantile groups according to the size of the directed relation answer space and report the MRR improvement in the final RAPC score over the multimodal prior score. The results are shown in Table 11.
Table 11.
MRR improvement of RAPC over the multimodal prior ranking under different relation answer space sizes. Values are reported in percentage points, and the number of queries in each group is shown in parentheses.
As shown in Table 11, RAPC gains more on small and medium answer spaces, while the improvement becomes smaller in the largest groups. For example, the MRR gain drops from 10.39 to 0.60 points on DB15K and from 7.66 to 0.12 points on MKG-W. This suggests that relation answer spaces provide useful evidence, but overly broad answer spaces may contain more weakly related anchors and reduce prototype discriminability. The positive but non-monotonic trend on MKG-Y also supports the need for selective calibration.
5.3.6. Long-Tail Relation Frequency Analysis
We analyze RAPC under different relation frequency groups to examine its behavior on long-tail and frequent relations. Test queries are divided into four quantile groups according to the training frequency of their directed relations. The results are shown in Table 12.
Table 12.
Long-tail relation frequency analysis. MRR values are reported in percentage form, and gains are reported in percentage points.
As shown in Table 12, RAPC consistently improves over the multimodal prior across different relation frequency groups. This indicates that relation answer space evidence is not limited to a specific frequency range. The gain becomes smaller in the highest-frequency group of MKG-Y, which is consistent with the observation that overly broad answer spaces may introduce weakly related anchors and reduce prototype discriminability. This also suggests that relation frequency alone does not determine prediction difficulty; high-frequency relations may still be difficult when their answer spaces are broad and semantically diffuse.
5.3.7. Analysis of the Number of Answer Anchors and Inference Efficiency
The number of answer anchors k controls how many historical answers are used to construct prototype evidence. We compare different k values and evaluate inference overhead against the prior-only model. Timing is measured on an NVIDIA GeForce RTX 3090 GPU, including forward scoring and filtered ranking on the full test set, excluding model loading. Each result is averaged over three runs.
As shown in Figure 2a, the model performs relatively poorly when on most datasets, indicating that a single historical answer anchor is insufficient to represent the potential answer region under the current relation. As k increases to 4 or 8, the model performance improves and reaches the best result when . When k further increases to 16 or 32, the performance slightly decreases, suggesting that too many anchors may introduce weakly related historical answer entities. Therefore, we set the default number of answer anchors to .
As shown in Figure 2b, the inference time of RAPC is about 1.94 to 2.03 times that of the prior-only model. The additional overhead mainly comes from answer anchor selection, prototype construction, and selective calibration, but the full test set evaluation still remains on the order of seconds. In terms of complexity, answer anchor selection has a complexity of approximately , prototype aggregation has a complexity of , and final candidate scoring remains . Therefore, RAPC improves ranking quality while keeping the additional computation within an acceptable range.
5.3.8. Hyperparameter Sensitivity
We further evaluate the sensitivity of RAPC to key calibration hyperparameters, including , , and the anchor temperature . The results are shown in Table 13.
Table 13.
Hyperparameter sensitivity analysis on DB15K and MKG-W. All metric values are reported in percentage form.
As shown in Table 13, RAPC is relatively stable under different calibration and anchor temperature settings. The results for and show only small fluctuations, suggesting that the selective calibration module is not highly sensitive to these parameters. The anchor temperature has a moderate influence, and different datasets may favor slightly different temperatures. Although a few individual test metrics are slightly higher under non-default values, all hyperparameters are selected according to validation performance and kept fixed during test evaluation.
5.3.9. Case Study
To provide a more intuitive understanding of how RAPC changes candidate ranking, we present three representative cases in Table 14. The table reports whether the target answer is covered by the training relation answer space, the size of the answer space, and the rank of the target entity under the prior, prototype, and final scores.
Table 14.
Case study of candidate ranking changes. A smaller rank indicates a better position of the target entity.
As shown in Table 14, RAPC can substantially improve the target rank when the selected prototype evidence is highly consistent with the true answer region. In the large-gain case from DB15K, the prior ranking places the target entity at a low position, while the prototype evidence ranks it first, and the final score promotes it to the top-ranked region. For the unseen-answer case from MKG-W, although the target entity is not included in the training relation answer space, RAPC still improves its rank from 13197 to 16, showing that the method does not rely on hard answer space masking. The broad space case from MKG-Y shows that even under a large relation answer space, RAPC can preserve the top-ranked result when the multimodal prior and prototype evidence are already consistent. These examples illustrate that RAPC uses relation answer space evidence as complementary ranking evidence while preserving the multimodal prior when it is already confident.
5.4. Limitations
Although RAPC improves candidate ranking by using relation answer space evidence, it still has several limitations. First, its effectiveness depends on the quality and coverage of the relation answer space. When the answer space is overly broad, sparse, or weakly concentrated, the selected anchors may contain weakly related historical answers and provide less discriminative prototype evidence. Second, RAPC obtains larger gains on seen-answer queries than on unseen-answer queries because seen answers are directly covered by the training relation answer space. Although unseen-answer queries can still be ranked by the multimodal prior, the corrective effect of prototype evidence is weaker in this case. Third, the anchor retrieval, prototype construction, and selective calibration modules introduce additional inference overhead compared with the prior-only model. Finally, the current framework is mainly evaluated in a transductive MMKGC setting, and its extension to inductive or dynamically evolving multimodal knowledge graphs remains an important direction for future work.
6. Conclusions
This paper has presented RAPC, a Relation Answer Space Prototype Calibration framework for multimodal knowledge graph completion. RAPC uses the historical answer entities of each directed relation as a relation answer space, retrieves query-relevant anchors, and injects the resulting prototype evidence through prior-preserving selective calibration. Experiments on DB15K and MKG-W show clear gains over strong MMKGC baselines. On MKG-Y, RAPC achieves the best top-rank metrics, namely MRR and Hits@1, although its advantage becomes weaker for wider ranking ranges.
Theoretically, this study shows that relation-level historical answer distributions can be explicitly modeled as ranking evidence, complementing existing MMKGC methods that mainly focus on multimodal representation learning and modality fusion. Practically, RAPC can benefit applications such as semantic retrieval and recommendation, where relation-conditioned answer space evidence may help promote reliable candidates and suppress semantically plausible-but-incorrect alternatives. For example, in a recommendation-oriented multimodal knowledge graph, RAPC can use historical answers under relations such as item category, brand, or compatible product to promote relation-consistent candidates and suppress visually or textually similar but relation-inconsistent entities.
Future work will focus on more robust answer space modeling, adaptive anchor selection for broad or long-tail relations, and extension to inductive or dynamically evolving multimodal knowledge graphs.
Author Contributions
A.Y. (Aizihairijiang Yusufu): Conceptualization, Methodology, and Software; J.L.: Formal Analysis, Visualization, and Writing—Reviewing and Editing; S.W.: Data Curation and Writing—Original Draft Preparation; A.A.: Investigation and Resources; C.M.: Validation and Investigation; A.Y. (Aizierguli Yusufu): Supervision. All authors have read and agreed to the published version of the manuscript.
Funding
This work was supported by the Xinjiang Uygur Autonomous Region Innovation Environment (Talent and Base) Construction Special Program, Natural Science Program (Special Training for Ethnic Minority Scientific and Technological Talents) (Grant No. 2025D03032); the Undergraduate Education and Teaching Research and Reform Project of Universities in the Xinjiang Uygur Autonomous Region (Grant No. XJGXPTJG-2026077); the Youth Top-notch Talent Support Program of Xinjiang Normal University (Grant No. XJNUQB2022-22); the Tender Project of the Engineering Research Center of Smart Education of Xinjiang Normal University (Grant No. XJNU-ZHJY202403); the National Natural Science Foundation of China (Grant No. 61662081); and the National Social Science Foundation of China (Grant No. 14AZD11).
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The datasets analyzed in this study are publicly available benchmark datasets described in Section 5.1. The processed data and experimental outputs are available from the corresponding author upon reasonable request.
Conflicts of Interest
The authors declare no conflicts of interest.
Abbreviations
The following abbreviations are used in this manuscript:
| KG | Knowledge graph |
| KGC | Knowledge graph completion |
| MMKG | Multimodal knowledge graph |
| MMKGC | Multimodal knowledge graph completion |
| RAS | Relation answer space |
| RAPC | Relation answer space prototype calibration |
| SRC | Selective relation calibration |
| RAHN | Relation-aware hard negatives |
References
- Hogan, A.; Blomqvist, E.; Cochez, M.; d’Amato, C.; de Melo, G.; Gutierrez, C.; Kirrane, S.; Labra Gayo, J.E.; Navigli, R.; Neumaier, S.; et al. Knowledge Graphs. ACM Comput. Surv. 2021, 54, 71:1–71:37. [Google Scholar] [CrossRef] [Scilit]
- Liu, Y.; Li, H.; Garcia-Duran, A.; Niepert, M.; Onoro-Rubio, D.; Rosenblum, D.S. MMKG: Multi-Modal Knowledge Graphs. In Proceedings of the 16th European Semantic Web Conference, Portorož, Slovenia, 2–6 June 2019; pp. 459–474. [Google Scholar]
- Xie, R.; Liu, Z.; Luan, H.; Sun, M. Image-Embodied Knowledge Representation Learning. In Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia, 19–25 August 2017; pp. 3140–3146. [Google Scholar]
- Hamid, O.H. Data-Centric and Model-Centric AI: Twin Drivers of Compact and Robust Industry 4.0 Solutions. Appl. Sci. 2023, 13, 2753. [Google Scholar] [CrossRef] [Scilit]
- Wang, Q.; Mao, Z.; Wang, B.; Guo, L. Knowledge Graph Embedding: A Survey of Approaches and Applications. IEEE Trans. Knowl. Data Eng. 2017, 29, 2724–2743. [Google Scholar] [CrossRef] [Scilit]
- Bordes, A.; Usunier, N.; Garcia-Duran, A.; Weston, J.; Yakhnenko, O. Translating Embeddings for Modeling Multi-Relational Data. Adv. Neural Inf. Process. Syst. 2013, 26, 2787–2795. [Google Scholar]
- Ji, G.; He, S.; Xu, L.; Liu, K.; Zhao, J. Knowledge Graph Embedding via Dynamic Mapping Matrix. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China, 26–31 July 2015; pp. 687–696. [Google Scholar]
- Sun, Z.; Deng, Z.H.; Nie, J.Y.; Tang, J. RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. In Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA, 6–9 May 2019. [Google Scholar]
- Chao, L.; He, J.; Wang, T.; Chu, W. PairRE: Knowledge Graph Embeddings via Paired Relation Vectors. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics, Online, 1–6 August 2021; pp. 4360–4369. [Google Scholar]
- Yang, B.; Yih, W.; He, X.; Gao, J.; Deng, L. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In Proceedings of the International Conference on Learning Representations, San Diego, CA, USA, 7–9 May 2015. [Google Scholar]
- Trouillon, T.; Welbl, J.; Riedel, S.; Gaussier, E.; Bouchard, G. Complex Embeddings for Simple Link Prediction. In Proceedings of the 33rd International Conference on Machine Learning, New York, NY, USA, 20–22 June 2016; pp. 2071–2080. [Google Scholar]
- Balažević, I.; Allen, C.; Hospedales, T.M. TuckER: Tensor Factorization for Knowledge Graph Completion. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing, Hong Kong, China, 3–7 November 2019; pp. 5185–5194. [Google Scholar]
- Mousselly-Sergieh, H.; Botschen, T.; Gurevych, I.; Roth, S. A Multimodal Translation-Based Approach for Knowledge Graph Representation Learning. In Proceedings of the 7th Joint Conference on Lexical and Computational Semantics, New Orleans, LA, USA, 5–6 June 2018; pp. 225–234. [Google Scholar]
- Wang, Z.; Li, L.; Li, Q.; Zeng, D. Multimodal Data Enhanced Representation Learning for Knowledge Graphs. In Proceedings of the International Joint Conference on Neural Networks, Budapest, Hungary, 14–19 July 2019; pp. 1–8. [Google Scholar]
- Wang, M.; Wang, S.; Yang, H.; Zhang, Z.; Chen, X.; Qi, G. Is Visual Context Really Helpful for Knowledge Graph? A Representation Learning Perspective. In Proceedings of the 29th ACM International Conference on Multimedia, Virtual Event, China, 20–24 October 2021; pp. 2735–2743. [Google Scholar]
- Liang, W.; De Meo, P.; Tang, Y.; Zhu, J. A Survey of Multi-Modal Knowledge Graphs: Technologies and Trends. ACM Comput. Surv. 2024, 56, 273:1–273:41. [Google Scholar] [CrossRef] [Scilit]
- Chen, Z.; Zhang, Y.; Fang, Y.; Geng, Y.; Guo, L.; Chen, X.; Li, Q.; Zhang, W.; Chen, J.; Zhu, Y.; et al. Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey. arXiv 2024, arXiv:2402.05391. [Google Scholar]
- Liu, T. Multi-Modal Knowledge Graph Completion: A Survey. In Proceedings of the International Conference on Image Processing, Machine Learning and Pattern Recognition, Nanjing, China, 6–8 December 2024; pp. 116–121. [Google Scholar]
- Chen, X.; Zhang, N.; Li, L.; Deng, S.; Tan, C.; Xu, C.; Huang, F.; Si, L.; Chen, H. Hybrid Transformer with Multi-Level Fusion for Multimodal Knowledge Graph Completion. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, 11–15 July 2022; pp. 904–915. [Google Scholar]
- Lee, J.; Chung, C.; Lee, H.; Jo, S.; Whang, J.J. VISTA: Visual-Textual Knowledge Graph Representation Learning. In Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, 6–10 December 2023; pp. 7314–7328. [Google Scholar]
- Shang, B.; Zhao, Y.; Liu, J.; Wang, D. LAFA: Multimodal Knowledge Graph Completion with Link Aware Fusion and Aggregation. Proc. Aaai Conf. Artif. Intell. 2024, 38, 8957–8965. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Y.; Chen, Z.; Guo, L.; Xu, Y.; Hu, B.; Liu, Z.; Zhang, W.; Chen, H. NativE: Multi-Modal Knowledge Graph Completion in the Wild. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, Washington, DC, USA, 14–18 July 2024; pp. 91–101. [Google Scholar]
- Zhang, Y.; Chen, Z.; Zhang, W. MACO: A Modality Adversarial and Contrastive Framework for Modality-Missing Multi-Modal Knowledge Graph Completion. In Natural Language Processing and Chinese Computing; Springer: Cham, Switzerland, 2023; pp. 123–134. [Google Scholar]
- Chen, Z.; Fang, Y.; Zhang, Y.; Guo, L.; Chen, J.; Pan, J.Z.; Chen, H.; Zhang, W. Noise-powered Multi-modal Knowledge Graph Representation Framework. In Proceedings of the 31st International Conference on Computational Linguistics, Abu Dhabi, United Arab Emirates, 19–24 January 2025; pp. 141–155. [Google Scholar]
- Xu, D.; Xu, T.; Wu, S.; Zhou, J.; Chen, E. Relation-Enhanced Negative Sampling for Multimodal Knowledge Graph Completion. In Proceedings of the 30th ACM International Conference on Multimedia, Lisboa, Portugal, 10–14 October 2022; pp. 3857–3866. [Google Scholar]
- Niu, G.; Zhang, X. Diffusion-Based Hierarchical Negative Sampling for Multimodal Knowledge Graph Completion. In Database Systems for Advanced Applications (DASFAA 2025); Lecture Notes in Computer Science; Springer: Singapore, 2026; Volume 15988, pp. 479–495. [Google Scholar] [CrossRef] [Scilit]
- Huang, W.; Li, P.; Liang, M.; Hou, X.; Li, Y.; Du, J.; Xue, Z.; Guan, Z. DiffusionCom: Structure-Aware Multimodal Diffusion Model for Multimodal Knowledge Graph Completion. In Proceedings of the 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, 4–8 May 2026; pp. 12452–12456. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Y.; Chen, Z.; Liang, L.; Chen, H.; Zhang, W. Unleashing the Power of Imbalanced Modality Information for Multi-Modal Knowledge Graph Completion. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, Torino, Italy, 20–25 May 2024; pp. 17120–17130. [Google Scholar]
- Zhang, Y.; Chen, Z.; Guo, L.; Xu, Y.; Hu, B.; Liu, Z.; Zhang, W.; Chen, H. Tokenization, Fusion, and Augmentation: Towards Fine-Grained Multi-Modal Entity Representation. Proc. Aaai Conf. Artif. Intell. 2025, 39, 13322–13330. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Y.; Chen, Z.; Guo, L.; Xu, Y.; Hu, B.; Liu, Z.; Zhang, W.; Chen, H. Multiple Heads Are Better Than One: Mixture of Modality Knowledge Experts for Entity Representation Learning. In Proceedings of the International Conference on Learning Representations, Singapore, 24–28 April 2025. [Google Scholar]
- Hamid, O.H. Beyond Probabilities: Unveiling the Delicate Dance of Large Language Models (LLMs) and AI-Hallucination. In Proceedings of the 2024 IEEE Conference on Cognitive and Computational Aspects of Situation Management, Montreal, QC, Canada, 7–10 May 2024; pp. 85–90. [Google Scholar] [CrossRef] [Scilit]
- Lehmann, J.; Isele, R.; Jakob, M.; Jentzsch, A.; Kontokostas, D.; Mendes, P.N.; Hellmann, S.; Morsey, M.; Van Kleef, P.; Auer, S.; et al. DBpedia—A Large-Scale, Multilingual Knowledge Base Extracted from Wikipedia. Semant. Web 2015, 6, 167–195. [Google Scholar] [CrossRef] [Scilit]
- Vrandečić, D.; Krötzsch, M. Wikidata: A Free Collaborative Knowledgebase. Commun. ACM 2014, 57, 78–85. [Google Scholar] [CrossRef] [Scilit]
- Suchanek, F.M.; Kasneci, G.; Weikum, G. YAGO: A Core of Semantic Knowledge. In Proceedings of the 16th International Conference on World Wide Web, Banff, AB, Canada, 8–12 May 2007; pp. 697–706. [Google Scholar]
- Tang, Y.; Huang, J.; Wang, G.; He, X.; Zhou, B. Orthogonal Relation Transforms with Graph Context Modeling for Knowledge Graph Embedding. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online, 5–10 July 2020; pp. 2713–2722. [Google Scholar]
- Lu, X.; Wang, L.; Jiang, Z.; He, S.; Liu, S. MMKRL: A Robust Embedding Approach for Multi-Modal Knowledge Graph Representation Learning. Appl. Intell. 2022, 52, 7480–7497. [Google Scholar]
- Zhang, Y.; Zhang, W. Knowledge Graph Completion with Pre-Trained Multimodal Transformer and Twins Negative Sampling. arXiv 2022, arXiv:2209.07084. [Google Scholar]
- Cao, Z.; Xu, Q.; Yang, Z.; He, Y.; Cao, X.; Huang, Q. OTKGE: Multi-Modal Knowledge Graph Embeddings via Optimal Transport. In Proceedings of the Advances in Neural Information Processing Systems, New Orleans, LA, USA, 28 November–9 December 2022; Volume 35. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.


