Next Article in Journal
Temporal Spectral Analysis of Late-Time Error in a Physics-Informed Neural Network Solution of the One-Dimensional Advection–Diffusion Equation
Previous Article in Journal
DeCyReM: De-Cycled Residual Memory with Utility-Gated Retrieval for Traffic Flow Forecasting
Previous Article in Special Issue
Fast Frequency Control Strategy Based on Worst-Case Network Attack Perception
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Automated Artistic Image Aesthetic Evaluation Framework via Expert Knowledge Injection into Large Vision-Language Models

1
College of Arts, Northeastern University, Shenyang 110819, China
2
College of Computer Science and Engineering, Northeastern University, Shenyang 110819, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Mathematics 2026, 14(17), 3205; https://doi.org/10.3390/math14173205
Submission received: 5 August 2026 / Revised: 1 September 2026 / Accepted: 3 September 2026 / Published: 4 September 2026

Abstract

Image aesthetic assessment (IAA) has progressed from handcrafted visual features to deep neural models, yet fine-art evaluation remains difficult because aesthetic judgment depends on style, historical context, and formal composition. Large Vision-Language Models (LVLMs) offer strong multimodal reasoning capabilities, but their direct application to art critique can produce generic descriptions, unstable scores, and weakly interpretable judgments. We therefore propose the Aesthetic Expert Knowledge Injection (AEKI) framework, which translates formal art principles into structured, machine-executable instructions. AEKI operationalizes four dimensions—Contrast & Harmony, Rhythm & Flow, Symmetry & Balance, and Variety & Unity—and assigns style-dependent weights w * across 16 artistic categories. The resulting three-stage pipeline performs style anchoring, expert-weight allocation, and structured instruction compilation before LVLM inference. We evaluate the framework on a multi-category painting collection and a balanced subset annotated by human evaluators. Comparisons with zero-shot LVLM baselines show improved alignment in both numerical scoring and critique professionalism, while ablation experiments clarify the contributions of style anchoring and dynamic weighting. These results indicate that domain knowledge can be incorporated into LVLM evaluation through a transparent rule-based layer, supporting applications in digital curation, computational aesthetics, and art education.

1. Introduction

The growth of digital art galleries, virtual museums, and multimedia collections has made image aesthetic assessment (IAA) an important problem in computer vision and multimedia analysis [1,2,3]. Reliable aesthetic assessment can support art curation, image retrieval, content moderation, and personalized recommendation [4,5,6,7,8,9,10]. Early methods relied on handcrafted cues, including color harmony, spatial layout, edge complexity, and photographic composition rules [11,12,13]. Subsequent work adopted data-driven neural models trained on large photographic datasets such as AVA and AADB [14,15]. Representative systems such as NIMA further modeled the distribution of human opinion scores rather than predicting only a single mean value, highlighting the inherently subjective nature of aesthetic judgment [16].
Models developed for ordinary photographs do not necessarily transfer well to fine art. Artistic image aesthetics assessment (AIAA) must consider style, brushwork, material, historical context, and formal organization, whereas generic feature extractors often emphasize photographic realism or object content [17,18,19]. The limited availability of fine-grained, expert-annotated artwork datasets further constrains the development and evaluation of specialized methods [20].
Multimodal large language models (MLLMs) and Large Vision-Language Models (LVLMs) provide a new basis for high-level visual analysis. Architectures such as BLIP-2 connect pretrained visual encoders with large language models [21], while visual instruction tuning enables models such as LLaVA to follow open-ended image-language instructions [22]. These advances motivate the use of off-the-shelf LVLMs for zero-shot aesthetic scoring and critique generation [23].
Recent work has also explored teaching LMMs to express subjective visual judgments through text-defined rating levels instead of unconstrained numerical regression [24]. This approach improves score alignment but does not explicitly encode the art-historical criteria needed for style-sensitive critique. In fine-art settings, direct LVLM prompting can still produce generic praise, unstable scores, or descriptions dominated by object recognition [25]. We refer to the misapplication of photographic or cross-style standards as aesthetic misinterpretation. For example, a model may penalize visible Pointillist brushstrokes as noise or interpret the unpainted space in an ink-wash composition as missing detail. Figure 1 illustrates this gap between semantic description and formal-aesthetic analysis.
To address this gap, we treat prompt construction as a rule-based expert knowledge layer rather than ad hoc text manipulation. The proposed AEKI Framework translates four formal-art dimensions-Contrast & Harmony, Rhythm & Flow, Symmetry & Balance, and Variety & Unity-into sequential, machine-executable instructions [26,27].
Because artistic traditions prioritize these dimensions differently, AEKI uses a dynamic weighting mechanism rather than a universal rubric. As shown in the bottom panel of Figure 1, Stage 1 anchors the media category and style, Stage 2 retrieves a corresponding expert-weight vector, and Stage 3 compiles these variables into a structured instruction. The LVLM then produces a numerical score and a principle-based critique in a machine-readable JSON format.
This design converts heuristic prompt generation into a structured and interpretable multimedia pipeline. We evaluate it using a multi-category painting collection, human-reference annotations, and quantitative and qualitative comparisons with zero-shot LVLM baselines [28].
In summary, the main contributions of this paper are fundamentally threefold:
  • Structured aesthetic evaluation: We combine LVLM reasoning with explicit formal art principles to reduce semantic bias and cross-style aesthetic misinterpretation.
  • Transparent expert knowledge injection: We define a reproducible weight matrix for 16 artistic categories and compile the selected style prior and weights into structured instructions.
  • Multi-model evaluation: We compare four LVLM backbones using human-reference scoring, ablation analysis, qualitative cases, and output-format compliance.

2. Proposed Method

This section presents the architecture, mathematical formulation, and inference pipeline of the Aesthetic Expert Knowledge Injection (AEKI) Framework. Directly prompting an LVLM for fine-art evaluation can produce unconstrained outputs dominated by semantic description. AEKI instead uses a deterministic template for prompt construction, making the requested evaluation criteria explicit, measurable, and machine-interpretable while leaving the LVLM generation process stochastic.
As illustrated in Figure 2, AEKI acts as an intermediate layer between the artwork and the LVLM. The pipeline contains three stages: Style Categorization, Dynamic Weight Allocation of Formal Beauty Principles, and Structured Instruction Generation. Rather than applying one universal template, the framework selects criteria according to the inferred medium and style. Each stage progressively specifies the evidence that the model should examine, encouraging analysis of formal structure instead of object enumeration alone.

2.1. Problem Formulation and System Abstract

To provide a rigorous analytical foundation for our AEKI Framework, we first formally define the aesthetic evaluation task mathematically. Let I R H × W × C denote the input visual media (e.g., a digitized fine art painting) with height H, width W, and C color channels. Let M represent the off-the-shelf multimodal Large Vision-Language Model serving as the foundational reasoning engine.
In a conventional, naive zero-shot paradigm (as illustrated in the top panel of Figure 1), the aesthetic evaluation O n a i v e is generated by simply feeding the image and a static, generic prompt P n a i v e into the model:
O n a i v e = M ( I , P n a i v e )
Due to the unconstrained nature of P n a i v e , O n a i v e frequently devolves into a superficial description of the image content. Conversely, our framework constructs a highly complex, dynamically assembled expert instruction, denoted as P e x p e r t .
We define S = { s 1 , s 2 , , s K } as a predefined set of K distinct artistic styles and genres (e.g., Renaissance, Impressionism, Cubism, Traditional Chinese Painting). Furthermore, we establish a core formal aesthetic vector F = { f 1 , f 2 , f 3 , f 4 } , representing four selected formal beauty principles: f 1 (Contrast & Harmony), f 2 (Rhythm & Flow), f 3 (Symmetry & Balance), and  f 4 (Variety & Unity).
Our system first predicts the target style s * S of the input image I. Subsequently, we introduce a style-dependent weight mapping function W , which structurally assigns a specific attention weight vector w * = [ w 1 , w 2 , w 3 , w 4 ] T prioritized for the detected style s * :
w * = W ( s * ) where i = 1 4 w i = 1
By orchestrating these dynamically allocated weights, our framework compiles the structured prompt P e x p e r t via an algorithmic template generator Φ . Finally, the explicit knowledge-injected evaluation output O e x p e r t is computed as:
O e x p e r t = M I , Φ ( s * , w * , F )
To support downstream compatibility and interpretability, the final output O e x p e r t is constrained to a standardized, machine-readable JSON structure.

2.2. Stage 1: Contextual Style and Genre Categorization

The premise of the Aesthetic Expert Knowledge Injection (AEKI) framework is that visual art evaluation criteria are heterogeneous and context-dependent. Unlike blind Image Quality Assessment (IQA), which typically uses low-level physical criteria such as exposure, sensor noise, sharpness, and photometric balance, fine art does not follow a single aesthetic rubric. A feature treated as a flaw in one movement may be intentional in another. For instance, the symmetry and linear perspective associated with Renaissance Classicism are deliberately reconfigured in Cubism and de-emphasized in Abstract Expressionism. A static evaluation template can therefore create cognitive misalignment when applied across artistic domains. The first operational unit of the pipeline addresses this issue through a contextual style anchoring module.
The objective of this stage is to identify the semantic, material, and historical context of the input image I before aesthetic scoring. We define a taxonomic space S containing K = 16 artistic media and stylistic categories. The taxonomy covers material media (e.g., oil painting, watercolor, traditional Chinese ink, and digital illustration) and stylistic movements (e.g., Impressionism, Post-Impressionism, Fauvism, Realism, and Surrealism). Mapping an artwork to one of these anchors reduces the risk of applying inappropriate cross-domain criteria, such as penalizing a Pointillist painting for its visible, disconnected brushstrokes.
Stage 1 is implemented at the model interface rather than by directly accessing an LVLM’s internal visual encoder, text embeddings, or logits. This distinction is important for proprietary APIs, which do not expose these representations. A fixed zero-shot classification prompt P s t y l e ( S ) presents the same 16 candidate labels to each evaluated model and requests one label together with a confidence value c * [ 0 , 1 ] . For model m, the operational mapping is
r m = M m I , P s t y l e ( S ) , ( s * , c * ) = Parse ( r m ) ,
where Parse ( · ) validates the returned label against S . The same prompt-and-parse procedure is used for GPT-4o, Gemini-1.5-Pro, Qwen-VL-Max, and LLaVA-1.5; only the model-specific API or inference wrapper differs. Thus, the equations describe observable input-output behavior and do not assume access to hidden model states.
The unified inference procedure is: (1) submit I and P s t y l e ( S ) to the selected LVLM; (2) parse the style label and confidence; (3) if the output is invalid or c * < γ , mark the image as uncertain and use the neutral vector [ 0.25 , 0.25 , 0.25 , 0.25 ] T ; otherwise retrieve the row of M e x p e r t indexed by s * ; (4) compile the evaluation prompt; and (5) request the four sub-scores and critique, then compute the overall score in post-processing. The present experiments did not separately record the fallback trigger rate, so the reported results should not be interpreted as an empirical evaluation of uncertainty handling.
Once the discrete categorical anchor s * is resolved, it is retained as a Semantic Prior for Stage 2, where the Formal Beauty Principles are mapped and weighted according to the selected context.

2.3. Stage 2: Dynamic Weight Allocation of Formal Beauty Principles

Once the semantic prior s * (i.e., the target stylistic genre) is successfully anchored in Stage 1, the computational pipeline immediately transitions to translating this discrete categorical anchor into a continuous, multidimensional evaluation metric. Human expert art critics do not evaluate a painting as an undifferentiated whole; rather, they intuitively decompose visual stimuli into foundational structural components. To computationally replicate this rigorous analytical framework, our system maps the abstract concept of “aesthetics” into a quantifiable formal feature space F . However, statically applying uniform evaluation criteria across all artistic styles fundamentally contradicts the evolutionary history of visual art. Therefore, the core innovation of Stage 2 lies in the formulation of an Algorithmic Expert Knowledge Injection mechanism that dynamically allocates attention weights to distinct aesthetic principles based on the anchored style s * .

2.3.1. Deconstruction of the Formal Beauty Space

Grounded in visual art theory and Gestalt principles, we organize the evaluation into four complementary formal beauty principles [29]. We define the feature set as F = { f 1 , f 2 , f 3 , f 4 } , where each dimension specifies a distinct focus of analysis:
  • f 1 : Contrast and Harmony: This principle dictates the evaluation of luminance gradients, color wheel oppositions, and chiaroscuro (light–dark transitions). It instructs the model to scrutinize how complementary colors (e.g., warm vermilion against cool ultramarine) create visual tension, and how overall tonal harmony resolves this tension into a cohesive palette [30].
  • f 2 : Rhythm and Flow: This dimension governs the temporal perception of static spatial images. It directs the foundation model to analyze the kinetic energy of brushstrokes (e.g., impasto textures), the directional flow of leading lines, and the geometric repetition of motifs that actively guide the viewer’s focal trajectory across the canvas.
  • f 3 : Symmetry and Balance: As a foundational spatial metric, this principle evaluates the distribution of visual weight. It differentiates between rigid axial symmetry (often signifying solemnity or classical divinity) and complex asymmetrical balance (where a small, high-contrast object mathematically balances a massive, low-contrast negative space).
  • f 4 : Variety and Unity: Serving as the holistic Gestalt metric, this dimension measures the delicate structural equilibrium between visual complexity and overarching cohesion. It assesses whether diverse textual and structural elements within the frame are effectively synthesized by a dominating overarching structural schema without collapsing into monotonous repetition.

2.3.2. Expert Knowledge Matrix and Dynamic Mapping Function

A naive, uncalibrated evaluation system would ostensibly assign uniform cognitive attention to all four principles (i.e., a static weight of 0.25 for each f i ). Such an approach is mathematically simplistic and phenomenologically flawed. For instance, holding an Action Painting (which overwhelmingly prioritizes dynamic f 2 Rhythm) to the same stringent f 3 Symmetry standards as a High Renaissance altarpiece would result in a heavily skewed, hallucinated penalty score.
To mitigate this domain bias, we construct an explicit, hand-specified (non-trainable) Expert Knowledge Prior Matrix, denoted as M e x p e r t R 0 K × 4 , where K = 16 corresponds to the complete set of predefined media and stylistic categories in space S . Each row k is a fixed heuristic weight combination derived from the formal interpretation of the four principles and encoded as a transparent rule before evaluation, rather than estimated or optimized on the test set.
Let e k = [ e k , 1 , e k , 2 , e k , 3 , e k , 4 ] T be the raw, unnormalized expert salience scores associated with style s k . We require e k , i 0 for every i and j = 1 4 e k , j > 0 for every row k; these conditions make the normalization well-defined and guarantee bounded non-negative weights. Once the target style s * (with corresponding index k * ) is anchored by Stage 1, the framework retrieves e k * and applies L 1 normalization to compute w * = [ w 1 , w 2 , w 3 , w 4 ] T :
w i = e k * , i j = 1 4 e k * , j , i { 1 , 2 , 3 , 4 }
By mathematical definition, this allocation satisfies the conservation of constraint attention:
i = 1 4 w i = 1 , w i [ 0 , 1 ]
To make the relationship between the expert weights and the four schema-constrained principle scores mathematically explicit, let c i ( I ) [ 0 , 100 ] denote the score returned for principle f i in the Sub_Scores field. We normalize these already available outputs as
q ( I ) = q 1 ( I ) , q 2 ( I ) , q 3 ( I ) , q 4 ( I ) T , q i ( I ) = c i ( I ) 100 , q ( I ) [ 0 , 1 ] 4 .
The corresponding expert-weighted formal-beauty aggregation functional is defined as
A ( I , s * ) = i = 1 4 w i * q i ( I ) = ( w * ) T q ( I ) , A ( I , s * ) [ 0 , 1 ] .
This linear composite functional follows the standard weighting–aggregation structure used for interpretable composite indices [31]. It is introduced as a transparent reference aggregation of the four returned sub-scores, rather than as an additional learned predictor or a replacement for the human alignment score (HAS) used in Section 3. Thus, the mathematical definition clarifies the action of w * without altering any reported experimental result.
Table 1 reports the exact operational settings used by the framework. The values encode relative priority rather than empirical effect sizes: larger entries cause the compiler to allocate more analytical emphasis to the associated principle. They were fixed before the evaluation phase and were not tuned against D t e s t . For example, the Impressionism row gives the greatest priority to contrast and color harmony, whereas Traditional Chinese Ink Wash emphasizes rhythm and flow. The matrix was specified as a previously author-defined design rather than elicited through a formal multi-expert rating study; therefore, the entries should not be interpreted as empirically validated or uniquely optimal. Publishing all values nevertheless makes the mapping reproducible and allows future studies to replace or calibrate the matrix without retraining the underlying LVLM.
By parameterizing the conceptual art criticism process, this mechanism provides a consistent and interpretable allocation of analytical emphasis. For example, if  s * is predicted as Impressionism, the mapping function retrieves w * = [ 0.50 , 0.20 , 0.20 , 0.10 ] T , directing the LVLM to prioritize lighting and color contrast while retaining secondary consideration of rhythm and compositional balance. The generated vector w * is subsequently passed to Stage 3 as the algebraic basis for generating the natural-language instruction constraints.

2.4. Stage 3: Structured Instruction Compilation and Machine-Readable Output

The preceding stages produce the semantic context s * and the continuous weight vector w * = [ w 1 , w 2 , w 3 , w 4 ] T . Because LVLMs operate on discrete language tokens rather than direct parameter updates at inference time, Stage 3 translates these variables into text. We define an Instruction Compiler  Φ that deterministically maps the expert priors to a structured prompt P e x p e r t . This deterministic compilation step does not make the underlying LVLM deterministic; repeated generations can still vary unless model-side decoding controls are fixed.
Unlike conventional prompt engineering, which relies on heuristic “trial-and-error” syntax, our compilation function Φ operates as a template instantiation engine. To reduce the stochastic “aesthetic hallucination” observed in unconstrained LVLM outputs, P e x p e r t is dynamically assembled through three complementary linguistic constraints:
1.
System Role Projection: The LVLM is instructed to adopt a specific professional role (e.g., “Assume the role of a professional art historian and aesthetic critic”), encouraging terminology appropriate to formal art analysis.
2.
Categorical Anchoring: The previously deduced style s * is explicitly hardcoded into the premise (e.g., “Evaluate this artwork under the strict historical and technical criteria of s * ”). This structurally prevents the model from attempting to classify the image’s style autonomously, thereby suppressing semantic drift.
3.
Attention Vector Translation: The core numerical weights w * are mapped into categorical linguistic intensifiers. For instance, if a specific principle’s weight w i > θ h i g h (an empirically predefined threshold), the compiler injects a high-priority directive: “Extensively analyze and heavily weight the role of f i in your final score.” Conversely, if  w i < θ l o w , the compiler issues a suppression directive: “Provide minimal consideration to f i , as it is not a primary structural objective of this stylistic genre.
Through this multi-tiered compilation process, the framework generates P e x p e r t = Φ ( s * , w * , F ) . When the base LVLM M processes I alongside P e x p e r t , it is prompted to address the designated formal beauty dimensions rather than relying only on superficial object recognition. The weights guide the requested emphasis but do not directly modify or expose the model’s internal attention mechanism.
Furthermore, a computational aesthetic pipeline is difficult to integrate at scale if its output requires manual parsing. Native LVLMs typically produce unstructured prose, which creates a practical barrier for downstream multimedia systems such as museum database retrieval, algorithmic curation, and personalized recommendation. To improve systemic interoperability, the final component of Stage 3 enforces a structural parsing constraint on the generative output layer.
Within the terminal block of P e x p e r t , the LVLM is requested to return the evaluation object O e x p e r t in a predefined JSON format without conversational wrappers. The standardized output schema comprises four key-value pairs:
1.
“Style_Anchor”: A string replication of s * to ensure alignment validation.
2.
“Sub_Scores”: A nested dictionary containing four independent numerical scores c i [ 0 , 100 ] explicitly corresponding to each formal principle f i F .
3.
“Overall_Aesthetic_Score”: The final scalar representation S [ 0 , 100 ] , calculated by the deterministic post-processing module from the four model-generated sub-scores and the selected style weights.
4.
“Professional_Critique”: A structured, concise string containing the textual aesthetic argument defending the assigned quantitative scores.
Specifically, after the LVLM returns the four sub-scores, the overall aesthetic score is computed outside the generative model as
S = i = 1 4 w i c i , c i [ 0 , 100 ] , i = 1 4 w i = 1 .
Thus, the LVLM is responsible for producing the principle-specific evidence, sub-scores, and critique, whereas the program inserts the value of S into the final JSON object. This separation removes ambiguity from the aggregation step: identical sub-scores and style weights always yield the same overall score.
The weighted sum is adopted as a transparent and easily auditable baseline aggregation rule. It assumes additive contributions among the four principles and does not model possible non-linear interactions, such as one principle compensating for another. We therefore do not claim that Equation (9) is a psychological model of aesthetic perception; evaluating multiplicative, interaction-based, or fuzzy-integral alternatives remains future work.
The expert-inference mapping in Equation (3) is implemented with the JSON schema described above, with the overall score inserted by deterministic post-processing.
Together, the three stages provide a structured bridge between unconstrained multimodal generation and machine-readable computational aesthetic assessment.

2.5. Parallel Batch Inference and Aggregation Algorithm

The three-stage inference procedure is separable at the image level: each image reads the same immutable expert matrix M e x p e r t , while style anchoring, weight retrieval, prompt compilation, LVLM inference, and schema validation do not require intermediate results from any other image. The batch therefore admits a task-parallel map–aggregate organization analogous to large-scale independent data processing [32]. For a batch of N images, let Q [ 0 , 1 ] N × 4 collect the normalized sub-score vectors from Equation (7), and let W [ 0 , 1 ] N × 4 collect the corresponding style-dependent weight vectors. The complete vector of transparent reference aggregation scores is
a = ( Q W ) 1 4 , a [ 0 , 1 ] N ,
where ⊙ denotes element-wise multiplication and 1 4 is a four-dimensional all-ones vector. Algorithm 1 summarizes the implementation without introducing trainable parameters or cross-image dependencies.
Algorithm 1: Parallel expert-guided batch inference and aggregation.
Input: images {I_n}_{n=1}ˆN, shared expert matrix M_expert,
            formal principles F, frozen LVLM M, P workers
Output: validated JSON objects {O_n}_{n=1}ˆN and reference scores a

parallel for n = 1, ..., N do
      1. Predict the style anchor s_n from I_n.
      2. Retrieve and normalize the corresponding row of M_expert to w_n.
      3. Compile the structured instruction P_n = Phi(s_n, w_n, F).
      4. Run O_n = M(I_n, P_n).
      5. Validate the required JSON fields and numerical ranges.
      6. Normalize the four returned sub-scores to q_n and set a_n = w_nˆT q_n.
end parallel for
Aggregate {(O_n, a_n)}_{n=1}ˆN in the original image order.
For a theoretical cost accounting, let t s , t w , t p , t m , and  t v denote the per-image costs of style anchoring, weight retrieval, prompt compilation, LVLM inference, and validation/aggregation, respectively. The sequential time and the idealized P-worker time are
T 1 N ( t s + t w + t p + t m + t v ) , T P N P ( t s + t w + t p + t m + t v ) + t s y n c ,
where t s y n c represents scheduling and result-aggregation overhead. The associated theoretical speedup and parallel efficiency are
S P = T 1 T P , E P = S P P .
These expressions provide a scalability model rather than a measured runtime claim. In particular, they make explicit that synchronization and the serial components bound the achievable speedup, consistent with Amdahl’s classical analysis [33].

3. Experimental and Analysis

This section evaluates the effectiveness, interpretability, and robustness of AEKI through quantitative, qualitative, ablation, and system-level experiments. The analysis is organized around the following research questions (RQs):
  • RQ1 (Human–Machine Alignment): How do the aggregate human-alignment scores of AEKI-generated evaluations compare with those of zero-shot baseline LVLMs?
  • RQ2 (Ablation & Module Efficacy): What is the independent impact of the contextual style anchoring (Stage 1) and the dynamic weight allocation (Stage 2) modules? Can the isolated extraction of formal beauty principles mitigate the semantic bias observed in foundation models?
  • RQ3 (Qualitative Interpretability): Does the AEKI Framework successfully mitigate “aesthetic hallucination” and produce professional, structurally argued critiques rather than superficial object recognition?
  • RQ4 (Output-Format Robustness): How does the instruction compiler ( Φ ) affect the valid-JSON parsing rate of the structured output layer (Stage 3)?
  • RQ5 (Cross-Model Transfer): Are the observed improvements consistent across the evaluated proprietary and open-weights LVLMs?

3.1. Experimental Setup

3.1.1. Dataset Curation: ArtAesthetics-25K

A primary challenge in computational art evaluation is the limited availability of genre-diverse datasets annotated for formal aesthetic principles. We therefore construct a proprietary image collection named ArtAesthetics-25K (AA-25K). It contains 24,879 high-resolution artwork images spanning the K = 16 categories in the taxonomic space S . The collection covers multiple media and historical periods to provide visual diversity across the evaluated categories.
Due to the inherently subjective nature of aesthetic scoring and the high cognitive cost of professional human annotation, evaluating the entire large-scale dataset manually is computationally and practically infeasible. Therefore, we sample an approximately category-balanced expert evaluation subset ( D t e s t ) consisting of 498 representative images. This subset serves as the human-reference set for our subsequent quantitative and qualitative evaluations.

3.1.2. Stage 1 Classification Evaluation

The three evaluators confirmed one reference category from the predefined 16-category taxonomy for each image in D t e s t . The Stage 1 output used in the subsequent AEKI experiments was then compared with these expert-confirmed labels. Of the 498 images, 445 were assigned to the correct category, corresponding to an overall accuracy of 89.36 % . Category-wise accuracy ranged from 83.87 % for Abstract Expressionism/Action Painting to 93.55 % for Renaissance Classicism and Realism (Table 2). The complete confusion matrix is reported in Table 3; the remaining errors were concentrated primarily among visually or historically related categories.

3.1.3. Baseline Foundation Models and Inference Configurations

To examine whether AEKI transfers across model families rather than depending on one backbone, we select four LVLMs covering proprietary APIs and an open-weights model:
1.
GPT-4o (OpenAI, San Francisco, CA, USA): A proprietary multimodal model used for general visual reasoning, called with the API model identifier gpt-4o.
2.
Gemini-1.5-Pro (Google, Mountain View, CA, USA): A proprietary model supporting long-context multimodal analysis, called with the API model identifier gemini-1.5-pro.
3.
LLaVA-1.5 (Open Source): An open-weights model that connects a vision encoder with a language model. We used the 7B version with checkpoint liuhaotian/llava-v1.5-7b, running locally through the LLaVA project code with PyTorch and Transformers.
4.
Qwen-VL-Max (Alibaba, Hangzhou, China): A proprietary multimodal model with multilingual and zero-shot capabilities, called with the API model identifier qwen-vl-max.
The three online models were accessed through HTTP requests between 1 July and 20 December 2025, without vendor-specific SDKs. The identifiers above are the model aliases used in the request code. The software environment comprised Python 3.10.13, PyTorch 2.1.2, Transformers 4.37.2, NumPy 1.26.4, pandas 2.2.2, Matplotlib 3.8.4 and Requests 2.31.0. Data aggregation used pandas and NumPy, and plotting used Matplotlib.
For each of the four designated models, we execute two distinct inference configurations, yielding a comprehensive 4 × 2 = 8 experimental matrix:
  • Baseline (Naive Zero-Shot Prompting): The LVLM is presented with the input image I and a direct, unconstrained prompt (e.g., “Act as an art critic. Score this image’s aesthetics from 0 to 100 and explain why.”). This represents the standard usability and inherent biases of current foundation models.
  • Ours (AEKI Framework): The LVLM receives the semantic prior s * , the dynamic formal beauty weight vector w * , and a structured request for the JSON-formatted response O e x p e r t .

3.1.4. Human Evaluation Protocol and Metrics

To quantify the perceived quality of the machine-generated aesthetic outputs, three independent external experts participated in the evaluation. The panel comprised three professors from three universities outside the authors’ institution. Two specialized in Chinese painting and one specialized in oil painting; each had more than 20 years of relevant teaching experience. Each expert independently reviewed all 498 images in D t e s t and the associated outputs from four models under the Baseline and AEKI settings. Thus, each expert reviewed 498 × 4 × 2 = 3984 model–condition outputs and provided two dimension-specific ratings per output, yielding 7968 categorical judgments per expert. The three experts completed their evaluations separately: they did not discuss individual cases, view one another’s ratings, or reconcile scores before all ratings were finalized and submitted for aggregation.
Each image was indexed by a unique case identifier, and all outputs were presented using the same evaluation form, category definitions, and scoring criteria. The evaluation sheet presented all cases in a fixed order rather than using a separately randomized order for each evaluator. Model and condition labels remained visible to ensure that each rating was matched to the correct output; accordingly, the study does not claim full blinding of model identity or Baseline/AEKI condition. These procedural conditions were applied consistently to all three evaluators.
The evaluation captures two complementary dimensions:
1.
Score Alignment Dimension ( y s c o r e ): Does the numerical score accurately reflect the structural and aesthetic integrity of the artwork within its specific stylistic genre?
2.
Critique Professionalism Dimension ( y c r i t i q u e ): Is the textual justification logically sound, free of “hallucinated” object recognition errors, and anchored in professional formal beauty principles (e.g., describing rhythm rather than merely counting distinct objects)?
For both dimensions, we institute a stringent Three-Point Likert Scale ( 1 , 0 , 1 ):
  • + 1   ( Agree ) : The evaluation is accurate, professional, and directly addresses the core aesthetic value of the piece.
  • 0   ( Neutral ) : The evaluation is acceptable but generic and lacks domain-specific insight.
  • 1   ( Disagree ) : The evaluation is fundamentally flawed, exhibits severe aesthetic hallucination, or applies the wrong stylistic standards.
Consequently, for each model m { 1 , 2 , 3 , 4 } under setting c { B a s e l i n e , A E K I } , we compute the average human alignment score ( H A S ) for dimension D { s c o r e , c r i t i q u e } over the test set N = 498 and R = 3 evaluators:
H A S m , c D = 1 N R i = 1 N r = 1 R y i , r , m , c D , N = 498 , R = 3 ,
where y i , r , m , c D { 1 , 0 , + 1 } denotes evaluator r’s judgment for image i. Thus, each reported model–condition–dimension value aggregates 498 × 3 = 1494 expert judgments. The theoretical bounds of this metric are [ 1.0 , 1.0 ] . Higher H A S values indicate greater agreement with the expert ratings.

3.2. Quantitative Evaluation of Human-Machine Aesthetic Alignment (RQ1)

To answer RQ1, we systematically compare the human alignment score (HAS) of the four selected Large Vision-Language Models (LVLMs) operating under the naive baseline prompting against those driven by our proposed Aesthetic Expert Knowledge Injection (AEKI) framework. The evaluation is conducted on the 498 images from the expert evaluation subset ( D t e s t ). The results for both the Score Alignment Dimension ( H A S s c o r e ) and the Critique Professionalism Dimension ( H A S c r i t i q u e ) are comprehensively summarized in Table 4.
As shown in Table 4, AEKI has higher aggregate HAS values than the corresponding baseline for all four assessed models. Several observations can be drawn from the reported results:
1. Mitigation of Aesthetic Misalignment: Under the Baseline setting, all models exhibit modest or, for LLaVA-1.5, negative agreement scores relative to the human-reference judgments. For instance, LLaVA-1.5 produces a baseline H A S s c o r e of 0.08 , indicating that human evaluators predominantly disagreed with its numerical scoring. This is consistent with our hypothesis that unconstrained LVLMs may apply generic evaluation criteria (e.g., penalizing an Impressionist painting for blurriness). With AEKI, LLaVA-1.5’s score alignment increases to 0.58 (↑0.66). By anchoring the semantic style (Stage 1) and allocating heuristic weights (Stage 2), the framework guides the model toward evaluation within the relevant art-historical context.
2. Elevation of Critique Professionalism: The improvement is more pronounced in the textual domain ( H A S c r i t i q u e ). GPT-4o achieves a baseline H A S c r i t i q u e of 0.41 ; human evaluators noted that its baseline critiques often focused on object enumeration rather than compositional structure. Under the AEKI constraint, GPT-4o achieves H A S c r i t i q u e = 0.89 . This high alignment provides evidence that translating the formal beauty space F into a structured instruction compiler (Stage 3) can reduce aesthetic misinterpretation and promote more terminology-rich artistic analysis.
3. Reduced Disparity Across Models: GPT-4o outperforms LLaVA-1.5 in the baseline setting, but the performance gap becomes smaller under AEKI. By defining the reasoning trajectory and output schema, the method helps models with lower baseline alignment improve substantially; for example, Qwen-VL-Max increases from 0.12 to 0.78 in Critique Professionalism. This comparison suggests that explicit priors can partially compensate for differences in baseline model capability.
Overall, the quantitative results indicate that AEKI contributes more than output formatting alone: its style and weighting constraints are associated with improved alignment between machine-generated evaluations and the human-reference judgments used in this study.

3.3. Ablation Study and Module Efficacy Analysis (RQ2)

To answer RQ2, we conduct an ablation study that separates the core modules of the three-stage pipeline and estimates their individual contributions to aesthetic alignment and critique professionalism.

3.3.1. Ablation Configurations

We define three distinct algorithmic variants of our framework. To maintain consistency, we conduct this architectural ablation using the GPT-4o backbone and evaluate it against the human-reference expert evaluation subset ( D t e s t ):
  • Variant A (w/o Stage 1—Contextual Style Anchoring): Stage 1 is bypassed, so the four formal beauty principles ( F ) are evaluated without the semantic style prior s * .
  • Variant B (w/o Stage 2—Dynamic Weight Allocation): Stage 1 retains s * , but the expert weight matrix M e x p e r t is disabled and the four principles use uniform weights ( w i = 0.25 ).
  • Full AEKI (Ours): Both contextual style anchoring and dynamic expert weight allocation are enabled.

3.3.2. Impact Analysis and Discussion

The ablation results in Table 5 show that both Stage 1 and Stage 2 contribute to the observed performance of the full pipeline under the tested GPT-4o setting. They do not establish that the same component effects are necessary for every model or dataset.
The Contribution of Stylistic Anchoring (Stage 1): Comparing Variant A with the Full AEKI pipeline reveals a performance decrease ( H A S s c o r e changes from 0.84 to 0.51 ) when the stylistic context is removed. Without Stage 1, the model tends to apply a “one-size-fits-all” aesthetic criterion, often defaulting to classical realism standards. For example, when evaluating a Cubist or Abstract Expressionist artwork, the absence of s * can lead the model to penalize structural deconstruction as “anatomically disproportionate” or “distorted.” These results provide evidence that genre context contributes materially to the evaluated aesthetic judgments.
The Contribution of Dynamic Prioritization (Stage 2): The transition from Variant B to the full AEKI design isolates the contribution of the dynamic weight vector w * . Under Variant B, uniform constraints ( w i = 0.25 ) allocate equal emphasis to rhythm, color, symmetry, and unity. Stage 2 instead reflects the differing priorities of art-historical contexts; for example, color harmony is emphasized in Impressionist critique, whereas geometric balance is more prominent in Neoclassicism. Activating Stage 2 increases H A S c r i t i q u e from 0.74 to 0.89 and produces more explicitly prioritized textual analysis.

3.4. Qualitative Analysis of Interpretability and Hallucination Mitigation (RQ3)

Quantitative metrics summarize aggregate behavior, but RQ3 requires a qualitative examination of the generated text. We therefore conduct a comparative case study to assess whether AEKI reduces aesthetic misinterpretation, defined here as the application of photographic realism standards to stylized art or the conflation of object recognition with formal aesthetic value.
Figure 3 illustrates a representative qualitative comparison utilizing the GPT-4o backbone on two distinct artistic genres: Impressionism and Traditional Chinese Ink Wash Painting.

3.4.1. Overcoming Superficial Semantic Parsing

As depicted in the qualitative examples (Figure 3), the zero-shot Baseline naturally defaults to a semantic parsing paradigm. When presented with the Impressionist landscape, the Baseline critique allocates over 70% of its token trajectory to object enumeration (e.g., “I can see three trees, a river, and a small boat in the foreground”). The aesthetic judgment is appended as an afterthought, relying on generic adjectives like “beautiful” or “colorful.”
In contrast, the output formulated through AEKI substantially reduces this semantic bias in the illustrated cases. Guided by the explicit JSON execution layer (Stage 3), the model places less emphasis on describing what is in the painting and more emphasis on analyzing how it is expressed. The AEKI critique discusses the “temperature contrast of the palette,” the “rhythmic juxtaposition of short, fragmented brushstrokes,” and the “asymmetrical compositional balance.”

3.4.2. Reducing Aesthetic Misinterpretations

The qualitative results also illustrate a reduction in “aesthetic hallucinations.” Without the contextual style anchoring ( s * ) from Stage 1, the baseline model can assume the implicit role of a “photographic quality inspector.” For instance, when evaluating the Chinese Ink Wash piece, the baseline penalizes large areas of unpainted paper as “empty space lacking visual detail” and interprets the flowing ink as “blurry edges.”
By injecting the expert weight vector ( w * ) tailored for traditional East Asian art, where “Rhythm & Vitality” or Qi Yun receives the highest weight, the AEKI-driven model interprets these features as the deliberate technique of “Leaving Blank” (Liu Bai). It identifies the spatial tension and fluidity of the ink using terminology appropriate to the style.
These cases provide evidence for RQ3: principle-guided constraints can reduce generic visual-language reasoning and encourage critiques that are more consistent with domain-specific art terminology. The result should nevertheless be interpreted as mitigation rather than elimination of aesthetic misinterpretation.

3.5. System Robustness and Output-Format Consistency (RQ4)

To address RQ4, we evaluate one engineering property of the AEKI framework: output-format consistency. Generative models can add prose around a requested object or produce malformed fields, which complicates automated parsing. We therefore quantify the proportion of responses that conform to the requested JSON schema. This measure concerns syntactic compliance and should not be interpreted as determinism of the underlying LVLM.

3.5.1. Syntactic Constraint and Format Compliance

Much like how linguistic syntax governs the ways different constituents are combined to form acceptable sentences, Stage 3 acts as a syntactic constraint for machine generation. We define the Formal Formatting Compliance Rate ( R f o r m a t ) as the percentage of inferences that produce a valid, parsable, strictly typed JSON string without extraneous conversational tokens.
Let N t o t a l be the total number of inference attempts, and  N v a l i d be the number of outputs that pass a rigorous structural parsing check. The rate is defined as:
R f o r m a t = N v a l i d N t o t a l × 100 %
As illustrated in Table 6, relying on naive baseline prompts (i.e., merely asking the model to “output JSON”) results in frequent formatting failures, especially in open-weights models like LLaVA-1.5 ( R f o r m a t = 42.0 % ). Models tend to add conversational wrappers (e.g., “Here is the requested JSON...”). In contrast, the instruction compiler yields substantially higher structural consistency across all evaluated models.

3.5.2. Traceability and API Considerations

Beyond structural syntax, the explicit weight vector w * and the four reported sub-scores make the aggregation path inspectable: a reader can trace how the reported overall score follows from the selected style prior and component scores. This is procedural traceability, not evidence of a causal explanation for the LVLM’s internal reasoning.
The fixed schema also makes response parsing and retry handling more predictable in an API pipeline. However, this study does not report controlled measurements of latency, token usage, rate-limit behavior, or cost, so operational scalability beyond output-format compliance remains to be evaluated.

3.6. Cross-Model Results Across Foundation LVLMs (RQ5)

To address RQ5, we compare the observed effect of AEKI across heterogeneous model families. Prompt-based methods can behave differently across systems because of distinct training and decoding procedures. We therefore examine whether the direction of the observed change is consistent across the four tested backbones, without treating this limited model set as proof of model-agnostic generalization.
To visualize this cross-architecture pattern, Figure 4 presents the baseline and AEKI results side by side for the four selected LVLMs, encompassing closed-source APIs (GPT-4o, Gemini-1.5-Pro and Qwen-VL-Max) and an open-weights model (LLaVA-1.5).

3.6.1. Observed Pattern Across the Tested Model Scales

The grouped bars in Figure 4 show higher AEKI values for both evaluation dimensions across every tested model. For Gemini-1.5-Pro, AEKI is associated with a change in H A S s c o r e from 0.28 to 0.79 . A positive score-alignment difference greater than 0.50 is also observed for the other evaluated models, showing a consistent direction within this model set; broader testing is needed before claiming architecture-independent generalization.

3.6.2. Implications for Intermediate-Scale Models

From a computational efficiency perspective, the structured formulation can also support intermediate-scale open-weights models. In the reported experiments, LLaVA-1.5 with AEKI attains human alignment scores that approach or exceed the zero-shot GPT-4o baseline.
This observation suggests that improved aesthetic evaluation does not depend solely on increasing model scale; structurally injecting domain-specific priors ( s * and F ) offers a potentially efficient approach for specialized multimedia evaluation tasks. The results support transfer across the four tested architectures but do not establish universal model independence.

4. Conclusions and Future Work

This paper investigated how Large Vision-Language Models can be guided to evaluate artistic images using explicit, style-sensitive criteria. Although LVLMs provide strong semantic descriptions, they may treat stylized artistic choices as photographic defects or focus on objects rather than formal structure. The proposed Aesthetic Expert Knowledge Injection (AEKI) framework addresses this issue through style anchoring, expert-weight allocation, and structured instruction compilation.
Across the four evaluated proprietary and open-weights backbones, AEKI improved both score alignment and critique professionalism relative to zero-shot prompting. The average increase in H A S s c o r e exceeded 0.50 , and formatting compliance was above 98 % for several tested models. The ablation results indicate that style anchoring and dynamic weighting make complementary contributions, while the cross-model results suggest that explicit domain priors can benefit models with different architectures and scales.
The main practical contribution is a transparent layer that can be applied without retraining the underlying LVLM. Because the scoring rule and output schema are explicit, the framework is easier to inspect and integrate into automated multimedia pipelines than an unconstrained natural-language prompt.
Several limitations should be considered. First, Stage 1 assigns a discrete style anchor, so classification errors can propagate to the weight matrix and subsequent critique. Hybrid or transitional works may not be adequately represented by a single category. Second, the 16-category taxonomy and hand-specified weights encode a particular formal-art perspective. The matrix was not derived from a multi-expert elicitation study, and no perturbation or sensitivity analysis was conducted. Third, the weighted sum assumes linear additivity and does not capture interactions among formal principles. Fourth, the framework evaluates static two-dimensional features and does not model temporal aesthetics in video or cinematic sequences. Finally, the four formal principles do not fully capture subjective emotional resonance, personal memory, or culturally situated interpretation.
Future work should validate the expert matrix with multiple specialists and test weight perturbations and non-linear aggregation alternatives. It should also extend the matrix to temporal media, evaluate culturally diverse annotation panels, and study soft or multi-label style assignments. These extensions would clarify how well the framework transfers beyond the current artwork categories, evaluators, and LVLM backbones.

Author Contributions

Conceptualization, B.Z.; methodology, B.Z. and M.S.; validation, M.S.; formal analysis, M.S.; investigation, M.S.; resources, T.Z. and S.X.; writing—original draft preparation, B.Z. and M.S.; writing—review and editing, B.Z., M.S., T.Z. and S.X.; supervision, S.X.; project administration, T.Z. and S.X.; funding acquisition, T.Z. and S.X. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China, grant numbers 62272093 and 62137001.

Data Availability Statement

The data supporting the findings of this study are available from the corresponding author upon reasonable request. The artwork image dataset used in this study was acquired by the authors’ college through an institutional purchase for academic research. As the purchase did not provide the authors with unrestricted rights to make the complete image dataset publicly downloadable, the raw images cannot be deposited in a public repository.

Acknowledgments

During the preparation of this manuscript, the authors used OpenAI Codex (model identifier: gpt-5.6-sol) to assist with English-language revision and the preparation of plotting code for Figure 4. This tool was used to improve the clarity and presentation of the manuscript and was not used to generate research data or determine the scientific conclusions. The authors reviewed and edited all AI-assisted output and take full responsibility for the content of this publication.

Conflicts of Interest

The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Li, Z.; Wu, X.; Du, H.; Liu, F.; Nghiem, H.; Shi, G. A survey of state of the art large vision language models: Benchmark evaluations and challenges. In Proceedings of the Computer Vision and Pattern Recognition Conference, Nashville, TN, USA, 11–15 June 2025; pp. 1587–1606. [Google Scholar]
  2. Zhang, J.; Miao, Y.; Yu, J. A comprehensive survey on computational aesthetic evaluation of visual art images: Metrics and challenges. IEEE Access 2021, 9, 77164–77187. [Google Scholar] [CrossRef] [Scilit]
  3. Perc, M. Beauty in artistic expressions through the eyes of networks and physics. J. R. Soc. Interface 2020, 17, 20190686. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  4. Deng, Y.; Loy, C.C.; Tang, X. Image aesthetic assessment: An experimental survey. IEEE Signal Process. Mag. 2017, 34, 80–106. [Google Scholar] [CrossRef] [Scilit]
  5. Manovich, L. Computer vision, human senses, and language of art. AI Soc. 2021, 36, 1145–1152. [Google Scholar] [CrossRef] [Scilit]
  6. Cheng, W.H.; Song, S.; Chen, C.Y.; Hidayati, S.C.; Liu, J. Fashion meets computer vision: A survey. ACM Comput. Surv. 2021, 54, 72. [Google Scholar] [CrossRef] [Scilit]
  7. Yang, L.; Kumar, R.; Kaur, R.; Babbar, A.; Makhanshahi, G.S.; Singh, A.; Kumar, R.; Bhowmik, A.; Alawadi, A.H. Exploring the role of computer vision in product design and development: A comprehensive review. Int. J. Interact. Des. Manuf. 2024, 18, 3633–3680. [Google Scholar] [CrossRef] [Scilit]
  8. Amoncio, E.; Chan, T.; Storz, C. Using computer vision to measure design similarity: An application to design rights. Res. Policy 2025, 54, 105309. [Google Scholar] [CrossRef] [Scilit]
  9. Luo, Y.; Tang, L.; Kim, E. A picture is worth a thousand words: The role of a cover photograph on a travel agency’s online identity. Int. J. Hosp. Manag. 2021, 94, 102801. [Google Scholar] [CrossRef] [Scilit]
  10. Lee, J.; Kim, D.; Park, J. A machine learning and computer vision study of the environmental characteristics of streetscapes that affect pedestrian satisfaction. Sustainability 2022, 14, 5730. [Google Scholar] [CrossRef] [Scilit]
  11. Datta, R.; Joshi, D.; Li, J.; Wang, J.Z. Studying aesthetics in photographic images using a computational approach. In Proceedings of the European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2006; pp. 288–301. [Google Scholar]
  12. Lu, X.; Lin, Z.; Jin, H.; Yang, J.; Wang, J.Z. Rating image aesthetics using deep learning. IEEE Trans. Multimed. 2015, 17, 2021–2034. [Google Scholar] [CrossRef] [Scilit]
  13. Lee, B.; Seo, M.K.; Kim, D.; Shin, I.S.; Schich, M.; Jeong, H.; Han, S.K. Dissecting landscape art history with information theory. Proc. Natl. Acad. Sci. USA 2020, 117, 26580–26590. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  14. Murray, N.; Marchesotti, L.; Perronnin, F. AVA: A large-scale database for aesthetic visual analysis. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012; pp. 2408–2415. [Google Scholar]
  15. Kong, S.; Shen, X.; Lin, Z.; Mech, R.; Fowlkes, C. Photo aesthetics ranking network with attributes and content adaptation. In Proceedings of the European Conference on Computer Vision; Springer: Cham, Switzerland, 2016; pp. 662–679. [Google Scholar]
  16. Talebi, H.; Milanfar, P. NIMA: Neural Image Assessment. IEEE Trans. Image Process. 2018, 27, 3998–4011. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  17. Yi, R.; Tian, H.; Gu, Z.; Lai, Y.K.; Rosin, P.L. Towards artistic image aesthetics assessment: A large-scale dataset and a new method. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 18–22 June 2023; pp. 22388–22397. [Google Scholar]
  18. Fiorucci, M.; Khoroshiltseva, M.; Pontil, M.; Traviglia, A.; Del Bue, A.; James, S. Machine learning for cultural heritage: A survey. Pattern Recognit. Lett. 2020, 133, 102–108. [Google Scholar] [CrossRef] [Scilit]
  19. Sartori, A.; Yanulevskaya, V.; Salah, A.A.; Uijlings, J.; Bruni, E.; Sebe, N. Affective analysis of professional and amateur abstract paintings using statistical analysis and art theory. ACM Trans. Interact. Intell. Syst. 2015, 5, 8. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  20. Jin, X.; Qiao, Q.; Lu, Y.; Gao, S.; Huang, H.; Li, G. Paintings and drawings aesthetics assessment with rich attributes for various artistic categories. arXiv 2024, arXiv:2405.02982. [Google Scholar]
  21. Li, J.; Li, D.; Savarese, S.; Hoi, S. BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models. In Proceedings of the 40th International Conference on Machine Learning, Honolulu, HI, USA, 23–29 July 2023; Volume 202, pp. 19730–19742. [Google Scholar]
  22. Liu, H.; Li, C.; Wu, Q.; Lee, Y.J. Visual Instruction Tuning. In Proceedings of the Advances in Neural Information Processing Systems, New Orleans, LA, USA, 10–16 December 2023; Volume 36. [Google Scholar] [CrossRef] [Scilit]
  23. Zhou, Z.; Wang, Q.; Lin, B.; Su, Y.; Chen, R.; Tao, X.; Zheng, A.; Yuan, L.; Wan, P.; Zhang, D. Uniaa: A unified multi-modal image aesthetic assessment baseline and benchmark. arXiv 2024, arXiv:2404.09619. [Google Scholar]
  24. Wu, H.; Zhang, Z.; Zhang, W.; Chen, C.; Liao, L.; Li, C.; Gao, Y.; Wang, A.; Zhang, E.; Sun, W.; et al. Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Austria, 21–27 July 2024; Volume 235, pp. 54015–54029. [Google Scholar]
  25. Liao, Z.; Liu, X.; Qin, W.; Li, Q.; Wang, Q.; Wan, P.; Zhang, D.; Zeng, L.; Feng, P. Humanaesexpert: Advancing a multi-modality foundation model for human image aesthetic assessment. arXiv 2025, arXiv:2503.23907. [Google Scholar]
  26. Jiang, B.; de Rijke, C. Structural beauty: A structure-based computational approach to quantifying the beauty of an image. J. Imaging 2021, 7, 78. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  27. Sartori, A.; Ćulibrk, D.; Yan, Y.; Job, R.; Sebe, N. Computational modeling of affective qualities of abstract paintings. IEEE Multimed. 2016, 23, 44–54. [Google Scholar] [CrossRef] [Scilit]
  28. Acar, S.; Organisciak, P.; Dumas, D. Automated scoring of figural tests of creativity with computer vision. J. Creat. Behav. 2025, 59, e677. [Google Scholar] [CrossRef] [Scilit]
  29. Zhang, L.; Zhang, D.; Sun, M.M.; Chen, F.M. Facial beauty analysis based on geometric feature: Toward attractiveness assessment application. Expert Syst. Appl. 2017, 82, 252–265. [Google Scholar] [CrossRef] [Scilit]
  30. Barnes, S.J. In living color? Understanding the importance of color complexity in listing images for accommodation sharing. Tour. Manag. 2022, 90, 104487. [Google Scholar] [CrossRef] [Scilit]
  31. Greco, S.; Ishizaka, A.; Tasiou, M.; Torrisi, G. On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness. Soc. Indic. Res. 2019, 141, 61–94. [Google Scholar] [CrossRef] [Scilit]
  32. Dean, J.; Ghemawat, S. MapReduce: Simplified Data Processing on Large Clusters. Commun. ACM 2008, 51, 107–113. [Google Scholar] [CrossRef] [Scilit]
  33. Amdahl, G.M. Validity of the Single Processor Approach to Achieving Large-Scale Computing Capabilities. In Proceedings of the Spring Joint Computer Conference, Atlantic City, NJ, USA, 18–20 April 1967; pp. 483–485. [Google Scholar] [CrossRef] [Scilit]
Figure 1. Comparison between conventional LVLM aesthetic evaluation and the proposed framework. (Top Panel) Naive prompting can yield evaluations dominated by semantic content. (Bottom Panel) AEKI uses a three-stage pipeline-style categorization, dynamic weight allocation, and structured instruction generation-to produce principle-based and machine-readable aesthetic critiques.
Figure 1. Comparison between conventional LVLM aesthetic evaluation and the proposed framework. (Top Panel) Naive prompting can yield evaluations dominated by semantic content. (Bottom Panel) AEKI uses a three-stage pipeline-style categorization, dynamic weight allocation, and structured instruction generation-to produce principle-based and machine-readable aesthetic critiques.
Mathematics 14 03205 g001
Figure 2. Architecture of the Aesthetic Expert Knowledge Injection (AEKI) framework. Stage 1 anchors the artistic category s * . Stage 2 retrieves a formal beauty weight vector w * from the expert matrix. Stage 3 compiles these variables into the structured instruction P e x p e r t . The LVLM M then returns a JSON-formatted aesthetic evaluation O e x p e r t . Ellipses indicate abbreviated prompt and output content in this schematic.
Figure 2. Architecture of the Aesthetic Expert Knowledge Injection (AEKI) framework. Stage 1 anchors the artistic category s * . Stage 2 retrieves a formal beauty weight vector w * from the expert matrix. Stage 3 compiles these variables into the structured instruction P e x p e r t . The LVLM M then returns a JSON-formatted aesthetic evaluation O e x p e r t . Ellipses indicate abbreviated prompt and output content in this schematic.
Mathematics 14 03205 g002
Figure 3. Enlarged qualitative comparison of aesthetic critiques generated by Baseline GPT-4o and the AEKI-enhanced GPT-4o. Panels (A,B) separate the Impressionism and Traditional Chinese Ink Wash examples so that the generated critiques and scores remain legible. The baseline outputs exhibit object-centered descriptions or apply photographic criteria to stylized features, whereas AEKI produces principle-anchored analyses. Bracketed ellipses indicate omitted portions of the displayed critiques.
Figure 3. Enlarged qualitative comparison of aesthetic critiques generated by Baseline GPT-4o and the AEKI-enhanced GPT-4o. Panels (A,B) separate the Impressionism and Traditional Chinese Ink Wash examples so that the generated critiques and scores remain legible. The baseline outputs exhibit object-centered descriptions or apply photographic criteria to stylized features, whereas AEKI produces principle-anchored analyses. Bracketed ellipses indicate omitted portions of the displayed critiques.
Mathematics 14 03205 g003
Figure 4. Grouped-bar comparison of baseline and AEKI results for the four evaluated LVLMs on the N = 498 expert evaluation subset. (a) Score alignment ( H A S s c o r e ). (b) Critique professionalism ( H A S c r i t i q u e ). Each bar represents the mean over 498 images, with three independent expert judgments per image ( R = 3 ). The figure summarizes the tested models and does not establish architecture-independent generalization.
Figure 4. Grouped-bar comparison of baseline and AEKI results for the four evaluated LVLMs on the N = 498 expert evaluation subset. (a) Score alignment ( H A S s c o r e ). (b) Critique professionalism ( H A S c r i t i q u e ). Each bar represents the mean over 498 images, with three independent expert judgments per image ( R = 3 ). The figure summarizes the tested models and does not establish architecture-independent generalization.
Mathematics 14 03205 g004
Table 1. Complete predefined expert weight matrix for the 16 artistic categories. The columns correspond to Contrast and Harmony ( f 1 ), Rhythm and Flow ( f 2 ), Symmetry and Balance ( f 3 ), and Variety and Unity ( f 4 ). Every row sums to 1.
Table 1. Complete predefined expert weight matrix for the 16 artistic categories. The columns correspond to Contrast and Harmony ( f 1 ), Rhythm and Flow ( f 2 ), Symmetry and Balance ( f 3 ), and Variety and Unity ( f 4 ). Every row sums to 1.
IndexArtistic Category w 1 w 2 w 3 w 4
s 1 Oil Painting (general)0.300.200.250.25
s 2 Watercolor0.350.300.100.25
s 3 Impressionism0.500.200.200.10
s 4 Post-Impressionism0.350.300.100.25
s 5 Pointillism0.400.300.100.20
s 6 Fauvism0.450.250.100.20
s 7 Renaissance Classicism0.200.150.400.25
s 8 Baroque0.350.250.250.15
s 9 Romanticism0.350.300.150.20
s 10 Realism0.250.150.300.30
s 11 Digital Illustration0.300.200.200.30
s 12 Traditional Chinese Ink Wash0.100.600.200.10
s 13 Expressionism0.400.300.100.20
s 14 Cubism0.200.200.300.30
s 15 Surrealism0.250.200.200.35
s 16 Abstract Expressionism/Action Painting0.300.450.050.20
Table 2. Stage 1 classification accuracy for the 16 artistic categories on the expert-confirmed evaluation subset (N = 498).
Table 2. Stage 1 classification accuracy for the 16 artistic categories on the expert-confirmed evaluation subset (N = 498).
CategorynCorrectAccuracyCategorynCorrectAccuracy
Oil Painting (general)322990.63%Romanticism312787.10%
Watercolor322990.63%Realism312993.55%
Impressionism312890.32%Digital Illustration312890.32%
Post-Impressionism312787.10%Traditional Chinese Ink Wash312787.10%
Pointillism312890.32%Expressionism312890.32%
Fauvism312890.32%Cubism312787.10%
Renaissance Classicism312993.55%Surrealism312787.10%
Baroque312890.32%Abstract Expressionism/Action Painting312683.87%
Table 3. Confusion matrix for Stage 1 classification on the expert-confirmed evaluation subset. Rows denote reference categories and columns denote predicted categories. OP, Oil Painting (general); WC, Watercolor; IM, Impressionism; PI, Post-Impressionism; PT, Pointillism; FV, Fauvism; RC, Renaissance Classicism; BA, Baroque; RO, Romanticism; RE, Realism; DI, Digital Illustration; CI, Traditional Chinese Ink Wash; EX, Expressionism; CU, Cubism; SU, Surrealism; AE, Abstract Expressionism/Action Painting.
Table 3. Confusion matrix for Stage 1 classification on the expert-confirmed evaluation subset. Rows denote reference categories and columns denote predicted categories. OP, Oil Painting (general); WC, Watercolor; IM, Impressionism; PI, Post-Impressionism; PT, Pointillism; FV, Fauvism; RC, Renaissance Classicism; BA, Baroque; RO, Romanticism; RE, Realism; DI, Digital Illustration; CI, Traditional Chinese Ink Wash; EX, Expressionism; CU, Cubism; SU, Surrealism; AE, Abstract Expressionism/Action Painting.
True∖Pred.OPWCIMPIPTFVRCBAROREDICIEXCUSUAE
OP29000000102000000
WC02920000000010000
IM00282100000000000
PI00227020000000000
PT00212800000000000
FV00010280000002000
RC00000029101000000
BA00000022810000000
RO00000002270002000
RE10000010029000000
DI00000000002800021
CI02000000000270002
EX00000200000028001
CU00000000000002722
SU00000000002002270
AE00000000000030226
Table 4. Quantitative comparison of human alignment scores ( H A S [ 1.0 , 1.0 ] ) across four foundation models. “Baseline” indicates zero-shot naive prompting. “+ AEKI” denotes the integration of our proposed three-stage framework. The best results for each model are highlighted in bold. The upward arrow (↑) indicates an increase; Δ is the AEKI score minus the corresponding baseline score.
Table 4. Quantitative comparison of human alignment scores ( H A S [ 1.0 , 1.0 ] ) across four foundation models. “Baseline” indicates zero-shot naive prompting. “+ AEKI” denotes the integration of our proposed three-stage framework. The best results for each model are highlighted in bold. The upward arrow (↑) indicates an increase; Δ is the AEKI score minus the corresponding baseline score.
Foundation ModelInference Setting HAS score Δ score HAS critique Δ critique
GPT-4o (OpenAI)Baseline 0.32 - 0.41 -
Ours (+ AEKI) 0 . 84 (↑0.52) 0 . 89 (↑0.48)
Gemini-1.5-Pro (Google)Baseline 0.28 - 0.35 -
Ours (+ AEKI) 0 . 79 (↑0.51) 0 . 86 (↑0.51)
Qwen-VL-Max (Alibaba)Baseline 0.15 - 0.12 -
Ours (+ AEKI) 0 . 72 (↑0.57) 0 . 78 (↑0.66)
LLaVA-1.5 (Open Source)Baseline 0.08 - 0.15 -
Ours (+ AEKI) 0 . 58 (↑0.66) 0 . 67 (↑0.82)
Table 5. Ablation study of the proposed decoupled modules utilizing the GPT-4o backbone. “Stage 1” refers to contextual style anchoring ( s * ), and “Stage 2” denotes dynamic weight allocation ( w * ). A checkmark (✓) indicates an enabled module; a cross (×) indicates a disabled module. Uniform denotes equal principle weights, and Dynamic denotes style-dependent weights.
Table 5. Ablation study of the proposed decoupled modules utilizing the GPT-4o backbone. “Stage 1” refers to contextual style anchoring ( s * ), and “Stage 2” denotes dynamic weight allocation ( w * ). A checkmark (✓) indicates an enabled module; a cross (×) indicates a disabled module. Uniform denotes equal principle weights, and Dynamic denotes style-dependent weights.
Architectural ConfigurationStage 1 ( s * )Stage 2 ( w * ) HAS score HAS critique
Zero-shot Baseline×× 0.32 0.41
Variant A (w/o Stage 1)×× (Uniform) 0.51 0.63
Variant B (w/o Stage 2)× (Uniform) 0.68 0.74
Full AEKI Pipeline (Ours)✓(Dynamic) 0 . 84 0 . 89
Table 6. Comparison of Format Compliance Rate ( R f o r m a t ) over N t o t a l = 498 queries. AEKI uses a structured instruction compiler to increase the rate of valid, parsable JSON relative to the baseline prompt.
Table 6. Comparison of Format Compliance Rate ( R f o r m a t ) over N t o t a l = 498 queries. AEKI uses a structured instruction compiler to increase the rate of valid, parsable JSON relative to the baseline prompt.
Model BackboneBaseline (Instructed JSON)Ours (AEKI Stage 3)
GPT-4o 88.2 % 99 . 8 %
Gemini-1.5-Pro 85.6 % 98 . 5 %
Qwen-VL-Max 71.4 % 96 . 2 %
LLaVA-1.5 42.0 % 89 . 4 %
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhang, B.; Shao, M.; Zhang, T.; Xu, S. An Automated Artistic Image Aesthetic Evaluation Framework via Expert Knowledge Injection into Large Vision-Language Models. Mathematics 2026, 14, 3205. https://doi.org/10.3390/math14173205

AMA Style

Zhang B, Shao M, Zhang T, Xu S. An Automated Artistic Image Aesthetic Evaluation Framework via Expert Knowledge Injection into Large Vision-Language Models. Mathematics. 2026; 14(17):3205. https://doi.org/10.3390/math14173205

Chicago/Turabian Style

Zhang, Bozhi, Mingxing Shao, Tiancheng Zhang, and Shenyu Xu. 2026. "An Automated Artistic Image Aesthetic Evaluation Framework via Expert Knowledge Injection into Large Vision-Language Models" Mathematics 14, no. 17: 3205. https://doi.org/10.3390/math14173205

APA Style

Zhang, B., Shao, M., Zhang, T., & Xu, S. (2026). An Automated Artistic Image Aesthetic Evaluation Framework via Expert Knowledge Injection into Large Vision-Language Models. Mathematics, 14(17), 3205. https://doi.org/10.3390/math14173205

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop