Next Article in Journal
RAMEN: Region-Adaptive Mixture of Ego-Networks for Multimodal Geospatial Fusion in Urban Region Representation
Previous Article in Journal
Lipschitz-Based Reinforcement Learning for Response-Time Distributions in Video-Game Design
Previous Article in Special Issue
Dynamic Economic–Environmental Dispatch with Generator Priority: A Machine Learning–Optimization Framework
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

LLM-Driven Unsupervised Discovery of Semantic Decision Dimensions for Dynamic Scheduling and Intelligent Systems: A Traditional Chinese Medicine Case Study

1
College of Traditional Chinese Medicine, Changchun University of Chinese Medicine, Changchun 130117, China
2
School of Design, Shandong University of Arts, Jinan 250307, China
3
Institute for Innovation and Development, Tsinghua University, Beijing 100190, China
*
Author to whom correspondence should be addressed.
Mathematics 2026, 14(15), 2681; https://doi.org/10.3390/math14152681
Submission received: 10 June 2026 / Revised: 9 July 2026 / Accepted: 15 July 2026 / Published: 24 July 2026

Abstract

Dynamic scheduling systems often rely on structured domain knowledge for real-time optimization and decision making. However, much of this knowledge originates from unstructured text, such as operational manuals, maintenance logs, and expert records. Extracting machine readable decision categories from such raw corpora without manual intervention remains a significant challenge. To address this issue, we propose a framework using large language models (LLMs) that automatically discovers latent semantic dimensions from unstructured text without any predefined schema. The LLM performs unsupervised semantic clustering via hierarchical prompts, autonomously inducing concept categories. We validate our method on Traditional Chinese Medicine (TCM), a domain characterized by highly nested, multi-dimensional knowledge structures. This makes it a challenging and representative benchmark for testing the generalizability of knowledge discovery methods. From 12,163 TCM herb records (64,107 independent short sentences), the DeepSeek-V3.2 model with batch-wise clustering generates 458 raw labels. These labels are further merged into 22 broad semantic categories. The resulting groups can be interpreted as potential decision dimensions or state abstractions for knowledge driven optimization systems. For evaluation, we adopt a dual approach: (1) semantic cosine similarity computed by Qwen3-Embedding-8B shows that 19 concepts achieve an average internal coherence above 60%; (2) domain experts rate the reasonableness of sampled concepts on a 1 to 5 scale, yielding an average score of 4.64. Experimental results demonstrate that our method autonomously induces high quality, interpretable concept taxonomies from large-scale unstructured text. We further validate the transferability of the method on an aircraft assembly manual, where it induces 12 semantically coherent concepts (average example coherence 59.6%) that align well with a domain ontology. This work offers a transferable paradigm for integrating unstructured domain knowledge into intelligent scheduling and optimization frameworks, with potential implications for dynamic scheduling systems.

1. Introduction

Dynamic scheduling and optimization systems in modern manufacturing, logistics, and service operations increasingly rely on domain knowledge to support real-time decision making under uncertainty [1]. Much of this knowledge, however, resides in unstructured text sources. Examples include equipment maintenance logs, standard operating procedures, fault reports, and expert notes. Extracting structured, machine readable decision dimensions from such raw corpora without manual intervention remains a significant challenge [2].
Knowledge graphs (KGs) have emerged as a powerful paradigm for organizing and representing structured domain knowledge, enabling applications in recommender systems, question answering, and decision support [3,4]. A typical KG consists of a schema layer, which defines concept classes and their hierarchical relations, and an instance layer, which populates entities and facts. In principle, a KG can serve as a structured knowledge base to enhance scheduling algorithms. For example, it can provide state abstractions for reinforcement learning or constraints for optimization models [5]. However, constructing the schema layer of a KG for any complex domain traditionally requires extensive manual effort from domain experts. This paradigm, which relies on a schema defined by humans followed by model extraction, is not only labor intensive but also struggles to capture implicit, nested, or evolving knowledge dimensions. Consequently, it limits the scalability and adaptability of KGs in dynamic environments [6,7].
Recent advances in large language models (LLMs), such as GPT and BERT, have demonstrated remarkable capabilities in semantic understanding and text generation [8]. In knowledge engineering, the convergence of LLMs and KGs has become a frontier research direction [9,10]. Nevertheless, most existing approaches still rely on manually predefined schema layers, using LLMs only for entity recognition and relation extraction. The schema itself remains defined by humans [11]. This leaves the fundamental bottleneck untouched: how to automatically discover the conceptual dimensions that should form the backbone of a KG from raw unstructured text.
To address this gap, we propose a novel “data speaking for itself” paradigm for automatic discovery of semantic decision dimensions. Our method leverages the robust unsupervised clustering capabilities of LLMs through prompt engineering without a predefined schema. This enables the model to autonomously induce latent concept categories directly from unstructured text [12]. Importantly, we do not claim to have solved industrial scheduling problems; instead, we validate our method on a domain widely recognized for its high complexity and nested knowledge structures: Traditional Chinese Medicine (TCM). TCM literature contains multi-dimensional, overlapping, and deeply nested descriptions of herbal functions, properties, and indications. This makes it an ideal benchmark for testing the generalizability of knowledge discovery methods. The complexity of TCM knowledge is comparable to that found in many technical domains, such as equipment fault diagnosis or process planning. Yet TCM data is publicly available and well documented, allowing reproducible experimentation. In addition to TCM, we further validate the method on a real-world aircraft assembly manual to demonstrate its transferability to scheduling related text.
Specifically, we collect 12,163 TCM herb records from three authoritative sources (Chinese Pharmacopoeia, Dictionary of Chinese Herbal Medicine, and Chinese Materia Medica) and extract 64,107 independent short sentences from key fields. Using the DeepSeek-V3.2 model and processing the sentences in batches, we automatically generate 458 raw concept labels. These are then merged via a second stage LLM aggregation into 22 broad semantic categories. In the context of dynamic scheduling, these categories can be interpreted as potential decision dimensions or state abstractions. They could inform optimization and real-time decision making, for example, by providing a structured ontology for encoding system states or constraints.
For evaluation, we adopt a dual verification mechanism. First, we compute semantic cosine similarity among sentences within each concept using Qwen3-Embedding-8B, quantitatively assessing concept coherence: 19 out of 22 concepts achieve an average similarity above 60%. Second, we invite ten TCM domain experts to rate the reasonableness of randomly sampled concepts on a 1 to 5 scale, yielding an overall average score of 4.64. These results demonstrate that our method autonomously induces high quality, interpretable concept taxonomies from large-scale unstructured text.
The main contributions of this paper are threefold:
  • We propose a method driven by large language models and free of predefined schemas for automatic discovery of semantic decision dimensions from unstructured text. This breaks the traditional paradigm of a schema defined by humans followed by model extraction.
  • Using TCM, a highly nested and complex knowledge domain, as a challenging benchmark, we successfully induce 22 high quality core concepts from over 64,000 short sentences. This provides a reproducible case study for knowledge discovery in other complex domains.
  • We establish a dual evaluation framework combining quantitative semantic similarity measurement and qualitative expert assessment. It offers an operational methodology for assessing the quality of concept taxonomies generated by LLMs.
The remainder of this paper is organized as follows. Section 2 reviews related work in knowledge graph construction, automatic concept learning, and LLM-KG integration. Section 3 details the proposed LLM-based automatic concept discovery method. Section 4 reports experimental setups and results, including a validation on aircraft assembly text. Section 5 discusses limitations and future work, including potential applications in dynamic scheduling systems. Section 6 concludes the paper.

2. Related Work

This section reviews four lines of research closely related to our work: knowledge graph applications in dynamic scheduling and manufacturing, the current state of TCM knowledge graph construction, automatic concept and ontology learning, and the integration of large language models with knowledge graphs.

2.1. Knowledge Graphs in Dynamic Scheduling and Manufacturing

Dynamic scheduling and intelligent manufacturing systems increasingly rely on structured knowledge representation to support real-time decision making under uncertainty. Knowledge graphs have emerged as a powerful tool for organizing and representing domain knowledge in manufacturing environments. Xiao et al. provide a comprehensive review of manufacturing process planning based on KGs, highlighting how these structures enable the representation of complex manufacturing knowledge and support intelligent decision making in process planning [13]. Similarly, several studies have explored the integration of KGs with scheduling algorithms. For instance, Kang et al. propose a dual dynamic graph attention network driven deep reinforcement learning framework for flexible job shop scheduling, demonstrating how graph structured knowledge representations can enhance scheduling performance under dynamic conditions [5]. Beyond manufacturing, the intersection of graph learning and scheduling has also attracted significant attention. Smit et al. present a systematic survey of graph neural networks (GNNs) for job shop scheduling problems, summarizing graph representations, GNN architectures, and training algorithms for various scheduling problem types [14]. These studies underscore the potential of KGs and graph based representations to enhance scheduling systems. However, existing approaches typically assume that the underlying knowledge schema—the concept classes and their relations—is manually predefined by domain experts. The automatic discovery of such schema layers from unstructured text remains an open challenge.

2.2. Traditional Chinese Medicine Knowledge Graphs

In recent years, knowledge graph technology has been widely adopted for knowledge organization in the TCM domain [15,16]. Researchers have constructed various TCM KGs of different scales, such as graphs for herb compatibility, prescription KGs based on the Shanghan Lun, and TCM knowledge bases fusing multi-source heterogeneous data [17,18,19]. These efforts typically follow a top-down approach: domain experts first define concepts and relations, then instances are extracted from texts or databases. Although such graphs have achieved promising results in specific applications, their schema construction remains heavily dependent on manual labor. This makes it difficult to cover implicit and evolving knowledge dimensions embedded in classical texts. Moreover, discrepancies exist in describing the same herb across different sources, such as the Chinese Pharmacopoeia, Dictionary of Chinese Herbal Medicine, and Chinese Materia Medica. Substantial manual alignment is often required for cross-source fusion, limiting the scalability of the resulting KGs.

2.3. Automatic Concept and Ontology Learning

To reduce human intervention, automatic concept and ontology learning has become a research hotspot in knowledge engineering. Early work primarily employed statistical machine learning methods. These include TF-IDF-based feature selection, Latent Dirichlet Allocation (LDA) topic modeling, and Formal Concept Analysis (FCA). They were used to automatically discover concepts and their hierarchical relations from text corpora [6,20,21]. While these methods are effective for large-scale, domain standardized texts, they struggle to handle the complex semantic relationships in TCM texts. For example, multiple terms may refer to the same symptom, or one term may cover multiple symptoms. Subsequently, deep learning improved semantic modeling capabilities for concept learning, employing word embeddings, convolutional neural networks (CNNs), and graph neural networks (GNNs) for representation learning of entities and concepts [7,22]. However, existing deep learning methods still mostly follow a paradigm of predefined categories plus supervised or semi-supervised learning. This does not fundamentally break free from concept scopes defined by humans.

2.4. Integration of Large Language Models and Knowledge Graphs

The rise of large language models has brought a new paradigm to knowledge graph construction and enhancement [9]. Current research mainly focuses on three directions: using LLMs for knowledge extraction (entities, relations, events); using LLMs to enhance KG reasoning and completion; and using KGs to provide external knowledge for LLMs to reduce hallucinations [9,11]. Among these, the most relevant direction to our work is the use of LLMs to extract knowledge from unstructured text for KG construction. Such approaches typically feed predefined schemas (e.g., entity types, relation types) as prompts to LLMs, and the model extracts instances according to the schema. Although this significantly reduces human annotation costs, the schema layer still requires expert predefinition. It essentially remains a paradigm of human definition plus model extraction.
Recent studies have begun exploring the potential of LLMs for ontology learning tasks. Giglou et al. propose LLMs4OL, a comprehensive evaluation of zero-shot LLM prompting for three ontology learning tasks: term typing, taxonomy discovery, and extraction of non-taxonomic relations. They demonstrate that LLMs can effectively apply their language pattern capturing capabilities to ontology learning [23]. Perera and Liu conduct a survey of generative AI, specifically LLMs, for ontology learning, discussing the applicability and efficacy of LLMs for ontology development tasks and identifying key challenges related to explainability and interpretability [24]. A few other studies have attempted to leverage LLMs to autonomously discover concepts or relations, for example, by using clustering prompts to induce latent categories [12]. However, these explorations have not been systematically validated in highly nested knowledge domains like TCM, nor have they provided rigorous quality evaluation frameworks for the generated concepts. Our work builds upon these pioneering efforts by focusing specifically on the unsupervised discovery of concept taxonomies from unstructured text. We use a dual evaluation mechanism that combines quantitative semantic similarity and qualitative expert assessment.

2.5. Differences from Our Work

In summary, existing methods for constructing the concept layer of knowledge graphs generally rely on either manual predefinition or using LLMs merely as information extraction tools. They fail to fully exploit the models’ capability for autonomous induction of knowledge dimensions. Moreover, while graph based representations have shown promise in scheduling systems, the automatic construction of knowledge schema from unstructured text remains largely unexplored. Yet, this is a prerequisite for integrating textual domain knowledge into scheduling algorithms. This paper proposes an LLM driven automatic concept generation method that requires no predefined schema whatsoever. Taking TCM, a representative knowledge nested domain, as a challenging benchmark, we achieve end-to-end construction from raw text to a high quality concept layer. We do this through semantic clustering without a schema and hierarchical merging, supported by a dual evaluation scheme of semantic similarity and expert scoring. This fills a gap in the current research.

3. Methodology

Figure 1 presents a high level overview of the proposed four stage pipeline for automatic concept layer construction. The following subsections describe each stage in detail.

3.1. Problem Formulation and Data Preprocessing

Let a knowledge graph (KG) be defined as G = ( C , I , R ) , where C is the set of concept classes (schema layer), I the instances, and R the relations. This paper focuses on automatically inducing C from an unstructured text corpus D .
We first embed each textual unit into a continuous vector space. Let S = { x 1 , , x M } be the set of short sentences obtained from D (see below). A sentence embedding function Ξ : S R d maps each x p to a vector v p = Ξ ( x p ) . The semantic similarity between two sentences x i and x j is defined as the cosine similarity:
sim ( x i , x j ) = v i · v j v i v j [ 1 , 1 ] .
For the text embedding spaces used in this work, cosine similarities are always non-negative.
The goal of concept discovery is to partition S into K disjoint clusters { G 1 , , G K } such that
k = 1 K G k = S , G i G j = ( i j ) ,
and to assign each cluster a natural language label k . This clustering problem can be formulated as an optimization objective: an ideal partition should maximize intra-cluster semantic similarity and minimize inter-cluster similarity:
max { G k } k = 1 K 1 | G k | 2 x i , x j G k sim ( x i , x j ) λ k l 1 | G k | | G l | x i G k , x j G l sim ( x i , x j ) ,
where λ 0 is a balancing hyperparameter that controls the trade-off between intra-cluster compactness and inter-cluster separation.
This objective formalizes the intuition that semantically similar sentences should be grouped together while dissimilar sentences should be separated. However, we do not solve this optimization directly via gradient based methods. Instead, we leverage the LLM as an implicit optimizer: the LLM’s internal semantic representations, acquired during large-scale pre-training, allow it to approximate the above objective by directly generating coherent clusters from the input text. The LLM achieves this through its contextual understanding of language, without requiring explicit gradient computation, iterative parameter updates, or a pre-specified number of clusters K. The batch by batch strategy described in the following subsection further enables scalable approximation on large corpora.
  • Data preprocessing
The original dataset is D = { ( h i , t i ) } i = 1 N with N = 12,163 herb records, where h i is the herb name and t i the text of the “functions and indications” field. We define a segmentation operator Ψ : t { s 1 , , s m } that splits t into independent short sentences based on punctuation and conjunctions (e.g., “;”, “,” followed by a verb). This yields the sentence set S with M = i | Ψ ( t i ) | = 64,107. Each x p S is stored with a unique identifier for traceability.
Optional auxiliary attributes (e.g., “properties and flavors”) are extracted and standardized for contextual reference but are not used in the clustering computation.

3.2. Unsupervised Short Sentence Clustering: Generating Raw Labels

We treat a large language model as a parameterized clustering function Φ clu . For any text set X S , Φ clu outputs a partition Π ( X ) = { G 1 , , G K } together with natural language labels k :
Φ clu ( X ) = { ( k , G k ) } k = 1 K .
The complete prompt templates used for clustering and the subsequent aggregation stage are provided in Appendix C. The number of clusters K is not specified a priori; it emerges from the LLM’s internal similarity judgments.
Due to context window constraints, we process S in disjoint batches B 1 , , B L with batch size B = 100 (except the last). Here L = M / B = 642 . For each batch B b , we compute:
Φ clu ( B b ) = { ( b , k , G b , k ) } k = 1 K b ,
where K b is the batch-specific number of clusters. Aggregating across all batches, the set of raw labels is L raw = b , k { b , k } , where each b , k is the natural-language label generated for cluster k in batch b. This aggregation yields | L raw | = 458 distinct labels.
It is important to clarify what this number represents. The value 458 refers to the number of unique label strings after exact-string deduplication across all batches. This is not the total number of sentence-level clusters generated by the LLM. The actual number of clusters produced across all batches is approximately 1500, varying slightly by batch due to the LLM’s adaptive clustering behavior. The deduplication step is necessary because the same semantic concept may appear in multiple batches with slightly different phrasings (e.g., “clear heat and detoxify” vs. “clear heat and eliminate toxins”). These semantically similar but textually distinct labels are then merged in the subsequent aggregation stage to form the final 22 broad concepts. A summary of these statistics is as follows: from the original 64,107 short sentences, the LLM generated approximately 1500 sentence-level clusters across 642 batches. These were reduced to 458 unique label strings by exact matching, and finally to 22 broad concepts through semantic aggregation.
This batch by batch LLM clustering adapts its granularity to the local text distribution. It overcomes the limitation of traditional algorithms (e.g., k-means) that require a fixed k and often a precomputed similarity matrix.

3.3. Hierarchical Label Aggregation: Forming Core Concepts

The raw labels L raw contain many synonyms and near-synonyms (e.g., “clear heat and detoxify” vs. “cool blood and detoxify”) and are too fine grained for a high level schema. We perform a second aggregation using an LLM as function Φ agg .
For each raw label L raw , we select a representative set of short sentences E (typically one or two sentences whose embeddings are closest to the centroid of the cluster that produced ). The input to Φ agg is:
I = { ( , E ) L raw } .
We instruct Φ agg to merge semantically similar raw labels into higher level concepts. Formally, the aggregation yields a partition of L raw :
L raw = c C L c , L c L c = ( c c ) ,
where C is the final set of core concepts, and L c L raw are the raw labels assigned to concept c. For each concept c, Φ agg also produces a name (a natural language phrase) and selects representative short sentences E c .
The number of final concepts | C | = K final is determined autonomously by the LLM based on semantic similarity; in our experiment K final = 22 . This set constitutes the schema layer (concept layer) of the knowledge graph.

3.4. Quality Evaluation of Concepts

We design both quantitative and qualitative metrics to assess the quality of the generated concepts.

3.4.1. Semantic Internal Cohesion

For each concept c C , let E c = { e 1 , , e n c } be its representative sentences ( n c 2 ). Using an independent embedding model Ξ (Qwen3-Embedding-8B), we compute vectors u i = Ξ ( e i ) R d . The internal cohesion is defined as:
Coh ( c ) = 2 n c ( n c 1 ) 1 i < j n c u i · u j u i u j .
Since Coh ( c ) [ 0 , 1 ] , higher values indicate tighter semantic consistency. This measure can be interpreted as the average pairwise cosine similarity within the cluster. For readability, all cohesion scores in the subsequent evaluation are reported as percentages.

3.4.2. Expert Judgement

Semantic similarity alone does not guarantee domain relevance. We randomly sample R = 10 concepts from C and invite E = 10 TCM experts to rate each concept on a Likert scale r e , c { 1 , 2 , 3 , 4 , 5 } (1 = very unreasonable, 5 = very reasonable). The rating criteria include: (i) alignment between concept name and its example sentences, (ii) familiarity of the concept in TCM theory, and (iii) discriminability from other concepts.
For each sampled concept c, the average expert score is r ¯ c = 1 E e = 1 E r e , c . The overall mean is R ¯ = 1 R c sample r ¯ c .
This dual evaluation provides complementary evidence: Coh ( c ) measures machine perceived semantic compactness, while r ¯ c captures human perceived conceptual validity.

3.5. Algorithmic Summary

The complete procedure consists of the following steps, with key parameters summarized in Table 1. To ensure reproducibility, we set the random seed to 42 for all stochastic operations, including sampling for example selection.
  • Step 1: Preprocessing
The input corpus D is segmented into short sentences S using punctuation based splitting. Each sentence is assigned a unique identifier, and a mapping from sentence ID to text is maintained for traceability.
  • Step 2: Raw Clustering (Stage 1)
The sentence set S is divided into disjoint batches of size B = 100 . For each batch B b , the LLM is invoked with a clustering prompt to generate semantic clusters. The response is parsed as JSON, and the cluster labels are collected. After processing all L batches, labels are deduplicated by exact string matching to produce the raw label set L raw .
  • Step 3: Label Aggregation (Stage 2)
For each raw label in L raw , two representative sentences are selected as examples. The LLM is then invoked with a merging prompt to group semantically similar labels into broad concepts. The response is parsed as JSON to obtain the final concept set C .
  • Step 4: Quality Evaluation
The quality of the induced concepts is assessed via (1) semantic internal cohesion computed using Qwen3-Embedding-8B, and (2) expert judgment on a 1 to 5 Likert scale.

4. Experiments and Results

4.1. Dataset and Implementation

We collected 12,163 herb records from three authoritative sources: the Chinese Pharmacopoeia, the Dictionary of Chinese Herbal Medicine, and the Chinese Materia Medica. After sentence segmentation, we obtained 64,107 short sentences. The TCM domain is characterized by highly nested, multi-dimensional knowledge (e.g., overlapping indications, subtle distinctions between treatment principles, and context dependent interpretations). This makes it an ideal benchmark for evaluating knowledge discovery methods that could later be applied to other complex domains. Examples include industrial fault diagnosis or dynamic scheduling systems, where textual knowledge is similarly unstructured and nested.
For the first stage clustering, we used DeepSeek-V3.2 via API with temperature 0.3, max tokens 4000, and batch size 100 (642 batches). For the second stage label merging, we employed the same model with max tokens 32,000. For internal cohesion evaluation, the Qwen3-Embedding-8B model generated 4096-dimensional sentence embeddings. Ten TCM experts (five licensed practitioners and five herbal medicine researchers) participated in the rating task. The same methodology is then applied to an aircraft assembly manual (Section 4.5) to evaluate transferability to scheduling related text.

4.2. Clustering Results: Induced Semantic Decision Dimensions

Table 2 lists the 22 broad concepts obtained after the two stage process. In the context of scheduling and optimization, these concepts can be interpreted as semantic decision dimensions or potential state abstractions that could help structure domain knowledge for intelligent algorithms. For each concept, we report its English name (translated from the original Chinese label), the number of raw labels subsumed, and a representative example sentence (English translation). The number of raw labels varies from 13 (“Traumatic Injury”) to 91 (“Liver Disease Treatment”), reflecting the frequency of related descriptions in the corpus. Concepts such as “Wind-Dispelling and Dampness-Removing” (46 labels) and “External Use for Skin” (56 labels) cover broad therapeutic categories.
Figure 2 visualises the 20 most frequent raw labels produced by the first stage clustering across all 642 batches. Labels such as “Clear Heat and Detoxify”, “Clear Heat and Remove Dampness”, and “Cool Blood and Stop Bleeding” appear in many batches, indicating their high prevalence in the TCM corpus. The presence of these overlapping yet subtly distinct labels highlights the necessity of the second stage merging to aggregate them into broader decision dimensions.

4.3. Internal Consistency Evaluation

Table 3 presents the internal cohesion scores Coh ( c ) for all 22 concepts, computed as the average cosine similarity among example sentence pairs. The scores range from 36.91% (“Other Miscellaneous Conditions”) to 81.51% (“Heat-Clearing and Detoxifying”). Notably, 19 out of 22 concepts achieve a score 60 % , and 11 exceed 70%. These high scores confirm strong semantic compactness within most induced decision dimensions. This indicates that the LLM can discover well separated semantic groupings without any prior supervision.
Several observations can be made. Concepts that correspond to well defined TCM treatment principles, such as “Heat-Clearing and Detoxifying” (81.51%), “Warming Middle and Regulating Qi” (76.99%), and “Parasite-Expelling and Insect-Killing” (77.43%), exhibit the highest cohesion. This indicates that the LLM effectively captures established functional categories without human supervision. Concepts that are inherently broader or include heterogeneous symptoms, such as “Childhood Diseases” (59.25%), “External Use for Skin” (58.39%), and “Cold and Fever” (51.43%), score relatively lower but remain above 50%. This is acceptable given their natural diversity. The concept “Other Miscellaneous Conditions” has a very low score (36.91%). This is expected because it serves as a catch-all category for short sentences that could not be assigned to any specific concept. Its low cohesion reflects the diversity of the residual data rather than a methodological failure.
Compared to traditional clustering methods like k-means, which require manually choosing k and often produce clusters with mixed semantics, our LLM based approach yields categories that are statistically coherent and semantically meaningful. For example, the raw label “Heat-Clearing and Dampness-Drying” was correctly merged into the broader “Heat-Clearing and Detoxifying” concept instead of being left as a separate cluster. This demonstrates the benefit of the two stage aggregation. Such semantic grouping is analogous to what would be required when abstracting state spaces in dynamic scheduling: from low level event descriptions to high level operation modes.

4.4. Expert Evaluation

Ten TCM experts independently rated ten randomly sampled concepts on a 1 to 5 scale. Table 4 summarises the average scores and standard deviations. The overall mean across the ten concepts is 4.64/5. Concepts such as “Tumor-Related” received a perfect score (5.0) with zero variance, indicating strong expert consensus. “Diuresis-Promoting and Stranguria-Relieving” and “Tonifying and Regulating” both averaged 4.9. Even the lowest-rated concept, “Heat-Clearing and Detoxifying” (4.1), was still considered reasonable by experts. They commented that its example sentences cover both infectious and non-infectious conditions, but it remains a valid broad category. The standard deviations range from 0.00 to 0.70, suggesting good inter-rater agreement overall.
To further quantify the reliability of the expert assessments, we analyzed the distribution of individual ratings. The overall mean score across all 100 ratings (10 experts × 10 concepts) was 4.58/5. Notably, 64% of all individual ratings were 5, 30% were 4, and only 6% were 3 or lower. Seven out of ten concepts had a rating range of 1 point or less, indicating strong expert consensus, and six concepts had standard deviations below 0.50. The concept “Tumor-Related” received a perfect score from all ten experts. These statistics confirm that the expert evaluations are reliable and consistent. The observed variability primarily reflects the inherent complexity of concepts that span multiple therapeutic categories rather than disagreement among experts.
Figure 3 visualises the average scores with error bars representing standard deviations. The high acceptance level confirms that the automatically generated concepts align well with domain experts’ knowledge. This further supports the validity of the method for extracting meaningful decision dimensions from unstructured text.

4.5. Validation on Aircraft Assembly Scheduling Text

To further demonstrate the generalizability of our method beyond TCM, we apply the same two stage LLM clustering pipeline to a corpus of aircraft assembly and commissioning documentation. The text is extracted from the Aviation Manufacturing Engineering Manual: Aircraft Assembly [25] (Chapters 9–11). It describes aircraft structural assembly, pipeline installation, control system adjustment, cable laying, system testing, and production planning. The ontology and knowledge extraction methods for this domain have been previously studied in [10,26]. After sentence segmentation, we obtain 13,025 short sentences.
Following the same procedure as in the TCM experiment, we use DeepSeek-V3.2 with batch size 100 to generate raw clusters. We then apply a second LLM merging step to produce 12 broad concepts. These concepts are listed in Table 5. In the context of dynamic scheduling, they can be interpreted as potential decision categories or state abstractions for assembly line scheduling, resource allocation, and task sequencing.

4.5.1. Internal Cohesion Evaluation

We evaluate semantic cohesion using the same Qwen3-Embedding-8B model as in the TCM experiment. For each concept, we compute the average pairwise cosine similarity among all its associated short sentences (full set) and also among the four representative example sentences extracted during the merging stage. Because some concepts contain thousands of sentences, we randomly sample up to 200 sentences. Table 6 reports the results. All cohesion values in the table are expressed as percentages for consistency with the TCM experiment, although the raw similarity scores lie in [ 0 , 1 ] .
The average full set cohesion of 46.6% is lower than the example based cohesion of 59.6%. This is expected because the full set includes more diverse and noisy expressions. Nevertheless, all values are substantially higher than the baseline of random pairs (10–25%), confirming that the discovered concepts capture meaningful semantic groupings. The highest cohesion is observed for “Assembly Production Plan and Network Diagram” (56.7%), while the lowest is for “Equipment and System Installation and Debugging” (39.4%). The latter reflects the inherent diversity of equipment installation tasks.
We acknowledge that classic clustering validity indices such as the Silhouette coefficient and Davies-Bouldin index are not well-suited for evaluating the proposed concepts. These indices assume well-separated, convex clusters with balanced sizes. Such conditions do not hold in the aircraft assembly domain, where concepts naturally overlap (e.g., “piping installation” and “equipment installation” share technical vocabulary) and concept sizes vary substantially (ranging from 50 to 2564 sentences). Under these conditions, such indices tend to produce artificially low scores even when intra-concept cohesion is strong.

4.5.2. Mapping to Reference Ontology

To assess the alignment of our automatically induced concepts with established domain knowledge, we map each concept to the aviation assembly ontology defined in [26]. This ontology comprises five entity types: component, facility, operation, step, and tool. The mapping is presented in Table 7. Most concepts correspond to one or two ontology types, and all five types are covered. The induced concepts are generally finer grained than the reference ontology. This demonstrates the capacity of our method to capture nuanced knowledge dimensions without manual predefinition.
This validation on a real world industrial document confirms that our LLM-driven unsupervised clustering method can be successfully transferred from TCM to a scheduling related domain. The automatically induced concepts are semantically coherent, interpretable, and align well with expert defined ontologies. This makes them suitable as decision categories or state abstractions for scheduling algorithms.

4.6. Comparison with Traditional Clustering Methods

To provide a quantitative reference, we compared our method with two established unsupervised approaches on the aircraft assembly corpus: (1) k-means clustering on sentence embeddings, and (2) Latent Dirichlet Allocation (LDA) topic modeling. Both are widely used for text clustering and topic discovery, making them suitable baselines for evaluating our LLM driven approach.
  • Experimental Setup
We randomly sampled 1000 sentences from the aircraft assembly corpus (Section 4.5). For k-means, we used the same Qwen3-Embedding-8B embeddings as in our cohesion evaluation. The number of clusters was set to k = 12 to match the 12 concepts induced by our method. For LDA, we set the number of topics to 12 with default hyperparameters. We used a CountVectorizer with a maximum of 2000 features and removed English stop words. The random seed was fixed to 42 for reproducibility.
  • Evaluation Protocol
We used an independent large language model (DeepSeek-V3.2) as an evaluator to assess clustering quality. The evaluator rated each method on three dimensions, each scored from 1 to 5:
  • Coherence:whether sentences within each group are semantically related;
  • Clarity: whether each group has a focused, distinguishable theme;
  • Interpretability: how easily a meaningful label could be assigned to each group.
For k-means, the evaluator received the three sentences closest to each cluster centroid. For LDA, the top 10 keywords of each topic were provided. For our method, the evaluator was given the concept name and its representative example sentences.
  • Results
Table 8 presents the results. Our method achieved the highest overall score (4.42), substantially outperforming k-means (3.42) and LDA (2.11). The largest gap appears in interpretability: our method scored 4.42, compared to 3.42 for k-means and 2.08 for LDA. This is expected. K-means produces only numeric cluster indices that require manual post hoc interpretation. LDA generates keyword lists that are often fragmented and domain agnostic. In contrast, our method directly produces natural language concept labels. Examples include “Assembly Production Plan and Network Diagram” and “Piping System Installation and Connection”. These labels are immediately usable for downstream applications.
These results confirm that traditional clustering methods can group sentences by surface level similarity. However, they fall short in producing semantically interpretable and usable concept structures. Our approach, driven by large language models, discovers coherent groupings and also generates human readable, domain relevant labels. It does so without requiring any predefined schema or manual annotation. This capability is especially valuable for knowledge graph construction and decision support in knowledge intensive domains.

5. Discussion

5.1. Effectiveness of the Proposed Method

Experimental results demonstrate that the proposed two stage LLM-based clustering method can automatically induce a domain relevant concept taxonomy from unstructured text. Compared to traditional approaches that require manually predefined entity types and relation sets, our method needs no annotated data or prior schema. This substantially reduces human effort for constructing the schema layer of a knowledge graph. Leveraging the rich semantic associations acquired during pre-training, the LLM effectively identifies synonyms, near-synonyms, and hypernym–hyponym relations. It thereby generates semantically compact and interpretable broad concepts. For example, concepts such as “Heat-Clearing and Detoxifying”, “Wind-Dispelling and Dampness-Removing”, and “Blood-Activating and Menstruation-Regulating” exhibit strong internal cohesion (all above 70%) and received high acceptance from domain experts (overall mean score 4.64/5). These results confirm that LLMs possess the capability to autonomously discover knowledge dimensions from raw texts. This offers a new technical pathway for data driven domain knowledge engineering.
Furthermore, the method is domain agnostic. While initially validated on TCM, a highly nested and complex knowledge domain, we have further demonstrated its applicability to an aircraft assembly manual. This is a real world scheduling related text corpus. On this corpus, the method induced 12 semantically coherent concepts with an average full set cohesion of 46.6%, substantially higher than the random baseline of 10–25%. The same unsupervised, schema free approach can thus be applied to other knowledge intensive fields, including dynamic scheduling and intelligent manufacturing. In such settings, textual knowledge (e.g., equipment fault logs, maintenance instructions, operational guidelines) could be automatically clustered into semantic decision dimensions. Examples include critical failure modes, preventive maintenance actions, or resource contention patterns. These could then serve as state abstractions for reinforcement learning agents or as structured inputs for optimization algorithms.
To further illustrate the practical connection to dynamic scheduling, we consider the aircraft assembly scenario as a concrete example. The 12 induced concepts from the assembly manual can be directly mapped to components of a scheduling model. For instance, the concept “Assembly Production Plan and Network Diagram” corresponds to the precedence constraints and task ordering in a project scheduling problem. The concept “Component Joining Process and Scheme” identifies operations that require specific resources (e.g., joining fixtures, specialized tooling), which can be mapped to resource allocation constraints. The concepts “Piping System Installation and Connection” and “Cable Laying and Electrical Connection” represent operations with sequential dependencies that affect the critical path in a scheduling network. Finally, the concept “System Function Test and Verification” corresponds to quality assurance checkpoints that must be completed before a job is considered finished. These mappings suggest a pathway for using the induced concepts as: (1) state space features in a reinforcement learning scheduler (e.g., encoding the current set of pending operations by their concept categories), or (2) constraint categories in a mixed-integer programming formulation (e.g., grouping operations with similar resource requirements). While a full integration with a scheduling optimizer is beyond the scope of this paper, the aircraft assembly validation demonstrates that the method can extract semantically coherent and domain-relevant decision dimensions from real-world scheduling-related text, providing a concrete foundation for such integration in future work.

5.2. Comparison with Existing Approaches

The comparative experiment presented in Section 4.6 (Table 8) confirms that our LLM-driven method substantially outperforms traditional unsupervised approaches—k-means and LDA—in terms of semantic coherence, topic clarity, and particularly interpretability. While k-means and LDA produce numeric indices or keyword lists that require substantial human post-processing, our method directly generates natural-language concept labels that are immediately usable for knowledge graph construction and downstream scheduling applications. This advantage stems from the LLM’s capacity to capture nuanced semantic relationships and produce domain-relevant categorical names without any predefined schema or manual annotation.

5.3. Limitations

Despite the satisfactory performance, several limitations should be acknowledged.
  • Flat concept hierarchy: The current method produces only a set of flat concept classes without defining semantic relations among them (e.g., subClassOf, attribute associations, instance relationships). For instance, in TCM theory, “Heat-Clearing and Detoxifying” and “Heat-Clearing and Dampness-Drying” may overlap. Yet our approach does not explicitly model such relations. Therefore, the output is better regarded as a preliminary schema; subsequent relation inference is needed to form a full ontology.
  • Sensitivity to rare concepts: Short sentence clustering relies on the LLM’s ability to judge semantic similarity. Pre-trained models are relatively weaker at representing low frequency terms (e.g., descriptions of obscure herbs). In our experiments, a small number of rare sentences may be mis-assigned to the “Other Miscellaneous Conditions” category or mixed with semantically unrelated concepts. This affects clustering granularity.
  • Low cohesion of the catch-all category: The internal cohesion score of “Other Miscellaneous Conditions” is only 36.91%, far lower than that of any other concept. This is primarily a design choice: gathering all unclassifiable sentences into a single residual category naturally leads to semantic dispersion. While this avoids forced misclassifications, it sacrifices utility. Future work could adopt a multi-level classification or introduce an “unassigned” marker.

5.4. Future Work

Based on the above limitations, we outline three directions for future research.
  • Incorporating multimodal and contextual information: Current clustering uses only the “functions and indications” field. TCM knowledge is embedded in multiple attributes such as “properties and flavors”, “meridian entry”, and “dosage and administration”. Future work can combine embedding fusion techniques to leverage these auxiliary features (e.g., sweet, bitter, pungent; lung meridian, spleen meridian) as additional signals to better discriminate semantic boundaries.
  • Defining inter-concept relations: Based on the current concept layer, we can further apply LLMs or graph neural networks to automatically discover hierarchical relations (e.g., subClassOf), attribute relations (e.g., associations between properties and functions), and instance relations. This would upgrade the flat concept set to a full ontology with reasoning capabilities.
  • Application to dynamic scheduling and intelligent systems: Building on our successful validation on the aircraft assembly manual, we plan to integrate the induced concepts into a scheduling optimization framework. Specifically, we will use the concept categories as state features in a deep reinforcement learning scheduler for a flexible job-shop scheduling problem. We will also evaluate the impact on scheduling performance (e.g., makespan reduction) compared to using raw text or manually defined categories. We will further extend the method to larger-scale scheduling-related text corpora, including machine breakdown logs, standard operating procedures, and shift reports, to validate its practical value for dynamic scheduling and intelligent manufacturing systems.

6. Conclusions

This paper proposed an automatic method for discovering semantic decision dimensions from unstructured text using large language models, with a case study on Traditional Chinese Medicine knowledge graphs. Without any pre-defined schema or manual annotation, the method performs two stage unsupervised clustering. First, it applies DeepSeek-V3.2 to process 64,107 short sentences in batches, generating 458 raw labels. Second, it re-employs the LLM to merge semantically similar labels into broad concepts. As a result, 22 high quality, domain discriminative core concepts are induced from unstructured text. For evaluation, a dual verification mechanism was adopted. Semantic internal cohesion computed using Qwen3-Embedding-8B shows that 19 concepts achieve a similarity of at least 60%, and 11 exceed 70%. Ten TCM experts gave an overall mean rationality score of 4.64 out of 5. To demonstrate transferability, we additionally applied the method to an aircraft assembly manual. This yielded 12 concepts with an average coherence of 46.6%, significantly exceeding the random baseline. Experimental results demonstrate that our method effectively breaks the limitation of a schema predefined by humans. It enables end-to-end automatic construction from raw corpus to a structured set of semantic concepts.
The significance of this work is twofold. First, it provides a low cost, scalable automatic paradigm for building the concept layer of knowledge graphs in complex, nested domains. This greatly reduces the need for manual intervention. Second, the method is domain agnostic and can be extended to other knowledge intensive tasks where mature ontologies are lacking or textual knowledge is highly unstructured. Our validation on the aircraft assembly manual provides a concrete example of this transferability: concepts such as Assembly Production Plan and Network Diagram and Component Joining Process and Scheme can be mapped to precedence constraints and resource allocation categories in scheduling models. More generally, in domains such as dynamic scheduling and intelligent manufacturing, equipment logs, maintenance records, and operational guidelines could be automatically clustered into decision dimensions (e.g., failure modes, maintenance actions, resource states) to support optimization algorithms or reinforcement learning agents.
Future work will focus on three directions. (1) Defining inter-concept relations (e.g., hierarchies, attribute associations) to upgrade the flat concept set into a full ontology with reasoning capabilities. (2) Incorporating multi source features (e.g., properties, flavors, meridian entries in TCM, or sensor metadata in industrial settings) to improve clustering accuracy. (3) Building on our validation on the aircraft assembly manual, we will apply the method to larger scale real-world scheduling text corpora. These include machine breakdown logs and standard operating procedures. The goal is to automatically derive state abstractions for dynamic scheduling systems and to evaluate the impact on scheduling performance through integration with existing optimization frameworks.

Author Contributions

Conceptualization, X.W. and P.L.; methodology, X.W. and P.L.; software, P.L.; validation, X.W.; formal analysis, X.W.; investigation, X.W. and X.M.; resources, P.L.; data curation, X.W.; writing—original draft preparation, X.W.; writing—review and editing, X.M. and P.L.; visualization, X.W. and X.M.; supervision, P.L.; project administration, P.L.; funding acquisition, P.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the China Postdoctoral Science Foundation under Grant No. 2025M783694.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The original TCM herb data are publicly available from the Chinese Pharmacopoeia(The data were accessed online via the official portal of the Chinese Pharmacopoeia Commission: https://www.chp.org.cn/, accessed on 14 July 2026), Dictionary of Chinese Herbal Medicine (This is a printed reference work published by Shanghai Scientific and Technical Publishers. We compiled the herb records from the printed edition.), and Chinese Materia Medica (This is a printed reference work published by Jiangsu New Medical College. We compiled the herb records from the printed edition). The raw data supporting the conclusions of this article will be made available by the authors on request.

Acknowledgments

The authors would like to thank the ten TCM experts for their valuable time and professional assessments. During the preparation of this work, the authors used a large language model (DeepSeek-V3.2) for language translation and polishing to improve readability. After using this tool, the authors reviewed and edited the content as needed and take full responsibility for the final version of the manuscript.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A. Example of First-Stage Clustering Output (Batch 0)

Table A1 shows the first five clusters from Batch 0 of the first stage clustering. Each cluster includes a semantic label and the number of short sentences assigned. The original sentence identifiers (which contain Chinese herb names) are not shown here; only the cluster size is presented. The full output for all 642 batches is available as supplementary data.
Table A1. First five clusters from Batch 0 (first stage clustering).
Table A1. First five clusters from Batch 0 (first stage clustering).
Cluster LabelNumber of Sentences
Clear Heat and Detoxify23
Dispel Wind and Relieve Pain11
Traumatic Injury5
Digestive System38
Tonify Qi and Blood7
The full list contains 15 clusters for Batch 0.

Appendix B. Raw Expert Rating Data

Ten TCM experts rated ten randomly selected concepts on a 1 to 5 scale (1 = very unreasonable, 5 = very reasonable). The raw scores (extracted from the original Chinese language questionnaires and translated into English for this table) are presented in Table A2. Concepts are listed in the same order as in the main text (Section 4.3).
Table A2. Raw expert ratings for ten sampled concepts.
Table A2. Raw expert ratings for ten sampled concepts.
ConceptE1E2E3E4E5E6E7E8E9E10
Tumor-Related5555555555
Diuresis-Promoting and Stranguria-Relieving5455555554
Tonifying and Regulating5555554555
Traumatic Injury4545555554
Cold and Fever4555555454
Neurological Paralysis5555444555
Edema and Eczema5455554454
Blood-Activating and Menstruation-Regulating5553545453
Childhood Diseases4543444454
Heat-Clearing and Detoxifying4544344335
E1–E10: anonymised expert identifiers. Raw data from the original Chinese questionnaire forms.

Appendix C. LLM Prompt Templates and Reproducibility Details

Appendix C.1. Stage 1: Clustering Prompt

The following prompt template was used for each batch of sentences (with batch size B = 100 ). The template was adapted for the aircraft assembly corpus; the TCM corpus used an equivalent prompt with domain-specific terminology.
  • You are an expert in industrial assembly and commissioning. Below are 100 short sentences about aircraft final assembly, commissioning, testing, or process design (each listed as “ID: content”).
  • Task: Without any predefined entity types, automatically cluster these short sentences into several groups based on semantic similarity. Each group should represent a meaningful concept category (e.g., “wing joining process”, “hydraulic test procedure”, “quality inspection standard”, “tool usage instruction”).
  • Requirements:
  • 1. Each short sentence must belong to exactly one group.
  • 2. The number of groups is determined naturally by the semantics; do not force a fixed number.
  • 3. Generate a short label for each group (5–10 characters in Chinese, or its English translation).
  • 4. Output format: a JSON array, where each element contains:
  • - “group_label”: the group label
  • - “sentences”: the list of sentence IDs belonging to this group
  • (use the IDs provided in the input)
  • Input data:
  • --- Start ---
  • IDaircraft_000001: Aircraft final assembly and commissioning
  • IDaircraft_000002: Chapter 9: Final assembly process design
  • ...
  • --- End ---
  • Please output only the JSON array, with no additional explanation.

Appendix C.2. Stage 2: Aggregation Prompt

The following prompt template was used to merge raw labels into broad concepts.
  • You are an expert in industrial engineering and knowledge modeling. Below is a list of raw labels automatically clustered from aircraft final assembly and commissioning text, each accompanied by 1–2 example short sentences.  Please merge semantically similar labels into higher-level ontological concepts.
  • Requirements:
  • 1. Each merged concept should have a short name (5–10 characters in Chinese, or its English translation).
  • 2. Output format: a JSON array, where each element contains:
  • - “concept_name”: the merged concept name
  • - “original_labels”: the list of original labels merged into this concept
  • - “example_sentences”: 2–3 representative sentences selected from the examples of the merged labels
  • 3. If a label cannot be merged with any other, it remains as a standalone concept.
  • Input labels:
  • 1. Label: Wing joining, Examples: Left wing to fuselage joining...
  • 2. Label: Hydraulic test, Examples: Hydraulic system pressure test...
  • ...
  • Please output only the JSON array, with no additional explanation.

Appendix C.3. Handling of Invalid or Inconsistent Outputs

For each API call, the LLM response was parsed as JSON. In cases where the response included Markdown code blocks (e.g., ‘‘‘json ... ’’’), the code block delimiters were removed before parsing. If the response was not valid JSON (e.g., due to malformed structure or incomplete output), the batch was reprocessed with the same prompt. This occurred for less than 2% of batches in our experiments. For all successfully parsed responses, no manual correction was applied to the cluster labels or sentence assignments.

Appendix C.4. Determinism and Stability

With temperature set to 0.3, the LLM outputs are not strictly deterministic across repeated API calls, but the resulting cluster structures are highly consistent. To assess stability, we repeated the full clustering pipeline on a random subset of 10 batches three times. The number of clusters varied by at most 15%, and the majority of cluster labels were semantically consistent across runs. For the merging stage, which operates on the aggregated label set, we observed even higher consistency because the input space is smaller and more semantically differentiated. The final set of 22 broad concepts was stable across repeated runs.
Additionally, to mitigate concerns about training data contamination (i.e., whether DeepSeek-V3.2 was pre-trained on TCM texts), we validated the method on the aircraft assembly corpus. This domain is unlikely to appear in the LLM’s training data. The successful transfer of the method to this independent corpus supports the generalizability of our approach.

References

  1. Pinedo, M.L. Scheduling: Theory, Algorithms, and Systems, 4th ed.; Springer: Berlin/Heidelberg, Germany, 2016. [Google Scholar]
  2. Ko, Y.; Yang, H.; Kim, T.; Kim, H. Subgraph-Aware Training of Language Models for Knowledge Graph Completion Using Structure-Aware Contrastive Learning. In Proceedings of the ACM on Web Conference 2025 (WWW ’25), Sydney, Australia, 28 April–2 May 2025; pp. 72–85. [Google Scholar]
  3. Peng, C.; Xia, F.; Naseriparsa, M.; Osborne, F. Knowledge Graphs: Opportunities and Challenges. Artif. Intell. Rev. 2023, 56, 13071–13102. [Google Scholar] [CrossRef]
  4. Liu, P.; Zhang, Y.; Yang, Y.; Zhao, X.; Tao, B. Intelligent generation and reasoning method for aviation assembly knowledge graph based on joint knowledge embedding learning. Appl. Soft Comput. 2026, 186, 114140. [Google Scholar] [CrossRef]
  5. Kang, Y.; Li, T.; Zhao, L.; Gao, Z.; He, J.; Chen, Z.; Pu, B. Dual dynamic graph attention network driven deep reinforcement learning for flexible job-shop scheduling. Knowl.-Based Syst. 2026, 335, 115192. [Google Scholar] [CrossRef]
  6. Jalal, A.A.; Ali, B.H. Text documents clustering using data mining techniques. Int. J. Electr. Comput. Eng. 2021, 11, 664–670. [Google Scholar] [CrossRef]
  7. Ristoski, P.; Paulheim, H. Semantic Web in data mining and knowledge discovery: A comprehensive survey. J. Web Semant. 2016, 36, 1–22. [Google Scholar] [CrossRef]
  8. Min, B.; Ross, H.; Sulem, E.; Veyseh, A.P.B.; Nguyen, T.H.; Sainz, O.; Agirre, E.; Heintz, I.; Roth, D. Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey. ACM Comput. Surv. 2023, 56, 1–40. [Google Scholar] [CrossRef]
  9. Pan, S.; Luo, L.; Wang, Y.; Chen, C.; Wang, J.; Wu, X. Unifying Large Language Models and Knowledge Graphs: A Roadmap. IEEE Trans. Knowl. Data Eng. 2024, 36, 3580–3599. [Google Scholar] [CrossRef]
  10. Liu, P.; Qian, L.; Zhao, X.; Tao, B. Joint Knowledge Graph and Large Language Model for Fault Diagnosis and Its Application in Aviation Assembly. IEEE Trans. Ind. Inform. 2024, 20, 8160–8169. [Google Scholar] [CrossRef]
  11. Jin, B.; Liu, G.; Han, C.; Jiang, M.; Ji, H.; Han, J. Large Language Models on Graphs: A Comprehensive Survey. IEEE Trans. Knowl. Data Eng. 2024, 36, 8622–8642. [Google Scholar] [CrossRef]
  12. Jung, H.S.; Lee, H.; Woo, Y.S.; Baek, S.Y.; Kim, J.H. Expansive data, extensive model: Investigating discussion topics around LLM through unsupervised machine learning in academic papers and news. PLoS ONE 2024, 19, e0304680. [Google Scholar] [CrossRef] [PubMed]
  13. Xiao, Y.; Zheng, S.; Shi, J.; Du, X.; Hong, J. Knowledge graph-based manufacturing process planning: A state-of-the-art review. J. Manuf. Syst. 2023, 70, 417–435. [Google Scholar] [CrossRef]
  14. Smit, I.G.; Zhou, J.; Reijnen, R.; Wu, Y.; Chen, J.; Zhang, C.; Bukhsh, Z.; Zhang, Y.; Nuijten, W. Graph neural networks for job shop scheduling problems: A survey. Comput. Oper. Res. 2025, 176, 106914. [Google Scholar] [CrossRef]
  15. Wang, S.; Li, Z.-J.; Yang, T.; Hu, K.-F. Current status and development trend of knowledge graph research in traditional Chinese medicine. J. Nanjing Univ. Tradit. Chin. Med. 2022, 38, 272–278. [Google Scholar]
  16. Weng, H.; Chen, J.; Ou, A.; Lao, Y. Leveraging representation learning for the construction and application of a knowledge graph for traditional Chinese medicine: Framework development study. JMIR Med. Inform. 2022, 10, e38414. [Google Scholar] [CrossRef] [PubMed]
  17. Wu, Y.; W, K.; Liu, X. A Two-Channel End-to-End Network Based on Dynamic Corpus of Knowledge Graph for Intelligent Recognition of Traditional Chinese Medicine Terminology. IEEE Trans. Audio Speech Lang. Process. 2025, 33, 640–649. [Google Scholar] [CrossRef]
  18. Qu, X.; Tian, Z.; Cui, J.; Li, R.; Li, D.; Zhang, X. A Review of Knowledge Graph in Traditional Chinese Medicine: Analysis, Construction, Application and Prospects. Comput. Mater. Contin. 2024, 81, 3583–3616. [Google Scholar] [CrossRef]
  19. Zhuang, Y.; Yu, L.; Jiang, N.; Ge, Y. TCM-KLLaMA: Intelligent generation model for Traditional Chinese Medicine Prescriptions based on knowledge graph and large language model. Comput. Biol. Med. 2025, 189, 109887. [Google Scholar] [CrossRef] [PubMed]
  20. Cimiano, P.; Hotho, A.; Staab, S. Learning concept hierarchies from text corpora using formal concept analysis. J. Artif. Intell. Res. 2005, 24, 305–339. [Google Scholar] [CrossRef]
  21. Tho, Q.T.; Hui, S.C.; Fong, A.C.M.; Cao, T.H. Automatic fuzzy ontology generation for semantic Web. IEEE Trans. Knowl. Data Eng. 2006, 18, 842–856. [Google Scholar] [CrossRef]
  22. Zhao, W.; Fu, Z.; Fan, T.; Wang, J. Ontology construction and mapping of multi-source heterogeneous data based on hybrid neural network and autoencoder. Neural Comput. Appl. 2023, 35, 25131–25141. [Google Scholar] [CrossRef]
  23. Babaei Giglou, H.; D’Souza, J.; Auer, S. LLMs4OL: Large Language Models for Ontology Learning. In The Semantic Web–ISWC 2023; Springer Nature Switzerland: Cham, Switzerland, 2023; pp. 408–427. [Google Scholar]
  24. Perera, O.; Liu, J. Exploring large language models for ontology learning. Issues Inf. Syst. 2024, 25, 299–310. [Google Scholar]
  25. Aviation Manufacturing Engineering Manual Editorial Board. Aviation Manufacturing Engineering Manual: Aircraft Assembly; Aviation Industry Press: Beijing, China, 2010. [Google Scholar]
  26. Liu, P.; Qian, L.; Lu, H.; Xue, L.; Zhao, X.; Tao, B. The joint knowledge reasoning model based on knowledge representation learning for aviation assembly domain. Sci. China Technol. Sci. 2024, 67, 143–156. [Google Scholar]
Figure 1. Overview of the proposed LLM-driven automatic concept layer construction framework. The framework consists of four stages: (1) data preprocessing, (2) unsupervised raw clustering using DeepSeek-V3.2 to generate 458 raw labels, (3) label merging and hierarchical clustering to form 22 core concepts, and (4) dual quality evaluation using semantic similarity and expert ratings.
Figure 1. Overview of the proposed LLM-driven automatic concept layer construction framework. The framework consists of four stages: (1) data preprocessing, (2) unsupervised raw clustering using DeepSeek-V3.2 to generate 458 raw labels, (3) label merging and hierarchical clustering to form 22 core concepts, and (4) dual quality evaluation using semantic similarity and expert ratings.
Mathematics 14 02681 g001
Figure 2. Top 20 raw labels by frequency across all 642 batches. The labels are raw cluster labels generated by the first stage LLM clustering. The high frequency of overlapping labels (e.g., “Heat-Clearing and Detoxifying” and “Cooling Blood and Detoxifying”) highlights the need for the second stage merging to form broader concepts (semantic decision dimensions).
Figure 2. Top 20 raw labels by frequency across all 642 batches. The labels are raw cluster labels generated by the first stage LLM clustering. The high frequency of overlapping labels (e.g., “Heat-Clearing and Detoxifying” and “Cooling Blood and Detoxifying”) highlights the need for the second stage merging to form broader concepts (semantic decision dimensions).
Mathematics 14 02681 g002
Figure 3. Average expert ratings (1 to 5) for ten randomly sampled concepts. Error bars indicate standard deviations.
Figure 3. Average expert ratings (1 to 5) for ten randomly sampled concepts. Error bars indicate standard deviations.
Mathematics 14 02681 g003
Table 1. Key parameters used in the algorithm.
Table 1. Key parameters used in the algorithm.
ParameterValueDescription
Batch size B100Sentences per clustering batch
Temperature T0.3LLM sampling temperature
Random seed42Fixed seed for reproducible sampling
Max tokens (Stage 1)4000Maximum output length per batch
Max tokens (Stage 2)32,000Maximum output length for merging
Number of batches (TCM)642 64,107 / 100
Number of batches (Aircraft)131 13,025 / 100
Table 2. The 22 induced core concepts (semantic decision dimensions) with number of raw labels and an example short sentence (English translation).
Table 2. The 22 induced core concepts (semantic decision dimensions) with number of raw labels and an example short sentence (English translation).
Concept NameRaw LabelsExample Sentence (English)
Heat-Clearing and Detoxifying17Clears heat and resolves toxins; mainly for cold and fever
Wind-Dispelling and Dampness-Removing46Dispels wind and removes dampness; mainly for rheumatic pain
Phlegm-Resolving and Cough-Stopping23Resolves phlegm and stops cough; mainly for cough with copious sputum
Blood-Activating and Menstruation-Regulating33Activates blood and regulates menstruation; for irregular menstruation
Traumatic Injury13Treats traumatic injury; for bruises and fractures
Hemostasis22Stops bleeding by removing stasis; for internal hemorrhage
Warming Middle and Regulating Qi47Warms the middle, aids digestion, stops pain
Diuresis-Promoting and Stranguria-Relieving33Promotes diuresis and relieves stranguria; for difficult urination
Childhood Diseases32Infantile malnutrition; strengthens spleen and reduces food stagnation
External Use for Skin56For skin chapping; heals wounds externally
Tonifying and Regulating41Tonifies and strengthens; used as a tonic
Neurological Paralysis70Facial paralysis; sequelae of polio
Impotence and Spermatorrhea44Impotence; treats blood deficiency, hemoptysis, and spermatorrhea
Liver Disease Treatment91Treats hepatitis and liver cirrhosis
Heat-Clearing and Dampness-Drying43Clears heat, cools blood, dries dampness
Hemostasis and Astringency47Nourishes yin and stops bleeding; for chronic cough with hemoptysis
Parasite-Expelling and Insect-Killing57Kills parasites and reduces food stagnation; mainly for ascariasis
Head, Face and Five Sense Organs49Migraine; also treats wind-type headache
Cold and Fever45Treats common cold with fever and parotitis
Cardiovascular Diseases55Treats hypertension and coronary heart disease
Edema and Eczema26Edema; eczema
Tumor-Related62Anti-tumor; used for multiple types of cancer
Other Miscellaneous Conditions37Prolapse of uterus; resolves masses
Concepts are ordered as in the original Chinese dataset.
Table 3. Internal cohesion scores Coh ( c ) for the 22 induced concepts (in percentage).
Table 3. Internal cohesion scores Coh ( c ) for the 22 induced concepts (in percentage).
Concept Name Coh ( c ) (%)Rank
Heat-Clearing and Detoxifying81.511
Warming Middle and Regulating Qi76.992
Parasite-Expelling and Insect-Killing77.433
Diuresis-Promoting and Stranguria-Relieving75.214
Blood-Activating and Menstruation-Regulating73.645
Hemostasis72.406
Traumatic Injury72.397
Phlegm-Resolving and Cough-Stopping71.198
Wind-Dispelling and Dampness-Removing70.119
Hemostasis and Astringency69.2710
Tumor-Related67.8111
Heat-Clearing and Dampness-Drying65.9412
Cardiovascular Diseases63.6913
Impotence and Spermatorrhea63.6214
Edema and Eczema61.8515
Tonifying and Regulating60.7716
Liver Disease Treatment60.3517
Childhood Diseases59.2518
External Use for Skin58.3919
Head, Face and Five Sense Organs55.7320
Cold and Fever51.4321
Other Miscellaneous Conditions36.9122
Table 4. Expert ratings (1 to 5) for ten randomly sampled concepts.
Table 4. Expert ratings (1 to 5) for ten randomly sampled concepts.
Concept NameAverage ScoreStandard DeviationRange
Tumor-Related5.000.005–5
Diuresis-Promoting and Stranguria-Relieving4.900.304–5
Tonifying and Regulating4.900.304–5
Traumatic Injury4.800.404–5
Cold and Fever4.700.464–5
Neurological Paralysis4.700.464–5
Edema and Eczema4.600.494–5
Blood-Activating and Menstruation-Regulating4.500.673–5
Childhood Diseases4.200.603–5
Heat-Clearing and Detoxifying4.100.703–5
Overall mean across ten concepts: 4.64
Table 5. The 12 induced concepts from aircraft assembly text.
Table 5. The 12 induced concepts from aircraft assembly text.
Concept NameSentencesExample Sentence (English)
Aircraft Final Assembly Process and Design143“Aircraft final assembly content and characteristics”
Final Assembly Line and Plant Layout273“Process layout of final assembly line”
Assembly Production Plan and Network Diagram88“Program evaluation and review technique (PERT) in final assembly”
Component Joining Process and Scheme338“Component joining: forms and characteristics of joints”
Piping System Installation and Connection1625“Connection of flared tube fittings”
Control System Installation and Adjustment650“Requirements for rod end connections”
Cable Laying and Electrical Connection1948“Cable laying and fixing”
Equipment and System Installation and Debugging2372“Engine installation and adjustment”
System Function Test and Verification2564“Functional test of hydraulic, pneumatic and brake systems”
Assembly and Debugging Operation Specifications50“Do not leave foreign objects on the aircraft”
Assembly Work Plan and Procedure1452Job plan tables and process step descriptions
Other or Unclassified Content669Chapter titles, table references, or malformed entries
Concepts are derived from the aircraft assembly manual; the number of sentences indicates the total occurrence count in the original corpus.
Table 6. Internal cohesion of induced concepts from aircraft assembly text. Cohesion measured on the full sentence set (sampled up to 200 per concept) and on the four representative examples. As a reference, random sentence pairs typically yield a cosine similarity between 10% and 25%.
Table 6. Internal cohesion of induced concepts from aircraft assembly text. Cohesion measured on the full sentence set (sampled up to 200 per concept) and on the four representative examples. As a reference, random sentence pairs typically yield a cosine similarity between 10% and 25%.
Concept NameSentences (Full)Cohesion (Full)Cohesion (4 Examples)
Aircraft Final Assembly Process and Design14349.7%56.5%
Final Assembly Line and Plant Layout27341.7%58.1%
Assembly Production Plan and Network Diagram8856.7%72.0%
Component Joining Process and Scheme33846.0%65.0%
Piping System Installation and Connection162542.7%59.6%
Control System Installation and Adjustment65044.8%62.5%
Cable Laying and Electrical Connection194841.2%56.7%
Equipment and System Installation and Debugging237239.4%58.4%
System Function Test and Verification256443.3%67.4%
Assembly and Debugging Operation Specifications5050.8%65.1%
Assembly Work Plan and Procedure145251.9%55.7%
Other or Unclassified Content66951.4%38.0%
Average46.6%59.6%
Range (min–max)39.4–56.7%38.0–72.0%
Reference: random sentence pairs10–25%
Table 7. Mapping between induced concepts and the reference ontology classes from [26].
Table 7. Mapping between induced concepts and the reference ontology classes from [26].
Induced ConceptCorresponding Reference Ontology Class
Aircraft Final Assembly Process and Designstep
Final Assembly Line and Plant Layoutfacility, step
Assembly Production Plan and Network Diagramstep
Component Joining Process and Schemecomponent, operation
Piping System Installation and Connectionoperation
Control System Installation and Adjustmentoperation
Cable Laying and Electrical Connectionoperation
Equipment and System Installation and Debuggingoperation, component
System Function Test and Verificationoperation
Assembly and Debugging Operation Specificationsstep, operation
Assembly Work Plan and Procedurestep
Other or Unclassified Content(mixed/not directly mappable)
Coverage:All five ontology types (component, facility, operation, step, tool) appear in the mapping, with operation and step being the most frequent.
Table 8. Comparative evaluation of clustering methods on the aircraft assembly corpus (1000 sentences, k = 12 ). Scores are 1–5 averages across 12 groups, evaluated by an independent LLM.
Table 8. Comparative evaluation of clustering methods on the aircraft assembly corpus (1000 sentences, k = 12 ). Scores are 1–5 averages across 12 groups, evaluated by an independent LLM.
MethodCoherenceClarityInterpretabilityOverall
LLM Driven Concept Discovery (Ours)4.424.424.424.42
k-means Clustering3.423.423.423.42
LDA Topic Modeling2.172.082.082.11
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, X.; Ma, X.; Liu, P. LLM-Driven Unsupervised Discovery of Semantic Decision Dimensions for Dynamic Scheduling and Intelligent Systems: A Traditional Chinese Medicine Case Study. Mathematics 2026, 14, 2681. https://doi.org/10.3390/math14152681

AMA Style

Wang X, Ma X, Liu P. LLM-Driven Unsupervised Discovery of Semantic Decision Dimensions for Dynamic Scheduling and Intelligent Systems: A Traditional Chinese Medicine Case Study. Mathematics. 2026; 14(15):2681. https://doi.org/10.3390/math14152681

Chicago/Turabian Style

Wang, Xiaona, Xuanyi Ma, and Peifeng Liu. 2026. "LLM-Driven Unsupervised Discovery of Semantic Decision Dimensions for Dynamic Scheduling and Intelligent Systems: A Traditional Chinese Medicine Case Study" Mathematics 14, no. 15: 2681. https://doi.org/10.3390/math14152681

APA Style

Wang, X., Ma, X., & Liu, P. (2026). LLM-Driven Unsupervised Discovery of Semantic Decision Dimensions for Dynamic Scheduling and Intelligent Systems: A Traditional Chinese Medicine Case Study. Mathematics, 14(15), 2681. https://doi.org/10.3390/math14152681

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop