Skip to Content

65 Results Found

  • Article
  • Open Access
1 Citations
863 Views
14 Pages

PBBQ: Plug-In Balanced Binary Quantization for LLMs

  • Zhangming Li,
  • Weifan Guan,
  • Zhengwei Chang,
  • Linghao Zhang and
  • Qinghao Hu

13 February 2026

In recent years, the expansion of large-model parameters has substantially increased storage and inference overhead. Consequently, post-training quantization has become a key technique for reducing model size and inference-time energy consumption. Ho...

(This article belongs to the Special Issue Emerging Computing Paradigms for Efficient Edge AI Acceleration)
  • Article
  • Open Access
2 Citations
4,706 Views
21 Pages

21 April 2025

Modern large language models (LLMs) achieve state-of-the-art performance through architectural advancements but require high computational costs for inference. Post-training quantization is a widely adopted approach to reduce these costs by quantizin...

(This article belongs to the Special Issue Machine Learning and Natural Language Processing)
  • Article
  • Open Access
529 Views
15 Pages

25 June 2026

This paper proposes the Continuous Operational Feedback Loop (COFL) architecture, a fully localized, event-driven operational monitoring and response system for Direct-to-Consumer (D2C) commerce. The architecture integrates the n8n workflow engine wi...

(This article belongs to the Special Issue Advancing AI Applications in Education and Engineering: A Multidisciplinary Perspective)
  • Article
  • Open Access
272 Views
21 Pages

16 October 2026

Large language model (LLM) inference is an increasing component of AI energy demand, while the energy effects of weight quantization depend on workload phase and implementation. We benchmarked four LLM families—Gemma 4 E4B IT, Qwen3.5 4B, Nemot...

(This article belongs to the Special Issue Smart Energy Management and Industrial Decarbonization: Artificial Intelligence, Digital Transformation, and Sustainable Energy Transition)
  • Article
  • Open Access
173 Views
38 Pages

30 October 2026

A spoken reply requires a host-side automatic speech recognition (ASR), language model (LLM), and text-to-speech (TTS) pipeline. Latency, device memory, and spoken-format adherence are properties of that pipeline. We evaluate it on 999 English read-a...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
13 Citations
10,142 Views
22 Pages

12 March 2025

Large language models (LLMs), consisting of billions and trillions of parameters, have demonstrated exceptional ability in natural language understanding (NLU) and natural language generation (NLG) tasks. Increases in their numbers of parameters and...

(This article belongs to the Special Issue Techniques and Applications of Natural Language Processing)
  • Review
  • Open Access
1 Citations
4,783 Views
56 Pages

The rapid growth of artificial intelligence (AI) workloads is reshaping semiconductor design across architecture, interconnect, memory hierarchy, packaging, timing, and design automation. Rather than converging on a single hardware solution, the fiel...

(This article belongs to the Topic AI Agents: Progress, Architecture, and Applications)
  • Article
  • Open Access
981 Views
27 Pages

20 July 2026

Deploying large language models on limited edge hardware remains an open challenge for natural language robot control. This study compares three quantized sub-1.5B models, namely SmolLM2-135M, Gemma3-1B, and TinyLlama-1.1B, for velocity-command gener...

(This article belongs to the Special Issue Advanced Mobile Robots: Research and Applications)
  • Article
  • Open Access
956 Views
10 Pages

As large language models (LLMs) move onto resource-constrained devices, maintaining factual reliability without adding another expensive decoding pass becomes a practical inference problem. Instead of introducing another complex hallucination detecto...

(This article belongs to the Special Issue From Edge AI to On-Device LLMs: Hardware Architectures, Systems, and Applications)
  • Article
  • Open Access
29 Citations
9,567 Views
30 Pages

Explaining Misinformation Detection Using Large Language Models

  • Vishnu S. Pendyala and
  • Christopher E. Hall

Large language models (LLMs) are a compressed repository of a vast corpus of valuable information on which they are trained. Therefore, this work hypothesizes that LLMs such as Llama, Orca, Falcon, and Mistral can be used for misinformation detection...

(This article belongs to the Special Issue Advanced Natural Language Processing Technology and Applications)
  • Article
  • Open Access
61 Citations
19,595 Views
20 Pages

18 October 2024

Artificial Intelligence (AI) has the potential to revolutionise the medical and healthcare sectors. AI and related technologies could significantly address some supply-and-demand challenges in the healthcare system, such as medical AI assistants, cha...

(This article belongs to the Collection Extravaganza Feature Papers on Hot Topics in Machine Learning and Knowledge Extraction)
  • Article
  • Open Access
4,771 Views
30 Pages

29 May 2026

Serving LLMs to many concurrent users gives rise to significant challenges for latency, throughput, and scalability. This paper presents a systematic and reproducible benchmark of two widely used large language model (LLM) serving frameworks, Ollama...

(This article belongs to the Special Issue Applied Artificial Intelligence and Data Science)
  • Article
  • Open Access
8 Citations
5,151 Views
17 Pages

Quantized large language models are large language models (LLMs) optimized for model size while preserving their efficacy. They can be executed on consumer-grade computers without the powerful features of dedicated servers needed to execute regular (...

(This article belongs to the Special Issue Privacy and Security in Computing Continuum and Data-Driven Workflows)
  • Article
  • Open Access
993 Views
14 Pages

Human-Level Extraction of Modified Rankin Scale Scores from Real-World Neurosurgical Clinical Notes Using a Locally Deployed, Quantized Large Language Model

  • Alban Bornet,
  • Abiram Sandralegar,
  • Anthony Yazdani,
  • Elias Adam Benguettat and ,
  • Michael Francis Righini,
  • Feres Ravarelli,
  • Paul Eugène Constanthin,
  • Alexandre Lavé,
  • Julien Haemmerli and
  • Douglas Teodoro
  • + 12 authors+ 7 authors

This study conducts a clinical evaluation of a secure, locally deployed, quantized large language model (LLM) for automating modified Rankin Scale (mRS) score extraction from unstructured neurosurgical notes. We retrospectively selected 103 authentic...

(This article belongs to the Special Issue Artificial Intelligence Applications in Biomedicine and Healthcare)
  • Feature Paper
  • Article
  • Open Access
4 Citations
4,296 Views
28 Pages

27 August 2025

The deployment of large language models (LLMs) in closed-network industrial environments remains constrained by privacy and connectivity limitations. This study presents a retrieval-augmented question-answering system designed to operate entirely off...

(This article belongs to the Special Issue AI-Driven Innovations in Power Electronics and Smart Grids: Enhancing Efficiency, Reliability and Sustainability)
  • Article
  • Open Access
3 Citations
3,291 Views
15 Pages

Leveraging Large Language Models for Departmental Classification of Medical Records

  • Baha Ihnaini,
  • Xintong Zeng,
  • Handi Yan,
  • Feige Fang and
  • Abdur Rashid Sangi

10 June 2025

This research develops large language models (LLMs) to alleviate the workload of healthcare professionals by classifying medical records into their departments. The models utilize medical records as a dataset for fine-tuning and use clinical knowledg...

(This article belongs to the Special Issue Machine Learning Approaches in Natural Language Processing)
  • Article
  • Open Access
15 Citations
6,237 Views
20 Pages

4 June 2025

This paper introduces a pioneering hybrid framework that integrates Q-learning/deep Q-network (DQN) with a locally deployed large language model (LLM) to enhance obstacle avoidance in embedded robotic systems. The STM32WB55RG microcontroller handles...

(This article belongs to the Section AI in Autonomous Systems)
  • Article
  • Open Access
1 Citations
1,738 Views
23 Pages

Large language models (LLMs) exhibit strong semantic reasoning capabilities for autonomous driving decision-making; however, their substantial inference latency poses a critical challenge for real-time closed-loop vehicle control. This study proposes...

  • Article
  • Open Access
3 Citations
3,023 Views
22 Pages

Synthesizing Olfactory Understanding: Multimodal Language Models for Image–Text Smell Matching

  • Sergio Esteban-Romero,
  • Iván Martín-Fernández,
  • Manuel Gil-Martín and
  • Fernando Fernández-Martínez

18 August 2025

Olfactory information, crucial for human perception, is often underrepresented compared to visual and textual data. This work explores methods for understanding smell descriptions within a multimodal context, where scent information is conveyed indir...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
109 Views
31 Pages

4 November 2026

Frontier large language models (LLMs) depend on energy-intensive cloud data centers and continuous connectivity that many low-resource healthcare settings lack. This paper investigates whether Low-Rank Adaptation (LoRA) fine-tuning combined with 4-bi...

(This article belongs to the Section Sustainable Engineering and Science)
  • Article
  • Open Access
2 Citations
7,251 Views
16 Pages

Investigating Reproducibility Challenges in LLM Bugfixing on the HumanEvalFix Benchmark

  • Balázs Szalontai,
  • Balázs Márton,
  • Balázs Pintér and
  • Tibor Gregorics

Benchmark results for large language models often show inconsistencies across different studies. This paper investigates the challenges of reproducing these results in automatic bugfixing using LLMs, on the HumanEvalFix benchmark. To determine the ca...

(This article belongs to the Topic Applications of NLP, AI, and ML in Software Engineering)
  • Article
  • Open Access
4 Citations
31,209 Views
35 Pages

18 October 2025

Open-weight generative large language models (LLMs) can be freely downloaded and modified. Yet, little empirical evidence exists on how these models are systematically altered and redistributed. This study provides a large-scale empirical analysis of...

(This article belongs to the Special Issue Artificial Intelligence (AI) and Natural Language Processing (NLP))
  • Article
  • Open Access
8 Citations
4,025 Views
32 Pages

Auditability and regulatory compliance are increasingly required for deploying large language models (LLMs). Prior work typically targets isolated stages such as training or unlearning and lacks a unified mechanism for verifiable accountability acros...

(This article belongs to the Special Issue Computer Networking Security and Privacy)
  • Article
  • Open Access
6 Citations
5,912 Views
28 Pages

14 August 2025

Smart contracts have become integral to decentralized applications, yet their programmability introduces critical security risks, exemplified by high-profile exploits such as the DAO and Parity Wallet incidents. Existing vulnerability detection metho...

(This article belongs to the Special Issue Network Security and Cryptography Applications)
  • Article
  • Open Access
23 Citations
10,653 Views
35 Pages

Bias and Cyberbullying Detection and Data Generation Using Transformer Artificial Intelligence Models and Top Large Language Models

  • Yulia Kumar,
  • Kuan Huang,
  • Angelo Perez,
  • Guohao Yang and ,
  • J. Jenny Li,
  • Patricia Morreale,
  • Dov Kruger and
  • Raymond Jiang
  • + 3 authors+ 0 author

29 August 2024

Despite significant advancements in Artificial Intelligence (AI) and Large Language Models (LLMs), detecting and mitigating bias remains a critical challenge, particularly on social media platforms like X (formerly Twitter), to address the prevalent...

(This article belongs to the Special Issue Emerging Artificial Intelligence Technologies and Applications)
  • Article
  • Open Access
4 Citations
4,998 Views
25 Pages

18 October 2025

Reference-less evaluation of machine translation, or Quality Estimation (QE), is vital for low-resource language pairs where high-quality references are often unavailable. In this study, we investigate segment-level QE methods comparing encoder-based...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
1,362 Views
25 Pages

13 January 2026

Legal judgment prediction (LJP) increasingly relies on large language models whose full fine-tuning is memory-intensive and susceptible to catastrophic forgetting. We present LawLLM-DS, a two-stage Low-Rank Adaptation (LoRA) framework that first perf...

(This article belongs to the Special Issue Symmetry and Asymmetry Study in Graph Theory)
  • Article
  • Open Access
14 Citations
11,857 Views
25 Pages

Software testing is critical for ensuring software reliability, with test case generation often being resource-intensive and time-consuming. This study leverages the Llama-2 large language model (LLM) to automate unit test generation for Java focal m...

(This article belongs to the Special Issue Intelligent Approaches for Solving Software Problems with AI Techniques)
  • Communication
  • Open Access
6 Citations
6,041 Views
8 Pages

Dental Loop Chatbot: A Prototype Large Language Model Framework for Dentistry

  • Md Sahadul Hasan Arian,
  • Faisal Ahmed Sifat,
  • Saif Ahmed,
  • Nabeel Mohammed and ,
  • Taseef Hasan Farook and
  • James Dudley
  • + 1 author+ 0 author

17 December 2024

The Dental Loop Chatbot was developed as a real-time, evidence-based guidance system for dental practitioners using a fine-tuned large language model (LLM) and Retrieval-Augmented Generation (RAG). This paper outlines the development and preliminary...

  • Article
  • Open Access
119 Views
33 Pages

Large language model (LLM) accelerators are commonly optimized for fixed model structures and isolated inference workloads, whereas emerging artificial-intelligence operating systems (AI OSs) primarily virtualize agents, memory, and tools in software...

(This article belongs to the Topic Artificial Neural Networks for Visual Learning)
  • Article
  • Open Access
1,063 Views
24 Pages

AI-Driven Dental Procedure Coding: A Multi-Model Framework for CDT Extraction from Clinical Text

  • Pranav Annareddy,
  • Ali Noori,
  • Deepthi Kollipara and
  • Prashanti Manda

2 June 2026

Background and Objectives: Dental procedure coding is essential for accurate billing, reimbursement, and clinical documentation, yet it remains largely manual, time-consuming, and error-prone. While natural language processing (NLP) has enabled signi...

  • Article
  • Open Access
71 Citations
13,706 Views
34 Pages

Tiny Language Models for Automation and Control: Overview, Potential Applications, and Future Research Directions

  • Ismail Lamaakal,
  • Yassine Maleh,
  • Khalid El Makkaoui,
  • Ibrahim Ouahbi and ,
  • Paweł Pławiak,
  • Osama Alfarraj,
  • May Almousa and
  • Ahmed A. Abd El-Latif
  • + 3 authors+ 0 author

21 February 2025

Large Language Models (LLMs), like GPT and BERT, have significantly advanced Natural Language Processing (NLP), enabling high performance on complex tasks. However, their size and computational needs make LLMs unsuitable for deployment on resource-co...

(This article belongs to the Section Intelligent Sensors)
  • Review
  • Open Access
1 Citations
2,275 Views
23 Pages

The Impact of Generative AI on 6G Network Architecture and Service

  • Yedil Nurakhov,
  • Serik Aibagarov,
  • Nurislam Kassymbek,
  • Aksultan Mukhanbet and ,
  • Bolatzhan Kumalakov and
  • Timur Imankulov
  • + 1 author+ 0 author

The transition from 5G to 6G wireless systems marks a paradigm shift from “connected things” to “connected intelligence,” driven by the necessity to manage hyper-heterogeneous networks and overcome the Shannon capacity limit....

  • Article
  • Open Access
14 Citations
11,570 Views
34 Pages

21 November 2024

Large language models (LLMs) have recently made significant advances, excelling in tasks like question answering, summarization, and machine translation. However, their enormous size and hardware requirements make them less accessible to many in the...

(This article belongs to the Collection Extravaganza Feature Papers on Hot Topics in Machine Learning and Knowledge Extraction)
  • Article
  • Open Access
2 Citations
3,563 Views
15 Pages

Artificial Intelligence (AI) has emerged as a transformative force, increasingly integrated into diverse aspects of modern society, from healthcare and education to business and entertainment. Among the most influential AI technologies are large lang...

(This article belongs to the Special Issue New Trends for Power Optimizations in FPGA-Based Embedded Systems)
  • Article
  • Open Access
2 Citations
1,503 Views
17 Pages

Performance Trade-Offs of Optimizing Small Language Models for E-Commerce

  • Josip Tomo Licardo,
  • Nikola Tanković,
  • Ivan Osman,
  • Ivan Lorencin and
  • Sandi Baressi Šegota

Large Language Models (LLMs) offer state-of-the-art performance in natural language understanding and generation tasks. However, the deployment of leading commercial models for specialized tasks, such as e-commerce, is often hindered by high computat...

  • Article
  • Open Access
4 Citations
2,327 Views
27 Pages

Multimodal Cognitive Architecture with Local Generative AI for Industrial Control of Concrete Plants on Edge Devices

  • Fernando Hidalgo-Castelo,
  • Antonio Guerrero-González,
  • Francisco García-Córdova,
  • Francisco Lloret-Abrisqueta and
  • Carlos Torregrosa Bonet

11 December 2025

Accessing operational information across industrial systems (ERP, MES, SCADA, PLC) in concrete plants requires 15–30 min and specialized knowledge. This work addresses this accessibility gap by developing a conversational AI system that democra...

(This article belongs to the Special Issue Multimodal Human Behavior Understanding in Human–AI Interaction: Sensor-Based Signal Processing and Interaction Techniques)
  • Article
  • Open Access
1,261 Views
27 Pages

2 July 2026

The adoption of Large Language Models (LLMs) in highly regulated, domain-specific sectors is constrained by high computational costs, cloud dependency, and strict data privacy regulations. Furthermore, specific-domain knowledge is usually locked in s...

(This article belongs to the Special Issue Generative Artificial Intelligence for Clinical Decision Support System and Healthcare)
  • Article
  • Open Access
5 Citations
5,704 Views
15 Pages

13 November 2024

Background: This article introduces SC-Phi2, a fine-tuned StarCraft II small language model. Small language models, like Phi2, Gemma, and DistilBERT, are streamlined versions of large language models (LLMs) with fewer parameters that require less com...

(This article belongs to the Section AI Systems: Theory and Applications)
  • Article
  • Open Access
1 Citations
1,501 Views
21 Pages

Generative recommendation systems based on Large Language Models leverage their reasoning capabilities to capture users’ latent interests. However, aligning continuous user behavioral embeddings with the discrete semantic space of LLMs remains...

(This article belongs to the Special Issue Multimodal Deep Learning and Its Applications)
  • Article
  • Open Access
1 Citations
2,198 Views
29 Pages

Fine-Tuning a Local LLM for Thermoelectric Generators with QLoRA: From Generalist to Specialist

  • José Miguel Monzón-Verona,
  • Santiago García-Alonso and
  • Francisco Jorge Santana-Martín

17 December 2025

This work establishes a large language model (LLM) specialized in the domain of thermoelectric generators (TEGs), for deployment on local hardware. Starting with the generalist JanV1-4B model and Qwen3-4B-Thinking-2507 models, an efficient fine-tunin...

(This article belongs to the Special Issue Large Language Models and Knowledge Computing)
  • Article
  • Open Access
7 Citations
1,854 Views
19 Pages

LLM-Assisted Reinforcement Learning for U-Shaped and Circular Hybrid Disassembly Line Balancing in IoT-Enabled Smart Manufacturing

  • Xiwang Guo,
  • Chi Jiao,
  • Jiacun Wang,
  • Shujin Qin and ,
  • Bin Hu,
  • Liang Qi,
  • Xianming Lang and
  • Zhiwei Zhang
  • + 3 authors+ 0 author

With the sharp increase in the number of products and the development of the remanufacturing industry, disassembly lines have become the mainstream recycling method. In view of the insufficient research on the layout of multi-form disassembly lines a...

(This article belongs to the Section Networks)
  • Article
  • Open Access
603 Views
15 Pages

ILL: A Lightweight Large Language Model for Legal and Courtroom Assistance

  • Zhaomin Lin,
  • Junnan Liang,
  • Xiaojie Zhao,
  • Zhiyuan Zhu and ,
  • Wenhua Hu and
  • Xiao Liu
  • + 1 author+ 0 author

Manual case review in legal and courtroom workflows faces efficiency bottlenecks. While LLMs offer potential for vertical domains, they often struggle with domain-specific accuracy and hallucinations. This paper introduces ILL, a lightweight model fo...

(This article belongs to the Special Issue AI-Powered Natural Language Processing Applications)
  • Article
  • Open Access
734 Views
23 Pages

25 August 2026

The configuration of AUTOSAR Basic Software (BSW) modules relies on verbose AUTOSAR XML (ARXML) files that are complex, error-prone, and costly to produce manually—particularly for safety-critical modules governed by ISO 26262. This paper prese...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
3 Citations
1,652 Views
29 Pages

Standardization of Neuromuscular Reflex Analysis—Role of Fine-Tuned Vision-Language Model Consortium and OpenAI gpt-oss Reasoning LLM-Enabled Decision Support System

  • Eranga Bandara,
  • Ross Gore,
  • Sachin Shetty,
  • Ravi Mukkamala and ,
  • Christopher K. Rhea,
  • Brittany S. Samulski,
  • Amin Hass,
  • Atmaram Yarlagadda,
  • Shaifali Kaushik and
  • Kasun De Zoysa
  • + 8 authors+ 3 authors

Background/Objectives: Accurate assessment of neuromuscular reflexes, such as the Hoffmann reflex (H-reflex), plays a critical role in sports science, rehabilitation, and clinical neurology. Conventional interpretation of H-reflex electromyography (E...

(This article belongs to the Special Issue Biomechanics in Sport and Ageing: Artificial Intelligence)
  • Article
  • Open Access
5 Citations
8,292 Views
12 Pages

29 October 2024

Error correction is a vital element in modern automatic speech recognition (ASR) systems. A significant portion of ASR error correction work is closely integrated within specific ASR systems, which creates challenges for adapting these solutions to d...

(This article belongs to the Collection Extravaganza Feature Papers on Hot Topics in Machine Learning and Knowledge Extraction)
  • Article
  • Open Access
9 Citations
4,193 Views
17 Pages

The escalating computational demands of deep learning and large-scale models have led to a significant increase in energy consumption, highlighting the urgent need for more energy-efficient hardware designs. This study presents a novel weight approxi...

(This article belongs to the Topic Advanced Integrated Circuit Design and Application)
  • Article
  • Open Access
11 Citations
5,157 Views
21 Pages

23 December 2024

Intelligent mining risk assessment (MIRA) is a vital approach for enhancing safety and operational efficiency in mining. In this study, we introduce MIRA-ChatGLM, which leverages pre-trained large language models (LLMs) for the domain of gas risk ass...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Review
  • Open Access
205 Views
47 Pages

19 October 2026

Compression changes both the information retained by a large language model and the resources required to complete a request. This narrative review examines quantization, pruning and sparsity, knowledge distillation, low-rank factorization, and token...

(This article belongs to the Special Issue Hot Topics in LLM Infrastructure)
  • Article
  • Open Access
14 Citations
5,819 Views
44 Pages

Legal AI in Low-Resource Languages: Building and Evaluating QA Systems for the Kazakh Legislation

  • Diana Rakhimova,
  • Assem Turarbek,
  • Vladislav Karyukin,
  • Assiya Sarsenbayeva and
  • Rashid Alieyev

27 August 2025

The research focuses on the development and evaluation of a legal question–answer system for the Kazakh language, a low-resource and morphologically complex language. Four datasets were compiled from open legal sources—Adilet, Zqai, Gov,...

(This article belongs to the Special Issue Natural Language Processing (NLP) and Large Language Modelling)

of 2