Skip to Content

10,062 Results Found

  • Article
  • Open Access
676 Views
18 Pages

25 November 2025

With the increased complexity of applications and systems, threat modelling struggles to keep pace with the evolution of risks. This article addresses this challenge by exploring how large language models (LLMs) can be leveraged to create comprehensi...

  • Article
  • Open Access
1 Citations
1,476 Views
24 Pages

Modelling Large-Scale Group Decision-Making Through Grouping with Large Language Models

  • Juan Carlos González-Quesada,
  • José Ramón Trillo,
  • Carlos Porcel,
  • Ignacio Javier Pérez and
  • Francisco Javier Cabrerizo

25 August 2025

The growing ubiquity of digital platforms has enabled unprecedented participation in large-scale group decision-making processes. Nevertheless, integrating subjective linguistically expressed opinions into structured decision protocols remains a sign...

  • Article
  • Open Access
7 Citations
6,403 Views
18 Pages

AI language models are increasingly transforming language research in various ways. How can language educators and researchers respond to the challenge posed by these AI models? Specifically, how can we embrace this technology to inform and enhance s...

  • Article
  • Open Access
2,346 Views
15 Pages

The Simulative Role of Neural Language Models in Brain Language Processing

  • Nicola Angius,
  • Pietro Perconti,
  • Alessio Plebe and
  • Alessandro Acciai

This paper provides an epistemological and methodological analysis of the recent practice of using neural language models to simulate brain language processing. It is argued that, on the one hand, this practice can be understood as an instance of the...

  • Review
  • Open Access
34 Citations
24,274 Views
39 Pages

A Survey of Robot Intelligence with Large Language Models

  • Hyeongyo Jeong,
  • Haechan Lee,
  • Changwon Kim and
  • Sungtae Shin

2 October 2024

Since the emergence of ChatGPT, research on large language models (LLMs) has actively progressed across various fields. LLMs, pre-trained on vast text datasets, have exhibited exceptional abilities in understanding natural language and planning tasks...

  • Article
  • Open Access
39 Citations
9,664 Views
22 Pages

Development of Language Models for Continuous Uzbek Speech Recognition System

  • Abdinabi Mukhamadiyev,
  • Mukhriddin Mukhiddinov,
  • Ilyos Khujayarov,
  • Mannon Ochilov and
  • Jinsoo Cho

19 January 2023

Automatic speech recognition systems with a large vocabulary and other natural language processing applications cannot operate without a language model. Most studies on pre-trained language models have focused on more popular languages such as Englis...

  • Article
  • Open Access
6 Citations
7,163 Views
21 Pages

Low-resource languages remain underserved by contemporary large language models (LLMs) because they lack sizable corpora, bespoke preprocessing tools, and the computing budgets assumed by mainstream alignment pipelines. Focusing on Kazakh, we present...

  • Article
  • Open Access
20 Citations
8,101 Views
18 Pages

An Investigation of Applying Large Language Models to Spoken Language Learning

  • Yingming Gao,
  • Baorian Nuchged,
  • Ya Li and
  • Linkai Peng

26 December 2023

People have long desired intelligent conversational systems that can provide assistance in practical scenarios. The latest advancements in large language models (LLMs) are making significant strides toward turning this aspiration into a tangible real...

  • Article
  • Open Access
4 Citations
2,825 Views
25 Pages

16 November 2023

Parallel natural language processing systems were previously successfully tested on the tasks of part-of-speech tagging and authorship attribution through mini-language modeling, for which they achieved significantly better results than independent m...

  • Proceeding Paper
  • Open Access
1,771 Views
5 Pages

The source of characters is hieroglyph. Hieroglyph is the imitation and reference of the phenomena and objects in the natural world. The objects and phenomena in the natural world are the original image. Or rather its own figurative meta-hieroglyphic...

  • Article
  • Open Access
36 Citations
17,308 Views
24 Pages

29 November 2023

The advent of Multilingual Language Models (MLLMs) and Large Language Models (LLMs) has spawned innovation in many areas of natural language processing. Despite the exciting potential of this technology, its impact on developing high-quality Machine...

  • Review
  • Open Access
188 Citations
67,061 Views
42 Pages

1 March 2024

Natural language processing (NLP) has significantly transformed in the last decade, especially in the field of language modeling. Large language models (LLMs) have achieved SOTA performances on natural language understanding (NLU) and natural languag...

  • Article
  • Open Access
2 Citations
4,902 Views
14 Pages

19 November 2024

This study focuses on Scene Text Recognition (STR), which plays a crucial role in various applications of artificial intelligence such as image retrieval, office automation, and intelligent transportation systems. Currently, pre-trained vision-langua...

  • Article
  • Open Access
9 Citations
5,858 Views
15 Pages

2 November 2018

Neural language models have drawn a lot of attention for their strong ability to predict natural language text. In this paper, we estimate the entropy rate of natural language with state-of-the-art neural language models. To obtain the estimate, we c...

  • Proceeding Paper
  • Open Access
1,806 Views
5 Pages

Discourses can be treated as instances of knowledge. The dynamic space in which the trajectories of these discourses are described can be regarded as a model of knowledge. Such a space is called a discursive space. Its scope is defined by a set of di...

  • Article
  • Open Access
5 Citations
4,885 Views
25 Pages

Sentiment analysis is a crucial tool for measuring public opinion and understanding human communication across digital social media platforms. However, due to linguistic complexities and limited data or computational resources, it is under-represente...

  • Proceeding Paper
  • Open Access
1,957 Views
5 Pages

Large language and multimodal models are revolutionising many aspects of human work and creativity, with broad potential not only as chatbots and for information retrieval but as interaction points and integrators of large technical systems. However,...

  • Article
  • Open Access
420 Views
18 Pages

Large language models (LLMs) have begun to function as assistants or teammates in language learning, teaching, and research. However, what prerequisites are required for LLMs to reliably play these roles, and how such prerequisites should be measured...

  • Article
  • Open Access
15 Citations
8,564 Views
17 Pages

29 June 2024

Pretrained language models have achieved great success in various natural language understanding (NLU) tasks due to their capacity to capture deep contextualized information in text using pretraining on large-scale corpora. Tokenization plays a signi...

  • Review
  • Open Access
22 Citations
5,276 Views
30 Pages

Contemporary Approaches in Evolving Language Models

  • Dina Oralbekova,
  • Orken Mamyrbayev,
  • Mohamed Othman,
  • Dinara Kassymova and
  • Kuralai Mukhsina

1 December 2023

This article provides a comprehensive survey of contemporary language modeling approaches within the realm of natural language processing (NLP) tasks. This paper conducts an analytical exploration of diverse methodologies employed in the creation of...

  • Article
  • Open Access
34 Citations
8,110 Views
28 Pages

Agile Methodology for the Standardization of Engineering Requirements Using Large Language Models

  • Archana Tikayat Ray,
  • Bjorn F. Cole,
  • Olivia J. Pinon Fischer,
  • Anirudh Prabhakara Bhat,
  • Ryan T. White and
  • Dimitri N. Mavris

10 July 2023

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and, in particular, a shift toward Model-Based Systems Engineering (MBSE) approaches for system design. The requiremen...

  • Article
  • Open Access
4 Citations
4,596 Views
19 Pages

MiNgMatch—A Fast N-gram Model for Word Segmentation of the Ainu Language

  • Karol Nowakowski,
  • Michal Ptaszynski and
  • Fumito Masui

16 October 2019

Word segmentation is an essential task in automatic language processing for languages where there are no explicit word boundary markers, or where space-delimited orthographic words are too coarse-grained. In this paper we introduce the MiNgMatch Segm...

  • Article
  • Open Access
7 Citations
5,925 Views
40 Pages

25 November 2024

The rise in abusive language on social media is a significant threat to mental health and social cohesion. For Bengali speakers, the need for effective detection is critical. However, current methods fall short in addressing the massive volume of con...

  • Review
  • Open Access
254 Citations
46,498 Views
23 Pages

The deployment of large language models (LLMs) within the healthcare sector has sparked both enthusiasm and apprehension. These models exhibit the remarkable ability to provide proficient responses to free-text queries, demonstrating a nuanced unders...

  • Article
  • Open Access
11 Citations
6,550 Views
15 Pages

University Student Dropout Prediction Using Pretrained Language Models

  • Hyun-Sik Won,
  • Min-Ji Kim,
  • Dohyun Kim,
  • Hee-Soo Kim and
  • Kang-Min Kim

13 June 2023

Predicting student dropout from universities is an imperative but challenging task. Numerous data-driven approaches that utilize both student demographic information (e.g., gender, nationality, and high school graduation year) and academic informatio...

  • Article
  • Open Access
16 Citations
9,399 Views
15 Pages

Language Representation Models: An Overview

  • Thorben Schomacker and
  • Marina Tropmann-Frick

28 October 2021

In the last few decades, text mining has been used to extract knowledge from free texts. Applying neural networks and deep learning to natural language processing (NLP) tasks has led to many accomplishments for real-world language problems over the y...

  • Article
  • Open Access
4 Citations
3,676 Views
11 Pages

31 March 2021

Multi-task learning (MTL) approaches are actively used for various natural language processing (NLP) tasks. The Multi-Task Deep Neural Network (MT-DNN) has contributed significantly to improving the performance of natural language understanding (NLU)...

  • Article
  • Open Access
1,977 Views
10 Pages

The Negative Concord Mystery: Insights from a Language Model

  • William O’Grady,
  • Haopeng Zhang and
  • Miseon Lee

20 August 2025

An important recent development in the field of linguistics is the use of small language models to investigate language acquisition. Following this line of research, we investigate the mysterious appearance of ‘negative concord’ (e.g., I ...

  • Article
  • Open Access
1 Citations
2,264 Views
22 Pages

8 July 2025

Building Information Modeling (BIM) has excellent potential to enhance building operation and maintenance. However, as a standardized data format in the architecture, engineering, and construction (AEC) industry, the retrieval of BIM information gene...

  • Review
  • Open Access
5 Citations
7,407 Views
22 Pages

31 October 2022

Because the pretraining model is not limited by the scale of data annotation and can learn general semantic information, it performs well in tasks related to natural language processing and computer vision. In recent years, more and more attention ha...

  • Proceeding Paper
  • Open Access
1,034 Views
10 Pages

10 November 2025

The usage of Artificial Intelligence (AI) in control loops and rule-based frameworks is a novel approach in automation and decision-making processes. Large Language Models (LLMs) are redefining conventional rule-based systems by introducing intuitive...

  • Article
  • Open Access
6 Citations
4,795 Views
11 Pages

8 October 2024

This study focuses on the neural machine translation task for the TR-EN language pair, which is considered a low-resource language pair. We investigated fine-tuning strategies for pre-trained language models. Specifically, we explored the effectivene...

  • Review
  • Open Access
6 Citations
2,302 Views
36 Pages

9 March 2024

In the field of edge-cloud computing environments, there is a continuous quest for new and simplified methods to automate the deployment and runtime adaptation to application lifecycle changes. Towards that end, cloud providers promote their own serv...

  • Article
  • Open Access
1 Citations
2,267 Views
16 Pages

17 April 2025

We study the performance of large language models (LLMs) in natural language understanding and natural language reasoning tasks in a low-resourced-language (LRL) setting. Using Yorùbá, an LRL, we curated a set of numerical probes with m...

  • Article
  • Open Access
2 Citations
3,521 Views
16 Pages

2 April 2025

Natural Language Processing (NLP) stands as a forefront of artificial intelligence research, empowering computational systems to comprehend and process human language as used in everyday contexts. Language models (LMs) underpin this field, striving t...

  • Article
  • Open Access
2 Citations
888 Views
19 Pages

An Evaluation Framework for Business Process Modeling Languages in Healthcare

  • Amir Afrasiabi Rad,
  • Morad Benyoucef and
  • Craig E. Kuziemsky

Web services composition is an emerging paradigm for enabling inter and intra organizational integration, and a landscape of languages and techniques for modeling business processes in web service based environments has emerged and is continuously be...

  • Article
  • Open Access
5 Citations
4,068 Views
17 Pages

Quantized large language models are large language models (LLMs) optimized for model size while preserving their efficacy. They can be executed on consumer-grade computers without the powerful features of dedicated servers needed to execute regular (...

  • Article
  • Open Access
4 Citations
4,360 Views
21 Pages

Offensive Text Span Detection in Romanian Comments Using Large Language Models

  • Andrei Paraschiv,
  • Teodora Andreea Ion and
  • Mihai Dascalu

21 December 2023

The advent of online platforms and services has revolutionized communication, enabling users to share opinions and ideas seamlessly. However, this convenience has also brought about a surge in offensive and harmful language across various communicati...

  • Review
  • Open Access
22 Citations
6,148 Views
35 Pages

6 March 2023

Modeling languages have gained ever-increasing importance for the Internet of Things (IoT) domain for improving the productivity and quality of IoT developments. In this study, we analyzed 32 different modeling languages that have been designed for I...

  • Review
  • Open Access
69 Citations
6,936 Views
14 Pages

Artificial intelligence (AI) and language models such as ChatGPT-4 (Generative Pretrained Transformer) have made tremendous advances recently and are rapidly transforming the landscape of medicine. Cardiology is among many of the specialties that uti...

  • Article
  • Open Access
402 Views
49 Pages

A Domain-Specific Modeling Language for Production Systems in Early Engineering Phases

  • Lasse Beers,
  • Hamied Nabizada,
  • Maximilian Weigand,
  • Alain Chahine,
  • Felix Gehlhoff and
  • Alexander Fay

30 January 2026

The development of modern production systems involves numerous interdependent disciplines, heterogeneous data sources, and frequent design iterations, making the conceptual design phase particularly complex and error-prone. Model-Based Systems Engine...

  • Article
  • Open Access
17 Citations
9,842 Views
20 Pages

Enhancing Robot Task Planning and Execution through Multi-Layer Large Language Models

  • Zhirong Luan,
  • Yujun Lai,
  • Rundong Huang,
  • Shuanghao Bai,
  • Yuedi Zhang,
  • Haoran Zhang and
  • Qian Wang

6 March 2024

Large language models have found utility in the domain of robot task planning and task decomposition. Nevertheless, the direct application of these models for instructing robots in task execution is not without its challenges. Limitations arise in ha...

  • Article
  • Open Access
1,990 Views
15 Pages

In the field of software engineering, applying language models to the token sequence of source code is the state-of-the-art approach to building a code recommendation system. When applying language models to source code, it is difficult for state-of-...

  • Article
  • Open Access
2 Citations
4,403 Views
21 Pages

Be Sure to Use the Same Writing Style: Applying Authorship Verification on Large-Language-Model-Generated Texts

  • Janith Weerasinghe,
  • Ovendra Seepersaud,
  • Genesis Smothers,
  • Julia Jose and
  • Rachel Greenstadt

25 February 2025

Recently, there have been significant advances and wide-scale use of generative AI in natural language generation. Models such as OpenAI’s GPT3 and Meta’s LLaMA are widely used in chatbots, to summarize documents, and to generate creative...

  • Article
  • Open Access
1,637 Views
16 Pages

The decision-making process to rule R&D relies on information related to current trends in particular research areas. In this work, we investigated how one can use large language models (LLMs) to transfer the dataset and its annotation from one l...

  • Article
  • Open Access
4 Citations
4,193 Views
18 Pages

With the continuous advancement of deep learning technology, pretrained language models have emerged as crucial tools for natural language processing tasks. However, optimization of pretrained language models is essential for specific tasks such as m...

  • Review
  • Open Access
35 Citations
15,732 Views
27 Pages

Language Model Applications to Spelling with Brain-Computer Interfaces

  • Anderson Mora-Cortes,
  • Nikolay V. Manyakov,
  • Nikolay Chumerin and
  • Marc M. Van Hulle

26 March 2014

Within the Ambient Assisted Living (AAL) community, Brain-Computer Interfaces (BCIs) have raised great hopes as they provide alternative communication means for persons with disabilities bypassing the need for speech and other motor activities. Altho...

of 202