Multimedia

We experience narratives in different media, such as text and picture stories. While some research suggests that inference generation operates similarly across media, few studies have directly compared inference generation across media. This study investigated whether there are differences in the generation of bridging inferences for narratives presented in either texts or pictures. Participants saw wordless pictures or text versions of the same stories, and the presence of a coherence gap was manipulated within them. When there was a coherence gap, a bridging inference was required. Experiment 1 involved participants doing think aloud protocols and Experiments 2a and 2b measured processing time. The results showed an advantage of pictures for generating bridging inferences in the think-aloud task, but no difference between media in the context of processing time data. These findings suggest that differences in comprehension may be influenced by contextual factors, such as the activity that one engages (e.g., think aloud or reading silently) in when processing narratives. Full article

This study investigates multi-label movie genre prediction from user-written reviews in which textual content is inherently subjective and the movies reviewed naturally belong to multiple genres. To address extreme class imbalance and label sparsity in the IMDb Large Movie Review Dataset, 234 fine-grained genre labels are consolidated into 35 parent categories using a deterministic genre-mapping strategy. A unified experimental pipeline evaluates traditional feature-based models (TF-IDF vectorization with Logistic Regression and Linear SVM), a sequence-based BiLSTM with self-attention using GloVe embeddings, and transformer-based architectures (DistilBERT and RoBERTa) under consistent evaluation metrics. Experimental analyses indicate that transformer-based architectures outperform alternative approaches, with RoBERTa achieving the best performance (Macro-F1 = 0.518, Micro-F1 = 0.576). The results indicate that genre consolidation enhances robustness under long-tailed label distributions. Moreover, contextualized transformer representations better capture implicit and subjective cues. The results further clarify practical trade-offs between predictive performance and computational efficiency across model families. Full article

Scalable production of interactive 3D assets is a key requirement for XR-based applications, yet the functional integration of GenAI-generated assets into game engines remains challenging for non-expert users. This article proposes and validates a Prompt-to-Trigger workflow that links GenAI-based asset ideation and generation with the implementation of basic interactive behaviors (triggers) in accessible XR platforms. The study adopted a qualitative and exploratory approach, using systematic observation throughout a two-stage development process. This process included an initial phase where 3D assets were generated and refined using tools such as Tripo AI and Meshy, followed by an optimization stage to ensure compatibility with Blender and XR environments like A-Frame and Godot, and subsequently, the creation of AI-powered activation scripts. The results show that GenAI’s current 3D outputs frequently exhibit topological inconsistencies and rigging errors that compromise performance and real-time interoperability, requiring cleanup and optimization before deployment. The Prompt-to-Trigger workflow formalizes this bridge, positioning AI assistance as a functional layer for iterative logic generation. The resulting model provides non-expert creators with structured, actionable framework to prototype complex XR experiences for applied domains like education and multimedia communication. Full article

The SensaSea System is a responsive multisensory environment, specifically, a room-sized interactive installation that incorporates wearable devices, interactive visual floor projections and auditory and tactile modalities. SensaSea is designed as a physical environment for embodied interaction and free play suitable for multiple players; the system uses social proximity as the primary mechanism. Our objective is to promote active peer interaction and social connectedness among elementary school children through sensory-guided approaches which include digitized and projected interactive sea creatures. The multi-modal system also features an interactive soundscape and innovative real-time haptic feedback. We conducted eight group user studies (24 children in total). Our usability and feasibility tests demonstrated that the system results in positive emotions and elicits multiple pro-social behaviors. Full article

The lack of accessibility in digital gaming platforms remains a significant barrier to equitable user participation. To address this issue, this article presents an inclusive solution developed as a multimedia project designed to promote access to digital games for any user through the ipcb.games platform. The platform offers features that enhance accessibility, including voice-based authentication, voice-assisted registration, facial recognition, visual and auditory feedback, and a simplified interface. It also enables users to submit their own games for subsequent approval and integration. The development process followed a multimedia project methodology, structured into phases of analysis, planning, design, production, testing, and validation. The proposal was informed by a systematic review of scientific literature on digital inclusion and accessibility, complemented by a comparative analysis of existing platforms. During usability testing, the platform was evaluated by approximately 50 teachers from different educational levels, who provided highly positive feedback. Future work includes implementing voice-controlled gameplay, enabling keyboard-based navigation, re-implementing a functional eye-tracking system, and creating pedagogical groups, further strengthening the platform’s role in educational contexts. Full article

This paper aims to study how heutagogy relates to multilingualism and distance education regarding augmenting learner autonomy, meta-linguistic awareness, and overall learning objectives. As such, in our modern age, pedagogical models have shifted their focus and promote self-regulation and flexible learning of students, focusing on broad principles such as andragogy and heutagogy. This means that the weight is shifted over the trainee to the trainer to actively co-create knowledge that aligns with his/her objectives while using modern tools and processes such as distance learning environments and other digital resources. Our article reviews international publications from 2020 to 2025 to provide a more recent and modern approach and highlights findings from approximately 40 key publications that explore the application of heutagogical and self-determining core values in multilingual online learning. The results of our study were generated based on some preset criteria that aimed to measure the degrees of autonomy and intrinsic motivation, evaluate metacognitive and metalinguistic development, and assess the contribution of technological advancements such as MALL tools, AI, and digital learning ecosystems. Finally, the challenges faced in our study suggested limitations in terms of digital inequality, learning readiness, and difficulties in educators’ training. All the above can be tackled by the heutagogy model in distance multilanguage education when and if supported by the necessary cultural awareness, pedagogical strategies, and most importantly, technological training and infrastructure of all participating parties. Full article

Effective signaling in instructional materials—through cues such as highlights, arrows, and annotations—can guide learner attention, reduce cognitive load, and enhance comprehension in multimedia-rich online courses. While the benefits of signaling are well documented, little is known about how combinations of signaling strategies influence both the average performance and the consistency of student outcomes. In this study, we propose a data-driven approach to evaluate and optimize signaling strategies in online teaching. Using lecture materials from three semesters of introductory and intermediate statistics courses, we extracted multiple features of textual and visual signaling, including highlighted words, annotated formulas, arrows, and notes. Principal Component Analysis identified four distinct signaling strategies employed by the instructor. We then applied a heteroscedastic beta regression model to link these strategies to topic-level exam performance, allowing simultaneous assessment of mean learning outcomes and their variability. Results show that strategies combining formula highlighting with arrows and detailed notes improve both the average proportion of successful learners and the stability of outcomes, while relying solely on formula highlighting increases variability. Our findings provide actionable guidance for instructors to design effective signaling strategies, and demonstrate a flexible framework for data-driven evaluation of teaching practices in online learning environments. Full article

This study presents a production-ready AI pipeline for audio content processing, implemented within the Youth Radio platform, which serves as an extension of the European School Radio initiative. The system uses a multi-server architecture: an AI Server that runs batch/offline jobs, orchestrated by Apache Airflow, and two Web Servers that deliver all the Backend as well as the Frontend applications, configured with load balancing and redundancy to ensure high availability and fault tolerance. The implemented AI Pipeline includes tasks such as preprocessing, transcription, audio classification and topic modeling. Processed Podcasts are indexed in a Qdrant vector database to facilitate both dense and sparse retrieval while a recommendation system enriches the user’s experience. We summarize design choices and report system-level metrics and task-level indicators (ASR quality after correction, retrieval effectiveness) to guide similar deployments. Full article

Tabletop Gaming Experiences are a form of traditional gaming that traditionally requires either models, illustrations, or a vivid imagination to fully benefit from. Technology can be used to supplement this, such as mobile or tablet applications to help visualise aspects of gameplay content. Augmented Reality technology has the potential to further enhance Tabletop Gaming; however, there is little research into how it can be used in the areas of accessibility and sustainability, whether by reducing the carbon footprint of producing these games or by enabling wider participation. Our research aims to explore these topics and answer the following questions: How is Augmented Reality currently being used in Tabletop Gaming Experiences? How can it be used to assist with accessibility and make Tabletop Gaming Experiences more available to a wider range of audiences? Can Augmented Reality be used to lower the environmental impact of producing and distributing these games? This paper seeks to review the existing literature on this topic to identify how existing research has explored these issues, and how their findings may inform future Augmented Reality research on Tabletop Gaming experiences that are both inclusive and environmentally sustainable. Full article

Designing inclusive multimedia systems that meet diverse accessibility needs remains a complex challenge requiring iterative refinement and sustained collaboration with end-users. This paper presents an empirically grounded case study of an accessible Augmented Reality (AR) authoring tool project that integrates Design-Based Research (DBR) with Agile Scrum. By blending DBR’s iterative design experimentation with Scrum’s adaptive software development cycles, we designed and implemented a multimedia authoring tool for instructors with diverse accessibility needs. We document the best practices derived through iterative evaluation, such as early stakeholder involvement, the use of accessibility-focused user stories, and the alignment of research evaluation cycles with sprint reviews. The study also identifies key challenges, including balancing research and development goals, coordinating interdisciplinary roles, and maintaining an accessibility focus under compressed iteration cycles. We situate our contribution within prior DBR–Agile integrations, emphasizing its novelty in addressing inclusive system design rather than pedagogical interventions. The paper offers actionable insights and a validated methodological framework for human–computer interaction (HCI) researchers and practitioners seeking to design accessible multimedia systems by leveraging the complementary strengths of DBR and Agile Scrum. Full article

Quantum image transmission is a critical enabler for next-generation communication systems, allowing for the reliable exchange of high-quality visual data over error-prone quantum channels. Existing quantum-encoding schemes, however, often suffer from limited efficiency and reduced robustness under noisy conditions. This work introduces a novel multi-qubit phase-shift keying (PSK) encoding framework to enhance both fidelity and reliability in quantum image transmission. In the proposed system, source-encoded images (JPEG/HEIF) are converted into bitstreams, segmented into varying qubit sizes from 1 to 8, and mapped onto multi-qubit states using quantum PSK modulation. By exploiting multi-qubit superposition and phase modulation, the scheme improves spectral efficiency while maintaining resilience to channel noise. The encoded quantum states are transmitted through noisy channels and reconstructed via inverse quantum operations combined with classical post-processing to recover the original images. Experimental results demonstrate substantial performance improvements, evaluated using peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and universal quality index (UQI). Compared to superposition-only approaches, the proposed method achieves up to 3 dB SNR gain for higher qubit sizes, while single-qubit encoding remains limited due to reduced phase utilization. Moreover, relative to classical communication systems, the proposed multi-qubit PSK scheme consistently outperforms across all tested qubit sizes, highlighting its effectiveness for reliable, efficient, and high-fidelity quantum image transmission. Full article

Media shape and reflect social imaginaries, influencing collective beliefs, norms, and aspirations. Video games and films frequently depict themes like urbanization, dystopian futures, and resource-driven expansion, often envisioning humanity colonizing new planets after depleting Earth’s resources. Such narratives risk reinforcing exploitative attitudes toward the environment, extending them to new frontiers. Research has shown that media, especially video games, influence societal perceptions and shape future possibilities. While largely reflecting anthropocentric worldviews, these media also have the potential to promote ecocentric perspectives. In the context of biodiversity loss and planetary imbalance, media’s role in fostering non-anthropocentric values is crucial. This study introduces the Non-Anthropocentric Media Evaluation Questionnaire (NAMEQ), a tool designed to help media producers assess whether their work aligns with ecocentric principles, and to support academic researchers and students in the study and analysis of media from a biocentric perspective. Applying this framework to 138 widely distributed video games and films reveals a strong dominance of anthropocentric narratives. While some works incorporate ecocentric themes, they remain inconsistent. The findings underscore the need for a more deliberate and coherent representation of bio-centric values in media, advocating for a shift in cultural narratives toward perspectives that recognize and respect the intrinsic value of the non-human world. Full article

Industry 4.0 has intensified the skills gap in industrial automation education, with graduates requiring extended on boarding periods and supplementary training investments averaging USD 11,500 per engineer. This paper introduces VisFactory, a multimedia learning system that extends the cognitive theory of multimedia learning by incorporating haptic feedback as a third processing channel alongside visual and auditory modalities. The system integrates a digital twin architecture with ultra-low latency synchronization (12.3 ms) across all sensory channels, a dynamic feedback orchestration algorithm that distributes information optimally across modalities, and a tripartite student model that continuously calibrates instruction parameters. We evaluated the system through a controlled experiment with 127 engineering students randomly assigned to experimental and control groups, with assessments conducted immediately and at three-month and six-month intervals. VisFactory significantly enhanced learning outcomes across multiple dimensions: 37% reduction in time to mastery (t(125) = 11.83, p < 0.001, d = 2.11), skill acquisition increased from 28% to 85% (${\eta }_p^2=0.54$), and 28% higher knowledge retention after six months. The multimodal approach demonstrated differential effectiveness across learning tasks, with haptic feedback providing the most significant benefit for procedural skills (52% error reduction) and visual–auditory integration proving most effective for conceptual understanding (49% improvement). The adaptive modality orchestration reduced cognitive load by 43% compared to unimodal interfaces. This research advances multimedia learning theory by validating tri-modal integration effectiveness and establishing quantitative benchmarks for sensory channel synchronization. The findings provide a theoretical framework and implementation guidelines for optimizing multimedia learning environments for complex skill development in technical domains. Full article

Metaverse Recordings (MVRs), screen recordings of user experiences in virtual environments, represent a mostly underexplored field. This article addresses the integration of MVR and Multimedia Information Retrieval (MMIR). Unlike conventional media, MVRs can include additional streams of structured data, such as Scene Raw Data (SRD) and Peripheral Data (PD), which capture graphical rendering states and user interactions. We explore the technical facets of recordings in the Metaverse, detailing diverse methodologies and their implications for MVR-specific Multimedia Information Retrieval. Our discussion not only highlights the unique opportunities of MVR content analysis, but also examines the challenges they pose to conventional MMIR paradigms. It addresses the key challenges around the semantic gap in existing content analysis tools when applied to MVRs and the high computational cost and limited recall of video-based feature extraction. We present a model for MVR structure, a prototype recording system, and an evaluation framework to assess retrieval performance. We collected a set of 111 MVRs to study and evaluate the intricacies. Our findings show that SRD and PD provide significant, low-cost contributions to retrieval accuracy and scalability, and support the case for integrating structured interaction data into future MMIR architectures. Full article