Search Results (25)

As streaming platforms adopt artificial intelligence (AI)-powered subtitle systems to satisfy global demand for instant localization, the cognitive impact of these automated translations on viewers remains largely unexplored. This study used a web-based eye-tracking protocol to compare the cognitive load that GPT-4o-generated Arabic subtitles impose with that of professional human translations among 82 native Arabic speakers who viewed a 10 min episode (“Syria”) from the BBC comedy drama series State of the Union. Participants were randomly assigned to view the same episode with either professionally produced Arabic subtitles (Amazon Prime’s human translations) or machine-generated GPT-4o Arabic subtitles. In a between-subjects design, with English proficiency entered as a moderator, we collected fixation count, mean fixation duration, gaze distribution, and attention concentration (K-coefficient) as indices of cognitive processing. GPT-4o subtitles raised cognitive load on every metric; viewers produced 48% more fixations in the subtitle area, recorded 56% longer fixation durations, and spent 81.5% more time reading the automated subtitles than the professional subtitles. The subtitle area K-coefficient tripled (0.10 to 0.30), a shift from ambient scanning to focal processing. Viewers with advanced English proficiency showed the largest disruptions, which indicates that higher linguistic competence increases sensitivity to subtle translation shortcomings. These results challenge claims that large language models (LLMs) lighten viewer burden; despite fluent surface quality, GPT-4o subtitles demand far more cognitive resources than expert human subtitles and therefore reinforce the need for human oversight in audiovisual translation (AVT) and media accessibility. Full article

Multisensory integration is fundamental for coherent perception and interaction with the environment. While cortical mechanisms of multisensory convergence are well studied, emerging evidence implicates specialized retinal ganglion cells—particularly melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs)—in crossmodal processing. This review explores how hierarchical brain networks (e.g., superior colliculus, parietal cortex) and ipRGCs jointly shape perception and behavior, focusing on their convergence in multisensory plasticity. We highlight ipRGCs as gatekeepers of environmental light cues. Their anatomical projections to multisensory areas like the superior colliculus are well established, although direct evidence for their role in human audiovisual integration remains limited. Through melanopsin signaling and subcortical projections, they may modulate downstream multisensory processing, potentially enhancing the salience of crossmodal inputs. A key theme is the spatiotemporal synergy between melanopsin and melatonin: melanopsin encodes light, while melatonin fine-tunes ipRGC activity and synaptic plasticity, potentially creating time-sensitive rehabilitation windows. However, direct evidence linking ipRGCs to audiovisual rehabilitation remains limited, with their role primarily inferred from anatomical and functional studies. Future implementations should prioritize quantitative optical metrics (e.g., melanopic irradiance, spectral composition) to standardize light-based interventions and enhance reproducibility. Nonetheless, we propose a translational framework combining multisensory stimuli (e.g., audiovisual cues) with circadian-timed melatonin to enhance recovery in visual disorders like hemianopia and spatial neglect. By bridging retinal biology with systems neuroscience, this review redefines the retina’s role in multisensory processing and offers novel, mechanistically grounded strategies for neurorehabilitation. Full article

This article investigated whether crossmodal correspondence, as a sensory translation phenomenon, can mediate crossmodal transfer from visual to auditory stimuli in category learning and whether multimodal category learning can influence the crossmodal correspondence between auditory and visual stimuli. Experiment 1 showed that the category knowledge acquired from elevation stimuli affected the categorization of pitch stimuli when there were robust crossmodal correspondence effects between elevation and size, indicating that crossmodal transfer occurred between elevation and pitch stimuli. Experiments 2 and 3 revealed that the size category knowledge could not be transferred to the categorization of pitches, but interestingly, size and pitch category learning determined the direction of the pitch-size correspondence, suggesting that the pitch-size correspondence was not stable and could be determined using multimodal category learning. Experiment 4 provided further evidence that there was no crossmodal transfer between size and pitch, due to the absence of a robust pitch-size correspondence. These results demonstrated that crossmodal transfer can occur between audio-visual stimuli with crossmodal correspondence, and multisensory category learning can change the corresponding relationship between audio-visual stimuli. These findings suggest that crossmodal transfer and crossmodal correspondence share similar abstract representations, which can be mediated by semantic content such as category labels. Full article

This article examines the communication and marketing requirements of a prospective business enterprise that specializes in offering online courses focusing on psychology, personal growth and professional development to change patterns of educational production and consumption. The objective of this research is to analyse the necessary brand positioning for this company to improve its visibility, attracting and retaining interested customers. Using a sequential and evidence-based methodology, this study analyses the precise business requirements to establish an optimal and competitive platform for professionals offering wellbeing courses. This involved analysing the characteristics and needs of the target audience—the professionals who would deliver the courses—and the audience who would enrol in the courses. In addition, we assessed the company’s environmental context, its strengths, weaknesses and unique selling points, as well as effective marketing and positioning strategies, and its direct competitors. We identified a growing interest in online training of courses that contribute to wellbeing. Among the target audience, preferences were diverse, with 58.1% leaning towards personal growth, 45.9% interested in meditation and 43.2% in psychology. Social media, particularly YouTube (52.7%), served as the main source of information for these courses. Criticisms focused mainly on issues such as poor visual and audio quality (20%), inadequate structuring of content (30%) and perceived boredom (23.6%). Addressing these preferences through multilingual translation, niche targeting, diverse course offerings, flexible pricing and membership options can effectively cater to diverse customer segments. The findings emphasise the importance of prioritising audiovisual quality and personalised learning experiences to foster audience loyalty. Full article

Reception studies in audiovisual translation seek to explore how translation choices affect the audience’s comprehension, emotional engagement, enjoyment, and overall viewing experience of audiovisual materials. This study focuses on the subtitling product and analyzes the acceptability of swear words translated through different stimuli: subtitles with softened, maintained, and intensified swearing, along with standard Netflix subtitles (control). Employing a multi-method approach, the study collected data through a survey, using questionnaires with a Likert scale and interviews, following the user-centered translation model to understand how participants receive and perceive swear words in subtitling. The results indicate that the control group had the highest acceptability of the participants, while the group with softened swear words presented the lowest acceptability rate. The analysis shows that participants across all groups reported that discomfort does not arise from reading the swear word in the subtitle but from perceiving a deliberate change in its offensive load—usually softened. The findings demonstrate that this change can lead to a breach of the contract of illusion in subtitling, as participants are exposed to the original dialogue and the translated subtitle simultaneously. In conclusion, when perceived, the change in the offensive load can redirect the viewer’s focus from the video to the subtitles, negatively affecting the enjoyment of the audiovisual experience. Full article

In recent years, the global upswing in vessel-bridge collisions underscores the vital need for robust vessel track identification in accident prevention. Contemporary vessel trajectory identification strategies often integrate target detection with trajectory tracking algorithms, employing models like YOLO integrated with DeepSORT or Bytetrack algorithms. However, the accuracy of these methods relies on target detection outcomes and the imprecise boundary acquisition method results in erroneous vessel trajectory identification and tracking, leading to both false positives and missed detections. This paper introduces a novel vessel trajectory identification framework. The Co-tracker, a long-term sequence multi-feature-point tracking method, accurately tracks vessel trajectories by statistically calculating the translation and heading angle transformation of feature point clusters, mitigating the impact of inaccurate vessel target detection. Subsequently, vessel trajectories are predicted using a combination of Long Short-Term Memory (LSTM) and a Graph Attention Neural Network (GAT) to facilitate anomaly vessel trajectory warnings, ensuring precise predictions for vessel groups. Compared to prevalent algorithms like YOLO integrated with DeepSORT, our proposed method exhibits superior accuracy and captures crucial heading angle features. Importantly, it effectively mitigates the common issues of false positives and false negatives in detection and tracking tasks. Applied in the Three Rivers area of Ningbo, this research provides real-time vessel group trajectories and trajectory predictions. When the predicted trajectory suggests potential entry into a restricted zone, the system issues timely audiovisual warnings, enhancing real-time alert functionality. This framework markedly improves vessel traffic management efficiency, diminishes collision risks, and ensures secure navigation in multi-target and wide-area vessel scenarios. Full article

Film remakes represent a form of cinematic translation that reconstructs various elements of the original text. This article relies on the translation strategies of domestication and foreignization to analyze “Āṣḥāb Wālā Āʿāz”, the Arabic remake of the Italian film “Perfetti Sconosciuti” or “Perfect Strangers”. This study shows that the Arabic remake, which sparked controversy across the Middle East, replicates many of the syntactic elements of the original film, such as the narrative and the plot structure, as well as cinematographic and paralinguistic elements. Still, it attempts to adopt a transformative approach in order to generate a cultural production. The result shows that the use of domestication in film remakes alters the rhetorical effect of the original version and that, although foreignization may promote an audience’s interest in foreign cultures, it may contribute to the reproduction of otherness due to the dissatisfaction of the targeted audiences. Full article

The InnoDAT project is framed within the TRADILEX Project, which is aimed at demonstrating the applicability of Audiovisual Translation (AVT) for teaching and learning languages. TRADILEX is an ongoing project presented at a state-funded competitive call and supported by the Spanish Government. This article is aimed at presenting InnoDAT, an innovative project based in the use of AVT for teaching and learning languages through: Subtitling for the Deaf and Hard-of-Hearing (SDH). It has been designed to learn Spanish as a Second Foreign Language in an Italian Higher Education context according to a B2 CEFR level. The methodology used was developed by researchers of TRADILEX. Six tailormade Learning Units (LU), based on the SDH mode, were designed and implemented among participants (N = 97). Authentic materials and cultural matters were also used and adapted according to the B2 level. The results show a clear improvement in the process of teaching and learning languages, knowledge of the culture and traditions of the target language, and the consciousness of accessibility among the participants. The authors compare this innovative research with former research The InnoDAT project validates the applicability of the didactic audiovisual translation (DAT) as a means for learning languages and cultures within digital educational settings and how languages and cultures are intricately connected. Moreover, not only cultural issues but also accessibility were paramount in this research. Finally, motivation, autonomous and meaningful learning, communicative language competence, and digital competence were also nurtured by means of the InnoDAT project. Full article

The motivation of our research is to explore the possibilities of automatic sound-to-image (S2I) translation for enabling a human receiver to visually infer occurrences of sound-related events. We expect the computer to ‘imagine’ scenes from captured sounds, generating original images that depict the sound-emitting sources. Previous studies on similar topics opted for simplified approaches using data with low content diversity and/or supervision/self-supervision for training. In contrast, our approach involves performing S2I translation using thousands of distinct and unknown scenes, using sound class annotations solely for data preparation, just enough to ensure aural–visual semantic coherence. To model the translator, we employ an audio encoder and a conditional generative adversarial network (GAN) with a deep densely connected generator. Furthermore, we present a solution using informativity classifiers for quantitatively evaluating the generated images. This allows us to analyze the influence of network-bottleneck variation on the translation process, highlighting a potential trade-off between informativity and pixel space convergence. Despite the complexity of the specified S2I translation task, we were able to generalize the model enough to obtain more than 14%, on average, of interpretable and semantically coherent images translated from unknown sounds. Full article

This article is a discursive and equivalence-generating study of the use of the multilingual property as a narrative transmission mechanism in audiovisual texts. Specific functions can be constructed and different events and aspects of the plot can be presented through the introduction of linguistic variation and its deliberate application to achieve defined purposes. The analysis is based on functionalist approaches to the study of fiction and translation and on the binary branching classification model of solution types for determining textual problems in translation based on the form these adopt. This article presents the findings of multilingual property identification and translation related to the application of this forms- and functions-based approach. Several classifications of solution types are also developed with representative examples extracted from film and series. Full article

Films serve to (re-)create a ‘world’ within the mind of the audience. Additionally, they introduce or reinforce stereotypes portrayed as a reality of the modern world through multiplexity and the strategic use of foreign languages, dialects, and non-native language use, among others. Various concepts of stereotypes can be explored in fiction feature films, especially as film characters are often based on different kinds of stereotypes. Audiovisual texts tend to operate as cultural constructs that reflect and convey certain ideologies within an industry that holds the power to marginalize or belittle voices. Multilingual films highlight the contrasts among and within cultures; hence, they can further exacerbate the marginalization and stereotyping of different cultures and nations, ultimately having damaging effects on society’s perception of different stereotypes, such as race and gender groups, which is shown with the examples from a multilingual film. This article analyzes the marginalization and stereotypes in a Hollywoodian multilingual film through film analysis and critical theory. By doing so, this study aims to provide insight into the stereotypes that have been depicted, covering various clichés and stereotypes, including cultural, gender, political, and religious stereotypes. Furthermore, it seeks to dissect the societal consequences that arise from detrimental portrayals of stereotyping in a purposeful selection of an American multilingual film. Full article

Developing intercultural competence is one of the most important aspects when mastering a second language (L2, henceforth). This can be achieved through different approaches, but this paper focuses on the possibility of acquiring this skill online through the use of Didactic Audiovisual Translation (DAT). Here, we present the findings of the TRADILEX Project, which has produced data that support the ability of DAT to encourage motivation in learners while they develop integrated L2 skills in general and intercultural competence in particular through a combination of intrinsic and explicit cultural components presented in different lesson plans. Full article

Linguistic diversity is present in many audiovisual productions and has given rise to fruitful research on translation of multilingualism and language variation. Monsoon Wedding (Mira Nair, 2001) is a prototypical film for translation analysis, since multilingualism is a recurrent feature, as the film dialogue combines English (L1) with Hindi and Punjabi (L3), which creates an effect of code-switching. This article analyses how the multilingualism and the cultural elements present in the source text (ST) have been transferred to the Spanish translated text (TT) La boda del monzón. The results show that in the Spanish dubbed and subtitled versions, few Indian cultural elements are left, and little language variation is preserved. Thus, L3 does not play a central role as it does in the source text. In the translation, only a few loan words from Hindi or Punjabi are kept, mainly from the domains of food and cooking, as well as terms of address and greetings, or words related to the wedding ceremony. The results also show that when L3 is not fully rendered in translation, otherness is still conveyed through image and music, thus (re)creating a different atmosphere for Spanish audiences. Full article

In the last decades, ethnolinguistic Otherness has assumed an increasingly prominent position in many audiovisual products focusing on non-mainstream cultures otherwise quite voiceless in audiovisual media and giving voice to multilingual discourse practices where code-switching stands out as a key conversational strategy in expressing linguacultural diverse identities. This ties issues of on-screen multilingualism to the field of audiovisual translation and raises new challenges as far as the screen representation/translation of linguacultural specificities is concerned. All this is interestingly to be observed in animated films; indeed, since the early 1990s, such important animation production companies as Walt Disney, Pixar, and Dreamworks began to produce ethnically diverse films offering deep sociolinguistic insights into non-dominant countries and populations whose richness is conveyed on the screen by dialogues interspersed with their native languages, acting as vital symbols of their ethnocultural identity. Starting from these observations, this paper aims at looking contrastively and diachronically at how L3s, i.e., languages different from both the language of the original film and the language of the film’s dubbed version, used in instances of turn-specific, intersentential and intra-sentential code-switching, have been dealt with in the original version and in the Italian dubbed version of thirty American multilingual animated films, released between 1991 and 2022. The main objectives of this study are: to verify to what extent the original ethnolinguistic Otherness is either retained for the Italian audience or manipulated in dubbing; to observe whether and how the screen translation studies’ approach in conveying linguistic diversity in animation has possibly changed over the last thirty years; and to point out what can be achieved by audiovisual translation in terms of intercultural/interlingual transmission when autochthonous linguacultures are represented in animated films. Full article

Multilingualism in audiovisual productions has substantially increased in recent years as a reflection of today’s globalised world. While the number of publications looking at the phenomenon from the perspective of audiovisual translation (AVT)—especially interlingual subtitling and dubbing—has grown considerably in the last decade, there seems to be relatively little research on the rendering of multilingualism from the perspective of accessibility modes, namely subtitling for the deaf and hard of hearing (SDH) and audio description (AD). This article aims to investigate how multilingualism is rendered for deaf and hard-of-hearing as well as blind and partially sighted audiences, focusing on SDH and AD, as well as audio subtitling (AST). The study analyses a small corpus of TV shows available on Netflix and aims to highlight how multilingualism is made accessible both in SDH and AD. The products selected for the study had to satisfy three main criteria: they had to be a recent production, include the presence of an L1 (English) and one or more third languages and offer both intralingual SDH (closed captions) and AD. The results show that, even within the context of a single streaming platform, the strategies applied to deal with multilingualism seem to vary quite significantly both in SDH and AD/AST, ranging from neutralisation to L3 visibility. Full article