You are currently viewing a new version of our website. To view the old version click .
Digital
  • This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
  • Article
  • Open Access

7 November 2025

Embodied Co-Creation with Real-Time Generative AI: An Ukiyo-E Interactive Art Installation

,
and
1
Faculty of Informatics, Chiba University, Chiba 263-8522, Japan
2
Faculty of Engineering, Chiba University, Chiba 263-8522, Japan
*
Author to whom correspondence should be addressed.
This article belongs to the Special Issue Advances in Semantic Multimedia and Personalized Digital Content

Abstract

Generative artificial intelligence (AI) is reshaping creative practices, yet many systems rely on traditional interfaces, limiting intuitive and embodied engagement. This study presents a qualitative observational analysis of participant interactions with a real-time generative AI installation designed to co-create Ukiyo-e-style artwork through embodied inputs. The system dynamically interprets physical presence, object manipulation, body poses, and gestures to influence AI-generated visuals displayed on a large public screen. Drawing on systematic video analysis and detailed interaction logs across 13 sessions, the research identifies core modalities of interaction, patterns of co-creation, and user responses. Tangible objects with salient visual features such as color and pattern emerged as the primary, most intuitive input method, while bodily poses and hand gestures served as compositional modifiers. The system’s immediate feedback loop enabled rapid learning and iterative exploration and enhanced the user’s feeling of control. Users engaged in collaborative discovery, turn-taking, and shared authorship, frequently expressing a positive effect. The findings highlight how embodied interaction lowers cognitive barriers, enhances engagement, and supports meaningful human–AI collaboration. This study offers design implications for future creative AI systems, emphasizing accessibility, playful exploration, and cultural resonance, with the potential to democratize artistic expression and foster deeper public engagement with digital cultural heritage.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.