Next Article in Journal / Special Issue
An Online Dissemination Workflow for the Scientific Process in CH through Semantic 3D: EMtools and EMviq Open Source Tools
Previous Article in Journal
Colorants Detected by HPLC-PDA in Textiles from 13th Century Lieto Ristinpelto, Finland
Previous Article in Special Issue
Development of an Immersive VR Experience Using Integrated Survey Technologies and Hybrid Scenarios
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

A Survey on Computational and Emergent Digital Storytelling

by
Georgios Trichopoulos
*,†,
Georgios Alexandridis
and
George Caridakis
Department of Cultural Technology and Communication, University of the Aegean, 81100 Mitilini, Greece
*
Author to whom correspondence should be addressed.
Current address: Department of Cultural Technology and Communication, University Hill, 81132 Mytilene, Greece.
Heritage 2023, 6(2), 1227-1263; https://doi.org/10.3390/heritage6020068
Submission received: 21 December 2022 / Revised: 19 January 2023 / Accepted: 25 January 2023 / Published: 28 January 2023
(This article belongs to the Special Issue Immersive Virtual Reality for Heritage and Museums)

Abstract

:
The research field of digital storytelling is cross-disciplinary and extremely wide. In this paper, methods, frameworks, and tools that have been created for authoring and presenting digital narratives, are selected and examined among hundreds of works. The basic criterion for selecting these works has been their ability to create content by computational, emergent methods. By delving into the work of many researchers, the objective is to study current trends in this research field and discuss possible future directions. Most of the relevant tools and methods have been designed with a specific purpose in mind, but their use could be expanded to other areas of interest or could at least be the steppingstone for other ideas. Therefore, the following works show elements of computational and emergent narrative creation and a classification is proposed according to their purpose of existence. Finally, new potential research directions in the field are identified and possible future research steps are discussed.

1. Introduction

Humans have always liked sharing stories. It is the most fundamental way we learn, encouraging both personal reflection and public discussion [1]. Storytelling is a widely used method for people across the world to engage emotionally, communicate, and project cultural elements and personalities. In addition, stories connect us with previous experiences and build bridges between the past and the present [2]. Narratologists agree that to constitute a narrative, a text must tell a story, exist in a world, be situated in time, include intelligent agents and have some form of a causal chain of events, while it also usually seeks to convey something meaningful to an audience [3]. Apart from humans, museums can be considered as “natural storytellers” [1]. Museums aim at making their exhibits appealing and engaging to an increasing variety of audiences, while also nurturing their role in conservation, interpretation, education and outreach [2]. Documentaries, films, video games, TV news, literature, theater, music and all kinds of art are ways of telling stories; true, fictional, or anything in-between. Even a board game, a religious ceremony, a sports event, or a dinner can be thought of as a storytelling procedure. Sometimes it is difficult to distinguish a narrative; instead it is easier to search in what ways any procedure can be considered as such. Narratives are often confused with stories and are erroneously considered to be synonyms. In this work, both are used interchangeably, even though their conceptual differences are well-known. In order to illustrate their difference, we can, for example, claim that the story of the modern Olympic Games is one, but there are countless narratives about the Olympic Games, expressing personal experiences and beliefs, for different periods and various games, happening around the globe. Some narratives may be famous already; others remain unknown and reach the listeners either from people who experienced them or from third parties. Narratives always contain personal aspects; according to Hills [4], a narrative is not merely a series of events, but a personification of events through a medium such as language. Thus, as storytelling connects us with deeper emotions and experiences, it builds bridges connecting the past and present [2], becoming an extremely powerful medium for communicating messages and ideas.
In the digital era, storytelling derives its engaging power by integrating images, music, narratives, and voice, thereby giving a deeper dimension and vivid color to characters, situations, experiences, and insights [5]. Computers have been involved in the creation, storage, reproduction, sharing, and publication of stories. Initially, they were just side tools, but advanced and complex algorithms over a constantly and exponentially growing processing power brought them closer to the generative procedure of story-making. Stories also became interactive; listeners could intervene in their flow and decide, to some extent, how they would unfold. This is how the term of the narrative paradox came up; the freedom of choice in the formation of the story, as opposed to its prefabricated plot by the author. The user interaction with the medium conflicts with the narrative design [6]. Thus, there is always a tension between the story and freedom [7] and a balance has to be established to preserve the internal consistency of the story. Rules and boundaries are necessary to maintain the story trajectory and end up communicating messages that are desirable—as originally defined by the author—and not unpleasant.
Narratives can be linear following a specific trajectory or interactive (branching), which means they can follow several paths and the user has some level of control over the story outcome. Computers can participate in the creation of these narratives, in different ways and to varying degrees. Each story needs characters, space and a plot; algorithms may be involved in any of the precedent elements. Research in interactive narratives (IN) offers, in general, two approaches for the creation of narrative content [8]; the bottom-up approach, where the story is emergent and created as a result of user interaction with a system, and the top-down approach, where a drama manager is employed (in later papers referred to as an experience manager—EM—as stories are not always dramas) and which means that a set of rules and conditions are predefined during story creation, so that the story does not exceed certain limits. In the former case, there is huge freedom in story creation and an infinite number of paths can occur, but on the other hand, the potential of an unpleasant, unsatisfying story is high. In the latter case, when a user or system deviates from the desired trajectory of a story (as again originally intended by the author), the role of EM is to apply a mediation strategy called accommodation to transition the user to a new desirable trajectory. According to Ryan [9], the concept of possible worlds (PW) describes the spheres of a fictional system of reality and calls for an inquiry into the nature of possibility. Or, in simpler words, PWs are the possible “shapes” a fictional story can take.
A narrative act is an abstract, complex action in a narrative engine [10], usually described as a verb such as promise, award, help, inform, and so forth. These acts contribute to the narrative sequence, show potential and can take a central role when they are used as building blocks in combinatorial generative systems. An extensive catalog of more than 200 narrative acts has been created. In addition, a general three-level taxonomy is proposed, associated with an interactive visualization tool available online, allowing researchers and creative authors to consult and expand the catalog. Agency (a term mostly used in games), is the actual level of control that players feel while in the game world [3,11]. The more the agency increases, the more a user feels more engaged in the formation of the story and experiences it as a real event. On the other hand, the elevation of agency enhances the narrative paradox. Multiplayer interactive narrative experiences (MINEs) are interactive authored narratives in which multiple players experience distinct narratives (multiplayer differentiability) and their actions influence the storylines of both themselves and others (inter-player agency) [12].
More focused on cultural heritage, the utilization of multimodal storytelling mechanisms, in which digital information is presented through multiple communication methods/ media (multimedia) is considered as a supplement to physical—traditional heritage preservation, activating users’ involvement—collaboration in integrated digital environments [13]. Thus, digital storytelling is one of the resources museums have in hand for enriching their contribution to visitors and to society at large. Through narratives, museums can find new ways to enhance and represent their exhibits’ stories to visitors, attracting their attention and increasing their interest through active engagement. Technologies such as augmented reality (AR) can influence the way museums can present their narratives and display their cultural heritage information to their visitors. AR can be seen as a form of mediation using interaction and customization that supports a form of narrative where visitors can engage or even create narrative scenarios in their cultural tour. There is an older review on narrative generation systems by Young et al. [14]. Additionally, an important attempt to categorize all DS authoring tools (IDN) was presented by Shibolet et al. [15]. Another taxonomy of authoring tools was contributed by Green et al. [16], where authors observe and discuss their experience from using these tools and also present Novella [17], their proprietary authoring tool. Selecting an authoring tool is directly associated with the result of a story. According to Kitromili et al. [18], many tools are bespoke; authors explore the world of authoring tools and try to figure out how each tool shapes a different type of story. To achieve that, they create the same story using different tools and report on the differences found between stories. These differences may not be that obvious when working on one platform only.
Mu [19] attempted a survey on the storytelling of an interactive documentary and a new theory model about the subject. A classic and important contribution to the narrative theory is the book of Marie-Laure Ryan [9]. In the extensive survey of Kybartas et al. [20], the authors presented techniques and tools used in the narrative generation and created a taxonomy for these projects, where algorithms generate parts of the plot, parts of the space, define characters, and offer templates for creators to speed up the creation processes, at a higher or lower level. Nevertheless, they conclude that computers will not be able to and should not substitute humans in the story creation process. As mentioned by Kasunic et al. [21], artificial intelligence (AI) work in storytelling can be categorized in three classes: (i) Teaching AI to generate and understand stories [22]; (ii) Helping human storytellers as a co-creator [23]; and (iii) Modeling story elements. As technology advances, research attention shifts to using AI to generate stories. Smart agents, text bots, advanced text-to-speech algorithms, and dialogue systems are just some of the AI products that show that tendency. Progress in natural language processing, generative art, language generation and deep learning (which is crucial to learn from the thousands of stories and tales produced by humanity at large), are some of the research trends that elevate the role of computers in the story creation procedure.
Thus, the research field of AI use in storytelling is still open, intriguing, challenging, and attractive for many researchers all over the world. It also carries a great ethical dilemma; is it right for computers to create our stories or should this remain a purely human quality? Humans can really benefit from their own stories and after all these years, we still learn and improve on telling stories [21]. On the other hand, stories coming from AI systems could potentially introduce bias, stereotypes, and prejudice about race, gender, color, nationality and religion.
Riedl [24] introduced the term of narrative intelligence as “the ability to craft, tell, understand and respond affectively to stories”. In his positional paper, he also refers to the term of machine enculturation which, in essence, is the way we—as humans—can transfer our culture(s) into a computer. Not an easy task, not even an easy concept to fully understand and digest. Nevertheless, this is an essential step in the procedure of computational narrative; otherwise stories with annoying, offensive, disrupting or no meaning at all may arise. Thus, in this paper, some concerns are raised to the creation of narratives by AI. In another work of Riedl and Harrison [25], the authors described “preliminary work on using stories to generate a value-aligned reward signal for reinforcement learning agents that prevents psychotic-appearing behaviors”. In other words, they argue about machines that are able to learn values, by reading stories. They refer to the term of value alignment as a property of an intelligent agent that can only pursue goals beneficial to humans. Stories reflect the culture of the society in which they were produced. In this respect, an important question is whether it is possible for machines to be taught human values, using existing stories, This is important because, ideally, a general artificial intelligence system with the capability of creating stories would be desirable, but a system, especially one that is embodied, that shows deviating behaviors that can potentially harm humans would be undesirable. The problem of value learning has preoccupied researchers in the past, such as Soares and Fallenstein [26].
Figure 1 displays the evolution in computer use for storytelling. The circles represent four distinctive but overlapping storytelling periods. The further we go to the right, the more human writing tasks are assigned to algorithms. More capabilities, options, and flexibility are added to the story paths, but the role of the writers diminishes. Of course, we can always look back, since the use of technology has never been mandatory, as narrative creation characterizes humans and algorithms are not made to substitute them.
Nevertheless, the current survey focuses on the research and collection of scientific works related to computational, emergent, interactive digital storytelling tools and methods. Hundreds of DS works have been collected and filtered according to their interactivity and potential for computational content creation. It is an attempt to bridge the gap between surveys published in the past by the authors mentioned above and the current state-of-the-art, in an effort to create an updated and useful survey for researchers in the field. In this respect, a taxonomy is proposed for contemporary DS works, according to their purpose and scope. Therefore, works published before 2015 have not been considered in this survey.
The works presented in this survey have been primarily retrieved from conferences related to emergent, computational, and interactive digital storytelling (Table 1). When an implementation was available, it was tested as well. Then the initial pool of works was expanded by considering their bibliographic references pertaining to the criteria discussed above (that is, published after 2015 and related to DS). Then, the final set of works was determined after expanding our search to scholarly databases such as Google Scholar and Semantic Scholar using the “emergent”, “computational”, “interactive” and “storytelling” search terms.
The rest of the paper is organized as follows: Section 2 overviews related work in computational and interactive DS applications, where works are presented and then classified. Section 3 categorizes works based on the employed media and interaction. A discussion and criticism on the subject follows in Section 4 and the current survey is concluded in Section 5.

2. Related Work

Digital Storytelling, as a method or tool, can be used multimodally almost everywhere; in education, entertainment, cultural sites, health applications, arts and so on. By taking advantage of the strengths of AR and VR technology, stories can become more vivid, interactive, compelling and immersive, providing an intense experience to users.
All the works in this survey are firstly divided into three main categories, as identified by their analysis (Figure 2):
  • DS Authoring Tools
    Tools specifically developed for the creation of stories are examined in this category. In this perspective, even a word processor (like Microsoft Word) may be viewed as an authoring tool, but in this survey, we focus on more complex, specialized tools that assist in the creation of stories by producing content in an automated way. Mitchell et al. [27] hosted a workshop discussion on whether authoring tools are really necessary. This is an interdisciplinary topic to discuss.
  • DS Systems and Applications
    In this category falls mobile applications that use DS to enhance user experience, in various cases and fields of interest. There are also more complex systems, combining databases, special hardware, desktop software applications and technologies such as VR, AR, and robotic mechanisms. In either case, this category includes projects fully or partially developed, either for commercial or research purposes.
  • DS Methods, Frameworks and Case Studies
    These are theoretical studies and designs for projects that use computational DS in various fields. Some of them are ongoing projects, in the middle of implementing a proof-of-concept, a demo or a complete application—system.
It is obvious that the above categories may overlap. In some cases, the researchers created their proprietary authoring tool in order to build their application (as, for example, in Narralive [28] and CHESS [29]). Equivalently, developed systems conclude in authoring tools, such as StoryAssembler [30] and Stories of the Town [31]. Additionally, there are authoring tools and DS systems that are still being developed and as such could be positioned also in the category of frameworks (e.g., Subject and Subjectivity [32] and Felt [33]). Table 2 presents all the 92 selected works considered in this survey, organized in the aforementioned three categories. The 18 DS authoring tools, 33 working systems and applications and 41 theoretical methods and frameworks were identified in total. The larger checkmark indicates each work’s primary classification, while overlapping categories are marked with smaller checkmarks.
At a second level of analysis, all works were classified according to their purpose and scope (Table 3). There are, for example, works that have been specially designed to engage museum visitors, others for educational purposes only, and some to assist the elderly to overcome loneliness. Nevertheless, there are a lot of research works that could be positioned in more than one category; in this case, a large checkmark designates the main classification and smaller checkmarks indicate the additional categories. In total, there exist four categories referred to in the literature as “newer genres of IDN” and some works considered in this study belong to these genres. More specifically, the said genres appeared in the realm of interactive narratives during the last decade and exhibited some interest, as they evolve constantly and show more potential in the use of interactive digital narratives.
The last column of Table 3 is titled “General Purpose” and contains 34 out of the 92 works in total. As this is almost one-third of the examined works, it is explained in more detail in the following subsections.

2.1. General Purpose Computational and Emergent Storytelling Works and Systems

As already discussed, the proposed classification is based on the scope of each work. Thus, it could be assumed that “general purpose” means that many works could not fit in any category, or there was no specific purpose during their creation. However, this is not the case; all of these 34 works designate the effort of researchers to learn more about interactive digital narratives. They created apps, systems and designed frameworks to test them and find their potential strengths and weaknesses. The said works form the basis for new theories and new technologies, meaning that their stated purpose could be equally “learning more about DN” or “going a step further”. Thus, writing stories or narratives constantly shifts from the pure writing of texts, to writing algorithms, methods, frameworks, rules and structures, handling data and variables, creating the logic and taking decisions according to conditions. This is more akin to using programming languages and coding than creating meaningful and touching stories. Computational storytelling is hard and can lead to meaningless and even disturbing results if no boundaries are set and rules are followed.
Every researcher or group of researchers follows their path and methodology for creating computational narratives, making any analysis and categorization difficult. To start with, a couple of works are character- or player-focused. Berov [80] aimed at conceptualizing and implementing a computational storytelling system in which the plot emerges according to the characters’ embedded narratives. His work is still in progress. An architecture of emergent player-triggered narratives used in games was also proposed by Chauvin et al. [8]. They designed an interpretation engine whose role is “to make sense of the emergent world as it is changing and Inform the Narrative Processes with high-level story concepts such as actors and places”. Through these works, a lot of terms emerged and were explained. Berov used the term tellability (as used by narratologists) to describe the internal quality of the plot and Chauvin explained and used the terms coherence, agency, possibility space, uncertainty and codirection.
In other projects, knowledge or data graphs are preferred as the stepping stone for emergent stories. Battad et al. [52] developed a computational system that parses data graphs to create descriptive texts. The system distinguishes “normal” and “abnormal” events by identifying visual patterns on graphs and, in the end, applies descriptions on a storytelling template. One year later, the same researchers presented their project that builds upon the existing multi-modal storytelling system. They used it to organize and describe Rensselaer Polytechnic Institute’s library archives, and they discussed their results.
In a couple of other works, narratives emerged according to the user’s choices. For example, StoryAssembler [30] is an open-source generative narrative system that creates dynamic choice-driven narratives. As a case study, it was used during the creation of the Emma’s Journey game. Similarly, Ink created by Inkle Studios is a scripting language that creates choice-based interactive fiction (IF). Kenton et al. [37] described the way they used Ink to teach interactive design by having students create a choice-based interactive fiction story as a major course project.
Many projects give more emphasis in theoretical frameworks and do not always proceed with implementations. Through these projects, however, new definitions and fields of research have been developed. Miller [4] conducted in-depth research and analysis of the world of interactive storytelling, covering all basic principles and also including AI in digital storytelling, the use of technologies such as AR, VR and mixed reality. Additionally, she presented numerous case studies that delve into the processes and challenges of developing works of interactive narratives. As another working example, the term story shifting was introduced by Ryan et al. [3] in order to define the selection of events that constitute a compelling story from a larger chronicle of events. Story shifting is one of the most challenging aspects of emergent storytelling but Kreminski et al. [33] attempted a first application by developing a system called Felt. Using query language and rules, they achieved a shifting of events and evaluated Felt in case study applications (Starfreighter, CMCK, Diarytown) in an effort of proceeding to a more sophisticated system for emergent storytelling. In the space-time theoretic approach of Schoenau-Fog [81], ideas, concepts and examples are examined with respect to how space-time may be used to organize events, while maintaining narrative engagement. More specifically, he proposed a system framework in IDS, which exploits the possibilities of the time-space continuum.
Some works are based on previously proposed theoretical designs and frameworks, with creators trying to implement and test them. For example, Szilas et al. [39] researched the central notion of conflict in drama. They used an algorithm to extract all kinds of conflict in a narrative and then they created a model of conflicts. Finally, a cluster analysis was performed, demonstrating that they can be reduced to three main “conflict groups”. The role of EMs in computational narratives is very important. Amos-Binks et al. [86] defined three desirable properties of a narrative trajectory (exemplar trajectories, narrative-theoretic comparison and efficiency) that EMs should handle and demonstrate how their plan-based Intention Dependency Graph addresses them. Kreminski et al. [84] attempted to map out the design space of storylet-based narrative systems in games. They refer to the term storylet as a discrete, reordable narrative chunk or module, found in a narrative database, usually for a game. During these games, storylets are redrawn from the database according to user actions in a way that they form a complete narrative. In their work, they also find and record common elements of storylet-based systems. Kybartas et al. [32] based their thinking on the theory of Ryan [9] and studied the potential of the PW model in an emergent narrative. They proceeded to a partial implementation (demo) and testing of such a tool and ended up with the conclusion that PWs afford several possibilities for emergent narratives and manage to quantify conflict in the system. The same authors, continuing their research [32], presented Subject and Subjectivity, “a conversational game that uses a possible worlds model of narrative and characters to support an exploratory dialogue system”. They came to the conclusion that a “dynamic and engaging dialogue system can be achieved, even with a small amount of content and a simple conflict model”.
A special approach to the creation of computational narratives is the use of narrative acts by Szilas et al. [10], which are, in a simple interpretation, complex verbs that contain a predicate and parameters that allow them to be linked to other acts. When used as building blocks in computational narrative systems, they could possibly create meaningful text. Along with the narrative acts, the authors created a very useful tool for IDS authors. Their online tool1 is an interactive visual (sunburst type) catalog of the 223 collected narrative acts. This collection forms a hierarchical database of acts (each act is part of a higher level category named class and each class is part of a domain, where a total of six domains form the whole database). Their tool is updatable, which means that if new narrative acts arise, they can be easily added to the database. Artificial Intelligence technologies pave the way for other researchers. Stefnisson and Thue [38] have implemented an authoring tool named Mimisbrunnur that “incorporates AI in a variety of ways”. Specifically, the tool uses natural language processing and mixed-initiative exploration to “help the author create an outline, and stories from this outline can be previewed within the tool using the outputs of a story generator that uses AI planning”. Mimisbrunnur was used to create story outlines as defined by Thue et al. [116,117]. An outline has been described as a set of relations, true or false, that put boundaries on the way a story will start and on the way it will continue. Martin et al. [79] took the challenge of computational improvisational storytelling in open-world domains. The goal for them is the development of an intelligent agent that can sensibly co-create a story with one or more humans through natural language. They discuss some of the challenges that need to be addressed and they propose two architectures that address some of these challenges as a starting point. Creating a computational, improvisational story is composed of finding the appropriate words from a collection and putting them together in sentences, in a way that meaning is created. Later on, Martin, along with other researchers [85], presented a technique for preprocessing textual story data into event sequences. They also presented a technique for automated story generation whereby the problem is decomposed into the generation of successive events and the generation of natural language sentences from events. GPT [118] (the current version during the writing of this survey is GPT3 [119]) is a very promising technology in the automated creation of text using complex AI algorithms. Austin [83] used GPT2, trying to learn how to write about a subject and additionally generate the topology for an encyclopedia. His work aims at fostering new research on using GPT2 as a computational storytelling tool.
All other works belonging to the “general purpose” category, follow their own unique way to deal with computational narrative creation. For example, Katsui et al. [50] proposed a creative support system that organizes the structure of entire stories. They start with two templates, one for the story structure and one for setting up the characters. Afterwards, they add four more functions, which are “creating unlimited profiles of characters, setting undulations of a story, drawing periods of each character appearing, and calculating the sentiment value of each period”. They have tested their system with authors who found the system useful for creating novels. The power of templates in the creation of computational narratives has been the research field of Kawagoe et al. [34]. The authors used four story templates to create stories with a computational method. Afterwards, they studied the efficiency of these templates, conducted experiments with real users, and they concluded that the backgrounds of characters are the most significant ingredient for the creation of attractive stories.
In another field approach, Womack and Freeman [82] presented a novel method for creating interactive narratives. Based on the literature approach for narratives, they considered that stories have genre and semantics and they added location-based context. Using a GPS geo-location, they try to anchor stories to the real world. The narrative structure is anchored to various locations, and they use a database of words, sentences, and phrases to select their data through machine learning procedures. Location data are also important in StoryPlaces (Figure 3). It is a platform presented by Hargood et al. [40] and focuses on locative narrative systems. Research in the field had been abandoned for some time, but the authors returned with an “open-source locative hypertext platform and authoring tool designed around a sculptural hypertext engine and built with existing Web technologies”. In other words, StoryPlaces can be used as an authoring tool for narratives that embed locative data and it has been tested and used in actual applications.
Green et al. [41] presented a three-stage design pipeline targeting the creation of interactive narrative authoring tools. To test their system, they proceeded with the creation of a new authoring tool, and they reported on the methodologies, analyses, and findings of each step. Xu et al. [87] emphasized the style of computational dialogues within the context of a narrative. They proposed an approach and demonstrated its feasibility through the support of deep learning techniques. Short [88] created a blog about the complexity of branching in narratives and the ways it could be more efficient, by dealing with some basic problems involved. Schoenau-Fog and Larsen [120] created a workshop to explore and address the challenges of creating interactive adaptive real-time story worlds. Participants in the workshop explored the potential of the field and presented their work. In another workshop, Koenitz et al. [89] studied the potential of card-based methods to create IDN prototypes.
There are narrative systems that do not create stories but use ready-made stories (i.e., created by hand or other systems) and transform them into movements, sounds, videos, animations, and so forth. For example, Kapadia et al. [53] presented CANVAS, a system that takes narratives and creates animations that could be used as prototypes by artists and directors. Stories of the Town by Miller [31] is another system that automatically generates narratives by synthesizing three distinct approaches to traditional narrative generation; context-free grammar, planning, and simulation. In this project, the authors try to balance narrative coherence and character autonomy. An open interactive narrative was introduced by Guzdial et al. [36], solving the problem of generating an interactive narrative experience about any possible topic. In addition, they presented an intelligent, open, interactive narrative system, Scheherazade-IF, that automatically generates interactive fiction about common topics. Scheherazade-IF uses crowdsourcing to learn a domain model for a given topic in a just-in-time fashion, meaning that it engages in domain knowledge acquisition during the development of the interactive narrative experience about a specific, requested topic. This work has been based on the previous work of Li et al. [121], in which crowdsourcing was used again to create domain models manually.

2.2. In the Field of Education

The impact of digital storytelling in education is huge, in terms of student engagement and satisfaction, ease of learning and memory retention. Nonetheless, according to Koenitz et al. [90], there has been no degree program in interactive narrative design, which indicates that many narrative designers are self-trained. By starting an educational program, the authors aimed to address this problem, using the opportunity to also include perspectives outside of games. The issue of the non-existence of a formal education discipline is also the subject of Bernstein et al. [91] according to whom it is a constant need, not yet fulfilled, because of the epistemological implications of the multiple disciplinary roots of the field. Shelton et al. [92], in their study on IDS in education, explored the use of interactive videos for a university hybrid course. The purpose of these videos is to support student learning and engagement and the results were very positive regarding student engagement, scaffolding learning, learning gains, and student accountability. Akin to the above, Molnar [122] used IDS in teaching microbiology and his research results show improvements in student engagement and participation.
Rizvic et al. [93] discussed the benefits but also addressed the challenges of introducing IDS and serious games in the classroom, on topics such as cultural heritage. Smith et al. [94] targeted the student group aged 9–11 and tried to combine the teaching of programming courses with the creative process of writing stories. Thus, they proposed an approach in block-based programming in order to create interactive digital narratives. This way, they aimed to engage upper elementary students in computational thinking and narrative skill development.

2.3. In the Field of Cultural Heritage

Digital storytelling has been applied in the context of museums and other cultural places for quite some time now. Stedelijk Museum in Amsterdam was the first museum to use recorded guiding stories and since then, most of the museums worldwide have used some form of technology to enhance the experience of visitors by telling stories and adding content to their guidance. Even though this field has been well-studied in the framework of DS, newer projects always try to enhance, transform and enrich the use of stories for a much richer user experience. To start with, Rizvic et al. [95] tried to create a methodology for creating IDS presentations for cultural heritage. The authors engaged for this project a group of multidisciplinary experts and as a result of their work, they wrote guidelines for other researchers. Guidelines to help shape design and development of interactive narrative projects in educational, museum, and heritage settings are also the result of a project by Rouse [123]. As she states, the telling of history has a long tradition of engagement with emerging technologies. She presents several case studies in which technologies such as AR and VR are combined, to promote cultural heritage, as a result of her long-time field research. She also focuses on the ethics of telling someone else’s story. Roussou et al. [2] reported on a series of experiences involving the creation of several interactive rich-media museum stories. These digital stories were authored by experts who collaborated in numerous intensive, hands-on participatory design workshops held at high-profile cultural sites; the Acropolis Museum in Greece, the archaeological site of Çatalhöyük in Turkey and the Stedelijk Museum in Amsterdam.
Teenagers are a difficult audience in a museum, in terms of engagement and satisfaction. Turning Point [55] is a project that targets teenagers as museum visitors and tries to make museums interesting using gamification, and narratives, offering a rich user experience. It is based on a mobile application that was used in the Natural History Museum of Funchal (Madeira island, Portugal). The application is location-based and challenges visitors to explore the museum and unlock fragments of narratives that compose the main story. A richer experience for museum visitors was also attempted by WoTEdu [54]. It is an IDS project based on the Web of Things (WoT) paradigm and was designed for museums as storytellers, to enhance the interactivity between artifacts and visitors. As a case study, in collaboration with the Galata maritime museum in Genoa, Italy, narratives about nautical artifacts were written for a pilot application of the system.
A practical tool created to assist storytellers was presented by Vrettakis et al. [28]. The authors described the web-based Narralive Storyboard Editor (NSE) and the Narralive Mobile Player (NMP) app (Figure 4) as “developed with the objective to assist the creative process and promote research on different aspects of the application of mobile digital storytelling in cultural heritage settings”. These tools were developed during the implementation of the CHESS project [29,124] (CHESS authoring tool) and afterwards they were upgraded, altered, and used in the EMOTIVE project [125]. Narralive has no emergent storytelling elements but can speed up the writing of stories through templates. In a later project [42], the authors created an authoring tool called The Story Maker and experimented on previous works with branching narratives in cultural heritage. In the said project, they presented their tool which aims to foster the development of multimedia interactive narratives for cultural heritage. It is a web-based, JavaScript tool which contains two parts; the story design editor (SDE) for designing the story and the storyboard editor (SBE) that produces the final visitor experience.
An attempt to bridge the academic discipline of history with IDS has been made by Revells and Chai [56] who used VR technology, Maya and Unity software, along with a range of visual and aural historical sources from Republican-era China (1912–1949), for a digital demonstration of “the possibilities of combining interactive digital narrative with long-accepted materials and modes of historical production”.

2.4. In Games (Entertainment or Serious)

Every computer game is attached to a story, which can be minimal or more complex than any movie story, as it can branch in multiple directions, according to player choice. In games, there is always a tension between agents and narratives and that is a basic challenge for game designers. When the level of agents is high, the narrative loses importance and meaning, while focusing on the narrative leads to the loss of agent feel. Strugnell et al. [97] attempted computational narrative improvisation in games, according to players’ reactions, so that a good balance between agents and narrative could occur. Large-scale games demand long scenarios, much longer than a movie, as a result of their interactivity. Creating the plot is the first step to reaching a scenario, and Kawano et al. [98] created a framework for automated plot generation. In their evaluation experiment, they ended up with a result very close to automated plots and they worked on creating more complex stories than just plots. Molnar and Kostakova [43] used a game engine to create an authoring tool that facilitates the development of IDS-based games. They also created several games using their authoring tool and they used these games as case studies in their research.
Suckling [57] is developing a mobile game in which the story is partially generated procedurally. It is called Dungeon Crawler, a type of game in which players control one or more characters with whom they explore a dungeon. The narrative is not handled by an AI system or any complex algorithm, but is procedurally generated as a production system, built on probability triggers. De Kegel and Haahr [58] attempted narrative design innovation in the form of a system for the procedural generation of puzzles, for use in story-rich games or games with large open worlds. They used context-free grammar as the basis for both the generation algorithm and puzzle-solving, which guarantees that the puzzles are solvable. They are based on their previous survey [126] on procedural puzzle generation. Their work has also been the basis of a newer project called Honey I’m Home [59], where a 2D adventure game based on the SPHINX framework is presented, mostly as an evaluation tool. Kreminski and Wardrip [60] presented Throwing Bottles at God, an experimental narrative game in which predictive text is used and narratives are formed partially by the player and partially by algorithms. In addition, dialogues of NPCs are created by AI, in a specific style. This work has been influenced by a previous work named Tracery [44], which is an author-focused, generative text tool intended to be used by novice and expert authors. In other words, it is a tool for people who need computational narratives for any purpose, without having to resort to messing, coding and algorithms. It exports content in several formats, such as HTML, SVG, and JavaScript.
A research area in AI for games focuses on the creation of personalized content for players, according to their reactions. Robertson and Young [99] studied the creation of a game engine that utilizes a procedural content generation (PCG) pipeline “to generate and control a range of gameplay experiences from an underlying IN experience management construct”. In other words, the authors created a computational narrative method and expanded their method to create procedural game content. Nielsen et al. [61] explored a method in which PCG was used to create virtual environments and embedded narratives. PCG is often used in game creation, usually by small groups of developers or even individuals, to produce games faster and cheaper. Many elements of the environment such as terrain and plantation would be time-consuming if created by hand, but PCG tools can take over all the boring, repeated work of creating environmental content. The authors created an online game 2 as a case study and experimented with real users. In their game, there was a single narrative embedded in the environment and some of the users experienced a steady pre-made environment, while others a procedurally created one. Researchers concluded that levels of narrative engagement and coherency were similar in all cases. Spawforth et al. [12] explored the potential of Multiplayer Interactive Narrative Experiences (MINEs) in the world of storytelling. They introduced a model for MINEs based on sculptural hypertext and created a prototype based on that model. Their tool, called StoryMINE, is one of the first attempts at this novel category of storytelling. The basis of this project was a previous work by Spawforth and Miller [100], in which authors create a framework for multi-participant interactive narratives. The framework was built upon a systematic analysis of 56 interactions across 17 multiplayer games and tested on 3 novel multiplayer games.
For the rest of the projects in the Game category, different proprietary approaches were followed. Bhide et al. [111] experimented on virtual reality games and analyzed the spatial sound serving the storytelling. Adversario [62] is an implemented system for creating interactive narrative games where autonomous agents are guided by an adversarial planner which conflicts with player goals. The world and agents are created procedurally and interaction with users occurs via a text interface. Cardona-Rivera et al. [101] attempted to formalize the narrative design for games, using a method called GFI (Goals, Feedback, Interpretation). The GFI framework attempts to bridge the gap between narrative design, game development, story analysis and game research. The authors also attempted to elucidate the potential of GFI as a general method for creating game narratives. Martens et al. [45,46] presented a more advanced authoring tool called Villanelle (Figure 5) which automates the creation of characters for storytelling. Their approach is language-based and they created algorithms using behavior trees (BT). The authors chose BTs because of their wide adoption in the game industry by designers. Villanelle is an API framework but also a standalone tool to author every part of an interactive narrative experience. Finally, as discussed above, Novella [17] is a DS authoring tool that targets video game stories.

2.5. Narrative Systems in Healthcare

Stories can indeed help people when in need, mentally or physically. Narrating the right story can work positively for the elderly, or for people in pain or discomfort. Bowman [69] used textual narratives against patient loneliness and isolation which originate from real patient experiences, gathered in interviews, and foster a sense of companionship. Companionship for the elderly was also the purpose of a social robot application created by Paradeda et al. [105]. This robot can entertain by choosing and narrating stories. Tokunaga et al. [68] proposed another robotic storytelling system that can improve the mental health and quality of life of older adults by conducting story dialogues. The purpose of these dialogues (sets of questions and answers) is to build resilience against cognitive decline because of age. The system is designed to be used as cognitive training on a daily basis.

2.6. Newer Genres in Interactive Narrative

The use of interactive narratives is less popular in some fields, either because the technology is not mature yet, or because the idea of using interactive narratives in these fields has not been developed enough. Researchers of IDN consider the following as newer genres in IDN.

2.6.1. Performing Arts

According to Rousse [96], digital storytelling traditionally used canned media, meaning that stories could be predefined or at least based on known data going in predefined directions. In theater and other performing arts, narratives emerge, and they are real-time and responsive. Real-time media dominate the 21st century, an era referred to by researchers as post-digital. Barnard [112] focused on the question of how theatrical and performative practices inform interactive digital narratives and vice versa, with the case study of fanSHEN, a theatre company advanced in interactive digital performances. Looking for Love was their first attempt on IF.
Vox Populi [113] is a card-based interactive theatre game that explores the mechanics of media narratives and representations of the European refugee crisis. It combines existing interactive narrative techniques and models, gamification and theatrical performance to produce new IDS forms. Green et al. [41] attempted to connect the audience’s input with performer output during live performances using finite state machines. The authors developed a software called Data Generation Engine (DGE). With DGE, data are generated to be used by performers for creating and developing narratives. Additionally, DGE provides audiences with the opportunity of manipulating data generation and distribution. That way, performers and audience are connected and co-create narratives without the performance being disrupted. An unexpected mixing of technologies occurred in The Thousand Autumns of Jacob de Zoet [71], where students managed to mix a radio-broadcasted drama novel with VR. This experiment intended to explore new insights into the practice of storytelling for VR.

2.6.2. Cinematic Interactive Narratives

WCIN is a term referring to cases where cinematography theory and practices are blended with IDN tools and methods. Such an approach to computational storytelling can be seen in ShowRunner [48]. The authors present a tool that can visualize stories in a cinematic way, within a 3D game environment. As described, ShowRunner gets as an input an abstract of the story, along with some declarative specifications of the story script. It also gets a set of mappings between terms in the story and data elements in the game engine and then executes the story’s actions. The overall approach is based on Unity and is available online 3. Similarly, FireBolt [73] is a system for automated low-level cinematic narrative realization, as its title defines. Machinima, a term used in cinematography, is a method of making an animated film using software designed for making video and computer games. FireBolt is suitable for use as a rendering system for a range of machinima-producing enterprises, from fully generative narrative systems to direct human authorship. Its algorithms handle aspects of cinematography such as camera angle, framing, movements, focal length, aperture, and depth of field. Dowling et al. [74] presented their case study on the VR film Faoladh 4 (Figure 6). The creators of Faoladh describe the film as “a stereoscopic virtual reality film that follows the perilous journey of a 9th-century Irish child whose village is attacked by Viking raiders”. In this paper, the authors researched the way cinematic storytelling has been adapted to VR. They deal with the challenge of making spectators focus on the stage where the plot is evolving and not the environment.
In a similar way as above, Vosmeer and Schouten [114], in their research project called Project Orpheus, examined VR as a new way of storytelling in the filmmaking industry. In the same project, they used 3D audio to guide the viewers’ attention in VR. Pillai and Verma [115] attempted to illustrate the significance of narrative immersion concerning the 360° medium of storytelling in VR, thus helping filmmakers to create effective narrative experiences. In a video game or a film that uses VR or 360° video, the prominent question is how to make users focus on the place where the narrative really happens. Ko et al. [109] discussed making new narrative structures because of issues such as that.
Kampa [110] studied the complexity of combining IDS components with AR technology, to produce systems for entertainment computing. New forms of media and experiences could arise, but according to the author, no publicly available authoring tool exists for producing such systems; instead, they are made from scratch by programmers and content authors from different fields.

2.6.3. Interactive Documentaries (iDocs)

With the term iDoc, we refer to a kind of documentary in which interaction with the audience is possible. As discussed before, Mu [19] delved into interactive documentary narratives. iDocs narrate real stories (in contrast with IF) and permit the audience to interact with reality. In his survey, he aimed at building a new systematic theory, based on the projects of previous researchers. Basaraba et al. [75] investigated cultural heritage under the iDocs genre with respect to creating a prototype for user testing titled “Sentenced to Transportation: A Virtual Tour of Australia’s Convict Past”. The authors analyzed perceived agents based on the narrative structure, choices provided in the interface design, and the ability to persuade further user participation and concluded that iDocs holds a high replay value.
Tell a Tail 360° [76] is a project designed for teenagers, that uses 360° video and VR technologies that expose the audience to animal welfare issues (Figure 7). It is an immersive, interactive documentary, designed in Unity for Oculus VR equipment and could be used in the classroom, as part of an educational course.

2.6.4. Interactive News

News are actual narratives, presenting nonfictional events. As the era of newspapers seems to have completely passed, we mostly consume news on mobile applications and feeds. They still have the traditional look and feel of a newspaper but can be interactive and combined with technologies such as AR and VR. Svensson et al. [77] created a demo of a VR application to present interactable news of an AR news service. Users can navigate in news via a geographic map on which news have been positioned. They experimented with the demo with young people aged 16–25 as potential users of AR news services.
Stavrakakis [78] created a system that takes RSS feeds from Greek news sites and parses through text to locate places and locations on a map. It presents news pinned on the map in an interactive way and in real-time.

3. Media and Interaction on Related Work

After classifying all the works according to their objectives, we proceed in discussing the employed media and form of interaction (Table 4). In some works, the narration comes in the form of text, while in others, it may be audio, visual, or may take a more specific form. Virtual and Augmented Reality technologies are very often used to enhance the user experience and immersion in virtual worlds. A portion of the projects relies on user interaction to create narratives on real, tangible objects. Even more notably, some projects use robotic mechanisms and narrative systems are embodied.

3.1. Tangible Interactive Narratives

Crafting interactive narratives under a tangible method has been under research for decades. For example, Gorbet et al. [127] used plastic triangles to create stories and the popular Rory’s Story Cubes was invented in 2004. Nevertheless, research on IN over the years mostly focused on screen-based applications and algorithms. Echeverri et al. [63] contributed to the body of works about tangible storytelling with Letters to José. This is a hybrid system using both digital and tangible artifacts, enabled by multimodal interactions. It is based on the letters written in the period 1948–1957, in Colombia, between two brothers. The authors created cards, as in a cardboard game and a digital system, which combined and led to a narrative system about life in that period. In addition, the authors attempted to create a theoretical basis for tangible narrative (TN) systems by defining associated terms. Prior to this project, Catala et al. [128] organized a workshop in which participant researchers tried to delve into the opportunities and challenges of TN. Chu [102] researched the use of tangible narrative interfaces for learning about and reflecting on cultural practices. The final target of this research is the design of a tangible interface, based on narrative content and supported by meaningful interactions. In a later project [103], she designed a framework for digitally presenting cultural heritage artifacts. Her tangible and embodied narrative framework (TENF) was used on a pilot project called Mapping Place to show that TNs help visitors to create a personal connection with a museum artifact.
Olegoru [64] is a sound composition tool in the form of “magic gloves” and “soul stones” to augment children’s storytelling when using physical objects. According to the authors, “children can create contextual and regional sound effects as well as event-based acoustics through speech, non-verbal and gestural interaction, and could potentially enable children to create more immersive story-worlds”. Another work focused on children is the one of Chu et al. [104] to support children’s creative self-efficacy and creative thinking in storytelling. The authors proposed a method in which children use real-world objects and act to create animated stories and enhance their creativity. Examples of these stories can be found on YouTube.
Vim [65] is a tangible interactive narrative about energy (Figure 8). According to the authors, “it is designed to illustrate how a story about a public issue could be designed for physical interaction and whether that interaction can encourage participation in that issue”. Vim is a wooden box with buttons and switches that includes a variety of technologies (like a thermal printer and cellular network connection) that print a story for the user according to his options. The main theme of the story is energy and there is a question for each reader to answer.

3.2. Gesture Recognition Narrative Systems

There are systems that create stories upon users’ gestures (mainly predefined gestures). Brown et al. [47] attempted to improve the functionality of systems such as by teaching them about design implications from feature analysis of iconic gestures during storytelling, as their title implies. In other words, they recorded gestures from 20 participants over the same stories, and by analyzing them, they produced iconic gestures, that is, representational gestures that provide information about objects such as their shape, location, or movement. Their work is based on that of other researchers in the field of gesture recognition [66,129,130].

3.3. Embodied Storytelling Systems

Embodied storytelling systems are actual hardware systems, usually human-like, but can possibly have any other organic shape and can process narratives. Wicke et al. [131] attempted an approach to the concepts of IDS, where stories become physical movements —gestures in an embodied system (robot) aiming at a direct meaning transmission and communication. The project is based on the previous work of the same researchers [132]. Social robots are often used as companions for the elderly, for educational purposes and during medical rehabilitation [133]. Paradeda et al. [105,134] studied the impact of social robots as storytellers and the way their personality (if existent) affects listeners (Figure 9). In another work by the same authors [106], where autonomous social robots are used as storytellers, research was focused on the power of the machines to convince the audience to follow a specific trajectory of the story. On a similar path, Striepe and Lugrin [107] researched how emotional robot storytellers support stories better than neutral social robots. Ozaeta and Graña [108] proposed digital storytelling as a central tool for social robotics and they emphasized the importance of DS in education.

3.4. Mixing AR, VR, 360° Video and Animation Technologies

When mixing technologies, we can benefit from the powerful elements of each one, in the creation and reproduction of stories for any purpose. For example, Svensson [70] used VR as a simulation environment for AR digital storytelling on cultural heritage sites (Figure 10). On the other hand, technologies such as VR and AR can make things more complicated, as they raise new challenges. For example, one challenging objective when creating VR content or a 360° video is how to make spectators focus on a specific part of the visual content. Kampa [110] studied the complexity of combining IDS components with AR technology to produce systems for entertainment computing. New forms of media and experiences could arise, but according to the author, no publicly available authoring tool exists for producing such systems, with the content being made from scratch by programmers and content authors from different fields. Additionally, Bhide et al. [111] combined IDS with VR technology and focused on spatial sound as a storytelling tool in a virtual game environment. Implementing a more complex idea, students in The Thousand Autumns of Jacob de Zoet [71] managed to combine a radio-broadcasted drama novel with virtual reality.

4. Discussion

General thoughts: As discussed above, the research field of interactive and computational DS is broad and expanding in several directions. The reason for that is the acceptance of DS as a method, because of the simplicity in its base, the ease of use and understanding, and the fact that, in the end, narrating a story is a simple natural human activity. We tell our stories from the period we start to talk. In addition, humans evolve in storytelling as they get older. We obtain an education, we socialize, we have to deal with everyday demands, and storytelling is interwoven into our life, appearing almost everywhere; at work, in family life, in social life, in education, in entertainment, in relationships, and so forth. As we advanced in the digital era, narratives also took digital forms and started traveling the globe at high speeds. News can travel all over the world almost instantly, films have their “global premiere” across continents (at least before the COVID-19 era), video games are massively sold through web stores, and TV shows are broadcasted through international online TV services and platforms. Literature and books, in general, took a digital form “for the well-being of the environment”, and as a result of all the above, newer generations are being exposed to more narratives than ever before. Young people are “tuned” globally through social media and societies are slowly shifting to a cultural equilibrium where everybody’s personal story can potentially have a global audience and acceptance.
The findings, after analyzing all the aforementioned works, are that the field is active and attracts many researchers, who come from different domains. They create applications and tools able to speed up the writing of new narratives but also manage to enrich these narratives with multiple media, giving them new dimensions. The areas of application of these narratives can be museums and cultural sites, schools, health and entertainment venues, video games, and so forth. Many research projects do not progress to any implementation but provide ideas, reflections, and thoughts for future projects. They result in theoretical frameworks and system designs that can form the basis for a subsequent project. Other projects result in portable applications, capable of creating or managing narratives to serve a specific purpose. Some of the apps that have been built are actually authoring tools that can be used to develop narratives with speed and relevance to a topic. These narratives generally obey rules to serve the purpose for which they are written, without deviating in terms of the impact they can have; they are free from prejudice, discrimination, and offensive or disturbing content. Some other implementations try to avoid the trend of the last decade and stay out of the screen of mobile devices. They result in tangible objects that the user can interact with in order to create a narrative. Selections are made by pressing buttons, pulling levers, dragging faders, flipping switches, turning knobs, gesturing in the air, and speaking. They require the physical participation of the user and the activation of the senses of touch and hearing. Some tangible implementations are autonomous robotic mechanisms that can move, respond to their user’s choices, and create narratives (usually in audio form), giving the feeling of communicating with an intelligent being. These implementations have been used in medical applications, to rehabilitate patients as well as provide care to the elderly. They have also been used in museums around the world. A typical example is the robot Pepper from Softbank Robotics, which is used to welcome people and provide information, in the Smithsonian museum. AR and VR technologies are widely used in storytelling. Despite their disadvantages, such as their cost and consequently low availability to the general public, their bulk, and weight, as well as the nausea they can cause to the user, they remain the most powerful means of user engagement, participation, and immersion in the world of the narrative. They offer a very powerful user experience and therefore cannot be ignored by the creators.
Future trends: In university education, it is expected that programs for the design of interactive narratives are going to appear. In fact, these programs are likely to be found in departments of theoretical as well as technological studies. In school education, technologies associated with storytelling will make it very easy to create interactive narratives in the classroom, even by elementary students.
Social robots will be used more and more. Whether in hospital care or caring for the elderly and disabled at home, they offer valuable companionship and communication. The evolution of speech and conversational algorithms will increase their usability, and ultimately, their demand.
It is expected that narratives created by computational methods, and more specifically by AI systems such as GPT3 [119], will start to be used more and more in everyday applications, such as writing letters and simple emails, professional text, websites, and so forth. However, what is of more interest to the present research is the ability of these systems to produce text in more complex ways, for example in cultural heritage applications to make descriptions of artworks, museum tours, recommendations for sightseeing routes, and so forth. Museums already use storytelling systems that include audio, video, VR and AR, robotic systems, and so forth. Until now, however, all narrations are pre-recorded and pre-planned, specific for each point and exhibit. What will be more interesting to see are emergent storytelling systems, where every tour, description, and recommendation are created instantly, and personalized for each visitor.
The gaming industry has always led technological developments due to its very large appeal to the public. Games are becoming more and more complex in terms of their plot and are converging towards cinema, where complete scenarios are required, with a plot that can deviate according to the user’s choices. This has never been easy to implement, but the emergent storytelling methods make it much easier to develop more interesting games, tailored to the player’s reactions and character. The same also holds true for the film industry, but even more impressively for live theater performances, where the scenario to be followed is created in real-time, due to the audience reactions in certain ways. Documentaries and news stories are not expected to remain unaffected by all these developments, as any other human activity related to the creation and presentation of text and narratives. ChatGPT has been accepted by the public with enthusiasm and companies are investing huge amounts in the further development of tools that will lead us to a new era of searching for knowledge on the Web.
The AI factor: Creating narratives with computational methods can be seen either as a natural evolution or as an abnormal situation in which we are losing a skill that is purely human. AI can be scary in all its forms and uses, as human activities are being replaced eventually by smart systems and algorithms, but this kind of fear follows our being since the 19th-century industrial revolution. What happened then is that many people lost their jobs as they had been replaced by machines and entire societies had to transform and adapt to new conditions. Tools and methods presented in this paper try to assist and not replace people in the creative process of storytelling. They can be used as tools for organizing fast and massively producing, distributing, enhancing and enriching stories, in a way that is beneficial for all audiences and every kind of use. The questions that follow the analysis of the above works is whether the time will finally arrive when human intervention will not be needed to create narratives and whether we really want that. The GPT system as well as other AI systems in development can create texts and narratives with increasing, to a frightening point, ease and fidelity. The boundaries between human and artificial creativity begin to blur. However, we must not forget that these systems are self-trained through the data they are fed, which might (the data) not always be accurate or complete. They may contain misinterpretations, incorrect conclusions, and ambiguities. So when we have scientific applications where we need to be precise, we certainly cannot trust such a system to build our narratives. In other words, for example, we cannot yet trust a system to be our personal guide in the archaeological Acropolis museum and answer all our questions regarding the exhibits, without falling into errors and contradictions. Furthermore, narratives always contain local cultural elements, as well as personal opinions and perceptions. In order for a system to be able to reliably create a narrative, it must have cultural knowledge and experiences transferred to it (machine enculturation) and, on the other hand, it must have formed its own personal opinions; that is, it must have its own personality.
The technologies that have been developed do not yet allow us to create fully automated narratives and that is probably not the point. They help us in terms of productivity, speed, enrichment, distribution, and availability, but they require human involvement and intervention. To build on the previous example, it is not possible, and perhaps not even desirable, to have an automated tour guide in a museum that knows every detail of the exhibits and can answer every question accurately. However, we can have tools that can make that visit to the museum much more interesting. Especially for the “difficult” ages of children and teenagers, these tools add elements of gamification and simplify the educational process.
Interaction with the narratives and UX: Summarizing Table 4 and in relation to user experience, it appears that all projects that have some kind of implementation can be divided into two broad categories; those that rely exclusively on the existence of a screen (computer, mobile device, VR or AR goggles) and those that either avoid the use of a screen (altogether, or use it in a limited way and in combination with another object). Projects in the former category far outnumber those in the latter. Another general observation is that audio is, in principle, an under-represented medium, despite its well-known importance in storytelling. Creators focus on the methodology for creating stories, their feasibility, distribution methods, modes and degree of interaction, and user interface design, but in the end, it is all too common to put aside issues related to quality, direction, type (binaural vs stereo), ways of integration, and the technical means for audio. In any case, creators try to make the most of all available technologies, old and new, to create the richest and most engaging user experience possible.
Where do these works come from: For those projects of Table 4 that included some form of implementation, an attempt was also made to locate them geographically, that is, to find in which countries and places they were implemented and utilized. This is a type of information that is not always available and so with all due caution, we note the following; of the 30 projects in Table 4, 12 are from the Americas (USA and Canada), 11 are from Europe (from 9 different countries), 7 are from Asia (China, Korea, India, and Japan), and 1 is from Oceania (Australia). Almost all projects have been implemented and tested in universities and research centers. A couple of them have also been tested in schools, with students [93,94]. Those research centers were all pinned on a map as a visual representation 5. The Emotive project [125] has been implemented in the Hunterian Museum in Glasgow and in the Ancient Agora in Athens, while the CHESS project [124] has been tested in the Acropolis Museum in Athens, with hundreds of visitors from all over the world. Social robots [133] were used in hospitals. Vim [65] was placed on a public road in Brisbane Australia, to be tested by bystanders. Being there [6] was tested by 35 people in Edinburgh UK, while Psomadaki et al. [13] performed their tests with 328 people in Thessaloniki, Greece. Some works such as Villanelle [45] and Fadolah [74] were placed online to be tested and reviewed by the public. fanSHEN [112] has been performed for 10 years in theaters in the UK. In conclusion, the examined projects span four continents and have been tested by countless people in a variety of ways.

5. Conclusions and Future Work

Numerous projects are aiming at designing and creating software and hardware tools that assist in the creation of stories. These tools use algorithms for automating procedures, such as the creation of characters, environment and a plot, or can just provide an environment with templates for the faster creation of stories. The stories created are suitable for specific uses, or they could be general-purpose stories that could fit in more applications. In this survey, we have set a taxonomy of works, according to their purpose and scope, and we have analyzed them to discover the emerging trends in the research field. Thus, AI methodologies seem to be gaining ground, in combination with AR and VR technologies. Companies, universities, and researchers invest time and money in the development of AI algorithms and systems that can create multimedia content, but also in the development of virtual and augmented reality technologies and applications, for everyday and widespread use by larger audiences. The GPT system (GPT3, as of writing) is expanding exponentially and becoming more and more efficient in creating narratives. Based on the latest machine learning methods, these systems learn by themselves by crawling web pages and by collecting crowdsourced data. However, as they proliferate, they also create new technological challenges such as whether the data they collect is correct and accurate, free from bias, whether such a system can distinguish cultural differences between countries, races, and ethnicities and reproduce them when necessary or whether it is possible to manipulate the system to produce a text that follows specific rules, without deviating from a desirable trajectory.
Continuing our research, we will try to train GPT3 models using valid scientific data related to the artifacts of a specific exhibition in the Hunterian Museum in Glasgow, Scotland. The relevant data have been collected by other researchers in the field [125], who also created audio narratives that are broadcasted inside the museum. Next, we plan on instructing the system to create new narratives and answer related questions and report on our results.

Author Contributions

Conceptualization, G.T. and G.C.; methodology, G.T.; validation, G.A. and G.C.; formal analysis, G.T.; investigation, G.T.; resources, G.T.; data curation, G.T.; writing—original draft preparation, G.T.; writing—review and editing, G.A. and G.C.; visualization, G.T. and G.A.; supervision, G.C.; project administration, G.T. and G.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ARAugmented Reality
DSDigital Storytelling
IDSInteractive Digital Storytelling
IDNInteractive Digital Narrative
GPTGenerative Pre-trained Transformer
DNDigital Narrative
CDSComputational Digital Storytelling
CHCultural Heritage
EMExperience Manager
PWPossible Worlds
MINEMultiplayer Interactive Narrative Experience
AIArtificial Intelligence
GPSGlobal Positioning System
NPCNon-Player Character
PCGProcedural Content Generation
GFIGoals Feedback Interpretation
APIApplication Programming Interface
IFInteractive Fiction
DGEData Generation Engine
CINCinematic Interactive Narrative
iDocInteractive Documentary
TNTangible Narratives
UXUser Experience
VRVirtual Reality

Notes

1
http://tecfalabs.unige.ch/narrativeacts_vis/, accessed on 24 January 2023.
2
https://raffba.itch.io/med10, accessed on 24 January 2023.
3
4
Film available on https://tilefilms.ie/productions/faoladh/, accessed on 24 January 2023.
5

References

  1. Bedford, L. Storytelling: The Real Work of Museums. Curator Mus. J. 2001, 44, 27–34. [Google Scholar] [CrossRef]
  2. Roussou, M.; Pujol, L.; Katifori, A.; Chrysanthi, A.; Perry, S.; Vayanou, M. The Museum as Digital Storyteller: Collaborative Participatory Creation of Interactive Digital Experiences. 2015. Available online: https://mw2015.museumsandtheweb.com/paper/the-museum-as-digital-storyteller-collaborative-participatory-creation-of-interactive-digital-experiences/index.html (accessed on 24 January 2023).
  3. Ryan, J.O.; Mateas, M.; Wardrip-Fruin, N. Open Design Challenges for Interactive Emergent Narrative. In Proceedings of the ICIDS, Copenhagen, Denmark, 30 November–4 December 2015. [Google Scholar]
  4. Miller, C.H. Digital Storytelling: A Creator’s Guide to Interactive Entertainment; Routledge: London, UK, 2014. [Google Scholar]
  5. Abas, H.; Zaman, H.B. Digital Storytelling Design with Augmented Reality Technology for Remedial Students in Learning Bahasa Melayu. Glob. Learn 2010, 2010, 3558–3563. [Google Scholar]
  6. Aylett, R.; Louchart, S. Being There: Participants and Spectators in Interactive Narrative. In International Conference on Virtual Storytelling. Using Virtual Reality Technologies for Storytelling; Cavazza, M., Donikian, S., Eds.; Springer: Berlin/Heidelberg, Germany, 2007; pp. 117–128. [Google Scholar]
  7. Adams, E.W. Resolutions to Some Problems in Interactive Storytelling; Teeside University: Middlesborough, UK, 2013. [Google Scholar]
  8. Chauvin, S.; Levieux, G.; Donnart, J.Y.; Natkin, S. Making sense of emergent narratives: An architecture supporting player-triggered narrative processes. In Proceedings of the 2015 IEEE Conference on Computational Intelligence and Games (CIG), Tainan, Taiwan, 31 August–2 September 2015; pp. 91–98. [Google Scholar]
  9. Ryan, M.L. Possible Worlds, Artificial Intelligence, and Narrative Theory; Indiana University Press: Bloomington, IN, USA, 1991. [Google Scholar]
  10. Szilas, N.; Marano, M.; Estupiñán, S. A Tool for Interactive Visualization of Narrative Acts. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 176–180. [Google Scholar]
  11. Peinado, F.; Gervás, P. Transferring Game Mastering Laws to Interactive Digital Storytelling. In International Conference on Technologies for Interactive Digital Storytelling and Entertainment; Göbel, S., Spierling, U., Hoffmann, A., Iurgel, I., Schneider, O., Dechau, J., Feix, A., Eds.; Springer: Berlin/Heidelberg, Germany, 2004; pp. 48–54. [Google Scholar]
  12. Spawforth, C.; Gibbins, N.; Millard, D.E. StoryMINE: A System for Multiplayer Interactive Narrative Experiences. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 534–543. [Google Scholar]
  13. Psomadaki, O.I.; Dimoulas, C.A.; Kalliris, G.M.; Paschalidis, G. Digital storytelling and audience engagement in cultural heritage management: A collaborative model based on the Digital City of Thessaloniki. J. Cult. Herit. 2019, 36, 12–22. [Google Scholar] [CrossRef]
  14. Young, M. Planning in Narrative Generation: A Review of Plan-Based Approaches to the Generation of Story, Discourse and Interactivity in Narratives. Sprache Datenverarb. Spec. Issue Form. Comput. Model. Narrat. 2015, 37, 41–64. [Google Scholar]
  15. Shibolet, Y.; Knoller, N.; Koenitz, H. A Framework for Classifying and Describing Authoring Tools for Interactive Digital Narrative. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 523–533. [Google Scholar]
  16. Green, D.; Hargood, C.; Charles, F. Contemporary Issues in Interactive Storytelling Authoring Systems. In Proceedings of the ICIDS, Dublin, Ireland, 5–8 December 2018. [Google Scholar]
  17. Green, D. Novella: An Authoring Tool for Interactive Storytelling in Games. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 556–559. [Google Scholar]
  18. Kitromili, S.; Jordan, J.; Millard, D.E. How Do Writing Tools Shape Interactive Stories? In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 514–522. [Google Scholar]
  19. Mu, C. A Research on Storytelling of Interactive Documentary: Towards a New Storytelling Theory Model. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 181–184. [Google Scholar]
  20. Kybartas, B.; Bidarra, R. A Survey on Story Generation Techniques for Authoring Computational Narratives. IEEE Trans. Comput. Intell. AI Games 2017, 9, 239–253. [Google Scholar] [CrossRef] [Green Version]
  21. Kasunic, A.; Kaufman, G.F. Learning to Listen: Critically Considering the Role of AI in Human Storytelling and Character Creation. 2018. Available online: https://aclanthology.org/W18-1501 (accessed on 24 January 2023).
  22. Purdy, C.; Riedl, M.O. Reading Between the Lines: Using Plot Graphs to Draw Inferences from Stories. In International Conference on Interactive Digital Storytelling; Nack, F., Gordon, A.S., Eds.; Springer International Publishing: Cham, Switzerland, 2016; pp. 197–208. [Google Scholar]
  23. Van Broeckhoven, F.; Vlieghe, J.; De Troyer, O. Using a Controlled Natural Language for Specifying the Narratives of Serious Games. In International Conference on Interactive Digital Storytelling; Schoenau-Fog, H., Bruni, L.E., Louchart, S., Baceviciute, S., Eds.; Springer International Publishing: Cham, Switzerland, 2015; pp. 142–153. [Google Scholar]
  24. Riedl, M.O. Computational narrative intelligence: A human-centered goal for artificial intelligence. arXiv 2016, arXiv:1602.06484. [Google Scholar]
  25. Riedl, M.O.; Harrison, B. Using Stories to Teach Human Values to Artificial Agents. In Proceedings of the AAAI Workshop: AI, Ethics, and Society, Phoenix, AZ, USA, 12–13 February 2016. [Google Scholar]
  26. Soares, N.; Fallenstein, B. Aligning Superintelligence with Human Interests: A Technical Research Agenda; Machine Intelligence Research Institute: Berkeley, CA, USA, 2015. [Google Scholar]
  27. Mitchell, A.; Spierling, U.; Hargood, C.; Millard, D.E. Authoring for Interactive Storytelling. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 544–547. [Google Scholar]
  28. Vrettakis, E.; Kourtis, V.; Katifori, A.; Karvounis, M.; Lougiakis, C.; Ioannidis, Y.E. Narralive—Creating and experiencing mobile digital storytelling in cultural heritage. Digit. Appl. Archaeol. Cult. Herit. 2019, 15, 00114. [Google Scholar] [CrossRef] [Green Version]
  29. Pujol, L.; Roussou, M.; Poulo, S.; Balet, O.; Vayanou, M.; Ioannidis, Y.E. Personalizing Interactive Digital Storytelling in Archaeological Museums: The CHESS Project; Springer International Publishing: Cham, Switzerland, 2011. [Google Scholar]
  30. Garbe, J.; Kreminski, M.; Samuel, B.; Wardrip-Fruin, N.; Mateas, M. StoryAssembler: An Engine for Generating Dynamic Choice-Driven Narratives. In Proceedings of the 14th International Conference on the Foundations of Digital Games (FDG ’19), San Luis Obispo, CA, USA, 26–30 August 2019; Association for Computing Machinery: New York, NY, USA, 2019. [Google Scholar] [CrossRef]
  31. Miller, C.; Dighe, M.; Martens, C.; Jhala, A. Stories of the Town: Balancing Character Autonomy and Coherent Narrative in Procedurally Generated Worlds. In Proceedings of the 14th International Conference on the Foundations of Digital Games (FDG ’19), San Luis Obispo, CA, USA, 26–30 August 2019; Association for Computing Machinery: New York, NY, USA, 2019. [Google Scholar] [CrossRef]
  32. Kybartas, B.; Verbrugge, C.; Lessard, J. Subject and Subjectivity: A Conversational Game Using Possible Worlds. In International Conference on Interactive Digital Storytelling; Nunes, N., Oakley, I., Nisi, V., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 332–335. [Google Scholar]
  33. Kreminski, M.; Dickinson, M.; Wardrip-Fruin, N. Felt: A Simple Story Sifter. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Swizerland, 2019; pp. 267–281. [Google Scholar]
  34. Kawagoe, S.; Ueno, M.; Isahara, H. A study on the efficiency of creating stories by the use of templates. In Proceedings of the 2015 2nd International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA), Chonburi, Thailand, 19–22 August 2015; pp. 1–6. [Google Scholar] [CrossRef]
  35. Kybartas, B.; Verbrugge, C.; Lessard, J. Expressive Range Analysis of a Possible Worlds Driven Emergent Narrative System. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 473–477. [Google Scholar]
  36. Guzdial, M.J.; Harrison, B.; Li, B.; Riedl, M.O. Crowdsourcing Open Interactive Narrative. In Proceedings of the FDG, Pacific Grove, CA, USA, 22–25 June 2015. [Google Scholar]
  37. Howard, K.T.; Donley, R. Using Ink and Interactive Fiction to Teach Interactive Design. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 68–72. [Google Scholar]
  38. Stefnisson, I.S.; Thue, D. Mimisbrunnur: AI-Assisted Authoring for Interactive Storytelling. In Proceedings of the Fourteenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE’18), Edmonton, AB, Canada, 13–17 November; AAAI Press: Palo Alto, CA, USA, 2018. [Google Scholar]
  39. Szilas, N.; Estupiñán, S.; Richle, U. Automatic Detection of Conflicts in Complex Narrative Structures. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 415–427. [Google Scholar]
  40. Hargood, C.; Weal, M.J.; Millard, D.E. The StoryPlaces Platform: Building a Web-Based Locative Hypertext System. In Proceedings of the 29th on Hypertext and Social Media (HT ’18), Baltimore, MD, USA, 9–12 July 2018; Association for Computing Machinery: New York, NY, USA, 2018; pp. 128–135. [Google Scholar] [CrossRef] [Green Version]
  41. Green, D.; Hargood, C.; Charles, F. A Novel Design Pipeline for Authoring Tools. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 102–110. [Google Scholar]
  42. Vrettakis, E.; Lougiakis, C.; Katifori, A.; Kourtis, V.; Christoforidis, S.; Karvounis, M.; Ioanidis, Y. The Story Maker—An Authoring Tool for Multimedia-Rich Interactive Narratives. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 349–352. [Google Scholar]
  43. Molnar, A.; Kostkova, P. Interactive Digital Storytelling Based Educational Games: Formalise, Author, Play, Educate and Enjoy! —The Edugames4all Project Framework. In Transactions on Edutainment XII; Springer: Berlin/Heidelberg, Germany, 2016; Volume 9292, pp. 1–20. [Google Scholar] [CrossRef]
  44. Compton, K.; Kybartas, B.; Mateas, M. Tracery: An Author-Focused Generative Text Tool. In International Conference on Interactive Digital Storytelling; Schoenau-Fog, H., Bruni, L.E., Louchart, S., Baceviciute, S., Eds.; Springer International Publishing: Cham, Switzerland, 2015; pp. 154–161. [Google Scholar]
  45. Martens, C.; Iqbal, O. Villanelle: An Authoring Tool for Autonomous Characters in Interactive Fiction. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 290–303. [Google Scholar]
  46. Martens, C.; Iqbal, O.; Azad, S.; Ingling, M.; Mosolf, A.; McCamey, E.; Timmer, J. Villanelle: Towards Authorable Autonomous Characters in Interactive Narrative. In Proceedings of the INT/WICED@AIIDE, Edmonton, AL, Canada, 13–14 November 2018. [Google Scholar]
  47. Brown, S.A.; Chu, S.L.; Quek, F.; Canaday, P.; Li, Q.; Loustau, T.; Wu, S.; Zhang, L. Towards a Gesture-Based Story Authoring System: Design Implications from Feature Analysis of Iconic Gestures During Storytelling. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 364–373. [Google Scholar]
  48. Sanghrajka, R.; Young, R.M.; Salisbury, B.; Lang, E.W. ShowRunner: A Tool for Storyline Execution/Visualization in 3D Game Environments. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 323–327. [Google Scholar]
  49. Battad, Z.; White, A.; Si, M. Facilitating Information Exploration of Archival Library Materials Through Multi-modal Storytelling. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 120–127. [Google Scholar]
  50. Katsui, T.; Ueno, M.; Isahara, H. A creation support system to manage the story structure based on template sets and graph. In Proceedings of the 31st Annual Conference of the Japanese Society for Artificial Intelligence, 4F1-3in2, Nagoya, Japan, 30 July 2018. [Google Scholar]
  51. Katsui, T.; Ueno, M.; Isahara, H. An analysis on the process of creating stories by the creation support system. In Proceedings of the 2017 International Conference on Advanced Informatics, Concepts, Theory, and Applications (ICAICTA), Denpasar, Indonesia, 16–18 August 2017; pp. 1–5. [Google Scholar]
  52. Battad, Z.; Si, M. Apply Storytelling Techniques for Describing Time-Series Data. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 483–488. [Google Scholar]
  53. Kapadia, M.; Frey, S.; Shoulson, A.; Sumner, R.W.; Gross, M.H. CANVAS: Computer-assisted narrative animation synthesis. In Proceedings of the Symposium on Computer Animation, Zurich, Switzerland, 11–13 July 2016. [Google Scholar]
  54. Alinam, M.; Ciotoli, L.; Koceva, F.; Torre, I. Digital Storytelling in a Museum Application Using the Web of Things. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 75–82. [Google Scholar]
  55. Cesário, V.; Olim, S.; Nisi, V. A Natural History Museum Experience: Memories of Carvalhal’s Palace—Turning Point. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 339–343. [Google Scholar]
  56. Revells, T.; Chai, Y. Digital Narrative, Documents and Interactive Public History. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 361–364. [Google Scholar]
  57. Suckling, M. Dungeon on the Move: A Case Study of a Procedurally Driven Narrative Project in Progress. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 144–147. [Google Scholar]
  58. De Kegel, B.; Haahr, M. Towards Procedural Generation of Narrative Puzzles for Adventure Games. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 241–249. [Google Scholar]
  59. Morgan, L.; Haahr, M. Honey, I’m Home: An Adventure Game with Procedurally Generated Narrative Puzzles. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 335–338. [Google Scholar]
  60. Kreminski, M.; Wardrip-Fruin, N. Throwing Bottles at God: Predictive Text as a Game Mechanic in an AI-Based Narrative Game. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 275–279. [Google Scholar]
  61. Nielsen, T.L.; Rafferty, E.I.; Schoenau-Fog, H.; Palamas, G. Embedded Narratives in Procedurally Generated Environments. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 30–43. [Google Scholar]
  62. Miller, C.; Dighe, M.; Martens, C.; Jhala, A. Crafting Interactive Narrative Games with Adversarial Planning Agents from Simulations. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 44–57. [Google Scholar]
  63. Echeverri, D.; Wei, H. Letters to José: A Design Case for Building Tangible Interactive Narratives. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 15–29. [Google Scholar]
  64. Huang, C.C.; Lin, Y.J.; Zeng, X.; Newman, M.; O’Modhrain, S. Olegoru: A Soundscape Composition Tool to Enhance Imaginative Storytelling with Tangible Objects. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’15), Stanford, CA, USA, 15–19 January 2015; Association for Computing Machinery: New York, NY, USA, 2015; pp. 709–714. [Google Scholar] [CrossRef]
  65. Doherty, S.; Snow, S.; Jennings, K.; Rose, B.; Matthews, B.; Viller, S. Vim: A Tangible Energy Story. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 271–280. [Google Scholar]
  66. Liang, H.; Chang, J.; Kazmi, I.K.; Zhang, J.J.; Jiao, P. Hand gesture-based interactive puppetry system to assist storytelling for children. Vis. Comput. 2017, 33, 517–531. [Google Scholar] [CrossRef] [Green Version]
  67. Wicke, P.; Veale, T. Wheels Within Wheels: A Causal Treatment of Image Schemas in An Embodied Storytelling System. In Proceedings of the TriCoLore, Bozen-Bolzano, Italy, 13–15 December 2018. [Google Scholar]
  68. Tokunaga, S.; Seaborn, K.; Tamura, K.; Otake-Matsuura, M. Cognitive Training for Older Adults with a Dialogue-Based, Robot-Facilitated Storytelling System. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 405–409. [Google Scholar]
  69. Bowman, A. Creating a Virtual Support Group in an Interactive Narrative: A Companionship Game for Cancer Patients. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 662–665. [Google Scholar]
  70. Svensson, T. Using VR to Simulate Interactable AR Storytelling. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 328–332. [Google Scholar]
  71. Vosmeer, M.; Sandovar, A.; Schouten, B. From Literary Novel to Radio Drama to VR Project. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 392–400. [Google Scholar]
  72. Green, C.P.; Holmquist, L.E.; Gibson, S. Towards the Emergent Theatre: A Novel Approach for Creating Live Emergent Narratives Using Finite State Machines. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 92–101. [Google Scholar]
  73. Thorne, B.R.; Winer, D.R.; Barot, C.; Young, R.M. Firebolt: A System for Automated Low-Level Cinematic Narrative Realization. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 333–342. [Google Scholar]
  74. Dowling, D.; Fearghail, C.O.; Smolic, A.; Knorr, S. Faoladh: A Case Study in Cinematic VR Storytelling and Production. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 359–362. [Google Scholar]
  75. Basaraba, N.; Conlan, O.; Edmond, J.; Arnds, P. User Testing Persuasive Interactive Web Documentaries: An Empirical Study. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 83–91. [Google Scholar]
  76. Bala, P.; Dionisio, M.; Andrade, T.; Nisi, V. Tell a Tail 360: Immersive Storytelling on Animal Welfare. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 357–360. [Google Scholar]
  77. Svensson, T.; Holloway-Attaway, L.; Beroldy, E. Leaving the Small Screen: Telling News Stories in a VR Simulation of an AR News Service. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 352–355. [Google Scholar]
  78. Stavrakakis, N. Live News Visualization on the Map of Greece. 2020. [Google Scholar]
  79. Martin, L.J.; Harrison, B.; Riedl, M.O. Improvisational Computational Storytelling in Open Worlds. In International Conference on Interactive Digital Storytelling; Nack, F., Gordon, A.S., Eds.; Springer International Publishing: Cham, Switzerland, 2016; pp. 73–84. [Google Scholar]
  80. Berov, L. A Character Focused Iterative Simulation Approach to Computational Storytelling. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 494–497. [Google Scholar]
  81. Schoenau-Fog, H. Adaptive storyworlds. In International Conference on Interactive Digital Storytelling; Springer: Berlin/Heidelberg, Germany, 2015; pp. 58–65. [Google Scholar]
  82. Womack, J.; Freeman, W. Interactive Narrative Generation Using Location and Genre Specific Context. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 343–347. [Google Scholar]
  83. Austin, J. The Book of Endless History: Authorial Use of GPT2 for Interactive Storytelling. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 429–432. [Google Scholar]
  84. Kreminski, M.; Wardrip-Fruin, N. Sketching a Map of the Storylets Design Space. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 160–164. [Google Scholar]
  85. Martin, L.J.; Ammanabrolu, P.; Wang, X.; Hancock, W.; Singh, S.; Harrison, B.; Riedl, M.O. Event Representations for Automated Story Generation with Deep Neural Nets. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence (AAAI’18/IAAI’18/EAAI’18), New Orleans, LA, USA, 2–7 February 2018; AAAI Press: Palo Alto, CA, USA, 2018. [Google Scholar]
  86. Amos-Binks, A.; Potts, C.; Young, R. Planning Graphs for Efficient Generation of Desirable Narrative Trajectories. Proc. AAAI Conf. Artif. Intell. Interact. Digit. Entertain. 2021, 13, 146–153. [Google Scholar] [CrossRef]
  87. Xu, W.; Hargood, C.; Tang, W.; Charles, F. Towards Generating Stylistic Dialogues for Narratives Using Data-Driven Approaches. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 462–472. [Google Scholar]
  88. Short, E. Beyond branching: Quality-based, salience-based, and waypoint narrative structures. Available online: https://emshort.blog/2016/04/12/beyond-branching-quality-based-and-salience-based-narrative-structures/ (accessed on 24 January 2023).
  89. Koenitz, H.; Dubbelman, T.; Knoller, N.; Roth, C.; Haahr, M.; Sezen, D.; Sezen, T.I. Card-Based Methods in Interactive Narrative Prototyping. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 552–555. [Google Scholar]
  90. Koenitz, H.; Dubbelman, T.; Roth, C. An Educational Program in Interactive Narrative Design. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 22–25. [Google Scholar]
  91. Bernstein, M.; Palosaari Eladhari, M.; Koenitz, H.; Louchart, S.; Nack, F.; Martens, C.; Rossi, G.C.; Bosser, A.G.; Millard, D.E. ICIDS2020 Panel: Building the Discipline of Interactive Digital Narratives. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 3–11. [Google Scholar]
  92. Shelton, C.C.; Warren, A.E.; Archambault, L.M. Exploring the Use of Interactive Digital Storytelling Video: Promoting Student Engagement and Learning in a University Hybrid Course. TechTrends 2016, 60, 465–474. [Google Scholar] [CrossRef]
  93. Rizvic, S.; Boskovic, D.; Okanovic, V.; Sljivo, S.; Zukic, M. Interactive digital storytelling: Bringing cultural heritage in a classroom. J. Comput. Educ. 2019, 6, 143–166. [Google Scholar] [CrossRef]
  94. Smith, A.; Mott, B.; Taylor, S.; Hubbard-Cheuoua, A.; Minogue, J.; Oliver, K.; Ringstaff, C. Toward a Block-Based Programming Approach to Interactive Storytelling for Upper Elementary Students. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 111–119. [Google Scholar]
  95. Rizvic, S.; Djapo, N.; Alispahic, F.; Hadzihalilovic, B.; Cengic, F.F.; Imamovic, A.; Okanovic, V.; Boskovic, D. Guidelines for interactive digital storytelling presentations of cultural heritage. In Proceedings of the 2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), Athens, Greece, 6–8 September 2017; pp. 253–259. [Google Scholar] [CrossRef]
  96. Rouse, R. Partners: Human and Nonhuman Performers and Interactive Narrative in Postdigital Theater. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 369–382. [Google Scholar]
  97. Strugnell, J.; Berry, M.; Zambetta, F.; Greuter, S. Narrative Improvisation: Simulating Game Master Choices. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 428–441. [Google Scholar]
  98. Kawano, Y.; Takaya, E.; Yamanobe, K.; Kurihara, S. Automatic Plot Generation Framework for Scenario Creation. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 453–461. [Google Scholar]
  99. Robertson, J.; Young, R.M. Automated Gameplay Generation from Declarative World Representations. Proc. AAAI Conf. Artif. Intell. Interact. Digit. Entertain. 2021, 11, 72–78. [Google Scholar] [CrossRef]
  100. Spawforth, C.; Millard, D.E. A Framework for Multi-participant Narratives Based on Multiplayer Game Interactions. In International Conference on Interactive Digital Storytelling; Nunes, N., Oakley, I., Nisi, V., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 150–162. [Google Scholar]
  101. Cardona-Rivera, R.E.; Zagal, J.P.; Debus, M.S. GFI: A Formal Approach to Narrative Design and Game Research. In International Conference on Interactive Digital Storytelling; Bosser, A.G., Millard, D.E., Hargood, C., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 133–148. [Google Scholar]
  102. Chu, J.H. Designing Tangible Interfaces to Support Expression and Sensemaking in Interactive Narratives. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, Stanford, CA, USA, 15–19 January 2015. [Google Scholar]
  103. Chu, J.H.; Mazalek, A. Embodied Engagement with Narrative: A Design Framework for Presenting Cultural Heritage Artifacts. Multimodal Technol. Interact. 2019, 3, 1. [Google Scholar] [CrossRef] [Green Version]
  104. Chu, S.L.; Quek, F.; Sridharamurthy, K. Augmenting Children’s Creative Self-Efficacy and Performance through Enactment-Based Animated Storytelling. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’15), Stanford, CA, USA, 15–19 January 2015; Association for Computing Machinery: New York, NY, USA, 2015; pp. 209–216. [Google Scholar] [CrossRef]
  105. Paradeda, R.; Ferreira, M.J.; Martinho, C.; Paiva, A. Communicating Assertiveness in Robotic Storytellers. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 442–452. [Google Scholar]
  106. Paradeda, R.; Ferreira, M.J.; Martinho, C.; Paiva, A. Would You Follow the Suggestions of a Storyteller Robot? In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 489–493. [Google Scholar]
  107. Striepe, H.; Lugrin, B. There Once Was a Robot Storyteller: Measuring the Effects of Emotion and Non-verbal Behaviour. In International Conference on Social Robotics; Kheddar, A., Yoshida, E., Ge, S.S., Suzuki, K., Cabibihan, J.J., Eyssel, F., He, H., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 126–136. [Google Scholar]
  108. Ozaeta, L.; Graña, M. On Intelligent Systems for Storytelling. In Proceedings of the International Joint Conference SOCO’18-CISIS’18-ICEUTE’18, San Sebastian, Spain, 6–8 June 2018; Graña, M., López-Guede, J.M., Etxaniz, O., Herrero, Á., Sáez, J.A., Quintián, H., Corchado, E., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 571–578. [Google Scholar]
  109. Ko, D.u.; Ryu, H.; Kim, J. Making New Narrative Structures with Actor’s Eye-Contact in Cinematic Virtual Reality (CVR). In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 343–347. [Google Scholar]
  110. Kampa, A. Authoring Concepts and Tools for Interactive Digital Storytelling in the Field of Mobile Augmented Reality. In International Conference on Interactive Digital Storytelling; Nunes, N., Oakley, I., Nisi, V., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 372–375. [Google Scholar]
  111. Bhide, S.; Goins, E.; Geigel, J. Experimental Analysis of Spatial Sound for Storytelling in Virtual Reality. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 3–7. [Google Scholar]
  112. Barnard, D. fanSHEN’s Looking for Love: A Case Study in How Theatrical and Performative Practices Inform Interactive Digital Narratives. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 401–407. [Google Scholar]
  113. Schalk, S. Vox Populi. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 408–411. [Google Scholar]
  114. Vosmeer, M.; Schouten, B. Project Orpheus A Research Study into 360° Cinematic VR. In Proceedings of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video (TVX ’17), Hilversum, The Netherlands, 14–16 June 2017; Association for Computing Machinery: New York, NY, USA, 2017; pp. 85–90. [Google Scholar] [CrossRef]
  115. Pillai, J.S.; Verma, M. Grammar of VR Storytelling: Narrative Immersion and Experiential Fidelity in VR Cinema. In Proceedings of the The 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry (VRCAI ’19), Brisbane, QLD, Australia, 14–16 November 2019; Association for Computing Machinery: New York, NY, USA, 2019. [Google Scholar] [CrossRef]
  116. Thue, D.; Schiffel, S.; Árnason, R.A.; Stefnisson, I.S.; Steinarsson, B. Delayed Roles with Authorable Continuity in Plan-Based Interactive Storytelling. In International Conference on Interactive Digital Storytelling; Nack, F., Gordon, A.S., Eds.; Springer International Publishing: Cham, Switzerland, 2016; pp. 258–269. [Google Scholar]
  117. Thue, D.; Schiffel, S.; Guethmundsson, T.P.; Kristjánsson, G.F.; Eiríksson, K.; Björnsson, M.V. Open World Story Generation for Increased Expressive Range. In International Conference on Interactive Digital Storytelling; Nunes, N., Oakley, I., Nisi, V., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 313–316. [Google Scholar]
  118. Radford, A.; Narasimhan, K. Improving Language Understanding by Generative Pre-Training. 2018. Available online: https://openai.com/blog/language-unsupervised/ (accessed on 24 January 2023).
  119. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems; Larochelle, H.; Ranzato, M.; Hadsell, R.; Balcan, M.; Lin, H. (Eds.) Curran Associates, Inc.: Red Hook, NY, USA, 2020; Volume 33, pp. 1877–1901. [Google Scholar]
  120. Schoenau-Fog, H.; Larsen, B.A. Creating Interactive Adaptive Real Time Story Worlds. In International Conference on Interactive Digital Storytelling; Rouse, R., Koenitz, H., Haahr, M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 548–551. [Google Scholar]
  121. Li, B.; Lee-Urban, S.; Johnston, G.; Riedl, M.O. Story Generation with Crowdsourced Plot Graphs. In Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence (AAAI’13); AAAI Press: Palo Alto, CA, USA, 2013; pp. 598–604. [Google Scholar]
  122. Molnar, A. The effect of interactive digital storytelling gamification on microbiology classroom interactions. In Proceedings of the 2018 IEEE Integrated STEM Education Conference (ISEC), Princeton, NJ, USA, 10 March 2018; pp. 243–246. [Google Scholar] [CrossRef] [Green Version]
  123. Rouse, R. Someone Else’s Story: An Ethical Approach to Interactive Narrative Design for Cultural Heritage. In International Conference on Interactive Digital Storytelling; Cardona-Rivera, R.E., Sullivan, A., Young, R.M., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 47–60. [Google Scholar]
  124. Vayanou, M.; Katifori, A.; Karvounis, M.; Kourtis, V.; Kyriakidi, M.; Roussou, M.; Tsangaris, M.; Ioannidis, Y.; Balet, O.; Prados, T.; et al. Authoring Personalized Interactive Museum Stories. In International Conference on Interactive Digital Storytelling; Mitchell, A., Fernández-Vara, C., Thue, D., Eds.; Springer International Publishing: Cham, Switzerland, 2014; pp. 37–48. [Google Scholar]
  125. Roussou, M.; Ripanti, F.; Servi, K. Engaging visitors of archaeological sites through ‘emotive’ storytelling experiences: A pilot at the Ancient Agora of Athens. Archeol. Calc. 2017, 28, 405–420. [Google Scholar]
  126. De Kegel, B.; Haahr, M. Procedural Puzzle Generation: A Survey. IEEE Trans. Games 2020, 12, 21–40. [Google Scholar] [CrossRef] [Green Version]
  127. Gorbet, M.G.; Orth, M.; Ishii, H. Triangles: Tangible interface for manipulation and exploration of digital information topography. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Los Angeles, CA, USA, 18–23 April 1998. [Google Scholar]
  128. Catala, A.; Theune, M.; Sylla, C.; Ribeiro, P. Bringing Together Interactive Digital Storytelling with Tangible Interaction: Challenges and Opportunities. In International Conference on Interactive Digital Storytelling; Nunes, N., Oakley, I., Nisi, V., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 395–398. [Google Scholar]
  129. Al-Shamayleh, A.S.; Ahmad, R.B.; Abushariah, M.A.A.M.; Alam, K.A.; Jomhari, N. A systematic literature review on vision based gesture recognition techniques. Multimed. Tools Appl. 2018, 77, 28121–28184. [Google Scholar] [CrossRef]
  130. Rautaray, S.S.; Agrawal, A. Vision based hand gesture recognition for human computer interaction: A survey. Artif. Intell. Rev. 2015, 43, 1–54. [Google Scholar] [CrossRef]
  131. Wicke, P.; Veale, T. Storytelling by a Show of Hands: A Framework for Interactive Embodied Storytelling in Robotic Agents. 2018. Available online: http://haddock.ucd.ie/Papers/AISB18-Wicke-Veale.pdf (accessed on 20 December 2022).
  132. Wicke, P.; Veale, T. Interview with the Robot: Question-Guided Collaboration in a Storytelling System. In Proceedings of the ICCC, Chengdu, China, 7–10 December 2018. [Google Scholar]
  133. Caić, M.; Mahr, D.; Oderkerken-Schröder, G. Value of social robots in services: Social cognition perspective. J. Serv. Mark. 2019, 33, 463–478. [Google Scholar] [CrossRef] [Green Version]
  134. Paradeda, R.B.; Martinho, C.; Paiva, A. Persuasion Based on Personality Traits: Using a Social Robot as Storyteller. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI ’17), Vienna, Austria, 6–9 March 2017; Association for Computing Machinery: New York, NY, USA, 2017; pp. 367–368. [Google Scholar] [CrossRef]
Figure 1. Evolution in computer use for digital storytelling.
Figure 1. Evolution in computer use for digital storytelling.
Heritage 06 00068 g001
Figure 2. Categorization of DS works.
Figure 2. Categorization of DS works.
Heritage 06 00068 g002
Figure 3. StoryPlaces [40].
Figure 3. StoryPlaces [40].
Heritage 06 00068 g003
Figure 4. Narralive [28].
Figure 4. Narralive [28].
Heritage 06 00068 g004
Figure 5. Villanelle [46].
Figure 5. Villanelle [46].
Heritage 06 00068 g005
Figure 6. Faoladh [74].
Figure 6. Faoladh [74].
Heritage 06 00068 g006
Figure 7. Tell a Tail 360° [76].
Figure 7. Tell a Tail 360° [76].
Heritage 06 00068 g007
Figure 8. Vim [65].
Figure 8. Vim [65].
Heritage 06 00068 g008
Figure 9. Robots as storytellers [105].
Figure 9. Robots as storytellers [105].
Heritage 06 00068 g009
Figure 10. Svensson [70].
Figure 10. Svensson [70].
Heritage 06 00068 g010
Table 1. Conferences related to computational DS.
Table 1. Conferences related to computational DS.
NoConference
1International Conference on Interactive Digital Storytelling (ICIDS)
2ACM Conference on Hypertext and Social Media (HT)
3International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH)
4International Conference on Advanced Informatics Concepts Theory and Applications (ICAICTA)
5Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE)
6Annual Conference of the Japanese Society for Artificial Intelligence (JSAI), AAAI Conference on Artificial Intelligence (AAAI)
7Innovative Applications of Artificial Intelligence Conference (IAAI)
8ACM/IEEE International Conference on Human-Robot Interaction (HRI)
9International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO)
10International Conference on Technologies for Interactive Digital Storytelling and Entertainment (TIDSE)
11International Conference on Social Robotics (ICSR)
12International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI)
13International Conference on Interactive Experiences for TV and Online Video (TVX)
14IEEE Integrated STEM Education Conference (ISEC)
15International Conference on Virtual Worlds and Games for Serious Applications (VS-Games)
16Conference on Tangible and Embedded Interaction (TEI)
17Foundations of Digital Games Conference (FDG)
Table 2. Categorization of the 92 examined works.
Table 2. Categorization of the 92 examined works.
NoWork Title/AuthorsCategory
DS Authoring ToolDS System/
Application
Method/
Framework/
Case Study
1Kawagoe S. et al. [34]
2Kybartas B. et al. [35]
3Subject and Subjectivity [32]
4Scheherazade-IF [36]
5Ink [37]
6Mimisbrunnur [38]
7Szilas N. et al. [39]
8StoryPlaces [40]
9Green D. et al. [41]
10Pujol et al. [29]
11The Story Maker [42]
12Narralive [28]
13Molnar A. et al. [43]
14Tracery [44]
15Villanelle [45,46]
16Novella [17]
17Brown S. et al. [47]
18ShowRunner [48]
19Battad Z. et al. [49]
20Felt [33]
21Katsui T. et al. [50,51]
22Battad Z. et al. [52]
23CANVAS [53]
24StoryAssembler [30]
25Stories of the town [31]
26WoTEdu [54]
27Turning Point [55]
28Revells and Chai [56]
29M.Suckling [57]
30De Kegel B. et al. [58]
31Honey I’m Home [59]
32Throwing Bottles at God [60]
33storyMINE [12]
34Nielsen T.L. et al. [61]
35Adversario [62]
36Letters to José [63]
37Olegoru [64]
38Vim [65]
39Liang H. et al. [66]
40Wicke P. et al. [67]
41Tokunaga et al. [68]
42Bowman A. [69]
43Svensson T. [70]
44The thousand autumns of Jacob de Zoet [71]
45Green C.P. et al. [72]
46Firebolt [73]
47Faoladh [74]
48Basaraba N. et al. [75]
49Tell a Tail 360° [76]
50Svensson T. et al. [77]
51Stavrakakis N. [78]
52Martin L.J. et al. [79]
53Leonid Berov [80]
54Chauvin S. et al. [8]
55Carolyn Miller [4]
56Schoenau-Fog H. [81]
57Womack and Freeman [82]
58Austin J. [83]
59Kreminski M. et al. [84]
60Szilas N. et al. [39]
61Martin L. et al. [85]
62Amos-Binks A. et al. [86]
63Xu W. et al. [87]
64Short E. [88]
65Koenitz H. et al. [89]
66Koenitz H. et al. [90]
67Bernstein M. et al. [91]
68Shelton et al. [92]
69Rizvic S. et al. [93]
70Smith A. et al. [94]
71Rizvic S. et al. [95]
72Rouse R. [96]
73Strugnell J. et al. [97]
74Kawano Y. et al. [98]
75Robertson J. et al. [99]
76Spawforth C. et al. [100]
77Cardona-Rivera R.E. et al. [101]
78Chu J. [102]
79Mapping Place [103]
80Chu S. at al. [104]
81Paradeda R. et al. [105]
82Paradeda R. et al. [106]
83Striepe and Lugrin [107]
84Ozaeta and Graña [108]
85Ko et al. [109]
86Kampa A. [110]
87Bhide S. et al. [111]
88fanSHEN [112]
89Vox Populi [113]
90Project Orpheus [114]
91Pillai J. and Verma M. [115]
92Mu C. [19]
Table 3. Classification of DS works according to their scope and purpose.
Table 3. Classification of DS works according to their scope and purpose.
NoWork Title/AuthorsEducationCultural
Heritage
GamesHealthcareNewer Genres of IDN
Performing ArtsCinematic INiDocsInteractive NewsGeneral Purpose
1Koenitz H. et al. [90]
2Bernstein M. et al. [91]
3C.C. Shelton [92]
4Rizvic S. et al. [93]
5Smith A. et al. [94]
6Olegoru [64]
7Chu S. at al. [104]
8Vim [65]
9Liang H. et al. [66]
10Ozaeta L. and Graña M. [108]
11Mapping Place [103]
12Svensson T. [70]
13Rizvic S. et al. [95]
14Roussou et al. [2]
15Rouse R. [123]
16WoTEdu [54]
17Turning Point [55]
18The Story Maker [42]
19Revells T. et al. [56]
20Narralive [28]
21Letters to José [63]
22Chu J. [102]
23Molnar A. et al. [43]
24M.Suckling [57]
25De Kegel B. et al. [58]
26Honey I’m Home [59]
27Throwing Bottles at God [60]
28Tracery [44]
29Strugnell J. et al. [97]
30Kawano Y. et al. [98]
31Robertson J. et al. [99]
32storyMINE [12]
33Spawforth C. et al. [100]
34Nielsen T.L. et al. [61]
35Adversario [62]
36Cardona-Rivera R.E. et al. [101]
37Villanelle [45,46]
38Novella [17]
39Bhide S. et al. [111]
40Paradeda R. et al. [105]
41Tokunaga et al. [68]
42Bowman A. [69]
43fanSHEN [112]
44Vox Populi [113]
45Green C.P. et al. [72]
46The thousand autumns
of Jacob de Zoet [71]
47Ko et al. [109]
48Kampa A. [110]
49ShowRunner [48]
50Firebolt [73]
51Faoladh [74]
52Project Orpheus [114]
53Pillai J. and Verma M. [115]
54Mu C. [19]
55Basaraba N. et al. [75]
56Tell a Tail 360° [76]
57Svensson T. et al. [77]
58Stavrakakis N. [78]
59Martin L.J. et al. [79]
60Leonid Berov [80]
61Chauvin S. et al. [8]
62Carolyn Miller [4]
63Battad Z. et al. [49]
64Felt [33]
65Schoenau-Fog H. [81]
66Womack and Freeman [82]
67Austin J. [83]
68Kreminski M. et al. [84]
69Szilas N. et al. [39]
70Martin L. et al. [85]
71Amos-Binks A. et al. [86]
72Katsui T. et al. [50,51]
73Xu W. et al. [87]
74Battad Z. et al. [52]
75Short E. [88]
76Koenitz H. et al. [89]
77CANVAS [53]
78StoryAssembler [30]
79Stories of the town [31]
80Kawagoe S. et al. [34]
81Kybartas B. et al. [35]
82Subject and Subjectivity [32]
83Scheherazade-IF [36]
84Ink [37]
85Mimisbrunnur [38]
86Szilas N. et al. [10]
87StoryPlaces [40]
88Green D. et al. [41]
89Paradeda R. et al. [106]
90Striepe H. and Lugrin B. [107]
91Brown S. et al. [47]
92Wicke P. et al. [67]
Table 4. Type of media and interaction used in works.
Table 4. Type of media and interaction used in works.
NoWork Title/AuthorsTangible IDNGesture RecognitionEmbodied DSVR/AR/360° Video/AnimationInteraction/UX
1Koenitz H. et al. [89] Cards
2Letters to José [63] Paper objects
3Chu J. [102] Special objects
4Mapping Place [103] Embodied replicas
5Olegoru [64] Special objects
6Chu S. at al. [104] Special objects
7Vim [65] Complex construction
8Brown S. et al. [47] Hand gestures
9Liang H. et al. [66] Hand gestures
10Wicke P. et al. [67] Hand gestures
11Paradeda R. et al. [105] Robot
12Paradeda R. et al. [106] Robot
13Striepe H. and Lugrin B. [107] Robot
14Ozaeta L. and Graña M. [108] Robot
15Tokunaga et al. [68] Robot
16CANVAS [53] Computer animation and sound
17Rouse R. [123] Augmented Reality
18Revells T. et al. [56] Virtual Reality
19Carolyn Miller [4] AR, VR and mixed reality
20Svensson T. [70] VR and AR
21Ko et al. [109] 360° Video and VR
22Kampa A. [110] Mobile app with AR
23Bhide S. et al. [111] VR and Spacial sound
24The thousand autumns of Jacob de Zoet [71] Sound recordings and VR
25Firebolt [73] Animation and Video
26Project Orpheus [114] 360° Video and VR
27Pillai J. and Verma M. [115] Cinematic VR
28Mu C. [19] Interactive Video
29Tell a Tail 360° [76] 360° Video
30Svensson T. et al. [77] VR and AR
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Trichopoulos, G.; Alexandridis, G.; Caridakis, G. A Survey on Computational and Emergent Digital Storytelling. Heritage 2023, 6, 1227-1263. https://doi.org/10.3390/heritage6020068

AMA Style

Trichopoulos G, Alexandridis G, Caridakis G. A Survey on Computational and Emergent Digital Storytelling. Heritage. 2023; 6(2):1227-1263. https://doi.org/10.3390/heritage6020068

Chicago/Turabian Style

Trichopoulos, Georgios, Georgios Alexandridis, and George Caridakis. 2023. "A Survey on Computational and Emergent Digital Storytelling" Heritage 6, no. 2: 1227-1263. https://doi.org/10.3390/heritage6020068

Article Metrics

Back to TopTop