An Extended AI-Experience: Industry 5.0 in Creative Product Innovation
Abstract
:1. Introduction
2. Research Methodology
State-of-the-Art VR and AI Brainstorming Applications
3. Creativity in Engineering Design Teams
Current Ideation Techniques
4. Integrating Virtual Reality (VR) and Creativity
4.1. Elements Comprising Virtual Brainstorming
5. Integrating Artificial Intelligence (AI) and Creativity
6. Discussion
6.1. Application of AI and VR for Design Ideation
6.1.1. Key Area of Intervention: Facilitation
6.1.2. Key Area of Intervention: Stimulation
6.1.3. Key Area of Intervention: Immersion
6.2. The Creation of an AI-Facilitated VR-Based Environment
Challenges Faced during Facilitation, Stimulation, and Immersion
7. Conclusions
- Stimulation through multiple senses which positively contribute to various methods of communication, recording of information and therefore leading to creative ideation [44].
- Immersion achieved via advanced interaction between avatars [9], with the environment [45,46] and with digital artefacts relevant to the design problem [9,40]. This results in positive emotional engagement, enhanced social identification effects and Proteus effects enabled by VR, improved focus due to the increased immersion effects and therefore a higher quality of group ideation [7,53,54].
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Conflicts of Interest
References
- Ocker, R.J. Influences on creativity in asynchronous virtual teams: A qualitative analysis of experimental teams. IEEE Trans. Prof. Commun. 2005, 48, 22–39. [Google Scholar] [CrossRef]
- Rickards, T. Brainstorming revisited: A question of context. Int. J. Manag. Rev. 1999, 1, 91–110. [Google Scholar] [CrossRef]
- Sutton, R.I.; Hargadon, A. Brainstorming groups in context: Effectiveness in a product design firm. Adm. Sci. Q. 1996, 41, 685–718. [Google Scholar] [CrossRef]
- Castellano, S.; Davidson, P.; Khelladi, I. Creativity techniques to enhance knowledge transfer within global virtual teams in the context of knowledge-intensive enterprises. J. Technol. Transf. 2017, 42, 253–266. [Google Scholar] [CrossRef]
- Chamakiotis, P.; Dekoninck, E.A.; Panteli, N. Factors influencing creativity in virtual design teams: An interplay between technology, teams and individuals. Creat. Innov. Manag. 2013, 22, 265–279. [Google Scholar] [CrossRef]
- Whyte, J.; Bessant, J.R.; Neely, A.D.; Yaghi, B. Management of Creativity and Design within the Firm; DTI London: London, UK, 2005. [Google Scholar]
- Guegan, J.; Buisine, S.; Mantelet, F.; Maranzana, N.; Segonds, F. Avatar-mediated creativity: When embodying inventors makes engineers more creative. Comput. Hum. Behav. 2016, 61, 165–175. [Google Scholar] [CrossRef] [Green Version]
- Guegan, J.; Segonds, F.; Barré, J.; Maranzana, N.; Mantelet, F.; Buisine, S. Social identity cues to improve creativity and identification in face-to-face and virtual groups. Comput. Hum. Behav. 2017, 77, 140–147. [Google Scholar] [CrossRef] [Green Version]
- Gong, Z.; Lee, L.-H.; Soomro, S.A.; Nanjappan, V.; Georgiev, G.V. A systematic review of virtual brainstorming from the perspective of creativity: Affordances, framework, and outlook. Digit. Creat. 2022, 33, 96–127. [Google Scholar] [CrossRef]
- Commission, E. Industry 5.0: A Transformative Vision for Europe ESIR Policy Brief No. 3; Publications Office of the European Union: Luxembourg, 2022. [Google Scholar]
- Perlin, K.; He, Z.; Zhu, F. Chalktalk VR/AR. International SERIES on Information Systems and Management in Creative eMedia (CreMedia). 2018, pp. 30–31. Available online: https://www.ambientmediaassociation.org/Journal/index.php/series/article/view/278 (accessed on 4 October 2022).
- He, Z.; Du, R.; Perlin, K. Collabovr: A reconfigurable framework for creative collaboration in virtual reality. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Porto de Galinhas, Brazil, 9–13 November 2020; pp. 542–554. [Google Scholar]
- Lee, B.; Feldman, B.; Fu, K. Speech2Mindmap: Testing the Accuracy of Unsupervised Automatic Mindmapping Technology with Speech Recognition. J. Mech. Des. 2022, 144, 021401. [Google Scholar] [CrossRef]
- Ide, M.; Oshima, S.; Mori, S.; Yoshimi, M.; Ichino, J.; Tano, S. Effects of Avatar’s Symbolic Gesture in Virtual Reality Brainstorming. In Proceedings of the 32nd Australian Conference on Human-Computer Interaction, Sydney, Australia, 2–4 December 2020; pp. 170–177. [Google Scholar]
- Kramer, T.J.; Fleming, G.P.; Mannis, S.M. Improving face-to-face brainstorming through modeling and facilitation. Small Group Res. 2001, 32, 533–557. [Google Scholar] [CrossRef]
- Strohmann, T.; Siemon, D.; Robra-Bissantz, S. brAInstorm: Intelligent assistance in group idea generation. In Proceedings of the Designing the Digital Transformation 12th International Conference, DESRIST 2017, Karlsruhe, Germany, 30 May–1 June 2017; pp. 457–461. [Google Scholar]
- Wang, H.-C.; Cosley, D.; Fussell, S.R. Idea expander: Supporting group brainstorming with conversationally triggered visual thinking stimuli. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work, Savannah, GA, USA, 6–10 February 2010; pp. 103–106. [Google Scholar]
- Amabile, T.M. How to kill creativity. Harv. Bus. Rev. Breakthr. Think. 1998, 76, 76–87. [Google Scholar]
- Eisenberg, J.; Mattarelli, E. Building bridges in global virtual teams: The role of multicultural brokers in overcoming the negative effects of identity threats on knowledge sharing across subgroups. J. Int. Manag. 2017, 23, 399–411. [Google Scholar] [CrossRef]
- Kohn, N.W.; Paulus, P.B.; Choi, Y. Building on the ideas of others: An examination of the idea combination process. J. Exp. Soc. Psychol. 2011, 47, 554–561. [Google Scholar] [CrossRef]
- McMahon, K.; Ruggeri, A.; Kämmer, J.E.; Katsikopoulos, K.V. Beyond idea generation: The power of groups in developing ideas. Creat. Res. J. 2016, 28, 247–257. [Google Scholar] [CrossRef]
- Van Boeijen, A.; Daalhuizen, J.; van der Schoor, R.; Zijlstra, J. Delft Design Guide: Design Strategies and Methods; BIS Publishers: Amsterdam, The Netherlands, 2014. [Google Scholar]
- Dennis, A.R.; Minas, R.K.; Bhagwatwar, A.P. Sparking creativity: Improving electronic brainstorming with individual cognitive priming. J. Manag. Inf. Syst. 2013, 29, 195–216. [Google Scholar] [CrossRef]
- Nijstad, B.A.; Stroebe, W.; Lodewijkx, H.F.M. Production blocking and idea generation: Does blocking interfere with cognitive processes? J. Exp. Soc. Psychol. 2003, 39, 531–548. [Google Scholar] [CrossRef]
- Isaksen, S.G.; Gaulin, J.P. A reexamination of brainstorming research: Implications for research and practice. Gift. Child Q. 2005, 49, 315–329. [Google Scholar] [CrossRef]
- Garfield, M.J.; Taylor, N.J.; Dennis, A.R.; Satzinger, J.W. Modifying paradigms—Individual differences, creativity techniques, and exposure to ideas in group idea generation. Inf. Syst. Res. 2001, 12, 322–333. [Google Scholar] [CrossRef] [Green Version]
- Osman, A.; Cuellar, E.; Chiem, A.T.; Bethel, C.; Lutz, B.D. Investigating Student Perceptions of Team-based Brainstorming During Conceptual Design: Challenges and Recommendations. 2021. Available online: https://sftp.asee.org/38238 (accessed on 5 October 2022).
- Kelly, T.; Littman, J. The art of innovation: Lessons in creativity from IDEO. New Archit. 2002, 7, 52–53. [Google Scholar]
- Wodehouse, A.J.; Ion, W.J. Information use in conceptual design: Existing taxonomies and new approaches. Int. J. Des. 2010, 4, 53–65. [Google Scholar]
- Smith, S.M.; Kohn, N.W.; Shah, J. What you see is what you get: Effects of provocative stimuli in creative invention. In Proceedings of the NSF International Workshop on Studying Design Creativity’08-Design Science, Computer Science, Cognitive Science and Neuroscience Approaches: The State-of-the-Art, Aix-en-Provence, France, 10–11 March 2008. [Google Scholar]
- Benami, O.; Jin, Y. Creative stimulation in conceptual design. In Proceedings of the ASME 2002 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Montreal, QC, Canada, 29 September–2 October 2002; pp. 251–263. [Google Scholar]
- Schilling, M.A. Strategic Management of Technological Innovation, 4th ed.; McGraw-Hill/Irwin: New York, NY, USA, 2012. [Google Scholar]
- Kohn, N.W.; Smith, S.M. Collaborative fixation: Effects of others’ ideas on brainstorming. Appl. Cogn. Psychol. 2011, 25, 359–371. [Google Scholar] [CrossRef]
- Wodehouse, A.; Loudon, B.; Urquhart, L. The configuration and experience mapping of an accessible VR environment for effective design reviews. Artif. Intell. Eng. Des. Anal. Manuf. AIEDAM 2020, 34, 387–400. [Google Scholar] [CrossRef]
- Jerald, J. The VR Book: Human-Centered Design for Virtual Reality, 1st ed.; Association for Computing Machinery: New York, NY, USA; Morgan & Claypool: San Rafael, CA, USA, 2016. [Google Scholar]
- Slater, M.; Wilbur, S. A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators Virtual Environ. 1997, 6, 603–616. [Google Scholar] [CrossRef]
- Felton, W.M.; Jackson, R.E. Presence: A review. Int. J. Hum. Comput. Interact. 2022, 38, 1–18. [Google Scholar] [CrossRef]
- McCreery, M.P.; Schrader, P.G.; Krach, S.K.; Boone, R. A sense of self: The role of presence in virtual environments. Comput. Hum. Behav. 2013, 29, 1635–1640. [Google Scholar] [CrossRef]
- Nah, K.; Oh, S.; Han, B.; Kim, H.; Lee, A. A Study on the User Experience to Improve Immersion as a Digital Human in Lifestyle Content. Appl. Sci. 2022, 12, 12467. [Google Scholar] [CrossRef]
- Shigapov, M.; Kugurakova, V. Design and development of a hardware and software system for simulation of feedback tactility. In Proceedings of the 2021 International Siberian Conference on Control and Communications (SIBCON), Kazan, Russia, 13–15 May 2021; pp. 1–6. [Google Scholar]
- Burdea, G.C. Haptic Feedback for Virtual Reality. In Proceeedings of the International Workshop on Virtual Prototyping, Laval, France, 3–4 June 1999; pp. 17–29. [Google Scholar]
- Fast-Berglund, Å.; Gong, L.; Li, D. Testing and validating Extended Reality (xR) technologies in manufacturing. Procedia Manuf. 2018, 25, 31–38. [Google Scholar] [CrossRef]
- Gong, Z.; Georgiev, G.V. Literature review: Existing methods using VR to enhance creativity. In Proceedings of the 6th International Conference on Design Creativity (ICDC 2020), Oulu, Finland, 26–28 August 2020; pp. 117–124. [Google Scholar]
- Graessler, I.; Taplick, P. Supporting creativity with virtual reality technology. In Proceedings of the ICED19: The 22nd International Conference on Engineering Design, Delft, Netherlands, 5–8 August 2019; pp. 2011–2020. [Google Scholar]
- Bhagwatwar, A.; Massey, A.; Dennis, A.R. Creative virtual environments: Effect of supraliminal priming on team brainstorming. In Proceedings of the 2013 46th Hawaii International Conference on System Sciences, Wailea, HI, USA, 7–10 January 2013; pp. 215–224. [Google Scholar]
- Minas, R.K.; Dennis, A.R.; Massey, A.P. Opening the mind: Designing 3D virtual environments to enhance team creativity. In Proceedings of the 2016 49th Hawaii International Conference on System Sciences (HICSS), Koloa, HI, USA, 5–8 January 2016; pp. 247–256. [Google Scholar]
- Hwang, A.H.-C.; Sun, Y.; McKee, C.; Won, A.S. Real or surreal: A pilot study on creative idea generation in MR vs. VR: Anonymous. In Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Atlanta, GA, USA, 22–26 March 2020; pp. 676–677. [Google Scholar]
- Kuťák, D.; Doležal, M.; Kerous, B.; Eichler, Z.; Vašek, J.; Liarokapis, F. An interactive and multimodal virtual mind map for future workplace. Front. ICT 2019, 6, 14. [Google Scholar] [CrossRef] [Green Version]
- Tenorio Morales, M.C.; Yamamoto, K.; Tsujino, Y. SyncMeet: Virtual Work Environment for Collaborative Manga Creation. In Proceedings of the Design, User Experience, and Usability. Case Studies in Public and Personal Interactive Systems: 9th International Conference, DUXU 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, 19–24 July 2020; pp. 518–532. [Google Scholar]
- Bell, M.W. Toward a Definition of “Virtual Worlds”. J. Virtual Worlds Res. 2008, 18. [Google Scholar] [CrossRef] [Green Version]
- Sanchez-Vives, M.V.; Slater, M. From presence to consciousness through virtual reality. Nat. Rev. Neurosci. 2005, 6, 332–339. [Google Scholar] [CrossRef]
- Yee, N.; Bailenson, J. The Proteus effect: The effect of transformed self-representation on behavior. Hum. Commun. Res. 2007, 33, 271–290. [Google Scholar] [CrossRef] [Green Version]
- Buisine, S.; Guegan, J. Proteus vs. social identity effects on virtual brainstorming. Behav. Inf. Technol. 2020, 39, 594–606. [Google Scholar] [CrossRef]
- Bonnardel, N.; Forens, M.; Lefevre, M. Enhancing collective creative design: An exploratory study on the influence of static and dynamic personas in a virtual environment. Des. J. 2016, 19, 221–235. [Google Scholar] [CrossRef]
- Forens, M.; Bonnardel, N.; Barbier, M.-L. How communication modalities can impact group creativity in multi-user virtual environments. In Proceedings of the European Conference on Cognitive Ergonomics 2015, Warsaw, Poland, 1–3 July 2015; pp. 1–4. [Google Scholar]
- Petrykowski, M.; Berger, P.; Hennig, P.; Meinel, C. Digital Collaboration with a Whiteboard in Virtual Reality. In Proceedings of the Sixth Future Technologies Conference (FTC) 2018, Vancouver, Canada, 15–16 November 2018; Volume 1, pp. 962–981. [Google Scholar]
- Gonçalves, F.; Campos, P. Mild place illusion: A virtual reality factor to spark creativity in writing. In Proceedings of the 36th European Conference on Cognitive Ergonomics, Utrecht, The Netherlands, 5–7 September 2018; pp. 1–8. [Google Scholar]
- Stuart, R.; Peter, N. Artificial Intelligence: A Modern Approach, 4th ed.; Pearson: Hoboken, NJ, USA, 2020. [Google Scholar]
- Wienrich, C.; Latoschik, M.E. Extended Artificial Intelligence: New Prospects of Human-AI Interaction Research. Front. Virtual Real. 2021, 2, 686–783. [Google Scholar] [CrossRef]
- De Silva, D.; Sierla, S.; Alahakoon, D.; Osipov, E.; Yu, X.; Vyatkin, V. Toward intelligent industrial informatics: A review of current developments and future directions of artificial intelligence in industrial applications. IEEE Ind. Electron. Mag. 2020, 14, 57–72. [Google Scholar] [CrossRef]
- Bi, Z. Embracing Internet of Things (IoT) and big data for industrial informatics. Enterp. Inf. Syst. 2017, 11, 949–951. [Google Scholar] [CrossRef]
- Small, S.G.; Medsker, L. Review of information extraction technologies and applications. Neural Comput. Appl. 2014, 25, 533–548. [Google Scholar] [CrossRef]
- Chowdhary, K.R. Natural language processing. Fundam. Artif. Intell. 2020, 603–649. [Google Scholar] [CrossRef]
- Singh, A.P.; Nath, R.; Kumar, S. A survey: Speech recognition approaches and techniques. In Proceedings of the 2018 5th IEEE Uttar Pradesh Section International Conference on Electrical, Electronics and Computer Engineering (UPCON), Gorakhpur, India, 2–4 November 2018; pp. 1–4. [Google Scholar]
- Amberkar, A.; Awasarmol, P.; Deshmukh, G.; Dave, P. Speech recognition using recurrent neural networks. In Proceedings of the 2018 International Conference on Current Trends Towards Converging Technologies (ICCTCT), Coimbatore, India, 1–3 March 2018; pp. 1–4. [Google Scholar]
- Wu, T.H.; Zhao, Y.; Amiruzzaman, M. Interactive Visualization of AI-based Speech Recognition Texts. In Proceedings of the EuroVA, Eleventh International EuroVis workshop on Visual Analytics, Norrköping, Sweden, 25 May 2020. [Google Scholar]
- Kelleher, J.D. Deep Learning; MIT Press: Cambridge, MA, USA, 2019. [Google Scholar]
- Furui, S.; Kikuchi, T.; Shinnaka, Y.; Hori, C. Speech-to-text and speech-to-speech summarization of spontaneous speech. IEEE Trans. Speech Audio Process. 2004, 12, 401–408. [Google Scholar] [CrossRef]
- Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; pp. 779–788. [Google Scholar]
- Kendall, A.; Grimes, M.; Cipolla, R. Convolutional networks for real-time 6-DOF camera relocalization. CoRR abs/1505.07427. In Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, 11–18 December 2015. [Google Scholar]
- Ryskeldiev, B.; Ilić, S.; Ochiai, Y.; Elliott, L.; Nikonole, H.; Billinghurst, M. Creative Immersive AI: Emerging Challenges and Opportunities forCreative Applications of AI in Immersive Media. In Proceedings of the Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 8–13 May 2021; pp. 1–3. [Google Scholar]
- Hilton, C.; Plant, N.; González Díaz, C.; Perry, P.; Gibson, R.; Martelli, B.; Zbyszynski, M.; Fiebrink, R.; Gillies, M. InteractML: Making machine learning accessible for creative practitioners working with movement interaction in immersive media. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, Osaka, Japan, 8–10 December 2021; pp. 1–10. [Google Scholar]
- DiPaola, S.; Yalçin, Ö.N. A multi-layer artificial intelligence and sensing based affective conversational embodied agent. In Proceedings of the 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), Cambridge, UK, 3–6 September 2019; pp. 91–92. [Google Scholar]
- Luck, M.; Aylett, R. Applying artificial intelligence to virtual reality: Intelligent virtual environments. Appl. Artif. Intell. 2000, 14, 3–32. [Google Scholar] [CrossRef]
- Lv, Z.; Poiesi, F.; Dong, Q.; Lloret, J.; Song, H. Deep Learning for Intelligent Human–Computer Interaction. Appl. Sci. 2022, 12, 11457. [Google Scholar] [CrossRef]
- Commission, E. Enabling Technologies for Industry 5.0 Results of a Workshop with Europe’s Technology Leaders; Publications Office of the European Union: Luxembourg, 2020. [Google Scholar]
- Kim, D.; Jo, D. Effects on co-presence of a virtual human: A comparison of display and interaction types. Electronics 2022, 11, 367. [Google Scholar] [CrossRef]
Product Name | Product Capabilities | Distinctive Features |
---|---|---|
Noda® (Olympia, WA, USA) (Source: https://sidequestvr.com/app/1986/noda-mind-mapping-in-vr) (Accessed on 1 November 2022) |
|
|
MeetinVR® (Valby, Denmark) (Source: https://www.meetinvr.com/2021/04/14/brainstorming-in-vr/) (Accessed on 1 November 2022) |
|
|
Glue® (Helsinki, Finland) (Source: https://glue.work/glue-platform/) (Accessed on 1 November 2022) |
|
|
rumii® (Bellevue, WA, USA) (Source: https://sidequestvr.com/app/17/rumii-for-oculus-quest-version-205) (Accessed on 1 November 2022) |
|
|
Arthur® (Munich, Germany) (Source: https://www.arthur.digital/use-cases) (Accessed on 1 November 2022) |
|
|
ShapesXR® (San Mateo, CA, USA) (Source: https://www.shapesxr.com/) (Accessed on 1 November 2022) |
|
|
Facilitation | Stimulation | Immersion | |
---|---|---|---|
AI |
| ||
VR |
|
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Grech, A.; Mehnen, J.; Wodehouse, A. An Extended AI-Experience: Industry 5.0 in Creative Product Innovation. Sensors 2023, 23, 3009. https://doi.org/10.3390/s23063009
Grech A, Mehnen J, Wodehouse A. An Extended AI-Experience: Industry 5.0 in Creative Product Innovation. Sensors. 2023; 23(6):3009. https://doi.org/10.3390/s23063009
Chicago/Turabian StyleGrech, Amy, Jörn Mehnen, and Andrew Wodehouse. 2023. "An Extended AI-Experience: Industry 5.0 in Creative Product Innovation" Sensors 23, no. 6: 3009. https://doi.org/10.3390/s23063009
APA StyleGrech, A., Mehnen, J., & Wodehouse, A. (2023). An Extended AI-Experience: Industry 5.0 in Creative Product Innovation. Sensors, 23(6), 3009. https://doi.org/10.3390/s23063009