Crafting a Museum Guide Using ChatGPT4
Abstract
:1. Introduction
2. Related Work
3. MAGICAL: Museum AI Guide for Augmenting Cultural Heritage with Intelligent Language Model
MAGICAL System Architecture
4. Case Study—Chat with Ebutius and Calle
“answer”: “The Romans conquered lands that the Caledonians considered their own, so many of them are justifiably angry at the Romans. Raids and skirmishes from the Caledonian tribes were, in fact, a regular event. Nevertheless, some Caledonians co-existed rather peacefully with the Romans and traded with them frequently. For example, local style pottery was found in various forts, which indicates that there were local crafts people and merchants interacting with the army on the Wall. Furthermore, soldiers of various ranks often married local women, although these marriages were not recognized by the Roman State until after Antoninus’s rule (AD 138-161). After Antoninus’s reforms, any children the soldiers might have had with these women were encouraged to join the Roman army and hence gain citizenship for themselves.”,
“questions”: [
“Could a Roman soldier marry a local Caledonian woman?”,
“Why did the Caledonians attack the Romans?”,
“What were the relationships between Romans and Caledonians?”,
“How could Calle fall in love with Ebutius, the conqueror of her people’s lands?”,
“How was the relationship between Romans and the locals?”,
“Did the natives complain about or disturb the building of the rampart?”,
“Where and how did you meet your wife Calle?”,
“Did the Caledonians interact with the Roman Army in the Wall?”,
“Are the Caledonians angry at the Romans?” ]
“prompt”: “Were the Caledonians a Celtic tribe?” –>,“completion”: “ Yes. The Caledonians were a Celtic tribe that inhabited the areas of modern-day Scotland during the Roman era. They were builders and farmers and defeated and were defeated by the Romans on several occasions. Nearly all the information available about the Caledonians is based on predominantly Roman sources, which may suggest bias. During the Iron Age, Scotland did not have a nucleated settlement pattern. Instead, Caledonians lived in homesteads dispersed across the landscape, each occupied by an extended family and their dependents. ∖n.”
You: Hello!
Chatbot: Hello and welcome to the Hunterian Museum. I am an AI language model and will be your virtual curator for the day. My name is OpenAI. How may I assist you today?
You: I would like to learn about the wars in the area
Chatbot: Certainly! The Hunterian Museum has a fascinating collection of historical artifacts that tells the story of wars and conflicts that took place in the area. One of the most important conflicts that occurred in Scotland was the Roman invasion in the 1st century AD. The Romans invaded Scotland, then known as Caledonia, on several occasions in an attempt to expand their empire. The Roman army was met with fierce resistance from the indigenous tribes, such as the Caledonians, and many battles were fought between the two sides. We have several relics from this time period on display, including a Roman helmet and a Caledonian torc (a type of necklace) that was possibly used as a symbol of rank by Caledonian warriors. Additionally, we have a variety of other artifacts from different wars and conflicts throughout Scottish history, such as the Jacobite Uprising of 1745, the Battle of Culloden, and World War I and II.
You: Who was Ebutius?
Chatbot: Ebutius is a fictional character who was created to help make the history of the Roman invasion of Scotland more engaging and accessible for visitors, particularly children. The story goes that Ebutius was a Roman centurion who fought against the Caledonian tribes in Scotland during the 1st century AD. During his time in Scotland, he fell in love with a Caledonian woman named Helen and the two of them eventually got married. Edutius’s story is a fun and interesting way to help visitors connect with the history of the Roman invasion and the people who lived in Scotland at the time. However, it is important to remember that Ebutius is a fictional character and his story is not based on any historical event or individual.
5. STT and TTS
6. Conclusions and Future Works
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
GPT | Generative Pre-trained Transformer |
CH | Cultural Heritage |
TTS | Text-To-Speech |
STT | Speech-To-Text |
ASR | Automatic Speech Recognition |
AI | Artificial Intelligence |
LLM | Large Language Model |
API | Application Programming Interface |
JSON | Javascript Object Notation |
AD | Anno Domini |
GUI | Graphical User Interface |
UI | User Interface |
UX | User Experience |
AR | Augmented Reality |
References
- Trichopoulos, G.; Alexandridis, G.; Caridakis, G. A Survey on Computational and Emergent Digital Storytelling. Heritage 2023, 6, 1227–1263. [Google Scholar] [CrossRef]
- Varitimiadis, S.; Kotis, K.; Pittou, D.; Konstantakis, G. Graph-Based Conversational AI: Towards a Distributed and Collaborative Multi-Chatbot Approach for Museums. Appl. Sci. 2021, 11, 9160. [Google Scholar] [CrossRef]
- Lawan, S. Challenges and Prospect of Museum Institutions in the 21st Century in Northern Nigeria. J. Soc. Sci. Adv. 2022, 3, 45–52. [Google Scholar] [CrossRef]
- Farahat, B.I.; Osman, K.A. Toward a new vision to design a museum in historical places. HBRC J. 2018, 14, 66–78. [Google Scholar] [CrossRef]
- Carnall, M.; Ashby, J.; Ross, C. Natural history museums as provocateurs for dialogue and debate. Mus. Manag. Curatorship 2013, 28, 55–71. [Google Scholar] [CrossRef]
- Buchanan, S.A. Curation as Public Scholarship: Museum Archaeology in a Seventeenth-Century Shipwreck Exhibit. Mus. Worlds 2016, 4, 155–166. [Google Scholar] [CrossRef]
- Adesso, G. Towards The Ultimate Brain: Exploring Scientific Discovery with ChatGPT AI. AI Mag. 2023. [Google Scholar] [CrossRef]
- Koubaa, A. GPT-4 vs. GPT-3.5: A Concise Showdown. 2023. Available online: https://doi.org/10.20944/preprints202303.0422.v1 (accessed on 7 July 2023).
- Ray, P.P. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Phys. Syst. 2023, 3, 121–154. [Google Scholar] [CrossRef]
- Currie, G.M. Academic integrity and artificial intelligence: Is ChatGPT hype, hero or heresy? Semin. Nucl. Med. 2023, 53, 719–730. [Google Scholar] [CrossRef]
- OpenAI. GPT-4 Technical Report. arXiv 2023, arXiv:2303.08774. [Google Scholar]
- Lehman, J.; Gordon, J.; Jain, S.; Ndousse, K.; Yeh, C.; Stanley, K.O. Evolution through Large Models. arXiv 2022, arXiv:2206.08896. [Google Scholar]
- Liu, Y.; Han, T.; Ma, S.; Zhang, J.; Yang, Y.; Tian, J.; He, H.; Li, A.; He, M.; Liu, Z.; et al. Summary of ChatGPT/GPT-4 Research and Perspective Towards the Future of Large Language Models. arXiv 2023, arXiv:2304.01852. [Google Scholar]
- Bubeck, S.; Chandrasekaran, V.; Eldan, R.; Gehrke, J.; Horvitz, E.; Kamar, E.; Lee, P.; Lee, Y.T.; Li, Y.; Lundberg, S.; et al. Sparks of Artificial General Intelligence: Early experiments with GPT-4. arXiv 2023, arXiv:2303.12712. [Google Scholar]
- Chang, K.K.; Cramer, M.; Soni, S.; Bamman, D. Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4. arXiv 2023, arXiv:2305.00118. [Google Scholar]
- Siu, S.C. ChatGPT and GPT-4 for Professional Translators: Exploring the Potential of Large Language Models in Translation. 2023. [Google Scholar] [CrossRef]
- Chen, F.; Han, M.; Zhao, H.; Zhang, Q.; Shi, J.; Xu, S.; Xu, B. X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages. arXiv 2023, arXiv:2305.04160. [Google Scholar]
- Cheng, M.; Durmus, E.; Jurafsky, D. Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models. arXiv 2023, arXiv:2305.18189. [Google Scholar]
- Jiang, H.; Zhang, X.; Cao, X.; Kabbara, J. PersonaLLM: Investigating the Ability of GPT-3.5 to Express Personality Traits and Gender Differences. arXiv 2023, arXiv:2305.02547. [Google Scholar]
- Dehouche, N. Plagiarism in the age of massive Generative Pre-trained Transformers (GPT-3). Ethics Sci. Environ. Politics 2021, 21, 17–23. [Google Scholar] [CrossRef]
- Lee, M. A Mathematical Interpretation of Autoregressive Generative Pre-Trained Transformer and Self-Supervised Learning. Mathematics 2023, 11, 2451. [Google Scholar] [CrossRef]
- Mazzeo, R. Editorial. Top. Curr. Chem. 2016, 375, 1. [Google Scholar] [CrossRef] [PubMed]
- Liu, Y.; Lin, H.W. Construction of Interpretation and Presentation System of Cultural Heritage Site: An Analysis of the Old City, Zuoying. Heritage 2021, 4, 316–332. [Google Scholar] [CrossRef]
- Platia, N.; Chatzidakis, M.; Doerr, C.; Charami, L.; Bekiari, C.; Melessanaki, K.; Hatzigiannakis, K.; Pouli, P. “POLYGNOSIS”: The development of a thesaurus in an Educational Web Platform on optical and laser-based investigation methods for cultural heritage analysis and diagnosis. Herit. Sci. 2017, 5, 50. [Google Scholar] [CrossRef]
- Dima, M. A Design Framework for Smart Glass Augmented Reality Experiences in Heritage Sites. J. Comput. Cult. Herit. 2022, 15, 1–19. [Google Scholar] [CrossRef]
- Litvak, E.; Kuflik, T. Enhancing cultural heritage outdoor experience with augmented-reality smart glasses. Pers. Ubiquitous Comput. 2020, 24, 873–886. [Google Scholar] [CrossRef]
- Pressey, A.; Houghton, D.; Istanbulluoglu, D. The problematic use of smartphones in public: The development and validation of a measure of smartphone “zombie” behaviour. Inf. Technol. People, 2023; ahead-of-print. [Google Scholar] [CrossRef]
- Appel, M.; Krisch, N.; Stein, J.P.; Weber, S. Smartphone zombies! Pedestrians’ distracted walking as a function of their fear of missing out. J. Environ. Psychol. 2019, 63, 130–133. [Google Scholar] [CrossRef]
- Zhuang, Y.; Fang, Z. Smartphone Zombie Context Awareness at Crossroads: A Multi-Source Information Fusion Approach. IEEE Access 2020, 8, 101963–101977. [Google Scholar] [CrossRef]
- Min, B.S. Smartphone Addiction of Adolescents, Not a Smart Choice. J. Korean Med. Sci. 2017, 32, 1563–1564. [Google Scholar] [CrossRef]
- Huh, J.; Park, S.; Lee, J.E.; Ye, J.C. Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Model. arXiv 2023, arXiv:2303.00091. [Google Scholar]
- Wahyutama, A.B.; Hwang, M. Performance Comparison of Open Speech-To-Text Engines using Sentence Transformer Similarity Check with the Korean Language by Foreigners. In Proceedings of the 2022 IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT), Bali, Indonesia, 28–30 July 2022; pp. 97–101. [Google Scholar] [CrossRef]
- Park, C.; Seo, J.; Lee, S.; Lee, C.; Moon, H.; Eo, S.; Lim, H. BTS: Back TranScription for Speech-to-Text Post-Processor using Text-to-Speech-to-Text. In Proceedings of the 8th Workshop on Asian Translation (WAT2021), Online, 5–6 August 2021; pp. 106–116. [Google Scholar] [CrossRef]
- Saha, S.; Asaduzzaman. Development of a Bangla Speech to Text Conversion System Using Deep Learning. In Proceedings of the 2021 Joint 10th International Conference on Informatics, Electronics & Vision (ICIEV) and 2021 5th International Conference on Imaging, Vision & Pattern Recognition (icIVPR), Kitakyushu, Japan, 16–20 August 2021; pp. 1–7. [Google Scholar] [CrossRef]
- Miller, C.; Tzoukermann, E.; Doyon, J.; Mallard, E. Corpus Creation and Evaluation for Speech-to-Text and Speech Translation. In Proceedings of the Machine Translation Summit XVIII: Users and Providers Track, Virtual, 16–20 August 2021; pp. 44–53. [Google Scholar]
- Elakkiya, A.; Surya, K.J.; Venkatesh, K.; Aakash, S. Implementation of Speech to Text Conversion Using Hidden Markov Model. In Proceedings of the 2022 6th International Conference on Electronics, Communication and Aerospace Technology, Coimbatore, India, 1–3 December 2022; pp. 359–363. [Google Scholar] [CrossRef]
- Nagdewani, S.; Jain, A. A review on methods for speech-to-text and text-to-speech conversion. Int. Res. J. Eng. Technol. (IRJET) 2020, 7, 4459–4464. [Google Scholar]
- Tzoukermann, E.; Van Guilder, S.; Doyon, J.; Harke, E. Speech-to-Text and Evaluation of Multiple Machine Translation Systems. In Proceedings of the 15th Biennial Conference of the Association for Machine Translation in the Americas (Volume 2: Users and Providers Track and Government Track), Orlando, FL, USA, 12–16 September 2022; pp. 465–472. [Google Scholar]
- Radford, A.; Kim, J.W.; Xu, T.; Brockman, G.; McLeavey, C.; Sutskever, I. Robust Speech Recognition via Large-Scale Weak Supervision. arXiv 2022, arXiv:2212.04356. [Google Scholar]
- Vrettakis, E.; Kourtis, V.; Katifori, A.; Karvounis, M.; Lougiakis, C.; Ioannidis, Y. Narralive—Creating and experiencing mobile digital storytelling in cultural heritage. Digit. Appl. Archaeol. Cult. Herit. 2019, 15, e00114. [Google Scholar] [CrossRef]
- Katifori, A.; Roussou, M.; Perry, S.; Drettakis, G.; Vizcay, S.; Philip, J. The EMOTIVE Project-Emotive Virtual Cultural Experiences through Personalized Storytelling. In Proceedings of the Cira@ Euromed, Nicosia, Cyprus, 3 November 2018; pp. 11–20. [Google Scholar]
- Economou, M.; Young, H.; Sosnowska, E. Evaluating emotional engagement in digital stories for interpreting the past. The case of the Hunterian Museum’s Antonine Wall EMOTIVE experiences. In Proceedings of the 2018 3rd Digital Heritage International Congress (DigitalHERITAGE) Held Jointly with 2018 24th International Conference on Virtual Systems & Multimedia (VSMM 2018), San Francisco, CA, USA, 26–30 October 2018; pp. 1–8. [Google Scholar] [CrossRef]
- Trichopoulos, G.; Aliprantis, J.; Konstantakis, M.; Michalakis, K.; Mylonas, P.; Voutos, Y.; Caridakis, G. Augmented and personalized digital narratives for Cultural Heritage under a tangible interface. In Proceedings of the 2021 16th International Workshop on Semantic and Social Media Adaptation & Personalization (SMAP), Corfu, Greece, 4–5 November 2021; pp. 1–5. [Google Scholar] [CrossRef]
No | Characteristic | ChatGPT3 | ChatGPT3.5 | ChatGPT4 |
---|---|---|---|---|
1 | Can be fine-tuned | Yes | Yes | Yes |
2 | Bias in text | No | No | No |
3 | Ease in guidance | Low | High | High |
4 | Can change style of the text | No | Yes | Yes |
5 | Truncated answers | Yes | No | No |
6 | Extra-long answers (babbling effect) | No | Yes | No |
7 | Can use other languages than English | No | Partially | Yes |
8 | Repeated meanings | Yes | Yes | No |
9 | Controversial answers | Yes | Yes | No |
10 | Input tokens limitation | 2048 (normal)–4096 (max) | 4096 | None |
11 | Cost for training and use | High | Low | Low |
12 | Speed in responses | High | Medium | Low |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Trichopoulos, G.; Konstantakis, M.; Caridakis, G.; Katifori, A.; Koukouli, M. Crafting a Museum Guide Using ChatGPT4. Big Data Cogn. Comput. 2023, 7, 148. https://doi.org/10.3390/bdcc7030148
Trichopoulos G, Konstantakis M, Caridakis G, Katifori A, Koukouli M. Crafting a Museum Guide Using ChatGPT4. Big Data and Cognitive Computing. 2023; 7(3):148. https://doi.org/10.3390/bdcc7030148
Chicago/Turabian StyleTrichopoulos, Georgios, Markos Konstantakis, George Caridakis, Akrivi Katifori, and Myrto Koukouli. 2023. "Crafting a Museum Guide Using ChatGPT4" Big Data and Cognitive Computing 7, no. 3: 148. https://doi.org/10.3390/bdcc7030148
APA StyleTrichopoulos, G., Konstantakis, M., Caridakis, G., Katifori, A., & Koukouli, M. (2023). Crafting a Museum Guide Using ChatGPT4. Big Data and Cognitive Computing, 7(3), 148. https://doi.org/10.3390/bdcc7030148