Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation
Abstract
:1. Introduction
2. Theoretical Background
2.1. Two Sources of Information Search: Search Engines and AI Chatbots
2.2. The Mediating Role of Familiarity in Consumer Search Preference and Self-Disclosure
2.3. The Role of Relationship Quality in Moderating Responses to Online Product Search
2.4. Sources of Information Search, Persuasion Knowledge, and Consumer Perceptions of Bias
3. Materials and Methods
Participants and Procedure
4. Results
5. Discussion
5.1. Theoretical Contributions
5.2. Managerial Implications
5.3. Limitations
5.4. Recommended Future Research
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A. Search Results Stimuli Used in Study
References
- OpenAI. Introducing ChatGPT. Available online: https://openai.com/blog/chatgpt (accessed on 2 April 2025).
- Kirshner, S.N. GPT and CLT: The Impact of ChatGPT’s Level of Abstraction on Consumer Recommendations. J. Retail. Consum. Serv. 2024, 76, 103580. [Google Scholar] [CrossRef]
- Liu, L.; Meng, J.; Yang, Y. LLM Technologies and Information Search. J. Econ. Technol. 2024, 2, 269–277. [Google Scholar] [CrossRef]
- Spatharioti, S.E.; Rothschild, D.M.; Goldstein, D.G.; Hofman, J.M. Comparing Traditional and LLM-Based Search for Consumer Choice: A Randomized Experiment. arXiv 2023. [Google Scholar] [CrossRef]
- Rooney, K. OpenAI Tops 400 Million Users Despite DeepSeek’s Emergence. CNBC. Available online: https://www.cnbc.com/2025/02/20/openai-tops-400-million-users-despite-deepseeks-emergence.html (accessed on 10 March 2025).
- Wang, C.L. Editorial–What Is an Interactive Marketing Perspective and What Are Emerging Research Areas? J. Res. Interact. Mark. 2024, 18, 161–165. [Google Scholar] [CrossRef]
- Ooi, K.-B.; Tan, G.W.-H.; Al-Emran, M.; Al-Sharafi, M.A.; Capatina, A.; Chakraborty, A.; Dwivedi, Y.K.; Huang, T.-L.; Kar, A.K.; Lee, V.-H.; et al. The Potential of Generative Artificial Intelligence Across Disciplines: Perspectives and Future Directions. J. Comput. Inf. Syst. 2025, 65, 76–107. [Google Scholar] [CrossRef]
- Peltier, J.W.; Dahl, A.J.; Schibrowsky, J.A. Artificial Intelligence in Interactive Marketing: A Conceptual Framework and Research Agenda. J. Res. Interact. Mark. 2023, 18, 54–90. [Google Scholar] [CrossRef]
- Heitzman, A. How People Search Today: Evolving Search Behaviors. 2025. Available online: https://www.highervisibility.com/seo/learn/how-people-search/ (accessed on 23 April 2025).
- Yahoo Finance, Search Engine Optimization (SEO) Market Size Worth USD 157.41 Billion in 2032 Emergen Research. 2024. Available online: https://finance.yahoo.com/news/search-engine-optimization-seo-market-125900367.html (accessed on 2 April 2025).
- Zajonc, R.B. Attitudinal Effects of Mere Exposure. J. Personal. Soc. Psychol. 1968, 9, 1. [Google Scholar] [CrossRef]
- Taylor, D.A. The Development of Interpersonal Relationships: Social Penetration Processes. J. Soc. Psychol. 1968, 75, 79–90. [Google Scholar] [CrossRef]
- Fournier, S. Consumers and Their Brands: Developing Relationship Theory in Consumer Research. J. Consum. Res. 1998, 24, 343–373. [Google Scholar] [CrossRef]
- Smit, E.; Bronner, F.; Tolboom, M. Brand Relationship Quality and Its Value for Personal Contact. J. Bus. Res. 2007, 60, 627–633. [Google Scholar] [CrossRef]
- Friestad, M.; Wright, P. The Persuasion Knowledge Model: How People Cope with Persuasion Attempts. J. Consum. Res. 1994, 21, 1–31. [Google Scholar] [CrossRef]
- APA Dictionary of Psychology. 2025. Available online: https://dictionary.apa.org/ (accessed on 2 April 2025).
- Kim, J.; Giroux, M.; Lee, J.C. When Do You Trust AI? The Effect of Number Presentation Detail on Consumer Trust and Acceptance of AI Recommendations. Psychol. Mark. 2021, 38, 1140–1155. [Google Scholar] [CrossRef]
- Su, Z.; Yang, M.; Zhai, Q.; Guo, K.; Huang, Y.; Cong, Y. A Multigrained Preference Analysis Method for Product Iterative Design Incorporating AI-Generated Review Detection. Sci. Rep. 2025, 15, 2528. [Google Scholar] [CrossRef] [PubMed]
- Davis, F.D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 1989, 13, 319–340. [Google Scholar] [CrossRef]
- Engel, J.F.; Kollat, D.T.; Blackwell, R.D. Consumer Behaviour; Holt, Rinehart, Winston: New York, NY, USA, 1968. [Google Scholar]
- Devanur, G. The Future of SEO Is Answer Engine Optimization (AEO). Forbes. Available online: https://www.forbes.com/councils/forbesbusinesscouncil/2023/03/14/the-future-of-seo-is-answer-engine-optimization-aeo/ (accessed on 14 March 2025).
- Honka, E.; Seiler, S.; Ursu, R. Consumer Search: What Can We Learn from Pre-Purchase Data? J. Retail. 2024, 100, 114–129. [Google Scholar] [CrossRef]
- Lewandowski, D.; Haider, J.; Sundin, O. JASIST Special Issue Editorial: Re-Orienting Search Engine Research in Information Science. J. Assoc. Inf. Sci. Technol. 2024, 75, 503–511. [Google Scholar] [CrossRef]
- Similarweb. Top Websites Ranking-Most Visited Websites in April 2024. 2024. Available online: https://www.similarweb.com/top-websites/ (accessed on 4 June 2024).
- Ghose, A.; Impeirotis, P.; Li, B. Surviving Social Media Overload: Predicting Consumer Footprints on Product Search Engines. Workshop Inf. Syst. Econ. (WISE) 2012, 1–33. [Google Scholar]
- Ursu, R.M. The Power of Rankings: Quantifying the Effect of Rankings on Online Consumer Search and Purchase Decisions. Mark. Sci. 2018, 37, 530–552. [Google Scholar] [CrossRef]
- Caldarini, G.; Jaf, S.; McGarry, K. A Literature Survey of Recent Advances in Chatbots. Information 2022, 13, 41. [Google Scholar] [CrossRef]
- Cheng, Z.; Zhang, W.; Chou, C.-C.; Jau, Y.-Y.; Pathak, A.; Gao, P.; Batur, U. E-Commerce Product Categorization with LLM-Based Dual-Expert Classification Paradigm. In Proceedings of the 1st Workshop on Customizable NLP: Progress and Challenges in Customizing NLP for a Domain, Application, Group, or Individual (CustomNLP4U), Miami, FL, USA, 16 November 2024; Association for Computational Linguistics: Miami, FL, USA, 2024; pp. 294–304. [Google Scholar]
- Chang, W.; Park, J. A Comparative Study on the Effect of ChatGPT Recommendation and AI Recommender Systems on the Formation of a Consideration Set. J. Retail. Consum. Serv. 2024, 78, 103743. [Google Scholar] [CrossRef]
- Chakraborty, U.; Biswal, S.K. Is ChatGPT a Responsible Communication: A Study on the Credibility and Adoption of Conversational Artificial Intelligence. J. Promot. Manag. 2024, 30, 929–958. [Google Scholar] [CrossRef]
- Niu, B.; Mvondo, G.F.N. I Am ChatGPT, the Ultimate AI Chatbot! Investigating the Determinants of Users’ Loyalty and Ethical Usage Concerns of ChatGPT. J. Retail. Consum. Serv. 2024, 76, 103562. [Google Scholar] [CrossRef]
- Vo, D.-T.; Nguyen, L.T.V.; Dang-Pham, D.; Hoang, A.-P. When Young Customers Co-Create Value of AI-Powered Branded App: The Mediating Role of Perceived Authenticity. Young- Consum. 2024, 25, 557–578. [Google Scholar] [CrossRef]
- Kim, J.H.; Kim, J.; Kim, C.; Kim, S.S. Do You Trust ChatGPTs? Effects of the Ethical and Quality Issues of Generative AI on Travel Decisions. J. Travel Tour. Mark. 2023, 40, 779–801. [Google Scholar] [CrossRef]
- Rahimzadeh, V.; Kostick-Quenet, K.; Blumenthal Barby, J.; McGuire, A.L. Ethics Education for Healthcare Professionals in the Era of ChatGPT and Other Large Language Models: Do We Still Need It? Am. J. Bioeth. 2023, 23, 17–27. [Google Scholar] [CrossRef]
- Cong-Lem, N.; Soyoof, A.; Tsering, D. A Systematic Review of the Limitations and Associated Opportunities of ChatGPT. Int. J. Hum. Comput. Interact. 2024, 41, 3851–3866. [Google Scholar] [CrossRef]
- Rice, S.; Crouse, S.R.; Winter, S.R.; Rice, C. The Advantages and Limitations of Using ChatGPT to Enhance Technological Research. Technol. Soc. 2024, 76, 102426. [Google Scholar] [CrossRef]
- Khan, R.; Gupta, N.; Sinhababu, A.; Chakravarty, R. Impact of Conversational and Generative AI Systems on Libraries: A Use Case Large Language Model (LLM). Sci. Technol. Libr. 2024, 43, 319–333. [Google Scholar] [CrossRef]
- Bettman, J.R.; Park, C.W. Effects of Prior Knowledge and Experience and Phase of the Choice Process on Consumer Decision Processes: A Protocol Analysis. J. Consum. Res. 1980, 7, 234–248. [Google Scholar] [CrossRef]
- Krueger, L.E. Familiarity Effects in Visual Information Processing. Psychol. Bull. 1975, 82, 949–974. [Google Scholar] [CrossRef]
- Dahlen, M. Banner Advertisements through a New Lens. J. Advert. Res. 2001, 41, 23–30. [Google Scholar] [CrossRef]
- Fournier, S.; Alvarez, C. Brands as Relationship Partners: Warmth, Competence, and in-Between. J. Consum. Psychol. 2012, 22, 177–185. [Google Scholar] [CrossRef]
- Janiszewski, C. Preattentive Mere Exposure Effects. J. Consum. Res. 1993, 20, 376–392. [Google Scholar] [CrossRef]
- Rhee, E.S.; Jung, W.S. Brand Familiarity as a Moderating Factor in the Ad and Brand Attitude Relationship and Advertising Appeals. J. Mark. Commun. 2019, 25, 571–585. [Google Scholar] [CrossRef]
- Coupey, E.; Irwin, J.; Payne, J. Product Category Familiarity and Preference Construction: Business Source. J. Consum. Res. 1998, 24, 459–468. [Google Scholar] [CrossRef]
- Casaló, L.; Flavián, C.; Guinalíu, M. The Role of Perceived Usability, Reputation, Satisfaction and Consumer Familiarity on the Website Loyalty Formation Process. Comput. Hum. Behav. 2008, 24, 325–345. [Google Scholar] [CrossRef]
- Kaya, B.; Behravesh, E.; Abubakar, A.M.; Kaya, O.S.; Orús, C. The Moderating Role of Website Familiarity in the Relationships Between E-Service Quality, e-Satisfaction and e-Loyalty. J. Internet Commer. 2019, 18, 369–394. [Google Scholar] [CrossRef]
- Altman, I.; Taylor, D.A. Social Penetration: The Development of Interpersonal Relationships; Holt, Rinehart & Winston: New York, NY, USA, 1973. [Google Scholar]
- Brockner, J.; Swap, W.C. Effects of Repeated Exposure and Attitudinal Similarity on Self-Disclosure and Interpersonal Attraction. J. Personal. Soc. Psychol. 1976, 33, 531. [Google Scholar] [CrossRef]
- Derlega, V.J.; Metts, S.; Petronio, S.; Margulis, S.T. Self-Disclosure; Sage Publications, Inc.: Newbury Park, CA, USA, 1993. [Google Scholar]
- Bornstein, R.F. Exposure and Affect: Overview and Meta-Analysis of Research, 1968–1987. Psychol. Bull. 1989, 106, 265. [Google Scholar] [CrossRef]
- Li, H.; Sarathy, R.; Xu, H. Understanding Situational Online Information Disclosure as a Privacy Calculus. J. Comput. Inf. Syst. 2010, 51, 62–71. [Google Scholar] [CrossRef]
- Metzger, M.J. Privacy, Trust, and Disclosure: Exploring Barriers to Electronic Commerce. J. Comput. Mediat. Commun. 2004, 9, JCMC942. [Google Scholar] [CrossRef]
- Park, J.; Stoel, L. Effect of Brand Familiarity, Experience and Information on Online Apparel Purchase. Int. J. Retail. Distrib. Manag. 2005, 33, 148–160. [Google Scholar] [CrossRef]
- Rose, J.; Cho, E.; Smith, K.R. The Effects of Brand Familiarity on Perceived Risk, Attitude, and Purchase Intentions toward an Intimate Apparel Brand. In International Textile and Apparel Association Annual Conference Proceedings; Iowa State University Digital Press: Ames, IA, USA, 2016; Volume 73. [Google Scholar]
- Bryce, J.; Fraser, J. The Role of Disclosure of Personal Information in the Evaluation of Risk and Trust in Young Peoples’ Online Interactions. Comput. Hum. Behav. 2014, 30, 299–306. [Google Scholar] [CrossRef]
- Bonnin, G. The Roles of Perceived Risk, Attractiveness of the Online Store and Familiarity with AR in the Influence of AR on Patronage Intention. J. Retail. Consum. Serv. 2020, 52, 101938. [Google Scholar] [CrossRef]
- Manser Payne, E.H.; Peltier, J.; Barger, V.A. Enhancing the Value Co-Creation Process: Artificial Intelligence and Mobile Banking Service Platforms. J. Res. Interact. Mark. 2021, 15, 68–85. [Google Scholar] [CrossRef]
- Alvarez, C.; Brick, D.J.; Fournier, S. Doing Relationship Work: A Theory of Change in Consumer–Brand Relationships. J. Consum. Res. 2021, 48, 610–632. [Google Scholar] [CrossRef]
- Huber, F.; Vollhardt, K.; Matthes, I.; Vogel, J. Brand Misconduct: Consequences on Consumer–Brand Relationships. J. Bus. Res. 2010, 63, 1113–1120. [Google Scholar] [CrossRef]
- Pentina, I.; Gammoh, B.S.; Zhang, L.; Mallin, M. Drivers and Outcomes of Brand Relationship Quality in the Context of Online Social Networks. Int. J. Electron. Commer. 2013, 17, 63–86. [Google Scholar] [CrossRef]
- Campbell, M.C.; Mohr, G.S.; Verlegh, P.W.J. Can Disclosures Lead Consumers to Resist Covert Persuasion? The Important Roles of Disclosure Timing and Type of Response. J. Consum. Psychol. 2013, 23, 483–495. [Google Scholar] [CrossRef]
- Jain, S.P.; Posavac, S.S. Prepurchase Attribute Verifiability, Source Credibility, and Persuasion. J. Consum. Psychol. 2001, 11, 169–180. [Google Scholar] [CrossRef]
- Campbell, M.C.; Kirmani, A. Consumers’ Use of Persuasion Knowledge: The Effects of Accessibility and Cognitive Capacity on Perceptions of an Influence Agent. J. Consum. Res. 2000, 27, 69–83. [Google Scholar] [CrossRef]
- Fein, S.; Hilton, J.L.; Miller, D.T. Suspicion of Ulterior Motivation and the Correspondence Bias. J. Personal. Soc. Psychol. 1990, 58, 753. [Google Scholar] [CrossRef] [PubMed]
- Fransen, M.L.; Verlegh, P.W.J.; Kirmani, A.; Smit, E.G. A Typology of Consumer Strategies for Resisting Advertising, and a Review of Mechanisms for Countering Them. Int. J. Advert. 2015, 34, 6–16. [Google Scholar] [CrossRef]
- Grant, R.; Clarke, R.J.; Kyriazis, E. A Review of Factors Affecting Online Consumer Search Behaviour from an Information Value Perspective. J. Mark. Manag. 2007, 23, 519–533. [Google Scholar] [CrossRef]
- Berry, S.; Does Company Size Affect SEO Strategy? Yes, And Here’s How. SEO.com. Available online: https://www.seo.com/blog/does-company-size-affect-seo-strategy/ (accessed on 20 March 2025).
- Dean, B.; We Analyzed 11.8 Million Google Search Results. Here’s What We Learned About SEO. 2025. Available online: https://backlinko.com/search-engine-ranking (accessed on 14 March 2025).
- Bort, J. Perplexity CEO Says Its Browser Will Track Everything Users Do Online to Sell “Hyper Personalized” Ads. TechCrunch. Available online: https://techcrunch.com/2025/04/24/perplexity-ceo-says-its-browser-will-track-everything-users-do-online-to-sell-hyper-personalized-ads/ (accessed on 30 April 2025).
- Li, C.; Pan, R.; Xin, H.; Deng, Z. Research on Artificial Intelligence Customer Service on Consumer Attitude and Its Impact during Online Shopping. J. Phys. Conf. Ser. 2020, 1575, 012192. [Google Scholar] [CrossRef]
- Wang, R.; Harper, F.M.; Zhu, H. Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual Differences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu HI, USA, 25–30 April 2020; ACM: Honolulu, HI, USA, 2020; pp. 1–14. [Google Scholar] [CrossRef]
- Hayes, A.F. Introduction to Mediation, Moderation, and Conditional Process Analysis, 2nd ed.; A Regression-Based Approach; Guilford Publications: New York, NY, USA, 2017. [Google Scholar]
- Kees, J.; Berry, C.; Burton, S.; Sheehan, K. An Analysis of Data Quality: Professional Panels, Student Subject Pools, and Amazon’s Mechanical Turk. J. Advert. 2017, 46, 141–155. [Google Scholar] [CrossRef]
- Oppenheimer, D.M.; Meyvis, T.; Davidenko, N. Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power. J. Exp. Soc. Psychol. 2009, 45, 867–872. [Google Scholar] [CrossRef]
- Miller, F.M.; Fournier, S.; Allen, C.T. Exploring Relationship Analogues in the Brand Space. In Consumer-Brand Relationships; Routledge: New York, NY, USA, 2012; pp. 30–56. [Google Scholar]
- Zaichkowsky, J.L. Measuring the Involvement Construct. J. Consum. Res. 1985, 12, 341–352. [Google Scholar] [CrossRef]
- Chang, S.-J.; Van Witteloostuijn, A.; Eden, L. Common Method Variance in International Business Research. In Research Methods in International Business; Eden, L., Nielsen, B.B., Verbeke, A., Eds.; JIBS Special Collections; Springer International Publishing: Cham, Switzerland, 2020; pp. 385–398. [Google Scholar] [CrossRef]
- Brodie, R.J.; Ilic, A.; Juric, B.; Hollebeek, L. Consumer Engagement in a Virtual Brand Community: An Exploratory Analysis. J. Bus. Res. 2013, 66, 105–114. [Google Scholar] [CrossRef]
- Jiang, L.C.; Bazarova, N.N.; Hancock, J.T. From Perception to Behavior: Disclosure Reciprocity and the Intensification of Intimacy in Computer-Mediated Communication. Commun. Res. 2013, 40, 125–143. [Google Scholar] [CrossRef]
- Aaker, J.L. Dimensions of Brand Personality. J. Mark. Res. 1997, 34, 347–356. [Google Scholar] [CrossRef]
- Kim, S.; Moore, S.G.; Murray, K. “Don’t Buy” or “Do Not Buy”? How Negation Style in Online Reviews Influences Consumer Product Evaluations. J. Mark. Theory Pract. 2021, 29, 308–322. [Google Scholar] [CrossRef]
- Yaeger-Dror, M.; Hall-Lew, L.; Deckert, S. It’s Not or Isn’t It? Using Large Corpora to Determine the Influences on Contraction Strategies. Lang. Var. Change 2002, 14, 79–118. [Google Scholar] [CrossRef]
- Sharma, R.W. Communicating across Age-Groups: Variance in Consumer Attitudes from Tweenagers to Adults. Young Consum. 2015, 16, 348–362. [Google Scholar] [CrossRef]
- Druckman, J.N.; Kam, C.D. Students as Experimental Participants. Camb. Handb. Exp. Political Sci. 2011, 1, 41–57. [Google Scholar]
- Bernardic, U.; Scheibehenne, B. Familiarity Attracts Consumer Attention: Two Methods to Objectively Measure Consumer Brand Familiarity. In Proceedings of the 34th Bled eConference Digital Support from Crisis to Progressive Change, University of Maribor, Maribor, Slovenia, 27–30 June 2021. [Google Scholar]
- Allen, M.S.; Iliescu, D.; Greiff, S. Single Item Measures in Psychological Science: A Call to Action. Eur. J. Psychol. Assess. 2022, 38, 1–5. [Google Scholar] [CrossRef]
- Bergkvist, L.; Rossiter, J.R. The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs. J. Mark. Res. 2007, 44, 175–184. [Google Scholar] [CrossRef]
- Fuchs, C.; Diamantopoulos, A. Using Single-Item Measures for Construct Measurement in Management Research: Conceptual Issues and Application Guidelines. Die Betriebswirtschaft 2009, 69, 195. [Google Scholar]
- Park, C.W.; Lessig, V.P. Familiarity and Its Impact on Consumer Decision Biases and Heuristics. J. Consum. Res. 1981, 8, 223–230. [Google Scholar] [CrossRef]
- Zhou, K.Z.; Nakamoto, K. How Do Enhanced and Unique Features Affect New Product Preference? The Moderating Role of Product Familiarity. J. Acad. Mark. Sci. 2007, 35, 53–62. [Google Scholar] [CrossRef]
- Williams, R. How to Use AI to Plan Your Next Vacation|MIT Technology Review. 2024. Available online: https://www.technologyreview.com/2024/07/08/1094733/how-to-use-ai-to-plan-your-next-vacation/ (accessed on 14 March 2025).
- Park, C.; Jun, J.-K. A Cross-Cultural Comparison of Internet Buying Behavior: Effects of Internet Usage, Perceived Risks, and Innovativeness. Int. Mark. Rev. 2003, 20, 534–553. [Google Scholar] [CrossRef]
- Pavlou, P.A.; Chai, L. What Drives Electronic Commerce across Cultures? Across-Cultural Empirical Investigation of the Theory of Planned Behavior. J. Electron. Commer. Res. 2002, 3, 240–253. [Google Scholar]
Measure | Percentage |
---|---|
Age | |
Under 18 | 0.5% |
18–24 | 93.8% |
25–34 | 2.8% |
35–44 | 0.5% |
45–54 | 1.4% |
55 or above | 0.9% |
Gender | |
Male | 34.6% |
Female | 63.0% |
Non-binary | 0.9% |
Prefer not to say | 1.4% |
b Coefficient (SE) | Lower 95% BCBCI | Upper 95% BCBCI | |
---|---|---|---|
Direct Effect | |||
Outcome: Search Preference (H1) | |||
ChatGPT vs. Search Engine | −0.32 (0.14) | −0.59 | −0.04 |
Laptop purchase plan | 0.16 (0.05) | 0.07 | 0.26 |
Outcome: Self-disclosure (H3) | |||
ChatGPT vs. Search Engine | −0.38 (0.16) | −0.69 | −0.07 |
Laptop purchase plan | 0.22 (0.06) | 0.11 | 0.33 |
Mediation Effect | |||
Outcome: Familiarity | |||
ChatGPT vs. Search Engine (X) | −0.51 (0.20) | −0.89 | −0.13 |
Laptop purchase plan | 0.13 (0.07) | −0.01 | 0.03 |
Outcome: Search Preference | |||
ChatGPT vs. Search Engine (X) | −0.20 (0.13) | −0.47 | 0.06 |
Familiarity (Med) | 0.03 (0.05) | 0.17 | 0.34 |
Laptop purchase plan (Cov) | 0.12 (0.05) | 0.03 | 0.22 |
Indirect mediation effect (H2) | −0.13 (0.06) | −0.26 | −0.03 |
Outcome: Self-disclosure | |||
ChatGPT vs. Search Engine (X) | −0.24 (0.15) | −0.54 | 0.06 |
Familiarity (Med) | 0.27 (0.05) | 0.16 | 0.37 |
Laptop purchase plan (Cov) | 0.18 (0.05) | 0.08 | 0.29 |
Indirect mediation effect (H4) | −0.13 (0.06) | −0.26 | −0.03 |
Moderated Mediation Effect | |||
Outcome: Search Preference | |||
ChatGPT vs. Search Engine (X) | −0.55 (0.36) | −1.25 | 0.15 |
Familiarity (Med) | −0.06 (0.11) | −0.28 | 0.16 |
Relationship Quality (Mod) | −0.02 (0.22) | −0.45 | 0.40 |
XxMod | 0.13 (0.11) | −0.09 | 0.34 |
MedxMod | 0.07 (0.03) | 0.01 | 0.14 |
Laptop purchase plan (Cov) | 0.01 (0.04) | −0.07 | 0.09 |
Index of moderated mediation (H5a) | −0.04 (0.03) | −0.10 | −0.004 |
Outcome: Self-disclosure | |||
ChatGPT vs. Search Engine (X) | −1.33 (0.39) | −2.11 | −0.55 |
Familiarity (Med) | −0.23 (0.12) | −0.47 | 0.13 |
Relationship Quality (Mod) | −0.39 (0.24) | −0.86 | 0.08 |
XxMod | 0.37 (0.12) | 0.13 | 0.61 |
MedxMod | 0.13 (0.03) | 0.06 | 0.21 |
Laptop purchase plan (Cov) | 0.05 (0.05) | −0.05 | 0.14 |
Index of moderated mediation (H5b) | −0.07 (0.03) | −0.14 | −0.02 |
Constructs | Indicators | Factor Loadings | Composite Reliability | Average Variance Extracted (AVE) | Cronbach’s Alpha |
---|---|---|---|---|---|
Bias perception toward a source of information (BP) | BP1 | 0.84 | 0.89 | 0.67 | 0.87 |
BP2 | 0.83 | ||||
BP3 | 0.82 | ||||
BP4 | 0.79 | ||||
Search preference (SP) | SP1 | 0.74 | 0.70 | 0.53 | - |
SP2 | 0.73 | ||||
Relationship Quality (RQ) | RQ1 | 0.86 | 0.84 | 0.73 | - |
RQ2 | 0.84 |
Constructs | Familiarity | Search Preference | Relationship Quality | Self-Disclosure Intention | Bias Perception |
---|---|---|---|---|---|
Familiarity | 1 | ||||
Search preference | 0.38 ** | 1 | |||
Relationship quality | 0.27 ** | 0.56 ** | 1 | ||
Self-disclosure intention | 0.36 ** | 0.68 ** | 0.55 ** | 1 | |
Bias perception | −0.32 ** | −0.49 ** | −0.36 ** | −0.45 ** | 1 |
Hypotheses | Test Results |
---|---|
H1: ChatGPT (vs. Search Engine) → Search preference | Supported |
H2: ChatGPT (vs. Search Engine) → Familiarity → Search preference | Supported |
H3: ChatGPT (vs. Search Engine) → Self-disclosure intention | Supported |
H4: ChatGPT (vs. Search Engine) → Familiarity → Self-disclosure intention | Supported |
H5a: ChatGPT (vs. Search Engine) → Familiarity x Relationship Quality → Search preference | Supported |
H5b: ChatGPT (vs. Search Engine) → Familiarity x Relationship Quality → Self-disclosure intention | Supported |
H6: ChatGPT (vs. Search Engine) → Bias perception | Supported |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kim, S.; Priluck, R. Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation. J. Theor. Appl. Electron. Commer. Res. 2025, 20, 93. https://doi.org/10.3390/jtaer20020093
Kim S, Priluck R. Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation. Journal of Theoretical and Applied Electronic Commerce Research. 2025; 20(2):93. https://doi.org/10.3390/jtaer20020093
Chicago/Turabian StyleKim, Soyoung, and Randi Priluck. 2025. "Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation" Journal of Theoretical and Applied Electronic Commerce Research 20, no. 2: 93. https://doi.org/10.3390/jtaer20020093
APA StyleKim, S., & Priluck, R. (2025). Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation. Journal of Theoretical and Applied Electronic Commerce Research, 20(2), 93. https://doi.org/10.3390/jtaer20020093