An Approach to Developing Likert Scale Survey Results Based on the Example of a Research Study Involving a Limited Number of Students
Abstract
1. Introduction
1.1. Study Framework
1.2. Study Purpose
2. Materials and Methods
3. Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Alkhwaldi, A.F. Investigating the social sustainability of immersive virtual technologies in higher educational institutions: Students’ perceptions toward metaverse technology. Sustainability 2024, 16, 934. [Google Scholar] [CrossRef]
- Su, Z.; Wang, H.; Shao, Z.; Liu, Z.; Liu, Y.; Liu, S. Ecological network analysis of attention flow in online learning: Insights into knowledge acquisition and dropout behaviors. Inf. Process. Manag. 2025, 62, 104163. [Google Scholar] [CrossRef]
- Creswell, J.W. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 3rd ed.; SAGE Publications Inc.: Los Angeles, CA, USA, 2009. [Google Scholar]
- Min, W.; Jiang, S.; Liu, L.; Rui, Y.; Jain, R. A survey on food computing. ACM Comput. Surv. 2019, 52, 1–36. [Google Scholar] [CrossRef]
- Mauer, W.A.; Kaneene, J.B.; DeArman, V.T.; Roberts, C.A. Ethnic-food safety concerns: An online survey of food safety professionals. J. Environ. Health 2006, 68, 32–38. [Google Scholar]
- Lazou, T.; Georgiadis, M.; Pentieva, K.; McKevitt, A.; Iossifidou, E. Food safety knowledge and food-handling practices of Greek university students: A questionnaire-based survey. Food Control 2012, 28, 400–411. [Google Scholar] [CrossRef]
- Wu, P.; Tang, T.; Zhou, L.; Martínez, L. A decision-support model through online reviews: Consumer preference analysis and product ranking. Inf. Process. Manag. 2024, 61, 103728. [Google Scholar] [CrossRef]
- Kim, J.; Choi, I.; Li, Q. Customer satisfaction of recommender system: Examining accuracy and diversity in several types of recommendation approaches. Sustainability 2021, 13, 6165. [Google Scholar] [CrossRef]
- Gaworski, M.; Sołtys, P. Assessment of consumer awareness regarding the implementation of innovative food packaging. Agron. Res. 2025, 23, 15–26. [Google Scholar] [CrossRef]
- Heide, M.; Olsen, S.O. Influence of packaging attributes on consumer evaluation of fresh cod. Food Qual. Prefer. 2017, 60, 9–18. [Google Scholar] [CrossRef]
- Gaworski, M.; Turbakiewicz, S. Understanding animal welfare by students and graduates of different studies. Agron. Res. 2020, 18, 1255–1266. [Google Scholar] [CrossRef]
- Singh, J.; Singh, H.; Singh, S. A questionnaire on survey of problems facing by agriculture field using data mining. Int. J. Comp. Technol. Appl. 2013, 4, 301. [Google Scholar]
- Mucherino, A.; Papajorgji, P.; Pardalos, P.M. A survey of data mining techniques applied to agriculture. Oper. Res. 2009, 9, 121–140. [Google Scholar] [CrossRef]
- Motyl, B.; Baronio, G.; Uberti, S.; Speranza, D.; Filippi, S. How will change the future engineers’ skills in the Industry 4.0 framework? A questionnaire survey. Procedia Manuf. 2017, 11, 1501–1509. [Google Scholar] [CrossRef]
- Syp, A.; Osuch, D. Dairy farmers’ views on environment, results of questionnaire survey from regions of Mazowsze and Podlasie in Poland. Eng. Rur. Develop. 2019, 18, 751–757. [Google Scholar] [CrossRef]
- Makinde, O.; Mowandi, T.; Munyai, T.; Ayomoh, M. Performance evaluation of the supply chain system of a food product manufacturing system using a questionnaire-based approach. Procedia Manuf. 2020, 43, 751–757. [Google Scholar] [CrossRef]
- Redmond, E.C.; Griffith, C.J. A comparison and evaluation of research methods used in consumer food safety studies. Int. J. Consum. Stud. 2003, 27, 17–33. [Google Scholar] [CrossRef]
- Suárez-García, A.; Álvarez-Hernández, M.; Arce, E.; Ribas, J.R. Exploring the efficacy of binary surveys versus Likert scales in assessing student perspectives using Bayesian analysis. Appl. Sci. 2024, 14, 4189. [Google Scholar] [CrossRef]
- Cardoso, C.S.; Hötzel, M.J.; Weary, D.M.; Robbins, J.A.; von Keyserlingk, M.A.G. Imagining the ideal dairy farm. J. Dairy Sci. 2016, 99, 1663–1671. [Google Scholar] [CrossRef] [PubMed]
- Perttu, R.K.; Ventura, B.A.; Endres, M.I. Youth and adult public views of dairy calf housing options. J. Dairy Sci. 2020, 103, 8507–8517. [Google Scholar] [CrossRef]
- Cardoso, C.S.; von Keyserlingk, M.A.G.; Hötzel, M.J. Views of dairy farmers, agricultural advisors, and lay citizens on the ideal dairy farm. J. Dairy Sci. 2019, 102, 1811–1821. [Google Scholar] [CrossRef]
- Gaworski, M.; de Cacheleu, C.; Inghels, C.; Leurs, L.; Mazarguil, C.; Ringot, B.; Tzu-Chen, C. The topic of the ideal dairy farm can inspire how to assess knowledge about dairy production processes: A case study with students and their contributions. Processes 2021, 9, 1357. [Google Scholar] [CrossRef]
- Kamińska, N.; Gaworski, M.; Kaźmierska, P.; Klepacka, A.M. Pilot study of variability on demand and knowledge concerning organic food on an example of two Polish regions. Agron. Res. 2016, 14, 67–74. [Google Scholar]
- Alwin, D.F.; Baumgartner, E.M.; Beattie, B.A. Number of response categories and reliability in attitude measurement. J. Surv. Stat. Methodol. 2018, 6, 212–239. [Google Scholar] [CrossRef]
- Aybek, E.C.; Toraman, C. How many response categories are sufficient for Likert type scales? An empirical study based on the Item Response Theory. Int. J. Assess. Tool. Educ. 2022, 9, 534–547. [Google Scholar] [CrossRef]
- Kusmaryono, I.; Wijayanti, D.; Maharani, H.R. Number of response options, reliability, validity, and potential bias in the use of the Likert scale education and social science research: A literature review. Int. J. Educ. Methodol. 2022, 8, 625–637. [Google Scholar] [CrossRef]
- Dawes, J. Do data characteristics change according to the number of scale points used? An experiment using 5-point, 7-point and 10-point scales. Int. J. Mark. Res. 2008, 50, 61–104. [Google Scholar] [CrossRef]
- Awang, Z.; Afthanorhan, A.; Mamat, M. The Likert scale analysis using parametric based Structural Equation Modeling (SEM). Comput. Methods Soc. Sci. 2016, 4, 13. [Google Scholar]
- Li, Q. A novel Likert scale based on fuzzy sets theory. Expert Syst. Appl. 2013, 40, 1609–1618. [Google Scholar] [CrossRef]
- Biasetton, N.; Disegna, M.; Barzizza, E.; Salmaso, L. A new adaptive membership function with CUB uncertainty with application to cluster analysis of Likert-type data. Expert Syst. Appl. 2023, 213, 118893. [Google Scholar] [CrossRef]
- Pirmoradi, A.; Hoeber, O. Bridging in-task emotional responses with post-task evaluations in digital library search interface user studies. Inf. Process. Manag. 2025, 62, 104069. [Google Scholar] [CrossRef]
- van der Sluis, F. Wanting information: Uncertainty and its reduction through search engagement. Inf. Process. Manag. 2025, 62, 103890. [Google Scholar] [CrossRef]
- Kim, C.; Costello, F.J.; Lee, J.; Lee, K.C. Metaverse-based distance learning as a transactional distance mitigator and memory retrieval stimulant. Inf. Process. Manag. 2025, 62, 103957. [Google Scholar] [CrossRef]
- Plutzer, E.; Berkman, M.B. Scaled paired comparisons as an alternative to ratings and rankings for measuring values. J. Surv. Stat. Methodol. 2025, 13, 39–65. [Google Scholar] [CrossRef]
- Gaworski, M.; Borowski, P.F.; Zajkowska, M. Attitudes of a group of young Polish consumers towards selected features of dairy products. Agron. Res. 2021, 19, 1023–1038. [Google Scholar] [CrossRef]
- Meng, G.; Liu, C. Personal information organization literacy in the academic context: Scale development, performance assessment, and influence exploration. Inf. Process. Manag. 2025, 62, 104166. [Google Scholar] [CrossRef]
- Lamm, A.J.; Lamm, K.W.; Trojan, S.; Sanders, C.E.; Byrd, A.R. A needs assessment to inform research and outreach efforts for sustainable agricultural practices and food production in the Western United States. Foods 2023, 12, 1630. [Google Scholar] [CrossRef]
- Jebb, A.T.; Ng, V.; Tay, L. A review of key Likert scale development advances: 1995–2019. Front. Psychol. 2021, 12, 637547. [Google Scholar] [CrossRef]
- Joshi, A.; Kale, S.; Chandel, S.; Pal, D.K. Likert scale: Explored and explained. Br. J. Appl. Sci. Technol. 2015, 7, 396–403. [Google Scholar] [CrossRef]
- Mircioiu, C.; Atkinson, J. A comparison of parametric and non-parametric methods applied to a Likert scale. Pharmacy 2017, 5, 26. [Google Scholar] [CrossRef]
- Norman, G. Likert scales, levels of measurement and the “laws” of statistics. Adv. Health Sci. Educ. 2010, 15, 625–632. [Google Scholar] [CrossRef]
- Sullivan, G.M.; Artino, A.R., Jr. Analyzing and interpreting data from Likert-type scales. J. Grad. Med. Educ. 2013, 5, 541–542. [Google Scholar] [CrossRef]
- Batterton, K.A.; Hale, K.N. The Likert scale what it is and how to use it. Phalanx 2017, 50, 32–39. [Google Scholar]
- Zhao, R.; Tang, J.; Zeng, W.; Guo, Y.; Zhao, X. Towards human-like questioning: Knowledge base question generation with bias-corrected reinforcement learning from human feedback. Inf. Process. Manag. 2025, 62, 104044. [Google Scholar] [CrossRef]
- Herold, I.; Bergmann, M.; Bethmann, A. Trust, concerns and attitudes: Examples for respondent (non-)cooperation in SHARE. Surv. Res. Methods 2025, 19, 295–305. [Google Scholar] [CrossRef]
- Nemoto, T.; Beglar, D. Likert-scale questionnaires. In JALT 2013 Conference Proceedings, Tokyo, Japan, 25–29 October 2013; JALT: Tokyo, Japan, 2013. [Google Scholar]
- Haslbeck, J.; Martínez, A.J.; Roefs, A.J.; Fried, E.I.; Lemmens, L.H.; Groot, E.; Edelsbrunner, P.A. Comparing Likert and visual analogue scales in ecological momentary assessment. Behav. Res. Methods 2025, 57, 217. [Google Scholar] [CrossRef]
- Nawaz, R.; Sun, Q.; Shardlow, M.; Kontonatsios, G.; Aljohani, N.R.; Visvizi, A.; Hassan, S.-U. Leveraging AI and machine learning for National Student Survey: Actionable insights from textual feedback to enhance quality of teaching and learning in UK’s higher education. Appl. Sci. 2022, 12, 514. [Google Scholar] [CrossRef]
- Olsson, D.; Gericke, N.; Chang Rundgren, S.N. The effect of implementation of education for sustainable development in Swedish compulsory schools–assessing pupils’ sustainability consciousness. Environ. Educ. Res. 2016, 22, 176–202. [Google Scholar] [CrossRef]
- Clark, L.A.; Watson, D. Constructing validity: New developments in creating objective measuring instruments. Psychol. Assess. 2019, 31, 1412. [Google Scholar] [CrossRef]
- Heine, S.J.; Lehman, D.R.; Peng, K.; Greenholtz, J. What’s wrong with cross-cultural comparisons of subjective Likert scales?: The reference-group effect. J. Pers. Soc. Psychol. 2002, 82, 903–918. [Google Scholar] [CrossRef] [PubMed]
- De Giorgis, S.; Gangemi, A.; Russo, A. Neurosymbolic graph enrichment for grounded world models. Inf. Process. Manag. 2025, 62, 104127. [Google Scholar] [CrossRef]
- Lee, J.W.; Jones, P.S.; Mineyama, Y.; Zhang, X.E. Cultural differences in responses to a Likert scale. Res. Nurs. Health 2002, 25, 295–306. [Google Scholar] [CrossRef] [PubMed]
- Jorge, M.L.; Madueno, J.H.; Cejas, M.Y.C.; Peña, F.J.A. An approach to the implementation of sustainability practices in Spanish universities. J. Clean. Prod. 2015, 106, 34–44. [Google Scholar] [CrossRef]
- Boca, G.D.; Saraçlı, S. Environmental education and student’s perception, for sustainability. Sustainability 2019, 11, 1553. [Google Scholar] [CrossRef]
- Brankovic, J.; Hamann, J.; Ringel, L. The institutionalization of rankings in higher education: Continuities, interdependencies, engagement. High. Educ. 2023, 86, 719–731. [Google Scholar] [CrossRef]
- Hassan, A.; Noordin, T.A.; Sulaiman, S. The status on the level of environmental awareness in the concept of sustainable development amongst secondary school students. Procedia Soc. Behav. Sci. 2010, 2, 1276–1280. [Google Scholar] [CrossRef]
- Uitto, A.; Saloranta, S. Subject teachers as educators for sustainability: A survey study. Educ. Sci. 2017, 7, 8. [Google Scholar] [CrossRef]
- Sassenrath, G.F.; Heilman, P.; Luschei, E.; Bennett, G.L.; Fitzgerald, G.; Klesius, P.; Tracy, W.; Williford, J.R.; Zimba, P.V. Technology, complexity and change in agricultural production systems. Renew. Agric. Food Syst. 2008, 23, 285–295. [Google Scholar] [CrossRef]
- Gębska, M.; Grontkowska, A.; Świderek, W.; Gołębiewska, B. Farmer awareness and implementation of sustainable agriculture practices in different types of farms in Poland. Sustainability 2020, 12, 8022. [Google Scholar] [CrossRef]
- Britt, J.H.; Cushman, R.A.; Dechow, C.D.; Dobson, H.; Humblot, P.; Hutjens, M.F.; Jones, G.A.; Ruegg, P.S.; Sheldon, I.M.; Stevenson, J.S. Invited review: Learning from the future—A vision for dairy farms and cows in 2067. J. Dairy Sci. 2018, 101, 3722–3741. [Google Scholar] [CrossRef]
- Gaworski, M.; Kic, P. Assessment of production technologies on dairy farms in terms of animal welfare. Appl. Sci. 2024, 14, 6086. [Google Scholar] [CrossRef]
- Boogaard, B.K.; Bock, B.B.; Oosting, S.J.; Wiskerke, J.S.; van der Zijpp, A.J. Social acceptance of dairy farming: The ambivalence between the two faces of modernity. J. Agric. Environ. Ethics 2011, 24, 259–282. [Google Scholar] [CrossRef]
- Bos, A.P.; Koerkamp, P.G.; Gosselink, J.M.J.; Bokma, S. Reflexive interactive design and its application in a project on sustainable dairy husbandry systems. Outlook Agric. 2009, 38, 137–145. [Google Scholar] [CrossRef]
- Steeneveld, W.; Hogeveen, H. Characterization of Dutch dairy farms using sensor systems for cow management. J. Dairy Sci. 2015, 98, 709–717. [Google Scholar] [CrossRef]
- Hogeveen, H.; Ouweltjes, W. Sensors and management support in high-technology milking. J. Anim. Sci. 2003, 81, 1–10. [Google Scholar] [CrossRef]
- Jacobs, J.A.; Siegford, J.M. Invited review: The impact of automatic milking systems on dairy cow management, behavior, health, and welfare. J. Dairy Sci. 2012, 95, 2227–2247. [Google Scholar] [CrossRef]
- Da Borso, F.; Chiumenti, A.; Sigura, M.; Pezzuolo, A. Influence of automatic feeding systems on design and management of dairy farms. J. Agric. Eng. 2017, 48, 48–52. [Google Scholar] [CrossRef]
- Romano, E.; Brambilla, M.; Cutini, M.; Giovinazzo, S.; Lazzari, A.; Calcante, A.; Tangorra, F.M.; Rossi, P.; Motta, A.; Bisaglia, C.; et al. Increased cattle feeding precision from automatic feeding systems: Considerations on technology spread and farm level perceived advantages in Italy. Animals 2023, 13, 3382. [Google Scholar] [CrossRef]
- Marino, R.; Petrera, F.; Abeni, F. Scientific productions on precision livestock farming: An overview of the evolution and current state of research based on a bibliometric analysis. Animals 2023, 13, 2280. [Google Scholar] [CrossRef] [PubMed]
- Gargiulo, J.I.; Eastwood, C.R.; Garcia, S.C.; Lyons, N.A. Dairy farmers with larger herd sizes adopt more precision dairy technologies. J. Dairy Sci. 2018, 101, 5466–5473. [Google Scholar] [CrossRef] [PubMed]
- Hansen, B.G.; Stræte, E.P. Dairy farmers’ job satisfaction and the influence of automatic milking systems. NJAS-Wagening. J. Life Sci. 2020, 92, 100328. [Google Scholar] [CrossRef]
- Guerra, A.L.; Gidel, T.; Vezzetti, E. Toward a common procedure using likert and likert-type scales in small groups comparative design observations. In DS 84: Proceedings of the DESIGN 2016 14th International Design Conference, Dubrovnik, Croatia, 16–19 May 2016; The Design Society: Glasgow, Scotland, 2016; pp. 23–32. [Google Scholar]
- France, S.; Adams, F.G.; Landers, V.M. Worst case resistance testing: A nonresponse bias solution for today’s survey research realities. Surv. Res. Methods 2024, 18, 187–210. [Google Scholar] [CrossRef]
- South, L.; Saffo, D.; Vitek, O.; Dunne, C.; Borkin, M.A. Effective use of Likert scales in visualization evaluations: A systematic review. Comput. Graph. Forum 2022, 41, 43–55. [Google Scholar] [CrossRef]
- Wang, J.; Hou, W.; Li, Y.; Sun, J.; Kang, L. Beyond boundaries: Exploring the interaction between science and technology in fusion knowledge communities. Inf. Process. Manag. 2025, 62, 104102. [Google Scholar] [CrossRef]
- Badilescu-Buga, E. Knowledge behaviour and social adoption of innovation. Inf. Process. Manag. 2013, 49, 902–911. [Google Scholar] [CrossRef]
- Grunert, K.G.; Bech-Larsen, T.; Bredahl, L. Three issues in consumer quality perception and acceptance of dairy products. Int. Dairy J. 2000, 10, 575–584. [Google Scholar] [CrossRef]
- Sajdakowska, M.; Gębski, J.; Guzek, D.; Gutkowska, K.; Żakowska-Biemans, S. Dairy products quality from a consumer point of view: Study among Polish adults. Nutrients 2020, 12, 1503. [Google Scholar] [CrossRef]
- Merlino, V.M.; Renna, M.; Nery, J.; Muresu, A.; Ricci, A.; Maggiolino, A.; Celano, G.; De Ruggieri, B.; Tarantola, M. Are local dairy products better? Using principal component analysis to investigate consumers’ perception towards quality, sustainability, and market availability. Animals 2022, 12, 1421. [Google Scholar] [CrossRef]
| The Issue Under Consideration in the Question: Modernity and Innovations in Technical Equipment for Dairy Production Have an Impact on… | Percentage Share [%] | FSI Value | |
|---|---|---|---|
| ps4,5 | ps1,2 | ||
| Efficiency of production processes | 90 | 5 | 18.0 |
| Sustainable milk production | 85 | 5 | 17.0 |
| Investments in research on dairy production technologies | 80 | 5 | 16.0 |
| Price of dairy products | 55 | 10 | 5.5 |
| Availability of dairy products | 70 | 30 | 2.33 |
| Taste of dairy products | 40 | 30 | 1.33 |
| The Issue Under Consideration in the Question: Modernity and Innovations in Technical Equipment for Dairy Production Have an Impact on… | Percentage Share [%] | FSIbis | FSI Value | |
|---|---|---|---|---|
| ps4,5 | ps1,2 | |||
| Product quality and safety of their consumption | 85 | 0 | 1.000 | – |
| Shelf life of dairy products | 90 | 0 | 1.000 | – |
| Competitiveness of a dairy plant in the dairy product market | 75 | 0 | 1.000 | – |
| Development of the dairy industry | 100 | 0 | 1.000 | – |
| Efficiency of production processes | 90 | 5 | 0.947 | 18.0 |
| Sustainable milk production | 85 | 5 | 0.944 | 17.0 |
| Investments in research on dairy production technologies | 80 | 5 | 0.941 | 16.0 |
| Price of dairy products | 55 | 10 | 0.846 | 5.5 |
| Availability of dairy products | 70 | 30 | 0.700 | 2.33 |
| Taste of dairy products | 40 | 30 | 0.571 | 1.33 |
| The Issue Under Consideration in the Question: Modernity and Innovations in Technical Equipment for Dairy Production Have an Impact on… | FSIbis | FSIbis1.0 |
|---|---|---|
| Development of the dairy industry | 1.00 | 1.00 |
| Shelf life of dairy products | 1.00 | 0.90 |
| Product quality and safety of their consumption | 1.00 | 0.85 |
| Competitiveness of a dairy plant in the dairy product market | 1.00 | 0.75 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Gaworski, M.; Daśko, A. An Approach to Developing Likert Scale Survey Results Based on the Example of a Research Study Involving a Limited Number of Students. Appl. Sci. 2026, 16, 2602. https://doi.org/10.3390/app16052602
Gaworski M, Daśko A. An Approach to Developing Likert Scale Survey Results Based on the Example of a Research Study Involving a Limited Number of Students. Applied Sciences. 2026; 16(5):2602. https://doi.org/10.3390/app16052602
Chicago/Turabian StyleGaworski, Marek, and Aleksandra Daśko. 2026. "An Approach to Developing Likert Scale Survey Results Based on the Example of a Research Study Involving a Limited Number of Students" Applied Sciences 16, no. 5: 2602. https://doi.org/10.3390/app16052602
APA StyleGaworski, M., & Daśko, A. (2026). An Approach to Developing Likert Scale Survey Results Based on the Example of a Research Study Involving a Limited Number of Students. Applied Sciences, 16(5), 2602. https://doi.org/10.3390/app16052602

