Usability Study through a Human-Robot Collaborative Workspace Experience
Round 1
Reviewer 1 Report
Dear Author, your paper is about the use of collaborative robots (cobots) in industrial and academic settings; this kind of robot facilitates physical and cognitive interaction with operators. It is known in literature and in industry that this framework is a challenge to determine how measures on concepts such as usability can be adapted to these new environments.
Usability can be a quality attribute prevalent in the field of human-computer interaction concerning the context of use and the measure of effectiveness, efficiency, and satisfaction of products and systems.
It is demonstrated how in your work the importance of benchmarking , as a relevant tool to organize design. You adopted a part of a general methodology for studying people and robots’ performance in collaboration. It is fundamental that your exeprience was designed and developed on a concrete job into a human-robot collaborative workspace.
For the above explained reasons, I think that the paper can be accepted in the present form.
Best regards
Reviewer
Author Response
Dear Reviewer,
my co-authors and I would like to thank you for your time and comments to enrich our manuscript. We appreciate your thorough review and constructive suggestions.
Thank you again for your consideration.
********
Dear Author, your paper is about the use of collaborative robots (cobots) in industrial and academic settings; this kind of robot facilitates physical and cognitive interaction with operators. It is known in literature and in industry that this framework is a challenge to determine how measures on concepts such as usability can be adapted to these new environments.
Usability can be a quality attribute prevalent in the field of human-computer interaction concerning the context of use and the measure of effectiveness, efficiency, and satisfaction of products and systems.
It is demonstrated how in your work the importance of benchmarking , as a relevant tool to organize design. You adopted a part of a general methodology for studying people and robots’ performance in collaboration. It is fundamental that your exeprience was designed and developed on a concrete job into a human-robot collaborative workspace.
- For the above explained reasons, I think that the paper can be accepted in the present form.
Thanks a lot for a so positive review and comments.
Reviewer 2 Report
This paper presents a usability case study for a human-robot collaborative experiment in a lab set-up environment. The paper is well written and clearly organized. The addressed topic is of practical importance. However, the contribution of this work is not clearly identified/highlighted. Different from what the title implies, this work appears more like a specific case study of implementation following the guidance of standard ISO9241. It is not clearly explained how the specific tasks can contribute to benchmarking the HRI usability. Considering the experiment procedures and result analyses are quite detailed already, the authors are suggested to elaborate on this major issue to improve the quality of the paper.
Author Response
Dear Reviewer, my co-authors and I would like to thank you for your time and comments to enrich our manuscript. We appreciate your thorough review and constructive suggestions.
We have carefully reviewed your comments and made revisions to accommodate them. We really believe each point raised significantly improved the original manuscript. Although changes are throughout the document, detailed responses to comments are given in the following page. We have responded to your questions and we hope to have soundly addressed your concerns.
Thank you again for your consideration.
************************************
This paper presents a usability case study for a human-robot collaborative experiment in a lab set-up environment. The paper is well written and clearly organized. The addressed topic is of practical importance.
- However, the contribution of this work is not clearly identified/highlighted. Different from what the title implies, this work appears more like a specific case study of implementation following the guidance of standard ISO9241. It is not clearly explained how the specific tasks can contribute to benchmarking the HRI usability. Considering the experiment procedures and result analyses are quite detailed already, the authors are suggested to elaborate on this major issue to improve the quality of the paper.
Yes, we agree. Benchmarking is a too generic, even too ambitious, framework, and the final provided results in the article are more specific to a usability study. So, the title of the paper is modified to “Usability Study through a Human-Robot Collaborative Workspace Experience”
************************
Round 2
Reviewer 2 Report
After the revisions made according to the first round review, the reviewer has no further comments on the revised manuscript.
