Next Article in Journal
Socio-Demographic Indicators, Intelligence, and Locus of Control as Predictors of Adult Financial Well-Being
Next Article in Special Issue
Missing the Wood for the Wrong Trees: On the Difficulty of Defining the Complexity of Complex Problem Solving Scenarios
Previous Article in Journal
Human Capital and Reemployment Success: The Role of Cognitive Abilities and Personality
Previous Article in Special Issue
What Can We Learn from “Not Much More than g”?
Article Menu

Export Article

Open AccessReview

Complex Problem Solving in Assessments of Collaborative Problem Solving

Psychology and the Institute for Intelligent Systems, University of Memphis, Memphis, TN 38152, USA
Graduate Institute of Educational Information and Measurement, National Taichung University of Education, Taichung 403, Taiwan
Department of Special Education, National Taichung University of Education, Taichung 403, Taiwan
Author to whom correspondence should be addressed.
Academic Editors: Samuel Greiff and Ronny Scherer
Received: 3 January 2017 / Revised: 23 February 2017 / Accepted: 15 March 2017 / Published: 27 March 2017
Full-Text   |   PDF [280 KB, uploaded 30 March 2017]


Collaborative problem solving (ColPS) proficiency was developed as a new assessment for the Programme for International Student Assessment (PISA) in the 2015 international evaluation of student skills and knowledge. The assessment framework defined by the PISA ColPS 2015 expert group crossed three major collaboration processes with four problem solving processes that were adopted from the PISA 2012 individual problem solving assessment to form a matrix of 12 specific skills. The three major collaboration processes are (1) establishing and maintaining shared understanding; (2) taking appropriate action; and (3) establishing and maintaining team organization. The four problem solving processes are exploring and understanding the problem, representing and formulating the problem, planning and executing strategies, and monitoring and reflecting on the problem-solving activities. This article discusses how the problem-solving dimension was integrated with the collaboration dimension. We also discuss how computer agents were involved in the PISA ColPS 2015 assessment in order to ensure a satisfactory assessment of collaborative problem solving. Examples of the use of agents to assess ColPS are provided in the context of a released PISA item and a project conducted in Taiwan. View Full-Text
Keywords: agents; collaborative problem solving; conversation-based assessment agents; collaborative problem solving; conversation-based assessment
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Graesser, A.; Kuo, B.-C.; Liao, C.-H. Complex Problem Solving in Assessments of Collaborative Problem Solving. J. Intell. 2017, 5, 10.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Metrics

Article Access Statistics



[Return to top]
J. Intell. EISSN 2079-3200 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top