Next Article in Journal
Socio-Demographic Indicators, Intelligence, and Locus of Control as Predictors of Adult Financial Well-Being
Next Article in Special Issue
Missing the Wood for the Wrong Trees: On the Difficulty of Defining the Complexity of Complex Problem Solving Scenarios
Previous Article in Journal
Human Capital and Reemployment Success: The Role of Cognitive Abilities and Personality
Previous Article in Special Issue
What Can We Learn from “Not Much More than g”?
Open AccessReview

Complex Problem Solving in Assessments of Collaborative Problem Solving

Psychology and the Institute for Intelligent Systems, University of Memphis, Memphis, TN 38152, USA
Graduate Institute of Educational Information and Measurement, National Taichung University of Education, Taichung 403, Taiwan
Department of Special Education, National Taichung University of Education, Taichung 403, Taiwan
Author to whom correspondence should be addressed.
Academic Editors: Samuel Greiff and Ronny Scherer
Received: 3 January 2017 / Revised: 23 February 2017 / Accepted: 15 March 2017 / Published: 27 March 2017
Collaborative problem solving (ColPS) proficiency was developed as a new assessment for the Programme for International Student Assessment (PISA) in the 2015 international evaluation of student skills and knowledge. The assessment framework defined by the PISA ColPS 2015 expert group crossed three major collaboration processes with four problem solving processes that were adopted from the PISA 2012 individual problem solving assessment to form a matrix of 12 specific skills. The three major collaboration processes are (1) establishing and maintaining shared understanding; (2) taking appropriate action; and (3) establishing and maintaining team organization. The four problem solving processes are exploring and understanding the problem, representing and formulating the problem, planning and executing strategies, and monitoring and reflecting on the problem-solving activities. This article discusses how the problem-solving dimension was integrated with the collaboration dimension. We also discuss how computer agents were involved in the PISA ColPS 2015 assessment in order to ensure a satisfactory assessment of collaborative problem solving. Examples of the use of agents to assess ColPS are provided in the context of a released PISA item and a project conducted in Taiwan. View Full-Text
Keywords: agents; collaborative problem solving; conversation-based assessment agents; collaborative problem solving; conversation-based assessment
MDPI and ACS Style

Graesser, A.; Kuo, B.-C.; Liao, C.-H. Complex Problem Solving in Assessments of Collaborative Problem Solving. J. Intell. 2017, 5, 10.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Search more from Scilit
Back to TopTop