Next Article in Journal
Zeroing in on the Genetics of Intelligence
Previous Article in Journal
Are Fit Indices Biased in Favor of Bi-Factor Models in Cognitive Ability Research?: A Comparison of Fit in Correlated Factors, Higher-Order, and Bi-Factor Models via Monte Carlo Simulations
Article Menu

Export Article

Open AccessArticle
J. Intell. 2015, 3(1), 21-40; doi:10.3390/jintelligence3010021

More is not Always Better: The Relation between Item Response and Item Response Time in Raven’s Matrices

1
German Institute for International Educational Research (DIPF), Centre for International Student Assessment (ZIB), Schloßstr. 29, 60486 Frankfurt am Main, Germany
2
Goethe-University of Frankfurt, Senckenberganlage 31, 60325 Frankfurt am Main, Germany
3
ECCS unit, University of Luxembourg, 11, Porte des Sciences, 4366 Esch, Luxembourg
*
Author to whom correspondence should be addressed.
Academic Editor: Paul De Boeck
Received: 28 November 2014 / Revised: 19 February 2015 / Accepted: 25 February 2015 / Published: 12 March 2015
View Full-Text   |   Download PDF [224 KB, uploaded 12 March 2015]   |  

Abstract

The role of response time in completing an item can have very different interpretations. Responding more slowly could be positively related to success as the item is answered more carefully. However, the association may be negative if working faster indicates higher ability. The objective of this study was to clarify the validity of each assumption for reasoning items considering the mode of processing. A total of 230 persons completed a computerized version of Raven’s Advanced Progressive Matrices test. Results revealed that response time overall had a negative effect. However, this effect was moderated by items and persons. For easy items and able persons the effect was strongly negative, for difficult items and less able persons it was less negative or even positive. The number of rules involved in a matrix problem proved to explain item difficulty significantly. Most importantly, a positive interaction effect between the number of rules and item response time indicated that the response time effect became less negative with an increasing number of rules. Moreover, exploratory analyses suggested that the error type influenced the response time effect. View Full-Text
Keywords: reasoning; item response times; generalized linear mixed modeling; moderation by person; moderation by item; number of rules; error type reasoning; item response times; generalized linear mixed modeling; moderation by person; moderation by item; number of rules; error type
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Goldhammer, F.; Naumann, J.; Greiff, S. More is not Always Better: The Relation between Item Response and Item Response Time in Raven’s Matrices. J. Intell. 2015, 3, 21-40.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
J. Intell. EISSN 2079-3200 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top