Carlos Fernando Collares, Maastricht University / EBMA


Workshop description

This workshop is aimed not only on understanding the item response theory approach to adaptive testing, but also on the practical matters: how to calibrate items and interpret compliance with assumptions, what are the different linking/equating methods to build an item bank, what are the advantages and disadvantages of the different systems available for adaptive testing and experiencing how an adaptive test works. Participants will be able to experience how dynamic item selection occurs and see how accelerated reduction of the standard measurement error happening in real time.


Objectives

  • Comprehension of item response theory principles
  • Calibration of test items in R
  • Interpretation of item parameters, dimensionality, local independence and fit indices
  • Comprehension of the equating methods used to build an item bank
  • Overview of the systems available for adaptive testing
  • Having experience on how the algorithm works using an online computerized adaptive testing tutorial environment.


References

Roex, A., & Degryse, J. (2004). A Computerized Adaptive Knowledge Test as an assessment tool in general practice: a pilot study. Medical teacher26(2), 178-183.

De Champlain, A. F. (2010). A primer on classical test theory and item response theory for assessments in medical education. Medical education44(1), 109-117.

Downing, S. M. (2003). Item response theory: applications of modern test theory in medical education. Medical Education37(8), 739-745.