Effects and Unforeseen Consequences of Accessing References on a Maintenance of Certification Examination: Findings From a National Study.

Permitting references caused an increase in performance, but also a decrease in the perception that the test has sufficient time limits. Implications for allowing references are discussed, including physician time management, impact on the construct assessed by the test, and the importance of providing validity evidence for all test design decisions.