Claire AI’s Impact on Item Writing: Research Findings1
67% less time per item: Average item-writing time decreased from 10.69 minutes manually to 3.49 minutes with Claire AI.
Nearly 3 times as many items produced: Participants produced an average of 28.2 AI-assisted items compared with 9.0 manually written items.
Comparable quality: Average quality ratings were 19.8/25 for AI-assisted items and 19.4/25 for manually written items.
More time for review: AI assistance reduced average drafting time from 9.13 minutes to 1.46 minutes, while revision time increased from 1.56 minutes to 2.03 minutes.
Faculty oversight remained essential: Educators were essential to evaluate clinical accuracy, cognitive level, defensibility and distractor plausibility.