validateIt: Crowdsourced Validation of Topic Models

Jan 1, 2022·
Luwei Ying
,
Jacob M. Montgomery
,
Brandon M. Stewart
· 0 min read
Abstract
Topic models generate topics — but are those topics coherent, and do the labels researchers assign actually capture what the topics represent? validateIt streamlines crowdsourced validation of topic models via Amazon Mechanical Turk, creating and managing validation tasks that assess both topic coherence and label accuracy. Designed to integrate directly into standard topic modeling workflows in R. Companion to Ying, Montgomery, and Stewart (2022), Political Analysis.
software