At low base rates, specificity works in extremely counterintuitive ways, as shown below. Generally, we think ML is going to help a lot with spotting paper mills and Scancar et al's classifier seems to work very well!
At low base rates, specificity works in extremely counterintuitive ways, as shown below. Generally, we think ML is going to help a lot with spotting paper mills and Scancar et al's classifier seems to work very well!
We looked at 100 IGT studies and found abysmal reporting standards, and 244 different scoring techniques. Applied to a new dataset, the average correlation between these 244 techniques was 0. 5/15 IGT meta-analyses we looked at did not account for this hetereogenity.
January 26, 2026 at 8:28 AM
We looked at 100 IGT studies and found abysmal reporting standards, and 244 different scoring techniques. Applied to a new dataset, the average correlation between these 244 techniques was 0. 5/15 IGT meta-analyses we looked at did not account for this hetereogenity.
But then, why skip everything after the "might" step and go straight to asking for more funding for social psych? Clearly there never was any curiosity in learning whether LLMs can do this.
December 10, 2025 at 10:21 AM
But then, why skip everything after the "might" step and go straight to asking for more funding for social psych? Clearly there never was any curiosity in learning whether LLMs can do this.
Cake club time! Today we're reading McNeish, "How Do Psychologists Determine Whether a Measurement Scale Is Good?" With a side of Sacher cake and lemon meringue cake www.annualreviews.org/content/jour...
October 3, 2025 at 7:16 AM
Cake club time! Today we're reading McNeish, "How Do Psychologists Determine Whether a Measurement Scale Is Good?" With a side of Sacher cake and lemon meringue cake www.annualreviews.org/content/jour...