Alex Coppock
@aecoppock.bsky.social
Associate Professor of Political Science at Northwestern University
alexandercoppock.com
Persuasion in Parallel: https://alexandercoppock.com/coppock_2023.html
Research Design: Declaration, Diagnosis, and Redesign: book.declaredesign.org
alexandercoppock.com
Persuasion in Parallel: https://alexandercoppock.com/coppock_2023.html
Research Design: Declaration, Diagnosis, and Redesign: book.declaredesign.org
Also, friends, reviewers, editors -- please be willing to publish experimental estimates of the effects of anti-corruption messages on vote choice even if the "theory isn't novel" or "so and so already published on the effects of anti-corruption."
This is an impt. estimand; we need many estimates!
This is an impt. estimand; we need many estimates!
November 20, 2025 at 8:21 PM
Also, friends, reviewers, editors -- please be willing to publish experimental estimates of the effects of anti-corruption messages on vote choice even if the "theory isn't novel" or "so and so already published on the effects of anti-corruption."
This is an impt. estimand; we need many estimates!
This is an impt. estimand; we need many estimates!
ever so slightly on the nose, eh?
November 19, 2025 at 10:21 PM
ever so slightly on the nose, eh?
ashamed as a sometime Minnesotan that I had to look up Ski U Mah!!
November 19, 2025 at 10:20 PM
ashamed as a sometime Minnesotan that I had to look up Ski U Mah!!
I agree that we learn from this study that the causal effect of asking for formula (relative to not asking) on getting formula is positive (and that it varies by religious institution!!)
I just mean she's not randomizing something else, like signaling religious affiliation vs not.
I just mean she's not randomizing something else, like signaling religious affiliation vs not.
November 13, 2025 at 5:02 PM
I agree that we learn from this study that the causal effect of asking for formula (relative to not asking) on getting formula is positive (and that it varies by religious institution!!)
I just mean she's not randomizing something else, like signaling religious affiliation vs not.
I just mean she's not randomizing something else, like signaling religious affiliation vs not.
I'm also prickly about the idea that survey experiments reveal which messages "poll well" in some kind of popularism sense.
They just tell you which message has the highest ATE on vote choice, which may or may not be the messages that people "like" the most
They just tell you which message has the highest ATE on vote choice, which may or may not be the messages that people "like" the most
November 5, 2025 at 6:20 PM
I'm also prickly about the idea that survey experiments reveal which messages "poll well" in some kind of popularism sense.
They just tell you which message has the highest ATE on vote choice, which may or may not be the messages that people "like" the most
They just tell you which message has the highest ATE on vote choice, which may or may not be the messages that people "like" the most
I've summed up what I personally know about attention here. I don't yet think we have the design worked out like we do vote the ATEs on vote choice. But I don't think a better experimental design is out of reach, I just don't think we've coordinated on it yet.
alexandercoppock.com
November 5, 2025 at 6:15 PM
I've summed up what I personally know about attention here. I don't yet think we have the design worked out like we do vote the ATEs on vote choice. But I don't think a better experimental design is out of reach, I just don't think we've coordinated on it yet.
will no one think of the visualizers [smh]
November 5, 2025 at 5:50 PM
will no one think of the visualizers [smh]
I suppose that first paper might have been the weirdo alpha of the time we make a type I error, but I suspect error rates here are not nominal...
November 5, 2025 at 2:59 PM
I suppose that first paper might have been the weirdo alpha of the time we make a type I error, but I suspect error rates here are not nominal...
Whoa that VOLCANO! (did you get the underlying data?)
November 4, 2025 at 11:18 PM
Whoa that VOLCANO! (did you get the underlying data?)
love this idea and I see your design problem re: significance on both sides of zero.
I think conditioning on significance from a one-tailed p-value would really make the point so well!
I think conditioning on significance from a one-tailed p-value would really make the point so well!
November 3, 2025 at 5:39 PM
love this idea and I see your design problem re: significance on both sides of zero.
I think conditioning on significance from a one-tailed p-value would really make the point so well!
I think conditioning on significance from a one-tailed p-value would really make the point so well!
Thank you for sharing -- I was unaware of this framework for choosing among replication targets. I think I stand with the critics. Of course I'm left still not knowing how to choose among empirical estimands!
Separately, this figure is amazing:
Separately, this figure is amazing:
October 30, 2025 at 4:46 PM
Thank you for sharing -- I was unaware of this framework for choosing among replication targets. I think I stand with the critics. Of course I'm left still not knowing how to choose among empirical estimands!
Separately, this figure is amazing:
Separately, this figure is amazing:
Truly! and thats *among* the studies that didn't already post their data.
Easily a majority of the studies in this area were already public.
Journal policy changes, norms of transparency, it's all happening!
Easily a majority of the studies in this area were already public.
Journal policy changes, norms of transparency, it's all happening!
October 30, 2025 at 4:31 PM
Truly! and thats *among* the studies that didn't already post their data.
Easily a majority of the studies in this area were already public.
Journal policy changes, norms of transparency, it's all happening!
Easily a majority of the studies in this area were already public.
Journal policy changes, norms of transparency, it's all happening!
no no it's not THAT good :)
first prompt was:
best practices according to hadley wickham for starting a brand new r package devtools roxygen etc.
first prompt was:
best practices according to hadley wickham for starting a brand new r package devtools roxygen etc.
October 29, 2025 at 4:09 PM
no no it's not THAT good :)
first prompt was:
best practices according to hadley wickham for starting a brand new r package devtools roxygen etc.
first prompt was:
best practices according to hadley wickham for starting a brand new r package devtools roxygen etc.