Glad to hear it! I wasn’t sure how many Stata users knew about it. Once you start doing it, it’s a game-changer. 👍

Wow, super helpful--thx, David! I don't usually run models like this in my own work, so there's a lot more I need to learn (looks like this book will help!).

In that graph I posted, it's clear that residuals are positively correlated, which is why I thought to cluster. But this article says no 🤯

Thanks so much! 😁

Not sure Daniel has anywhere near enough time (and not totally sure I have anywhere near enough experience doing meta science). That said, thinking about null results is kind of an obsession of mine, so I’ll keep it in mind for the future! 🙏

Really enjoyed this, as always!👏

FWIW, one argument I find persuasive is that, yes, high SES kids have advantages on the SAT that are unrelated to the underlying trait.

BUT—banning it would give more weight to things that high SES kids are *even more* advantaged on (rec letters, HS quality, etc) 🤔

Indeed! Would love to see a side-by-side comparison of (1) z/t-statistic distributions for hypothesized effects (we'd see the classic drop right around 1.96ish), vs. (2) z/t-statistic distributions for any placebo tests--just how different would these distributions look? 😬

The more I think about it, p-stacking might be esp common for robustness checks & placebo tests, wherein the goal is to show a non-significant effect.

For example, rule out an alternative explanation via showing it's non-significant, which serves as more evidence for one's significant effect. 🤔

😂 that one crossed my mind as well.

Ultimately I thought better to go with something that evokes “going up” (and maybe something less violent lol)

Really enjoyed this!

I esp loved the discussion of reverse p-hacking as a means of purposely generating null results. I could picture this happening more as null results become more acceptable--it'd be yet another way of creating a "clear story." Might I suggest calling it: "p-stacking"? 😉

I didn’t even notice—I just feel that last sentence deep in my soul every time I have to grade a new batch of assignments 😭

Amen to this, Andrew!

So nice of you to say that, Andrew. And thank you for sharing about your children—they’re lucky to have a dad as kind as you, and it makes the paper all the more touching.

And your graphs look terrific! 🤩 (I quickly spotted those bolded headings on the y-axis 😊) So glad the guides are useful! 🙏

Thanks so much for this, Andrew. Before the Ph.D. I was a social worker for 6 years, working with developmentally disabled adults. This research hits close to home 😔

LOVE this book ❤️🙏

@sgadarian.bsky.social and @polpsychangel.bsky.social, in case it’s useful for you! 👍

Much appreciated, Sam! 🙏

Link to article on Medium:
medium.com/the-stata-ga...

CC'ing some fellow @statacorp.bsky.social users (that I know of): @lilymasonphd.bsky.social @juliewronski.bsky.social @cbwlezien.bsky.social @profsamperry.bsky.social @nathankalmoe.bsky.social @mirya.bsky.social @asjadnaqvi.bsky.social