Anne Scheel
@annemscheel.bsky.social
Assistant prof at Utrecht University, trying to make science as reproducible as non-scientists think it is. Blogs at @the100ci.
IMO one of the absolute coolest projects in psych at the moment — solving the toothbrush problem in measurement with really clever use of LLMs. Incredibly useful!
🚨 SynthNet is out 🚨
Researchers propose new constructs and measures faster than anyone can track. We (@anniria.bsky.social @ruben.the100.ci) built a search engine to check what already exists and help identify redundancies; indexing 74,000 scales from ~31,500 instruments in APA PsycTests. 🧵1/3
Researchers propose new constructs and measures faster than anyone can track. We (@anniria.bsky.social @ruben.the100.ci) built a search engine to check what already exists and help identify redundancies; indexing 74,000 scales from ~31,500 instruments in APA PsycTests. 🧵1/3
November 28, 2025 at 6:21 AM
IMO one of the absolute coolest projects in psych at the moment — solving the toothbrush problem in measurement with really clever use of LLMs. Incredibly useful!
Reposted by Anne Scheel
🚨 SynthNet is out 🚨
Researchers propose new constructs and measures faster than anyone can track. We (@anniria.bsky.social @ruben.the100.ci) built a search engine to check what already exists and help identify redundancies; indexing 74,000 scales from ~31,500 instruments in APA PsycTests. 🧵1/3
Researchers propose new constructs and measures faster than anyone can track. We (@anniria.bsky.social @ruben.the100.ci) built a search engine to check what already exists and help identify redundancies; indexing 74,000 scales from ~31,500 instruments in APA PsycTests. 🧵1/3
November 26, 2025 at 11:42 AM
🚨 SynthNet is out 🚨
Researchers propose new constructs and measures faster than anyone can track. We (@anniria.bsky.social @ruben.the100.ci) built a search engine to check what already exists and help identify redundancies; indexing 74,000 scales from ~31,500 instruments in APA PsycTests. 🧵1/3
Researchers propose new constructs and measures faster than anyone can track. We (@anniria.bsky.social @ruben.the100.ci) built a search engine to check what already exists and help identify redundancies; indexing 74,000 scales from ~31,500 instruments in APA PsycTests. 🧵1/3
Reposted by Anne Scheel
The scandal of medical research still failing to adopt the Registered Report format for trial publications.
Great example of failure to weed out Questionable Research Practices by clinical trial register (preregistration)+ journal review + multiple systematic reviews + guideline development process
Great example of failure to weed out Questionable Research Practices by clinical trial register (preregistration)+ journal review + multiple systematic reviews + guideline development process
The stuff you find when you actually read the RCTs in a systematic review...
This paper is one of the foundational studies on vitamin D to prevent respiratory infections in kids. Cited 1,400 times as per Google Scholar.
This paper is one of the foundational studies on vitamin D to prevent respiratory infections in kids. Cited 1,400 times as per Google Scholar.
November 27, 2025 at 2:13 PM
The scandal of medical research still failing to adopt the Registered Report format for trial publications.
Great example of failure to weed out Questionable Research Practices by clinical trial register (preregistration)+ journal review + multiple systematic reviews + guideline development process
Great example of failure to weed out Questionable Research Practices by clinical trial register (preregistration)+ journal review + multiple systematic reviews + guideline development process
Reposted by Anne Scheel
Imagine you lived in the 18th century.
Smallpox kills 1 in 3 cases. Yet you can’t culture pathogens, don’t know germ theory, and have no idea what a virus is. How would you invent a vaccine?
In a new episode of HARD DRUGS, we trace the history of vaccines!
Smallpox kills 1 in 3 cases. Yet you can’t culture pathogens, don’t know germ theory, and have no idea what a virus is. How would you invent a vaccine?
In a new episode of HARD DRUGS, we trace the history of vaccines!
The history of vaccines
open.spotify.com
November 26, 2025 at 5:16 PM
Imagine you lived in the 18th century.
Smallpox kills 1 in 3 cases. Yet you can’t culture pathogens, don’t know germ theory, and have no idea what a virus is. How would you invent a vaccine?
In a new episode of HARD DRUGS, we trace the history of vaccines!
Smallpox kills 1 in 3 cases. Yet you can’t culture pathogens, don’t know germ theory, and have no idea what a virus is. How would you invent a vaccine?
In a new episode of HARD DRUGS, we trace the history of vaccines!
Reposted by Anne Scheel
“The articles in AMPPS offer, month in and month out, the invitation to practice aligning your values, intentions, and actions to do less scientific harm and reach for the methodological ceiling”
Grateful to @dsbarra.bsky.social for continuing what @profsimons.bsky.social & co started at AMPPS!
Grateful to @dsbarra.bsky.social for continuing what @profsimons.bsky.social & co started at AMPPS!
My time as Editor of AMPPS is coming to an end-- here are some parting thoughts. journals.sagepub.com/doi/full/10.... .
Taking Stock of Advances in Methods and Practices in Psychological Science at the End of the Beginning - David A. Sbarra, 2025
journals.sagepub.com
November 26, 2025 at 7:38 PM
“The articles in AMPPS offer, month in and month out, the invitation to practice aligning your values, intentions, and actions to do less scientific harm and reach for the methodological ceiling”
Grateful to @dsbarra.bsky.social for continuing what @profsimons.bsky.social & co started at AMPPS!
Grateful to @dsbarra.bsky.social for continuing what @profsimons.bsky.social & co started at AMPPS!
Reposted by Anne Scheel
Has anyone tried the trackdown package for collaborative quarto editing? Love writing papers on Quarto, but switching back to Word for co-author edits is still an awkward missing link claudiozandonella.github.io/trackdown/
Collaborative Editing of Rmd (or Quarto / Rnw) Documents in Google Drive
Collaborative writing and editing of R Markdown (or Quarto / Sweave) documents. The local .Rmd (or Quarto / .Rnw) is uploaded as a plain-text file to Google Drive. By taking advantage of the easily re...
claudiozandonella.github.io
November 18, 2025 at 2:49 AM
Has anyone tried the trackdown package for collaborative quarto editing? Love writing papers on Quarto, but switching back to Word for co-author edits is still an awkward missing link claudiozandonella.github.io/trackdown/
Reposted by Anne Scheel
Registration is now open for our Quarto workshop at Paul Meehl Graduate School!
Join us on December 12 in Eindhoven to learn how to use Quarto for reproducible research and communication.
More details and registration here:
paulmeehlschool.github.io/2025-11-03-q...
Join us on December 12 in Eindhoven to learn how to use Quarto for reproducible research and communication.
More details and registration here:
paulmeehlschool.github.io/2025-11-03-q...
New workshop announced: Quarto: Write, Code, Reproduce | Paul Meehl Graduate School
We are thrilled to announce that registration is now open for our new workshop. In this workshop, Ambra Perugini will...
paulmeehlschool.github.io
November 13, 2025 at 12:07 PM
Registration is now open for our Quarto workshop at Paul Meehl Graduate School!
Join us on December 12 in Eindhoven to learn how to use Quarto for reproducible research and communication.
More details and registration here:
paulmeehlschool.github.io/2025-11-03-q...
Join us on December 12 in Eindhoven to learn how to use Quarto for reproducible research and communication.
More details and registration here:
paulmeehlschool.github.io/2025-11-03-q...
Reposted by Anne Scheel
~40% of psyarxiv preprints contain links to open data in 2025 vs (e.g.) ~10% in 2019 (although in the latter case people mostly did not report this metadata): vuorre.com/psyarxiv-das...
November 12, 2025 at 2:50 PM
~40% of psyarxiv preprints contain links to open data in 2025 vs (e.g.) ~10% in 2019 (although in the latter case people mostly did not report this metadata): vuorre.com/psyarxiv-das...
Reposted by Anne Scheel
The print edition of Works in Progress is now available in:
• Canada 🇨🇦
• Australia 🇦🇺
• the European Union 🇪🇺 🇮🇪 🇩🇪
Subscribe today for 6 beautiful issues a year. The first edition ships in 2 weeks! 🥳
worksinprogress.co/print/
• Canada 🇨🇦
• Australia 🇦🇺
• the European Union 🇪🇺 🇮🇪 🇩🇪
Subscribe today for 6 beautiful issues a year. The first edition ships in 2 weeks! 🥳
worksinprogress.co/print/
Print - Works in Progress Magazine
worksinprogress.co
November 4, 2025 at 12:38 PM
The print edition of Works in Progress is now available in:
• Canada 🇨🇦
• Australia 🇦🇺
• the European Union 🇪🇺 🇮🇪 🇩🇪
Subscribe today for 6 beautiful issues a year. The first edition ships in 2 weeks! 🥳
worksinprogress.co/print/
• Canada 🇨🇦
• Australia 🇦🇺
• the European Union 🇪🇺 🇮🇪 🇩🇪
Subscribe today for 6 beautiful issues a year. The first edition ships in 2 weeks! 🥳
worksinprogress.co/print/
Reposted by Anne Scheel
Alternative suggestion
November 5, 2025 at 3:37 PM
Alternative suggestion
Reposted by Anne Scheel
My Shiny app containing 3530 Open Science blog posts discussing the replication crisis is updated - you can now use the SEARCH box. I fixed it as my new PhD Julia wanted to know who had called open scientists 'Methodological Terrorists' :) shiny.ieis.tue.nl/open_science...
Open Science Blog Browser
Open Science Blog Browser
shiny.ieis.tue.nl
November 8, 2025 at 7:15 PM
My Shiny app containing 3530 Open Science blog posts discussing the replication crisis is updated - you can now use the SEARCH box. I fixed it as my new PhD Julia wanted to know who had called open scientists 'Methodological Terrorists' :) shiny.ieis.tue.nl/open_science...
Reposted by Anne Scheel
Oops. Ooooooooooooops.
I do hope that nobody has been given or denied a job/promotion based on their SpringerNature citation counts in the past 15 years.
arxiv.org/pdf/2511.01675
h/t @nathlarigaldie.bsky.social
I do hope that nobody has been given or denied a job/promotion based on their SpringerNature citation counts in the past 15 years.
arxiv.org/pdf/2511.01675
h/t @nathlarigaldie.bsky.social
November 7, 2025 at 2:02 PM
Oops. Ooooooooooooops.
I do hope that nobody has been given or denied a job/promotion based on their SpringerNature citation counts in the past 15 years.
arxiv.org/pdf/2511.01675
h/t @nathlarigaldie.bsky.social
I do hope that nobody has been given or denied a job/promotion based on their SpringerNature citation counts in the past 15 years.
arxiv.org/pdf/2511.01675
h/t @nathlarigaldie.bsky.social
Reposted by Anne Scheel
Reposted by Anne Scheel
The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time.
scienceverse.github.io/metacheck/
scienceverse.github.io/metacheck/
Check Research Outputs for Best Practices
A modular, extendable system for automatically checking research outputs for best practices using text search, R code, and/or (optional) LLM queries.
scienceverse.github.io
November 3, 2025 at 4:20 PM
The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time.
scienceverse.github.io/metacheck/
scienceverse.github.io/metacheck/
Reposted by Anne Scheel
DEAR FOLLOWERS - LINKEDIN POSTING SURGE REQUESTED
November 4, 2025 at 10:57 AM
DEAR FOLLOWERS - LINKEDIN POSTING SURGE REQUESTED
Reposted by Anne Scheel
I successfully defended my Habilitation today, and was honoured by the committee’s positive feedback. I am very grateful for my colleagues, collaborators and students at the University of Bern who made this a very rewarding journey.
November 3, 2025 at 9:54 PM
I successfully defended my Habilitation today, and was honoured by the committee’s positive feedback. I am very grateful for my colleagues, collaborators and students at the University of Bern who made this a very rewarding journey.
Reposted by Anne Scheel
"We included 608 articles, of which 243 articles were identified as problematic (40.0%)." (bit.ly/3X4PtGF) This finding of so many image-related problems by a team that wanted to do a systemic review, is deeply concerning.
October 31, 2025 at 9:41 AM
"We included 608 articles, of which 243 articles were identified as problematic (40.0%)." (bit.ly/3X4PtGF) This finding of so many image-related problems by a team that wanted to do a systemic review, is deeply concerning.
Reposted by Anne Scheel
#episky #statsky
“The student, now a junior researcher, has learned how to operate the hyp test machinery but not how to feed it with meaningful input”
I felt this way when I first learned about DAGs. I could recite the rules, but I was still really confused if I needed to make my own
“The student, now a junior researcher, has learned how to operate the hyp test machinery but not how to feed it with meaningful input”
I felt this way when I first learned about DAGs. I could recite the rules, but I was still really confused if I needed to make my own
I completely agree! But if you realise that you can’t specify a SESOI for the life of you, it usually means that you can’t specify your research hypothesis enough to make it statistically testable. In that case, the best decision may to do something else: journals.sagepub.com/doi/10.1177/...
Why Hypothesis Testers Should Spend Less Time Testing Hypotheses - Anne M. Scheel, Leonid Tiokhin, Peder M. Isager, Daniël Lakens, 2021
For almost half a century, Paul Meehl educated psychologists about how the mindless use of null-hypothesis significance tests made research on theories in the s...
journals.sagepub.com
November 1, 2025 at 11:22 AM
Reposted by Anne Scheel
So (beyond this specific example of anchor-based approaches) I would be happy to see many diverse applied examples on how SESOIs have been reasonably specified in sport and exercise science (if they exist...).
October 31, 2025 at 5:19 AM
So (beyond this specific example of anchor-based approaches) I would be happy to see many diverse applied examples on how SESOIs have been reasonably specified in sport and exercise science (if they exist...).
Reposted by Anne Scheel
New paper finds that selective reporting remains the most replicable finding in science: journals.sagepub.com/doi/full/10.... I especially like their new exploratory metric 'p-values per participant'. Some papers had 11 p-values per participant! 🤯
Sage Journals: Discover world-class research
Subscription and open access journals from Sage, the world's leading independent academic publisher.
journals.sagepub.com
October 31, 2025 at 7:39 AM
New paper finds that selective reporting remains the most replicable finding in science: journals.sagepub.com/doi/full/10.... I especially like their new exploratory metric 'p-values per participant'. Some papers had 11 p-values per participant! 🤯
There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >
But here's, the thing, p values and significance become useless at such large sample sizes. When you're dividing the coefficient by the SE and the sample size is in the tens of thousands, EVERYTHING IS SIGNIFICANT. All you're testing is whether the coefficient is different than zero.
October 31, 2025 at 8:13 AM
There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >
Reposted by Anne Scheel
Are you interested in thinking about which studies are worth replicating? Then you have 10 articles to dig into in Meta-Psychology, representing a very wide range of viewpoint on this topic, out now: open.lnu.se/index.php/me...
LnuOpen
| Meta-Psychology
Original articles
open.lnu.se
October 30, 2025 at 3:43 PM
Are you interested in thinking about which studies are worth replicating? Then you have 10 articles to dig into in Meta-Psychology, representing a very wide range of viewpoint on this topic, out now: open.lnu.se/index.php/me...
Reposted by Anne Scheel
Which reminds me of this old classic on the Noise Miners.
“'Noise mining is a funny thing,' he said. 'When you first see a bit of noise, it doesn’t look so impressive. But as you work it out of the rock, it gets more and more refined.' This process, he explained, is called 'shucking.'"
“'Noise mining is a funny thing,' he said. 'When you first see a bit of noise, it doesn’t look so impressive. But as you work it out of the rock, it gets more and more refined.' This process, he explained, is called 'shucking.'"
October 30, 2025 at 9:24 AM
Which reminds me of this old classic on the Noise Miners.
“'Noise mining is a funny thing,' he said. 'When you first see a bit of noise, it doesn’t look so impressive. But as you work it out of the rock, it gets more and more refined.' This process, he explained, is called 'shucking.'"
“'Noise mining is a funny thing,' he said. 'When you first see a bit of noise, it doesn’t look so impressive. But as you work it out of the rock, it gets more and more refined.' This process, he explained, is called 'shucking.'"
Reposted by Anne Scheel
My paper with @lakens.bsky.social and @annaveer.bsky.social - “Replication value as a function of citation impact and sample size” - has just been published in Meta psychology! open.lnu.se/index.php/me...
October 30, 2025 at 9:11 AM
My paper with @lakens.bsky.social and @annaveer.bsky.social - “Replication value as a function of citation impact and sample size” - has just been published in Meta psychology! open.lnu.se/index.php/me...
Reposted by Anne Scheel
Looks like Christmas came early this year 🤩 @vincentab.bsky.social
October 29, 2025 at 5:22 PM
Looks like Christmas came early this year 🤩 @vincentab.bsky.social