Timo B. Roettger
@timoroettger.bsky.social
Cognitive scientist / Linguist - Full Professor at University of Oslo
Director of @manylanguagesc.bsky.social, PI of ICONIC (https://www.hf.uio.no/iln/english/research/projects/iconic/)
#MetaScience #OpenScience
#DataViz #PresentationDesign #SciComm
Director of @manylanguagesc.bsky.social, PI of ICONIC (https://www.hf.uio.no/iln/english/research/projects/iconic/)
#MetaScience #OpenScience
#DataViz #PresentationDesign #SciComm
Pinned
In our new tutorial, @meanwhileina.bsky.social and I walk you through meaningful hypothesis testing using a less known form of calculating Bayes Factor.
osf.io/preprints/ps...
People transitioning to Bayes often wonder how to decide if an effect is meaningful or not. Here you go... 1/🧵
osf.io/preprints/ps...
People transitioning to Bayes often wonder how to decide if an effect is meaningful or not. Here you go... 1/🧵
In our new tutorial, @meanwhileina.bsky.social and I walk you through meaningful hypothesis testing using a less known form of calculating Bayes Factor.
osf.io/preprints/ps...
People transitioning to Bayes often wonder how to decide if an effect is meaningful or not. Here you go... 1/🧵
osf.io/preprints/ps...
People transitioning to Bayes often wonder how to decide if an effect is meaningful or not. Here you go... 1/🧵
November 26, 2025 at 6:47 PM
In our new tutorial, @meanwhileina.bsky.social and I walk you through meaningful hypothesis testing using a less known form of calculating Bayes Factor.
osf.io/preprints/ps...
People transitioning to Bayes often wonder how to decide if an effect is meaningful or not. Here you go... 1/🧵
osf.io/preprints/ps...
People transitioning to Bayes often wonder how to decide if an effect is meaningful or not. Here you go... 1/🧵
Reposted by Timo B. Roettger
Who wants to be the new professor for general #linguistics in Cologne? 👀
ifl.phil-fak.uni-koeln.de/sites/lingui...
ifl.phil-fak.uni-koeln.de/sites/lingui...
ifl.phil-fak.uni-koeln.de
November 26, 2025 at 11:24 AM
Who wants to be the new professor for general #linguistics in Cologne? 👀
ifl.phil-fak.uni-koeln.de/sites/lingui...
ifl.phil-fak.uni-koeln.de/sites/lingui...
Reposted by Timo B. Roettger
Happy to share the first version of my textbook "Quantitative Data Analysis for Linguists in R".
stefanocoretta.github.io/qdal/
Comments and suggestions welcome! (on the GitHub repo: github.com/stefanocoret...)
The textbook takes you from 0 to basic stat modelling with Bayesian regression.
stefanocoretta.github.io/qdal/
Comments and suggestions welcome! (on the GitHub repo: github.com/stefanocoret...)
The textbook takes you from 0 to basic stat modelling with Bayesian regression.
Quantitative Data Analysis for Linguists in R
stefanocoretta.github.io
November 26, 2025 at 10:56 AM
Happy to share the first version of my textbook "Quantitative Data Analysis for Linguists in R".
stefanocoretta.github.io/qdal/
Comments and suggestions welcome! (on the GitHub repo: github.com/stefanocoret...)
The textbook takes you from 0 to basic stat modelling with Bayesian regression.
stefanocoretta.github.io/qdal/
Comments and suggestions welcome! (on the GitHub repo: github.com/stefanocoret...)
The textbook takes you from 0 to basic stat modelling with Bayesian regression.
Reposted by Timo B. Roettger
“Simine Vazire talks the talk and walks the walk,” writes @briannosek.bsky.social @cos.io.
🏆 The €150,000 award allows her to continue prioritizing research rigor and honors the mentors, colleagues, and students who made her work possible.
Short interview: www.youtube.com/watch?v=0H3g... (3/4)
🏆 The €150,000 award allows her to continue prioritizing research rigor and honors the mentors, colleagues, and students who made her work possible.
Short interview: www.youtube.com/watch?v=0H3g... (3/4)
November 25, 2025 at 11:03 AM
“Simine Vazire talks the talk and walks the walk,” writes @briannosek.bsky.social @cos.io.
🏆 The €150,000 award allows her to continue prioritizing research rigor and honors the mentors, colleagues, and students who made her work possible.
Short interview: www.youtube.com/watch?v=0H3g... (3/4)
🏆 The €150,000 award allows her to continue prioritizing research rigor and honors the mentors, colleagues, and students who made her work possible.
Short interview: www.youtube.com/watch?v=0H3g... (3/4)
To all speech scientists: I would be grateful if you could take 5-10 mins of your time to fill in the following short online survey on effect sizes: forms.gle/huQeiPerZBHE...
(apologies for cross-posting)
#Phon-CompLing
#Linguistics
(apologies for cross-posting)
#Phon-CompLing
#Linguistics
What is the smallest effect size of interest?
After two demographic questions, we are interested in your intuition about effect sizes. This survey takes approximately 5-10 minutes.
forms.gle
November 25, 2025 at 9:35 AM
To all speech scientists: I would be grateful if you could take 5-10 mins of your time to fill in the following short online survey on effect sizes: forms.gle/huQeiPerZBHE...
(apologies for cross-posting)
#Phon-CompLing
#Linguistics
(apologies for cross-posting)
#Phon-CompLing
#Linguistics
Anyone any insights?
To all educators out there: We are trying to formulate a criterion for our exams that tackles the vagueness of LLM output and punishes it more strictly. If you recognize the issue, has anyone of you come up with a crisp operationalization of such a criterion. Also grateful for other pointers 🙏
November 18, 2025 at 7:34 AM
Anyone any insights?
Reposted by Timo B. Roettger
A new study finds that jargon makes false information seem more credible. It boosts perceived expertise, especially among people with higher conspiracy mentality, even though it simultaneously reduces readability.
onlinelibrary.wiley.com/doi/full/10....
#MisinfoResearch
onlinelibrary.wiley.com/doi/full/10....
#MisinfoResearch
The Power of Technical Language: Does Jargon Use Influence the Credibility of Misinformation?
Across two studies, we examined the impact of different levels of jargon on the perceived credibility of texts containing reliable or unreliable information. Study 1 found that higher levels of jargo...
onlinelibrary.wiley.com
November 17, 2025 at 8:28 PM
A new study finds that jargon makes false information seem more credible. It boosts perceived expertise, especially among people with higher conspiracy mentality, even though it simultaneously reduces readability.
onlinelibrary.wiley.com/doi/full/10....
#MisinfoResearch
onlinelibrary.wiley.com/doi/full/10....
#MisinfoResearch
To all educators out there: We are trying to formulate a criterion for our exams that tackles the vagueness of LLM output and punishes it more strictly. If you recognize the issue, has anyone of you come up with a crisp operationalization of such a criterion. Also grateful for other pointers 🙏
November 14, 2025 at 8:29 AM
To all educators out there: We are trying to formulate a criterion for our exams that tackles the vagueness of LLM output and punishes it more strictly. If you recognize the issue, has anyone of you come up with a crisp operationalization of such a criterion. Also grateful for other pointers 🙏
Reposted by Timo B. Roettger
Finally, our 4-year long project has been published! We have conducted a multi-lab study comparing STM of musicians and nonmusicians, collecting many other cognitive, personality, musical, and demographic variables!
A big thank you to all collaborators!
journals.sagepub.com/doi/10.1177/...
A big thank you to all collaborators!
journals.sagepub.com/doi/10.1177/...
Do Musicians Have Better Short-Term Memory Than Nonmusicians? A Multilab Study - Massimo Grassi, Francesca Talamini, Gianmarco Altoè, Elvira Brattico, Anne Caclin, Barbara Carretti, Véronique Drai-Zer...
Musicians are often regarded as a positive example of brain plasticity and associated cognitive benefits. This emerges when experienced musicians (e.g., musicia...
journals.sagepub.com
November 7, 2025 at 10:49 AM
Finally, our 4-year long project has been published! We have conducted a multi-lab study comparing STM of musicians and nonmusicians, collecting many other cognitive, personality, musical, and demographic variables!
A big thank you to all collaborators!
journals.sagepub.com/doi/10.1177/...
A big thank you to all collaborators!
journals.sagepub.com/doi/10.1177/...
Really insightful talk by @kjhealy.co on trust in data #DataViz. What I take home is that a graph itself is not going to instil trust, no matter how hard you try, only its context can.
November 10, 2025 at 5:32 PM
Really insightful talk by @kjhealy.co on trust in data #DataViz. What I take home is that a graph itself is not going to instil trust, no matter how hard you try, only its context can.
Reposted by Timo B. Roettger
… so glad I ran 20 experiments this time!
If your p-value remains stubbornly above 0.05, there are some creative ways to describe that as well, see this blog post: mchankins.wordpress.com/2013/04/21/s...
If your p-value remains stubbornly above 0.05, there are some creative ways to describe that as well, see this blog post: mchankins.wordpress.com/2013/04/21/s...
Still Not Significant
What to do if your p-value is just over the arbitrary threshold for ‘significance’ of p=0.05? You don’t need to play the significance testing game – there are better methods…
mchankins.wordpress.com
November 4, 2025 at 2:19 PM
… so glad I ran 20 experiments this time!
If your p-value remains stubbornly above 0.05, there are some creative ways to describe that as well, see this blog post: mchankins.wordpress.com/2013/04/21/s...
If your p-value remains stubbornly above 0.05, there are some creative ways to describe that as well, see this blog post: mchankins.wordpress.com/2013/04/21/s...
Reposted by Timo B. Roettger
Well, that's nothing! My p-value is 0.000!
November 4, 2025 at 12:27 PM
Well, that's nothing! My p-value is 0.000!
Fill in the blank:
"My p-value is smaller than 0.05, so..."
Wrong answers only.
"My p-value is smaller than 0.05, so..."
Wrong answers only.
November 4, 2025 at 12:24 PM
Fill in the blank:
"My p-value is smaller than 0.05, so..."
Wrong answers only.
"My p-value is smaller than 0.05, so..."
Wrong answers only.
I'm sorry OSF, but did you involve a UX designer when overhauling your user interface? 🤦
November 4, 2025 at 7:56 AM
I'm sorry OSF, but did you involve a UX designer when overhauling your user interface? 🤦
Reposted by Timo B. Roettger
Then: et al
Now: et AI
Now: et AI
arXiv will no longer accept review articles and position papers unless they have been accepted at a journal or a conference and complete successful peer review.
This is due to being overwhelmed by a hundreds of AI generated papers a month.
Yet another open submission process killed by LLMs.
This is due to being overwhelmed by a hundreds of AI generated papers a month.
Yet another open submission process killed by LLMs.
Attention Authors: Updated Practice for Review Articles and Position Papers in arXiv CS Category – arXiv blog
blog.arxiv.org
November 2, 2025 at 5:48 PM
Then: et al
Now: et AI
Now: et AI
Reposted by Timo B. Roettger
New effect size just dropped: The PVPP
New paper finds that selective reporting remains the most replicable finding in science: journals.sagepub.com/doi/full/10.... I especially like their new exploratory metric 'p-values per participant'. Some papers had 11 p-values per participant! 🤯
Sage Journals: Discover world-class research
Subscription and open access journals from Sage, the world's leading independent academic publisher.
journals.sagepub.com
November 1, 2025 at 1:16 AM
New effect size just dropped: The PVPP
Reposted by Timo B. Roettger
This is an excellent point that generalizes.
Researchers often defend suboptimal practices by referring to future studies with better designs.
But: Why would anybody run those studies when you can just throw a bunch of variables into a regression and make sweeping "preliminary" claims?
Researchers often defend suboptimal practices by referring to future studies with better designs.
But: Why would anybody run those studies when you can just throw a bunch of variables into a regression and make sweeping "preliminary" claims?
October 28, 2025 at 11:22 AM
This is an excellent point that generalizes.
Researchers often defend suboptimal practices by referring to future studies with better designs.
But: Why would anybody run those studies when you can just throw a bunch of variables into a regression and make sweeping "preliminary" claims?
Researchers often defend suboptimal practices by referring to future studies with better designs.
But: Why would anybody run those studies when you can just throw a bunch of variables into a regression and make sweeping "preliminary" claims?
Reposted by Timo B. Roettger
👻 linguists
We wrote an article explaining why you shouldn't put several variables into a regression model and report which are statistically significant - even as exploratory research. bmjmedicine.bmj.com/content/4/1/.... How did we do?
October 28, 2025 at 11:36 AM
👻 linguists
@ folks who teach stats: How do you design your assignments nowadays? My students use LLMs for coding and that is fine. But I wonder what beautiful solutions you found to effectively assess students understanding of the conceptual content of statistical methods. Happy if you could share 🤓
October 28, 2025 at 10:57 AM
@ folks who teach stats: How do you design your assignments nowadays? My students use LLMs for coding and that is fine. But I wonder what beautiful solutions you found to effectively assess students understanding of the conceptual content of statistical methods. Happy if you could share 🤓
Reposted by Timo B. Roettger
Really excited to share this new paper on "Data Visualizations as Propaganda", co-led by PhD students Priya Dhawka and Nina Lutz, which just won a Best Paper award at the CSCW conference: dl.acm.org/doi/10.1145/...
[Short thread]
[Short thread]
Data Visualizations as Propaganda: Tracing Lineages, Provenance, and Political Framings in Online Anti-Immigrant Discourse | Proceedings of the ACM on Human-Computer Interaction
Along with other visual content, data visualizations are increasingly used within
online discourse, including political communication. Though often considered to be
''objective'', data visualizations ...
dl.acm.org
October 27, 2025 at 9:10 PM
Really excited to share this new paper on "Data Visualizations as Propaganda", co-led by PhD students Priya Dhawka and Nina Lutz, which just won a Best Paper award at the CSCW conference: dl.acm.org/doi/10.1145/...
[Short thread]
[Short thread]
Reposted by Timo B. Roettger
MetaROR, a platform for reviews of research on research, is a success! We have published 24 sets of reviews and have 16 submissions in process. MetaROR now has 9 partners - these are journals that agree to use our reviews when authors submit to them. metaror.org #metascience #openaccess
Home - MetaROR
MetaResearch Open Review
MetaResearch Open Review MetaResearch Open Review
A new platform designed to transform how we review and share metaresearch
A new platform designed to transform
metaror.org
October 26, 2025 at 10:33 PM
MetaROR, a platform for reviews of research on research, is a success! We have published 24 sets of reviews and have 16 submissions in process. MetaROR now has 9 partners - these are journals that agree to use our reviews when authors submit to them. metaror.org #metascience #openaccess
always the same kind of plenary speakers, from the same privileged places, perpetually keeping us in our bubble 🥱
October 24, 2025 at 9:56 AM
always the same kind of plenary speakers, from the same privileged places, perpetually keeping us in our bubble 🥱
I just learned that my understanding of what is referred to as just noticeable differences (JNDs) in speech perception is completely misconceived 🤯
October 23, 2025 at 6:38 AM
I just learned that my understanding of what is referred to as just noticeable differences (JNDs) in speech perception is completely misconceived 🤯
Project idea: Find published open data sets that do that, re-run models with appropriate random effect structures in brms, and compare how often the published claims hold. Anyone in?
Pretty wild to me how many people when realizing their linear mixed effects models do not converge with appropriate random effect structures, reduce the random effect structure until convergence and then very confidently use the inferential results to make far-reaching claims about nature.
October 22, 2025 at 7:23 AM
Project idea: Find published open data sets that do that, re-run models with appropriate random effect structures in brms, and compare how often the published claims hold. Anyone in?
Pretty wild to me how many people when realizing their linear mixed effects models do not converge with appropriate random effect structures, reduce the random effect structure until convergence and then very confidently use the inferential results to make far-reaching claims about nature.
October 22, 2025 at 7:21 AM
Pretty wild to me how many people when realizing their linear mixed effects models do not converge with appropriate random effect structures, reduce the random effect structure until convergence and then very confidently use the inferential results to make far-reaching claims about nature.