Daniel Heck
@danielheck.bsky.social
Professor of Psychological Methods @Phillips-Universtät Marburg
Mathematical psychology | Cognitive modeling | Psychometrics | Bayesian statistics
Personal: www.dwheck.de
Team: https://www.uni-marburg.de/de/fb04/team-heck
Mathematical psychology | Cognitive modeling | Psychometrics | Bayesian statistics
Personal: www.dwheck.de
Team: https://www.uni-marburg.de/de/fb04/team-heck
Reposted by Daniel Heck
The latest version of Sigmund, the #AI #research assistant, is able to fully control the #OpenSesame interface. This allows you to build #psychology experiments entirely through conversation. This is no AI slop, but real functionality with real benefits! Tutorial 👉 osdoc.cogsci.nl/4.1/tutorial...
November 13, 2025 at 9:40 AM
The latest version of Sigmund, the #AI #research assistant, is able to fully control the #OpenSesame interface. This allows you to build #psychology experiments entirely through conversation. This is no AI slop, but real functionality with real benefits! Tutorial 👉 osdoc.cogsci.nl/4.1/tutorial...
Reposted by Daniel Heck
November 12, 2025 at 12:32 AM
New paper by @matzekloft.bsky.social in Psychometrika🎉
We developed a model for aggregating response intervals which are obtained if a participant judges that the word "most" covers the range [86% - 97%].
The model aggregates such intervals while considering people's proficiency & item difficulty.
We developed a model for aggregating response intervals which are obtained if a participant judges that the word "most" covers the range [86% - 97%].
The model aggregates such intervals while considering people's proficiency & item difficulty.
The final paper of my dissertation has just been published in Psychometrika (@pmetricsoc.bsky.social). Many thanks to @bsiepe.bsky.social and @danielheck.bsky.social, who co-authored it with me.
www.cambridge.org/core/journal...
www.cambridge.org/core/journal...
The Interval Consensus Model: Aggregating Continuous Bounded Interval Responses | Psychometrika | Cambridge Core
The Interval Consensus Model: Aggregating Continuous Bounded Interval Responses
www.cambridge.org
November 5, 2025 at 3:20 PM
New paper by @matzekloft.bsky.social in Psychometrika🎉
We developed a model for aggregating response intervals which are obtained if a participant judges that the word "most" covers the range [86% - 97%].
The model aggregates such intervals while considering people's proficiency & item difficulty.
We developed a model for aggregating response intervals which are obtained if a participant judges that the word "most" covers the range [86% - 97%].
The model aggregates such intervals while considering people's proficiency & item difficulty.
Halloween in our lab 🎃
Beware of divergent transitions!
Beware of divergent transitions!
Actually, we recently spooked away some ghosts with warnings and other scary things (with @semihaktepe.bsky.social)
October 31, 2025 at 2:26 PM
Halloween in our lab 🎃
Beware of divergent transitions!
Beware of divergent transitions!
Reposted by Daniel Heck
There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >
But here's, the thing, p values and significance become useless at such large sample sizes. When you're dividing the coefficient by the SE and the sample size is in the tens of thousands, EVERYTHING IS SIGNIFICANT. All you're testing is whether the coefficient is different than zero.
October 31, 2025 at 8:13 AM
There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >
Reposted by Daniel Heck
Simulation studies have a conflict of interest problem. The same team:
- develops a new method
- designs a simulation study to evaluate it
However, the new method has to show good performance to get published.
We propose living synthetic benchmarks to address the issue (doi.org/10.48550/arX...).
- develops a new method
- designs a simulation study to evaluate it
However, the new method has to show good performance to get published.
We propose living synthetic benchmarks to address the issue (doi.org/10.48550/arX...).
October 23, 2025 at 4:02 PM
Simulation studies have a conflict of interest problem. The same team:
- develops a new method
- designs a simulation study to evaluate it
However, the new method has to show good performance to get published.
We propose living synthetic benchmarks to address the issue (doi.org/10.48550/arX...).
- develops a new method
- designs a simulation study to evaluate it
However, the new method has to show good performance to get published.
We propose living synthetic benchmarks to address the issue (doi.org/10.48550/arX...).
Welcome to @lauragroot.bsky.social as a new member in the Psychological Methods Lab at @unimarburg.bsky.social! 🎉
Laura just started as a PhD student and will work on Bayesian statistics and multinomial processing tree (MPT) modeling.
Laura just started as a PhD student and will work on Bayesian statistics and multinomial processing tree (MPT) modeling.
October 30, 2025 at 9:13 PM
Welcome to @lauragroot.bsky.social as a new member in the Psychological Methods Lab at @unimarburg.bsky.social! 🎉
Laura just started as a PhD student and will work on Bayesian statistics and multinomial processing tree (MPT) modeling.
Laura just started as a PhD student and will work on Bayesian statistics and multinomial processing tree (MPT) modeling.
Reposted by Daniel Heck
We built the openESM database:
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python
Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python
Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...
October 22, 2025 at 7:34 PM
We built the openESM database:
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python
Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python
Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...
Welcome to @timangelike.bsky.social as a new member of our lab at @unimarburg.bsky.social! 🎉
Tim just started as a postdoc in a Momentum project funded by @volkswagenstiftung.de:
"Bridging the Gap Between Verbal Psychological Theories and Formal Statistical Modeling with Large Language Models"
Tim just started as a postdoc in a Momentum project funded by @volkswagenstiftung.de:
"Bridging the Gap Between Verbal Psychological Theories and Formal Statistical Modeling with Large Language Models"
October 16, 2025 at 1:18 PM
Welcome to @timangelike.bsky.social as a new member of our lab at @unimarburg.bsky.social! 🎉
Tim just started as a postdoc in a Momentum project funded by @volkswagenstiftung.de:
"Bridging the Gap Between Verbal Psychological Theories and Formal Statistical Modeling with Large Language Models"
Tim just started as a postdoc in a Momentum project funded by @volkswagenstiftung.de:
"Bridging the Gap Between Verbal Psychological Theories and Formal Statistical Modeling with Large Language Models"
Reposted by Daniel Heck
Konservative 🤝Rechtsextreme = politischer Selbstmord?
In vielen EU-Ländern versuchen konservative Parteien durch Kooperationen, rechtsextreme Parteien zu „zähmen“. Die CDU-nahe Konrad-Adenauer-Stiftung hat untersucht, was das für Konsequenzen hat. Spoiler: Es funktioniert nicht. 1/6🧵
In vielen EU-Ländern versuchen konservative Parteien durch Kooperationen, rechtsextreme Parteien zu „zähmen“. Die CDU-nahe Konrad-Adenauer-Stiftung hat untersucht, was das für Konsequenzen hat. Spoiler: Es funktioniert nicht. 1/6🧵
Laut CDU-naher Studie: Rechte Parteien durch Kooperation zu zähmen, funktioniert nicht
Der Rechtsruck beschäftigt nicht nur Deutschland, in anderen EU-Ländern versuchen sich rechte Parteien in Regierungsverantwortung. Die Konrad-Adenauer-Stiftung hat untersucht, was das für Konservative...
www.spiegel.de
September 23, 2025 at 11:41 AM
Konservative 🤝Rechtsextreme = politischer Selbstmord?
In vielen EU-Ländern versuchen konservative Parteien durch Kooperationen, rechtsextreme Parteien zu „zähmen“. Die CDU-nahe Konrad-Adenauer-Stiftung hat untersucht, was das für Konsequenzen hat. Spoiler: Es funktioniert nicht. 1/6🧵
In vielen EU-Ländern versuchen konservative Parteien durch Kooperationen, rechtsextreme Parteien zu „zähmen“. Die CDU-nahe Konrad-Adenauer-Stiftung hat untersucht, was das für Konsequenzen hat. Spoiler: Es funktioniert nicht. 1/6🧵
Reposted by Daniel Heck
For all who use Bayesian hierarchical models, have a look at our new preprint, out now together with @linushof.bsky.social @nunobusch.bsky.social and @thorstenpachur.bsky.social
osf.io/preprints/ps...
osf.io/preprints/ps...
osf.io
September 10, 2025 at 2:41 PM
For all who use Bayesian hierarchical models, have a look at our new preprint, out now together with @linushof.bsky.social @nunobusch.bsky.social and @thorstenpachur.bsky.social
osf.io/preprints/ps...
osf.io/preprints/ps...
New paper showing that both the test–retest stability and the split-half reliability of the repetition-based truth effect is close to zero:
www.sciencedirect.com/science/arti...
www.sciencedirect.com/science/arti...
Assessing the truth effect’s reliability and test–retest stability
The finding that repeating a statement typically increases its perceived validity is referred to as the truth effect. Research on individual differenc…
www.sciencedirect.com
September 3, 2025 at 12:13 PM
New paper showing that both the test–retest stability and the split-half reliability of the repetition-based truth effect is close to zero:
www.sciencedirect.com/science/arti...
www.sciencedirect.com/science/arti...
Reposted by Daniel Heck
At the FORRT Replication Hub, our mission is to support researchers who want to replicate previous findings. We have now published a big new component with which we want to fulfill this mission: An open access handbook for reproduction and replication studies: forrt.org/replication_...
September 3, 2025 at 6:54 AM
At the FORRT Replication Hub, our mission is to support researchers who want to replicate previous findings. We have now published a big new component with which we want to fulfill this mission: An open access handbook for reproduction and replication studies: forrt.org/replication_...
Reposted by Daniel Heck
Help us show there is support for offering registered reports at one of Psychology's leading method's journal! chng.it/TwwnVBScVb
Adopt Registered Reports at Psychological Methods
Can you spare a minute to help this campaign?
chng.it
August 21, 2025 at 6:44 PM
Help us show there is support for offering registered reports at one of Psychology's leading method's journal! chng.it/TwwnVBScVb
Reposted by Daniel Heck
Reading this and trying to take in the full enormity of what is happening. The scale of it. open.substack.com/pub/christin...
Grand Designs: the loss of American freedom
Exactly seven months into Trump's second term, we have reached 1000 authoritarian actions. Here I lay out the enormity of what has happened.
open.substack.com
August 21, 2025 at 8:30 PM
Reading this and trying to take in the full enormity of what is happening. The scale of it. open.substack.com/pub/christin...
Reposted by Daniel Heck
1/3 I think the premise is worth some attention: why is there a (frequently wrong) expectation that science is precise? I am often confused even by textbooks for university student audiences. Confused about how frequently findings and expert judgements are portrayed as certain and final.
"Science is expected to be precise, and admissions of uncertainty (especially large levels) can be perceived as scientific failures, rather than natural limitations of knowledge of a topic." 😕
Broomell et al. (2025). Expert judgment and communication of uncertainty. doi.org/10.1007/978-...
Broomell et al. (2025). Expert judgment and communication of uncertainty. doi.org/10.1007/978-...
Expert Judgment and Communication of Uncertainty
Knowledge built through the scientific study of climate is essential for informed decision-making. In the presence of irreducible uncertainty, the results of climate science must be gathered and synth...
doi.org
July 22, 2025 at 3:39 PM
1/3 I think the premise is worth some attention: why is there a (frequently wrong) expectation that science is precise? I am often confused even by textbooks for university student audiences. Confused about how frequently findings and expert judgements are portrayed as certain and final.
"Science is expected to be precise, and admissions of uncertainty (especially large levels) can be perceived as scientific failures, rather than natural limitations of knowledge of a topic." 😕
Broomell et al. (2025). Expert judgment and communication of uncertainty. doi.org/10.1007/978-...
Broomell et al. (2025). Expert judgment and communication of uncertainty. doi.org/10.1007/978-...
Expert Judgment and Communication of Uncertainty
Knowledge built through the scientific study of climate is essential for informed decision-making. In the presence of irreducible uncertainty, the results of climate science must be gathered and synth...
doi.org
July 22, 2025 at 3:26 PM
"Science is expected to be precise, and admissions of uncertainty (especially large levels) can be perceived as scientific failures, rather than natural limitations of knowledge of a topic." 😕
Broomell et al. (2025). Expert judgment and communication of uncertainty. doi.org/10.1007/978-...
Broomell et al. (2025). Expert judgment and communication of uncertainty. doi.org/10.1007/978-...
Just submitted a minor bugfix of RRreg to CRAN:
github.com/danheck/RRre...
The R package focuses on analyzing univariate & multivariate data collected with the Randomized Response Technique (RRT), which protects anonymity in surveys by randomly scrambling responses.
I also added a new logo 🚀
github.com/danheck/RRre...
The R package focuses on analyzing univariate & multivariate data collected with the Randomized Response Technique (RRT), which protects anonymity in surveys by randomly scrambling responses.
I also added a new logo 🚀
July 22, 2025 at 9:33 AM
Just submitted a minor bugfix of RRreg to CRAN:
github.com/danheck/RRre...
The R package focuses on analyzing univariate & multivariate data collected with the Randomized Response Technique (RRT), which protects anonymity in surveys by randomly scrambling responses.
I also added a new logo 🚀
github.com/danheck/RRre...
The R package focuses on analyzing univariate & multivariate data collected with the Randomized Response Technique (RRT), which protects anonymity in surveys by randomly scrambling responses.
I also added a new logo 🚀
Reposted by Daniel Heck
What an incredible resource from the indefatigable @chrischirp.bsky.social . No one can say we didn't know -- it's all happening in broad daylight.
🧵Introducing the Trump Action Tracker website!
Today I’m launching www.trumpactiontracker.info - a live, searchable list of authoritarian‑style actions from Trump’s second term (over 740 actions so far). 1/14
Today I’m launching www.trumpactiontracker.info - a live, searchable list of authoritarian‑style actions from Trump’s second term (over 740 actions so far). 1/14
July 22, 2025 at 6:09 AM
What an incredible resource from the indefatigable @chrischirp.bsky.social . No one can say we didn't know -- it's all happening in broad daylight.
Reposted by Daniel Heck
Ein ganz ganz wichtiger Text in diesen Zeiten. "Die vorliegende Kampagne gegen eine deutsche Top-Juristin ist nichts anderes als ein weiterer Versuch der Trumpisierung deutscher Politik. [...] es liegt kurzum an wirklich allen Demokraten, dies nicht zuzulassen." 👊
"Rechtspopulisten, Rechtsradikale und Antidemokraten versuchen abermals, unsere demokratischen Institutionen zu schwächen, um so den Weg zu bereiten für ihre rechtspopulistische, rechtsradikale und antidemokratische Politik. Es liegt an uns allen, das zu verhindern."
Mein neuer Artikel!
Mein neuer Artikel!
Die Mär von der Neutralität (Der Fall Brosius-Gersdorf)
Eine unwahrscheinliche Kandidatin lässt momentan den Blutdruck der Nation anziehen: Frauke Brosius-Gersdorf. Top-Juristin, anerkannte Wissenschaftlerin und, wenn es nach…
steady.page
July 22, 2025 at 6:57 AM
Ein ganz ganz wichtiger Text in diesen Zeiten. "Die vorliegende Kampagne gegen eine deutsche Top-Juristin ist nichts anderes als ein weiterer Versuch der Trumpisierung deutscher Politik. [...] es liegt kurzum an wirklich allen Demokraten, dies nicht zuzulassen." 👊
Yet another checklist for science 🚀
✅A checklist...
✅for incentivizing...
✅and facilitating...
✅good theory building
✅https://osf.io/preprints/osf/7qvfz_v2
Luckily enough, we can nowadays use AI to fill out all the checklists during the research process 😅
✅A checklist...
✅for incentivizing...
✅and facilitating...
✅good theory building
✅https://osf.io/preprints/osf/7qvfz_v2
Luckily enough, we can nowadays use AI to fill out all the checklists during the research process 😅
July 8, 2025 at 9:31 AM
Yet another checklist for science 🚀
✅A checklist...
✅for incentivizing...
✅and facilitating...
✅good theory building
✅https://osf.io/preprints/osf/7qvfz_v2
Luckily enough, we can nowadays use AI to fill out all the checklists during the research process 😅
✅A checklist...
✅for incentivizing...
✅and facilitating...
✅good theory building
✅https://osf.io/preprints/osf/7qvfz_v2
Luckily enough, we can nowadays use AI to fill out all the checklists during the research process 😅
Reposted by Daniel Heck
Here's a paper with a skeleton of the idea, but there is really lots of research to do on the structure of workflow networks, now to make them robust, how to development diagnostics and calculi for steps within them. doi.org/10.1073/pnas...
Bridging theory and data: A computational workflow for cultural evolution | PNAS
Cultural evolution applies evolutionary concepts and tools to explain the change of
culture over time. Despite advances in both theoretical and emp...
doi.org
July 3, 2025 at 6:56 AM
Here's a paper with a skeleton of the idea, but there is really lots of research to do on the structure of workflow networks, now to make them robust, how to development diagnostics and calculi for steps within them. doi.org/10.1073/pnas...
Reposted by Daniel Heck
Experimentology is out today!!! A group of us wrote a free online textbook for experimental methods, available at experimentology.io - the idea was to integrate open science into all aspects of the experimental workflow from planning to design, analysis, and writing.
July 1, 2025 at 6:26 PM
Experimentology is out today!!! A group of us wrote a free online textbook for experimental methods, available at experimentology.io - the idea was to integrate open science into all aspects of the experimental workflow from planning to design, analysis, and writing.
Reposted by Daniel Heck
Simplifying ethics applications and their evaluation 👍
Leibniz Institute for Psychology (ZPID) provides a free webtool for ethics proposals in collaboration with #Chemnitz #University of #Technology
👉 ethiktool.org/en
Thank you @volkswagenstiftung.de
#ethic #psychology #humanities
Leibniz Institute for Psychology (ZPID) provides a free webtool for ethics proposals in collaboration with #Chemnitz #University of #Technology
👉 ethiktool.org/en
Thank you @volkswagenstiftung.de
#ethic #psychology #humanities
Ethiktool - Main page
ethiktool.org
June 26, 2025 at 7:49 AM
Simplifying ethics applications and their evaluation 👍
Leibniz Institute for Psychology (ZPID) provides a free webtool for ethics proposals in collaboration with #Chemnitz #University of #Technology
👉 ethiktool.org/en
Thank you @volkswagenstiftung.de
#ethic #psychology #humanities
Leibniz Institute for Psychology (ZPID) provides a free webtool for ethics proposals in collaboration with #Chemnitz #University of #Technology
👉 ethiktool.org/en
Thank you @volkswagenstiftung.de
#ethic #psychology #humanities