Felix Holzmeister
@flxhlzmstr.bsky.social
Assistant Professor @uniinnsbruck | Crowd-, Meta-, and Open Science | Behavioral and Experimental Economics and Finance | Lab Manager @econlab | @flxhlzmstr | www.felixholzmeister.com
Reposted by Felix Holzmeister
"p-Excuses"
E.g., p = .056 is “marginally significant” or “close to being significant”
🔹 Most p-excuses are used in psychology.
🔹 The least p-excuses are used in health.
Preprint: osf.io/preprints/me...
#MetaSci #AcademicSky 🧪
E.g., p = .056 is “marginally significant” or “close to being significant”
🔹 Most p-excuses are used in psychology.
🔹 The least p-excuses are used in health.
Preprint: osf.io/preprints/me...
#MetaSci #AcademicSky 🧪
November 14, 2025 at 3:43 PM
"p-Excuses"
E.g., p = .056 is “marginally significant” or “close to being significant”
🔹 Most p-excuses are used in psychology.
🔹 The least p-excuses are used in health.
Preprint: osf.io/preprints/me...
#MetaSci #AcademicSky 🧪
E.g., p = .056 is “marginally significant” or “close to being significant”
🔹 Most p-excuses are used in psychology.
🔹 The least p-excuses are used in health.
Preprint: osf.io/preprints/me...
#MetaSci #AcademicSky 🧪
Reposted by Felix Holzmeister
#GDRI_rep Update 9: We have been waiting a couple of months to make two announcements. A few journals were in the process of retracting GDRI article. The editors informed the authors and then lawyers got involved. Who knows how long it will take.
October 30, 2025 at 1:41 PM
#GDRI_rep Update 9: We have been waiting a couple of months to make two announcements. A few journals were in the process of retracting GDRI article. The editors informed the authors and then lawyers got involved. Who knows how long it will take.
Reposted by Felix Holzmeister
Join us for the virtual Replication Games😍🤓 on Nov 13th! (You don't have to be in the UK - join us from wherever you are😉)
We are hosting virtual Replication Games on Friday November 13th, 2025 with @ukrepro.bsky.social ro.bsky.social. This is our 2nd year collaborating with UKRN. Psych, public health, pol sci and econ studies will be reproduced!
Register here: www.surveymonkey.ca/r/I4R_Replic...
Register here: www.surveymonkey.ca/r/I4R_Replic...
October 20, 2025 at 7:32 PM
Join us for the virtual Replication Games😍🤓 on Nov 13th! (You don't have to be in the UK - join us from wherever you are😉)
Reposted by Felix Holzmeister
🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥
ReplicationResearch.org is now open for submissions!
Submit replications and reproductions from many different fields, as well as conceptual contributions. With diamond OA, open and citable peer review reports, and reproducibility checks, we push the boundaries of open and fair publishing.
Submit replications and reproductions from many different fields, as well as conceptual contributions. With diamond OA, open and citable peer review reports, and reproducibility checks, we push the boundaries of open and fair publishing.
October 11, 2025 at 3:28 AM
🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥
Reposted by Felix Holzmeister
Thought about scientific consensus recently? We have a new DP @i4replication.bsky.social that probes into the famous replication debate between Acemoglu, Johnson & Robinson (AJR) and Albouy - and how experts assess this debate. We find that they disagree. 1/8 www.econstor.eu/bitstream/10...
October 11, 2025 at 11:40 AM
Thought about scientific consensus recently? We have a new DP @i4replication.bsky.social that probes into the famous replication debate between Acemoglu, Johnson & Robinson (AJR) and Albouy - and how experts assess this debate. We find that they disagree. 1/8 www.econstor.eu/bitstream/10...
Reposted by Felix Holzmeister
Come joun us in Münster, it will be awesome😉😎
I4R Replication Games coming to Münster! @i4replication.bsky.social @aufdroeseler.bsky.social @fialalenka.bsky.social
September 17, 2025 at 2:49 PM
Come joun us in Münster, it will be awesome😉😎
Reposted by Felix Holzmeister
Excited to finally have my first paper officially published! "How Do Psychology Journals Handle Postpublication Critique?" is now online with AMPPS. Huge thanks to my supervisors @tomhardwicke.bsky.social and @simine.com and co-authors @bethclarke.bsky.social, N Moodie, S Schiavone, and R Thibault ☺️
Sage Journals: Discover world-class research
Subscription and open access journals from Sage, the world's leading independent academic publisher.
doi.org
September 17, 2025 at 11:23 PM
Excited to finally have my first paper officially published! "How Do Psychology Journals Handle Postpublication Critique?" is now online with AMPPS. Huge thanks to my supervisors @tomhardwicke.bsky.social and @simine.com and co-authors @bethclarke.bsky.social, N Moodie, S Schiavone, and R Thibault ☺️
Reposted by Felix Holzmeister
#GDRI_rep Update 8a: Major updates coming up over the next few weeks.
1st update: We reproduced "Parent–teacher meetings and student outcomes" some time ago. The paper was then retracted by the editors of the Euro Econ Rev.
Additional studies are connected (see diagram)
🧵
1st update: We reproduced "Parent–teacher meetings and student outcomes" some time ago. The paper was then retracted by the editors of the Euro Econ Rev.
Additional studies are connected (see diagram)
🧵
August 27, 2025 at 3:33 PM
#GDRI_rep Update 8a: Major updates coming up over the next few weeks.
1st update: We reproduced "Parent–teacher meetings and student outcomes" some time ago. The paper was then retracted by the editors of the Euro Econ Rev.
Additional studies are connected (see diagram)
🧵
1st update: We reproduced "Parent–teacher meetings and student outcomes" some time ago. The paper was then retracted by the editors of the Euro Econ Rev.
Additional studies are connected (see diagram)
🧵
Reposted by Felix Holzmeister
📢 Come work with us!
🏛️ Faculty of Economics & Statistics, UIBK @econstatuibk.bsky.social @uniinnsbruck.bsky.social
‼️ Three job openings for Full Professor positions
- Data Science
- Microeconomics
- Behavioral Economics
Please share! #datascience #economics
www.uibk.ac.at/de/info-beru...
🏛️ Faculty of Economics & Statistics, UIBK @econstatuibk.bsky.social @uniinnsbruck.bsky.social
‼️ Three job openings for Full Professor positions
- Data Science
- Microeconomics
- Behavioral Economics
Please share! #datascience #economics
www.uibk.ac.at/de/info-beru...
Aktuelle Ausschreibungen – Universität Innsbruck
None
www.uibk.ac.at
June 5, 2025 at 6:29 AM
📢 Come work with us!
🏛️ Faculty of Economics & Statistics, UIBK @econstatuibk.bsky.social @uniinnsbruck.bsky.social
‼️ Three job openings for Full Professor positions
- Data Science
- Microeconomics
- Behavioral Economics
Please share! #datascience #economics
www.uibk.ac.at/de/info-beru...
🏛️ Faculty of Economics & Statistics, UIBK @econstatuibk.bsky.social @uniinnsbruck.bsky.social
‼️ Three job openings for Full Professor positions
- Data Science
- Microeconomics
- Behavioral Economics
Please share! #datascience #economics
www.uibk.ac.at/de/info-beru...
Reposted by Felix Holzmeister
Are you a PhD-Candidate, Prae- or Post-Doc interested in open research practices and want to spend a few summer days in beautiful #Innsbruck?
👉 Then the #OpenScience Summer School at @uniinnsbruck.bsky.social might be the perfect match for you!
www.uibk.ac.at/en/weiterbil...
👉 Then the #OpenScience Summer School at @uniinnsbruck.bsky.social might be the perfect match for you!
www.uibk.ac.at/en/weiterbil...
Open Science
Summer School
www.uibk.ac.at
May 26, 2025 at 12:35 PM
Are you a PhD-Candidate, Prae- or Post-Doc interested in open research practices and want to spend a few summer days in beautiful #Innsbruck?
👉 Then the #OpenScience Summer School at @uniinnsbruck.bsky.social might be the perfect match for you!
www.uibk.ac.at/en/weiterbil...
👉 Then the #OpenScience Summer School at @uniinnsbruck.bsky.social might be the perfect match for you!
www.uibk.ac.at/en/weiterbil...
Reposted by Felix Holzmeister
A re-analysis of Ciacci's (2024) "Banning the purchase of sex increases cases of rape: Evidence from Sweden" Journal of Population Economics reveals major issues. A year ago, reproducers Adema, Folke, and Rickne found coding errors driving the paper's key results. Let's unpack this in a 🧵
May 9, 2025 at 12:21 PM
A re-analysis of Ciacci's (2024) "Banning the purchase of sex increases cases of rape: Evidence from Sweden" Journal of Population Economics reveals major issues. A year ago, reproducers Adema, Folke, and Rickne found coding errors driving the paper's key results. Let's unpack this in a 🧵
Reposted by Felix Holzmeister
🚨 REPLICATION REPORT UPDATE: One year ago, a tweet by John Holbein alerted me, @ollefolke.bsky.social, and @jopieboy.bsky.social to a paper with a shocking result about Sweden’s law criminalizing the purchase of sex.🧵
May 9, 2025 at 9:29 AM
🚨 REPLICATION REPORT UPDATE: One year ago, a tweet by John Holbein alerted me, @ollefolke.bsky.social, and @jopieboy.bsky.social to a paper with a shocking result about Sweden’s law criminalizing the purchase of sex.🧵
Reposted by Felix Holzmeister
Reposted by Felix Holzmeister
Great to see our comment now available online in the European Economic Review! (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Gunther Bensch & Abel Brodeur @i4replication.bsky.social) 🙌
“Try to balance the baseline”: A comment on “parent-teacher meetings and student outcomes: Evidence from a developing country” by Islam (2019)
Islam (2019) reports results from a randomized field experiment in Bangladesh that examines the effects of parent-teacher meetings on student test sco…
www.sciencedirect.com
April 4, 2025 at 7:37 AM
Great to see our comment now available online in the European Economic Review! (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Gunther Bensch & Abel Brodeur @i4replication.bsky.social) 🙌
Reposted by Felix Holzmeister
Our proposal for protocolled replicability & robustness assessments is out in Q Open. The main aim is to structure robustness reproductions, but also to extend the scope to external/construct validity as well as pre-specification checks. Comments welcome! academic.oup.com/qopen/advanc...
April 3, 2025 at 2:20 PM
Our proposal for protocolled replicability & robustness assessments is out in Q Open. The main aim is to structure robustness reproductions, but also to extend the scope to external/construct validity as well as pre-specification checks. Comments welcome! academic.oup.com/qopen/advanc...
Reposted by Felix Holzmeister
Do men increase their support for gender equality if they have daughters?
Some papers suggest so!
Join this meta-science project as a co-author, work with SOEP data and help us all learn more!
Some papers suggest so!
Join this meta-science project as a co-author, work with SOEP data and help us all learn more!
🔔 Call for Participation 🔔
Lab² is inviting researchers to take part in a multi-analyst study on the effects of having daughters on various outcomes.
Join this metascience project as a co-author and gain the opportunity to work with SOEP data!
Lab² is inviting researchers to take part in a multi-analyst study on the effects of having daughters on various outcomes.
Join this metascience project as a co-author and gain the opportunity to work with SOEP data!
#ManyDaughters
Many Analysts
www.manydaughters.com
March 31, 2025 at 4:18 PM
Do men increase their support for gender equality if they have daughters?
Some papers suggest so!
Join this meta-science project as a co-author, work with SOEP data and help us all learn more!
Some papers suggest so!
Join this meta-science project as a co-author, work with SOEP data and help us all learn more!
Reposted by Felix Holzmeister
🔔 Call for Participation 🔔
Lab² is inviting researchers to take part in a multi-analyst study on the effects of having daughters on various outcomes.
Join this metascience project as a co-author and gain the opportunity to work with SOEP data!
Lab² is inviting researchers to take part in a multi-analyst study on the effects of having daughters on various outcomes.
Join this metascience project as a co-author and gain the opportunity to work with SOEP data!
#ManyDaughters
Many Analysts
www.manydaughters.com
March 31, 2025 at 12:04 PM
🔔 Call for Participation 🔔
Lab² is inviting researchers to take part in a multi-analyst study on the effects of having daughters on various outcomes.
Join this metascience project as a co-author and gain the opportunity to work with SOEP data!
Lab² is inviting researchers to take part in a multi-analyst study on the effects of having daughters on various outcomes.
Join this metascience project as a co-author and gain the opportunity to work with SOEP data!
Reposted by Felix Holzmeister
Collaborators are looking for participants for a new multi-analyst study using SOEP data. For more information on registration, eligibility criteria, requirements, procedure, and timeline, please visit www.manydaughters.com. Deadline for registration is April 27
March 31, 2025 at 12:50 PM
Collaborators are looking for participants for a new multi-analyst study using SOEP data. For more information on registration, eligibility criteria, requirements, procedure, and timeline, please visit www.manydaughters.com. Deadline for registration is April 27
Reposted by Felix Holzmeister
#GDRI_rep Update 7: Retraction! Our comment of "Parent–teacher meetings and student outcomes: Evidence from a developing country" has led to the paper being retracted. Our comment is accepted as is.
Short 🧵
Short 🧵
March 27, 2025 at 9:48 PM
#GDRI_rep Update 7: Retraction! Our comment of "Parent–teacher meetings and student outcomes: Evidence from a developing country" has led to the paper being retracted. Our comment is accepted as is.
Short 🧵
Short 🧵
Reposted by Felix Holzmeister
Many psychological scientists are now calling for a “heterogeneity revolution,” focused on uncovering individual and contextual differences in experimental outcomes.
When One Size Doesn’t Fit All
Many psychological scientists are now calling for a “heterogeneity revolution,” focused on uncovering individual and contextual differences in experimental outcomes.
www.psychologicalscience.org
March 14, 2025 at 6:14 PM
Many psychological scientists are now calling for a “heterogeneity revolution,” focused on uncovering individual and contextual differences in experimental outcomes.
Reposted by Felix Holzmeister
#GDRI_rep Update 5: We have a new report. We reproduced the paper entitled "Partisan Effects of Information Campaigns in Competitive Authoritarian Elections: Evidence from Bangladesh" by Ahmed, Hodler and Islam published at the Economic Journal. See below for links to report and authors' responses.
March 14, 2025 at 1:25 PM
#GDRI_rep Update 5: We have a new report. We reproduced the paper entitled "Partisan Effects of Information Campaigns in Competitive Authoritarian Elections: Evidence from Bangladesh" by Ahmed, Hodler and Islam published at the Economic Journal. See below for links to report and authors' responses.
Reposted by Felix Holzmeister
Since we started mass reproducing GDRI, we have requested several replication packages. We have not managed to get a single new replication package as of today (excluding updated packages for one article at the request of editors).
March 14, 2025 at 1:25 PM
Since we started mass reproducing GDRI, we have requested several replication packages. We have not managed to get a single new replication package as of today (excluding updated packages for one article at the request of editors).
Reposted by Felix Holzmeister
In a new @i4replication.bsky.social report we replicate Islam (2019). Main issue: the randomized controlled trial was not randomized. And many other things on top of that. See full report for details. (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Bensch & Brodeur)
#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.
March 11, 2025 at 6:56 PM
In a new @i4replication.bsky.social report we replicate Islam (2019). Main issue: the randomized controlled trial was not randomized. And many other things on top of that. See full report for details. (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Bensch & Brodeur)
Reposted by Felix Holzmeister
#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.
March 11, 2025 at 5:12 PM
#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.
Reposted by Felix Holzmeister
#GDRI_rep Update 3: The paper "Improving Hygiene and Sanitation through Parental Skill Training" by Asadul Islam, Umair Khalil and Tabassum Rahman was conditionally accepted at Economic Development and Cultural Change. We requested a replication package. It has now been withdrawn
March 9, 2025 at 9:05 PM
#GDRI_rep Update 3: The paper "Improving Hygiene and Sanitation through Parental Skill Training" by Asadul Islam, Umair Khalil and Tabassum Rahman was conditionally accepted at Economic Development and Cultural Change. We requested a replication package. It has now been withdrawn