Matthew B. Jané
@matthewbjane.bsky.social
PhD student at UConn | Analyst at the Medical Evidence Project | Center for Scientific Integrity| matthewbjane.com
Update on Error Report #2: The impact of acoustic stimulation during sleep on memory and sleep architecture: A meta-analysis
The article has been retracted by agreement with the journal editor and authors #metascience
The article has been retracted by agreement with the journal editor and authors #metascience
June 19, 2025 at 9:11 PM
Update on Error Report #2: The impact of acoustic stimulation during sleep on memory and sleep architecture: A meta-analysis
The article has been retracted by agreement with the journal editor and authors #metascience
The article has been retracted by agreement with the journal editor and authors #metascience
Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses.
Link: matthewbjane.github.io/blog-posts/b...
#stats #metascience
Link: matthewbjane.github.io/blog-posts/b...
#stats #metascience
May 23, 2025 at 10:47 PM
Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses.
Link: matthewbjane.github.io/blog-posts/b...
#stats #metascience
Link: matthewbjane.github.io/blog-posts/b...
#stats #metascience
(#metascience) A good article by @stuartbuck.bsky.social on the Fluoride and IQ meta-analysis: goodscience.substack.com/p/the-resear.... Summarizes some of the points in our forensic review of it (see the forensic review as a pre-print here: osf.io/preprints/os...). Very nice excerpt below:
April 28, 2025 at 5:01 PM
(#metascience) A good article by @stuartbuck.bsky.social on the Fluoride and IQ meta-analysis: goodscience.substack.com/p/the-resear.... Summarizes some of the points in our forensic review of it (see the forensic review as a pre-print here: osf.io/preprints/os...). Very nice excerpt below:
Error Report #4: matthewbjane.quarto.pub/meta-analysi...
The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os...
#metascience
The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os...
#metascience
April 23, 2025 at 9:07 PM
Error Report #4: matthewbjane.quarto.pub/meta-analysi...
The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os...
#metascience
The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os...
#metascience
Coding RCTs for a meta-analysis…
April 11, 2025 at 5:18 PM
Coding RCTs for a meta-analysis…
They chose to use the standardized mean difference in IQ between a reference and exposure group however the reference in many studies has more fluoride exposure than the exposure group in other studies! There is no consistent definition for the groupings.
April 8, 2025 at 5:23 PM
They chose to use the standardized mean difference in IQ between a reference and exposure group however the reference in many studies has more fluoride exposure than the exposure group in other studies! There is no consistent definition for the groupings.
One major finding in our pre-print is that the journal ‘Fluoride’ publishes much larger effects than any other academic journal. Fluoride is published by the International Society for Fluoride Research which is run by anti-fluoride activists and hosts water defluoridation workshops. #metascience
April 8, 2025 at 5:16 PM
One major finding in our pre-print is that the journal ‘Fluoride’ publishes much larger effects than any other academic journal. Fluoride is published by the International Society for Fluoride Research which is run by anti-fluoride activists and hosts water defluoridation workshops. #metascience
Error Report #2 (#metascience): t.co/9xyqIVUele
The meta-analysis by Stanyer et al. (2022) contains severe data extraction errors. Due to these errors, the meta-analytic results for memory retention scores are incorrect. Reported effects for WPAL outcomes are 5x larger than the corrected effects.
The meta-analysis by Stanyer et al. (2022) contains severe data extraction errors. Due to these errors, the meta-analytic results for memory retention scores are incorrect. Reported effects for WPAL outcomes are 5x larger than the corrected effects.
March 18, 2025 at 6:12 PM
Error Report #2 (#metascience): t.co/9xyqIVUele
The meta-analysis by Stanyer et al. (2022) contains severe data extraction errors. Due to these errors, the meta-analytic results for memory retention scores are incorrect. Reported effects for WPAL outcomes are 5x larger than the corrected effects.
The meta-analysis by Stanyer et al. (2022) contains severe data extraction errors. Due to these errors, the meta-analytic results for memory retention scores are incorrect. Reported effects for WPAL outcomes are 5x larger than the corrected effects.
Pre-prints are a run-of-the-mill modern open science practice. I’d rather a more transparent review process than less. A completely open review process holds reviewers and authors accountable. Let’s not pretend that a blind review is “impartial” and “objective”. #metaresearch
December 2, 2024 at 9:02 PM
Pre-prints are a run-of-the-mill modern open science practice. I’d rather a more transparent review process than less. A completely open review process holds reviewers and authors accountable. Let’s not pretend that a blind review is “impartial” and “objective”. #metaresearch
Chopped all my hair off
December 2, 2024 at 7:50 PM
Chopped all my hair off
Matt’s are so back
November 24, 2024 at 4:53 PM
Matt’s are so back
#stats #metascience Change scores don’t make any sense here. Anyone have any ideas what the discrepancy could be?
November 22, 2024 at 7:47 PM
#stats #metascience Change scores don’t make any sense here. Anyone have any ideas what the discrepancy could be?
Oof.
Although now I wonder if you could estimate the within-original-replication variance in SMDs by using original-replication pairs as a random effect?
Also, ignoring the dichotomization, is there any substantive reason replications produce smaller effects outside of publication bias?
Although now I wonder if you could estimate the within-original-replication variance in SMDs by using original-replication pairs as a random effect?
Also, ignoring the dichotomization, is there any substantive reason replications produce smaller effects outside of publication bias?
November 19, 2024 at 10:15 PM
Oof.
Although now I wonder if you could estimate the within-original-replication variance in SMDs by using original-replication pairs as a random effect?
Also, ignoring the dichotomization, is there any substantive reason replications produce smaller effects outside of publication bias?
Although now I wonder if you could estimate the within-original-replication variance in SMDs by using original-replication pairs as a random effect?
Also, ignoring the dichotomization, is there any substantive reason replications produce smaller effects outside of publication bias?
Rhyming sand with quicksand is elite
November 17, 2024 at 6:47 PM
Rhyming sand with quicksand is elite
#stats #rstats New blog post!! The blog post for Individual Person Data (IPD) Meta-Analysis with Beta Regression in a repeated measures cross-over design is up! matthewbjane.github.io/blog-posts/b...
October 31, 2024 at 9:44 PM
#stats #rstats New blog post!! The blog post for Individual Person Data (IPD) Meta-Analysis with Beta Regression in a repeated measures cross-over design is up! matthewbjane.github.io/blog-posts/b...
Requesting assistance for upcoming blog, please read: Haidt and Raush’s part 3 written by David Stein is now out (www.afterbabel.com/p/fundamenta...). Stein’s post-hoc analysis here is quite strange. 1/4
October 4, 2024 at 5:17 PM
Requesting assistance for upcoming blog, please read: Haidt and Raush’s part 3 written by David Stein is now out (www.afterbabel.com/p/fundamenta...). Stein’s post-hoc analysis here is quite strange. 1/4
Made some new additions such as comparing linear and GAM model on the non-linear data set
September 25, 2024 at 2:54 AM
Made some new additions such as comparing linear and GAM model on the non-linear data set
Came across this foot note in Rausch and Haidt’s article. Unfortunately, this is exactly not what a random effects meta-analysis is. They seem to be confusing it with an equal-effect or common effect meta-analysis. Yet they state it as fact.
September 4, 2024 at 5:16 PM
Came across this foot note in Rausch and Haidt’s article. Unfortunately, this is exactly not what a random effects meta-analysis is. They seem to be confusing it with an equal-effect or common effect meta-analysis. Yet they state it as fact.
You know I actually do see that the note is up. This note is much better than the first one
September 2, 2024 at 6:56 PM
You know I actually do see that the note is up. This note is much better than the first one
My blog post critical of this re-analysis is up: matthewbjane.com/blog-posts/blo…
The re-analysis conducted by Rausch & Haidt does not follow a principled statistical approach. I re-do their re-analysis with appropriate statistical methods
The re-analysis conducted by Rausch & Haidt does not follow a principled statistical approach. I re-do their re-analysis with appropriate statistical methods
August 30, 2024 at 9:06 PM
My blog post critical of this re-analysis is up: matthewbjane.com/blog-posts/blo…
The re-analysis conducted by Rausch & Haidt does not follow a principled statistical approach. I re-do their re-analysis with appropriate statistical methods
The re-analysis conducted by Rausch & Haidt does not follow a principled statistical approach. I re-do their re-analysis with appropriate statistical methods
Excited that we have a very solid draft of our manuscript:
“Extracting Pre-Post Correlations for Meta-Analyses of Repeated Measures Designs”
Pre-post correlations often go unreported in studies, figure out how to extract them from other statistics: matthewbjane.quarto.pub/pre-post-cor...
“Extracting Pre-Post Correlations for Meta-Analyses of Repeated Measures Designs”
Pre-post correlations often go unreported in studies, figure out how to extract them from other statistics: matthewbjane.quarto.pub/pre-post-cor...
August 24, 2024 at 10:25 PM
Excited that we have a very solid draft of our manuscript:
“Extracting Pre-Post Correlations for Meta-Analyses of Repeated Measures Designs”
Pre-post correlations often go unreported in studies, figure out how to extract them from other statistics: matthewbjane.quarto.pub/pre-post-cor...
“Extracting Pre-Post Correlations for Meta-Analyses of Repeated Measures Designs”
Pre-post correlations often go unreported in studies, figure out how to extract them from other statistics: matthewbjane.quarto.pub/pre-post-cor...
Come work with me on a coffee, lo-fi, and stats livestream where I work on some quarto projects. www.youtube.com/live/KI9w9U9...
August 14, 2024 at 4:02 PM
Come work with me on a coffee, lo-fi, and stats livestream where I work on some quarto projects. www.youtube.com/live/KI9w9U9...
My attempt at stuffing the entirety of a random effects meta-analysis into a single visualization
July 3, 2024 at 1:32 AM
My attempt at stuffing the entirety of a random effects meta-analysis into a single visualization