François Jabouille
@francois-jabouille.bsky.social
• PT & Sport Addict 🏃🏋♀
• PhD Candidate in Rehabilitation Sciences at @uottawa.bsky.social 🎓
• Neurosciences | Physical Activity | Health | Automatic Tendencies | Human behavior | Open Science.
• PhD Candidate in Rehabilitation Sciences at @uottawa.bsky.social 🎓
• Neurosciences | Physical Activity | Health | Automatic Tendencies | Human behavior | Open Science.
@replicationindex.com I find that it is more meaningful for a non-expert audience to have it in frequency rather than density so that they can directly compare the obtained versus expected values, but I wanted to know if this is still valid in your opinion or if I am missing something. Thanks!
October 6, 2025 at 6:20 PM
@replicationindex.com I find that it is more meaningful for a non-expert audience to have it in frequency rather than density so that they can directly compare the obtained versus expected values, but I wanted to know if this is still valid in your opinion or if I am missing something. Thanks!
I will have a look, thanks for the information.
September 27, 2025 at 4:37 PM
I will have a look, thanks for the information.
I don't think it shows the same thing. Here we wanted to highlight publication bias by studying the distribution of p-values.
However, the average power of the positive results would definitely have been very useful data for assessing the reliability of the results!
However, the average power of the positive results would definitely have been very useful data for assessing the reliability of the results!
September 27, 2025 at 2:01 AM
I don't think it shows the same thing. Here we wanted to highlight publication bias by studying the distribution of p-values.
However, the average power of the positive results would definitely have been very useful data for assessing the reliability of the results!
However, the average power of the positive results would definitely have been very useful data for assessing the reliability of the results!
Exactly, whether it's for us practitioners or our patients, a change is needed here.
September 27, 2025 at 1:47 AM
Exactly, whether it's for us practitioners or our patients, a change is needed here.
Special thanks to @pbogdan.bsky.social for making his code available, which allowed us to calculate the proportion of fragile p-values in our sample 🙏
September 26, 2025 at 3:42 PM
Special thanks to @pbogdan.bsky.social for making his code available, which allowed us to calculate the proportion of fragile p-values in our sample 🙏
✍️ Conclusion
Questionable research practices, publication bias… Too many grey areas persist around the credibility of physical therapy research, and although tools exist to improve transparency, they still appear to be scarcely used. It’s time to base our practice on (real) evidence.
Questionable research practices, publication bias… Too many grey areas persist around the credibility of physical therapy research, and although tools exist to improve transparency, they still appear to be scarcely used. It’s time to base our practice on (real) evidence.
September 26, 2025 at 3:42 PM
✍️ Conclusion
Questionable research practices, publication bias… Too many grey areas persist around the credibility of physical therapy research, and although tools exist to improve transparency, they still appear to be scarcely used. It’s time to base our practice on (real) evidence.
Questionable research practices, publication bias… Too many grey areas persist around the credibility of physical therapy research, and although tools exist to improve transparency, they still appear to be scarcely used. It’s time to base our practice on (real) evidence.
Preprints:
- Only 6 articles (1%) were posted as preprints, slowing the pace of scientific discovery.
- Only 6 articles (1%) were posted as preprints, slowing the pace of scientific discovery.
September 26, 2025 at 3:42 PM
Preprints:
- Only 6 articles (1%) were posted as preprints, slowing the pace of scientific discovery.
- Only 6 articles (1%) were posted as preprints, slowing the pace of scientific discovery.
Open research practices:
- No registered reports, which help ensure methodological rigor.
- 72% of studies are not preregistered, leaving room for protocol or outcome changes.
- Only 12% of articles make their data accessible, which is necessary for reproducibility.
- No registered reports, which help ensure methodological rigor.
- 72% of studies are not preregistered, leaving room for protocol or outcome changes.
- Only 12% of articles make their data accessible, which is necessary for reproducibility.
September 26, 2025 at 3:42 PM
Open research practices:
- No registered reports, which help ensure methodological rigor.
- 72% of studies are not preregistered, leaving room for protocol or outcome changes.
- Only 12% of articles make their data accessible, which is necessary for reproducibility.
- No registered reports, which help ensure methodological rigor.
- 72% of studies are not preregistered, leaving room for protocol or outcome changes.
- Only 12% of articles make their data accessible, which is necessary for reproducibility.
Rigorous research practices:
- Sample size was justified in only 37% of quantitative studies, reducing the reliability of the results.
- No replication studies, even though they are essential to confirm the robustness of findings.
- Sample size was justified in only 37% of quantitative studies, reducing the reliability of the results.
- No replication studies, even though they are essential to confirm the robustness of findings.
September 26, 2025 at 3:42 PM
Rigorous research practices:
- Sample size was justified in only 37% of quantitative studies, reducing the reliability of the results.
- No replication studies, even though they are essential to confirm the robustness of findings.
- Sample size was justified in only 37% of quantitative studies, reducing the reliability of the results.
- No replication studies, even though they are essential to confirm the robustness of findings.
Publication bias:
- there are 2.6 times more p-values just below the 0.05 threshold than p-values just above it.
- 39% of p-values in an article fall in the “fragile” zone (.01 < p < .05), whereas a maximum of 26% is expected for studies with 80% statistical power.
- there are 2.6 times more p-values just below the 0.05 threshold than p-values just above it.
- 39% of p-values in an article fall in the “fragile” zone (.01 < p < .05), whereas a maximum of 26% is expected for studies with 80% statistical power.
September 26, 2025 at 3:42 PM
Publication bias:
- there are 2.6 times more p-values just below the 0.05 threshold than p-values just above it.
- 39% of p-values in an article fall in the “fragile” zone (.01 < p < .05), whereas a maximum of 26% is expected for studies with 80% statistical power.
- there are 2.6 times more p-values just below the 0.05 threshold than p-values just above it.
- 39% of p-values in an article fall in the “fragile” zone (.01 < p < .05), whereas a maximum of 26% is expected for studies with 80% statistical power.
📑 Results
High positive result rate:
- more than 8 out of 10 studies report a statistically significant result, an abnormally high and alarming proportion.
High positive result rate:
- more than 8 out of 10 studies report a statistically significant result, an abnormally high and alarming proportion.
September 26, 2025 at 3:42 PM
📑 Results
High positive result rate:
- more than 8 out of 10 studies report a statistically significant result, an abnormally high and alarming proportion.
High positive result rate:
- more than 8 out of 10 studies report a statistically significant result, an abnormally high and alarming proportion.
⚙️ Methods
465 articles published between 2022 and 2024 in official
journals of national physical therapy associations in the USA, Canada, the UK, and Australia were analyzed.
465 articles published between 2022 and 2024 in official
journals of national physical therapy associations in the USA, Canada, the UK, and Australia were analyzed.
September 26, 2025 at 3:42 PM
⚙️ Methods
465 articles published between 2022 and 2024 in official
journals of national physical therapy associations in the USA, Canada, the UK, and Australia were analyzed.
465 articles published between 2022 and 2024 in official
journals of national physical therapy associations in the USA, Canada, the UK, and Australia were analyzed.