Jay Patel
@infotainment.bsky.social
🎷 vibe adulting
#HCI #PeerReview #SciPub
#toolsforthought #ResearchSynthesis
#OpenScience #MetaSci #FoSci
🔎 Research: ethnography of peer review
🧑🏫 Teaching: Stats, DataViz
🐢 UMD: College of Info
🌐 PhD Candidate: Info Studies / HCI + Data
🏝️ OASISlab
#HCI #PeerReview #SciPub
#toolsforthought #ResearchSynthesis
#OpenScience #MetaSci #FoSci
🔎 Research: ethnography of peer review
🧑🏫 Teaching: Stats, DataViz
🐢 UMD: College of Info
🌐 PhD Candidate: Info Studies / HCI + Data
🏝️ OASISlab
Pinned
Jay Patel
@infotainment.bsky.social
· Jun 11
🌐 It strikes me that crowdsourced evaluation/benchmarking of LLMs for scientific work would be valuable and possible in the style of ManyLabs projects.
If I coordinate crowds of volunteers to assess how well LLMs can evaluate papers, would you be interested?
#openscience #metascience #AI #LLM
If I coordinate crowds of volunteers to assess how well LLMs can evaluate papers, would you be interested?
#openscience #metascience #AI #LLM
About a year after academics migrated from Twitter to Bluesky, still no pubpeerbot? Or similar bots working on adding context to research discussions?
I'm tempted to build something in this area. Would that be worth doing?
I'm tempted to build something in this area. Would that be worth doing?
November 14, 2025 at 10:31 PM
About a year after academics migrated from Twitter to Bluesky, still no pubpeerbot? Or similar bots working on adding context to research discussions?
I'm tempted to build something in this area. Would that be worth doing?
I'm tempted to build something in this area. Would that be worth doing?
Reposted by Jay Patel
Our paper on improving statistical reporting in psychology is now online 🎉
As a part of this paper, we also created the Transparent Statistical Reporting in Psychology checklist, which researchers can use to improve their statistical reporting practices
www.nature.com/articles/s44...
As a part of this paper, we also created the Transparent Statistical Reporting in Psychology checklist, which researchers can use to improve their statistical reporting practices
www.nature.com/articles/s44...
November 14, 2025 at 8:43 PM
Our paper on improving statistical reporting in psychology is now online 🎉
As a part of this paper, we also created the Transparent Statistical Reporting in Psychology checklist, which researchers can use to improve their statistical reporting practices
www.nature.com/articles/s44...
As a part of this paper, we also created the Transparent Statistical Reporting in Psychology checklist, which researchers can use to improve their statistical reporting practices
www.nature.com/articles/s44...
Reposted by Jay Patel
You know what they say about academics...
"causal" in the streets
"preliminary and hypothesis-generating" in the sheets
"causal" in the streets
"preliminary and hypothesis-generating" in the sheets
November 12, 2025 at 11:16 PM
You know what they say about academics...
"causal" in the streets
"preliminary and hypothesis-generating" in the sheets
"causal" in the streets
"preliminary and hypothesis-generating" in the sheets
New study idea:
Examine the mental health impacts of reading RetractionWatch posts every day.
Methods: qualitative, of course
retractionwatch.com/2025/11/12/b...
Examine the mental health impacts of reading RetractionWatch posts every day.
Methods: qualitative, of course
retractionwatch.com/2025/11/12/b...
BMJ places expression of concern on heavily criticized stem cell paper
The BMJ has issued an expression of concern for a paper claiming stem cell therapy can reduce the risk of heart failure. The move comes after sleuths and scientists critiqued the “complete mismatch…
retractionwatch.com
November 13, 2025 at 1:24 AM
New study idea:
Examine the mental health impacts of reading RetractionWatch posts every day.
Methods: qualitative, of course
retractionwatch.com/2025/11/12/b...
Examine the mental health impacts of reading RetractionWatch posts every day.
Methods: qualitative, of course
retractionwatch.com/2025/11/12/b...
Reposted by Jay Patel
This is one of the most remarkable academic debacles I've ever seen.
A large RCT got published in BMJ. There are currently 44 Pubpeer comments, mostly about the data, including...well. Read for yourself.
pubpeer.com/publications...
A large RCT got published in BMJ. There are currently 44 Pubpeer comments, mostly about the data, including...well. Read for yourself.
pubpeer.com/publications...
PubPeer - Prevention of acute myocardial infarction induced heart fail...
There are comments on PubPeer for publication: Prevention of acute myocardial infarction induced heart failure by intracoronary infusion of mesenchymal stem cells: phase 3 randomised clinical trial (P...
pubpeer.com
November 11, 2025 at 1:19 AM
This is one of the most remarkable academic debacles I've ever seen.
A large RCT got published in BMJ. There are currently 44 Pubpeer comments, mostly about the data, including...well. Read for yourself.
pubpeer.com/publications...
A large RCT got published in BMJ. There are currently 44 Pubpeer comments, mostly about the data, including...well. Read for yourself.
pubpeer.com/publications...
Hands down, the best PubPeer comment I've read in a while.
November 10, 2025 at 11:12 PM
Hands down, the best PubPeer comment I've read in a while.
I've never seen a qualitative research paper with excellent figures (relevant, eye-catching, etc.).
They only rely on text and photos/screenshots to communicate.
#dataviz + #qualitative research seem opposed, no?
#scicomm #AcademicWriting
They only rely on text and photos/screenshots to communicate.
#dataviz + #qualitative research seem opposed, no?
#scicomm #AcademicWriting
November 10, 2025 at 11:07 PM
I've never seen a qualitative research paper with excellent figures (relevant, eye-catching, etc.).
They only rely on text and photos/screenshots to communicate.
#dataviz + #qualitative research seem opposed, no?
#scicomm #AcademicWriting
They only rely on text and photos/screenshots to communicate.
#dataviz + #qualitative research seem opposed, no?
#scicomm #AcademicWriting
If synesthesia can help perceptual discrimination, I wonder if there are any synesthetic sleuths doing #ImageFraud checks.
#SciComment
matthewjamestaylor.com/synesthesia-...
#SciComment
matthewjamestaylor.com/synesthesia-...
Synesthesia Helps Me Find Four Leaf Clovers
I explain how my synesthesia condition helps me to find four-leaf clovers
matthewjamestaylor.com
November 10, 2025 at 10:42 PM
If synesthesia can help perceptual discrimination, I wonder if there are any synesthetic sleuths doing #ImageFraud checks.
#SciComment
matthewjamestaylor.com/synesthesia-...
#SciComment
matthewjamestaylor.com/synesthesia-...
Reposted by Jay Patel
Have increased capacity for this December INSPECT-SR online training workshop following a successful 1st event today. Book here: www.trybooking.com/uk/FKHV
Introduction to INSPECT-SR Training Workshop December
An introductory 2-hour online workshop will introduce participants to the INSPECT-SR tool for assessing trustworthiness of randomised controlled...
www.trybooking.com
November 6, 2025 at 5:55 PM
Have increased capacity for this December INSPECT-SR online training workshop following a successful 1st event today. Book here: www.trybooking.com/uk/FKHV
While reading a data science conference paper today, I noticed an interesting transparency statement.
Is this common to data mining conferences?
I like this sort of statement; it reminds me a bit of the 21-word solution. #metascience
Is this common to data mining conferences?
I like this sort of statement; it reminds me a bit of the 21-word solution. #metascience
November 7, 2025 at 2:47 AM
While reading a data science conference paper today, I noticed an interesting transparency statement.
Is this common to data mining conferences?
I like this sort of statement; it reminds me a bit of the 21-word solution. #metascience
Is this common to data mining conferences?
I like this sort of statement; it reminds me a bit of the 21-word solution. #metascience
#SciComment Nice example of protecting ECRs from critiques that they had no power to avoid...
I want to comment on a piece of research that came to my attention yesterday that I think is a reflection of endemic problems in our field. The study was published in a top-tier journal and was covered by the national press. It had a very large sample (N>30,000) and several yearly time points.
November 1, 2025 at 1:31 AM
#SciComment Nice example of protecting ECRs from critiques that they had no power to avoid...
Reposted by Jay Patel
New release of PowerLMM.js! Browser-based power analysis for longitudinal models with dropout.
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
October 28, 2025 at 2:02 PM
New release of PowerLMM.js! Browser-based power analysis for longitudinal models with dropout.
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
Reposted by Jay Patel
3rd International Conference “Integrity, Open Science and Artificial Intelligence in Academia and Beyond: Meeting at the Crossroads”
December 17-18
Online & Free
Call for abstracts and registration: armgpublishing.com/3rd-internat...
December 17-18
Online & Free
Call for abstracts and registration: armgpublishing.com/3rd-internat...
3rd International Conference “Integrity, Open Science and Artificial Intelligence in Academia and Beyond: Meeting at the Crossroads” | ArmgPublishing3rd International Conference “Integrity, Open Scien...
armgpublishing.com
October 27, 2025 at 11:46 AM
3rd International Conference “Integrity, Open Science and Artificial Intelligence in Academia and Beyond: Meeting at the Crossroads”
December 17-18
Online & Free
Call for abstracts and registration: armgpublishing.com/3rd-internat...
December 17-18
Online & Free
Call for abstracts and registration: armgpublishing.com/3rd-internat...
Reposted by Jay Patel
Considering Scrivener. Do any of you use any non-Word/Google writing programs?
October 27, 2025 at 12:23 AM
Considering Scrivener. Do any of you use any non-Word/Google writing programs?
Bit of a wild shot, but I'm playing with #RetractionWatch data and #Altmetrics data for a side project and am seeking light, informal guidance here and there from people with experience.
Happy to work through details in DMs (open for you).
Happy to work through details in DMs (open for you).
October 23, 2025 at 11:01 PM
Bit of a wild shot, but I'm playing with #RetractionWatch data and #Altmetrics data for a side project and am seeking light, informal guidance here and there from people with experience.
Happy to work through details in DMs (open for you).
Happy to work through details in DMs (open for you).
Reposted by Jay Patel
What if we did a single run and declared victory
October 23, 2025 at 2:28 AM
What if we did a single run and declared victory
Prediction: AWS Down Memorial Day will be the first new holiday created for GenZ.
Remember the fallen...servers.
Remember the fallen...servers.
October 20, 2025 at 8:06 PM
Prediction: AWS Down Memorial Day will be the first new holiday created for GenZ.
Remember the fallen...servers.
Remember the fallen...servers.
Dear Reviewer 2: Go F’ Yourself.
Another gem in the #peerreview literature, a joke paper, finds that it's Reviewer #3 who's the real problem.
The paper even has a credulous PubPeer comment!
Paper: doi:10.1111/ssqu.12824s
PubPeer: pubpeer.com/publications/80F9ACFE1DC2E6510A4CC3D2D841C1
Another gem in the #peerreview literature, a joke paper, finds that it's Reviewer #3 who's the real problem.
The paper even has a credulous PubPeer comment!
Paper: doi:10.1111/ssqu.12824s
PubPeer: pubpeer.com/publications/80F9ACFE1DC2E6510A4CC3D2D841C1
October 17, 2025 at 11:58 PM
Dear Reviewer 2: Go F’ Yourself.
Another gem in the #peerreview literature, a joke paper, finds that it's Reviewer #3 who's the real problem.
The paper even has a credulous PubPeer comment!
Paper: doi:10.1111/ssqu.12824s
PubPeer: pubpeer.com/publications/80F9ACFE1DC2E6510A4CC3D2D841C1
Another gem in the #peerreview literature, a joke paper, finds that it's Reviewer #3 who's the real problem.
The paper even has a credulous PubPeer comment!
Paper: doi:10.1111/ssqu.12824s
PubPeer: pubpeer.com/publications/80F9ACFE1DC2E6510A4CC3D2D841C1
Reposted by Jay Patel
To absolutely nobody’s surprise, the more than 2,200 episodes of the Joe Rogan Experience do not link to research items even once.
The team decided to run our algorithm across all available episodes of the Joe Rogan Podcast.
At 2261 eps, 3-4 hours long, this was a big task.
The algorithm detected not a single citation in nearly 7,000 hours of content.
The Altmetric team shed a collective tear.
It had worked flawlessly.
9/17
At 2261 eps, 3-4 hours long, this was a big task.
The algorithm detected not a single citation in nearly 7,000 hours of content.
The Altmetric team shed a collective tear.
It had worked flawlessly.
9/17
October 15, 2025 at 12:06 PM
To absolutely nobody’s surprise, the more than 2,200 episodes of the Joe Rogan Experience do not link to research items even once.
Reposted by Jay Patel
I have just left a lengthy Pubpeer comment on the autism/Tylenol study being cited by the Trump administration. There appear to be a number of fairly straightforward errors in the paper.
pubpeer.com/publications...
pubpeer.com/publications...
PubPeer - Evaluation of the evidence on acetaminophen use and neurodev...
There are comments on PubPeer for publication: Evaluation of the evidence on acetaminophen use and neurodevelopmental disorders using the Navigation Guide methodology (2025)
pubpeer.com
October 1, 2025 at 5:03 AM
I have just left a lengthy Pubpeer comment on the autism/Tylenol study being cited by the Trump administration. There appear to be a number of fairly straightforward errors in the paper.
pubpeer.com/publications...
pubpeer.com/publications...
Reposted by Jay Patel
Despite the gutting of the National Center for Educational Statistics, the dept of Ed *did* manage to release 2024 college major counts in the usual format, so I can run it through the same code I do every year. First off, the change since peak of the largest fields -- another year of drops.
September 28, 2025 at 2:20 AM
Despite the gutting of the National Center for Educational Statistics, the dept of Ed *did* manage to release 2024 college major counts in the usual format, so I can run it through the same code I do every year. First off, the change since peak of the largest fields -- another year of drops.
Reposted by Jay Patel
Matthew 15:29-31: And great crowds came to him, bringing with them the lame, the blind, the crippled, the mute, and many others, and they put them at his feet, and he healed them after verifying their citizenship status.
October 2, 2025 at 9:00 PM
Matthew 15:29-31: And great crowds came to him, bringing with them the lame, the blind, the crippled, the mute, and many others, and they put them at his feet, and he healed them after verifying their citizenship status.
One reason I like to post reviews of research papers on @paperstarsorg.bsky.social instead of @pubpeer.com: they actually pass moderation.
The same neutral, substantive comment gets very different results.
The same neutral, substantive comment gets very different results.
October 1, 2025 at 2:37 AM
One reason I like to post reviews of research papers on @paperstarsorg.bsky.social instead of @pubpeer.com: they actually pass moderation.
The same neutral, substantive comment gets very different results.
The same neutral, substantive comment gets very different results.
Reposted by Jay Patel
What’s the best platform for post publication peer review? @pubpeer.com ?
September 25, 2025 at 9:07 PM
What’s the best platform for post publication peer review? @pubpeer.com ?