Inconsistent is what I dislike the most

last time I tried it the system library autocomplete was super slow... not sure if I had a poor config, but I'd say half a second to get the proposal. I was really neat though

Great read.
If priced out of a bet, the best things is to sell the opportunity to bet to a higher bankroll party (if possible).
There are many cases in life where uncertainty can be traded at discount for certainty (insurance policy is a bet on a home getting flooded, bank loans, ...)

Oh make sense

I don’t know R but these things are not plain text files?

Does Lucy get a nametag ?

This project is supported by the Swiss National Science Foundation @snsf.ch, on a project grant specifically written for this reproducibility project! It’s a great win 🎉

.. but found Aider (usually Sonnet Architect + DeepSeek implementor) and Claude Code extremely productive.
Task is also important, it is incredible and safe for plotting and front-end... found it slows me down on many pure modeling task. All anecdotal obviously.

yes, very nice someone studied it so well. I am very curious on their hinted follow-up on agent. I always fount LLM clunky, and cursor frustrating (there is some kind of bad context compression or something) ...

But in fact, fly immunity is highly reproducible! 🎊

~80% of claims could be verified. Moreover, some challenged claims just reflect the field advancing its knowledge/tools.

The lesson: if the tools are good and the research largely exempt from direct translation pressures, science works.

3.5/n

When everything is considered together (w/ caveats), the most prestigious institutes are the most likely to produce irreproducible work. Journal tier was a more minor effect, and in fact, "high-impact" but not "trophy" journals publish the most reproducible science.

But, many caveats (cont.)

4.3/n

more than that but right order of magnitude. I always say $10^1 for preprint; $10^3 for journal article; $10^5 for research. most costs are staff not tech because of responsible screening, customer service, etc.

Seems like it cannot do these little neat interactive javascript diagrams but claude has gotten better at ascii

I remember you talking about this :D This is great (I get a Error though, only when I am logged with Claude).
Hope you get back the you get a list of the questions

I'm not in epiengage but I'll try with something more unformed ! Squares with LLMs ability in green field projects vs already existing stuff.

Oh no, I now have to test twice the hypothesis 😦

interesting, somehow never managed to use LLM for this, they always compromise my ideas/go too far.... I find them useful for nearly everything else (finding flaws in ideas, developing the concept).

Perhaps my notes are too scattered. Or my prompt is bad.

(Obvious disclaimer that LLM use comes with many shortcomings, and world model is something that is hard to define. Just hope for more nuance.)

arxiv.org/pdf/2403.154... is also a good read (yay for independent researchers).

Obviously, this last bit also highlights that the world-model is relatively brittle. But still, it exists.

That's for non-coders. For coders, there is a before and after using Claude Code. A lot of the academic literature on LLMs brushes over code (like the big PNAS piece recently forgot who).