Thanks! I forgot to share the article here so also thanks for that!

After many decades we discovered the reason for the duck shortage: the toaster casings were being made by melting them down.

This is why most toasters in Iceland are yellow, and why they're extremely buoyant.

🔥

I'm also loving the new folder structure. It makes way more sense to have things separated between server/frontend.

That's awesome! I haven't noticed any performance but I'm mostly doing small projects on an M1 macbook so I wouldn't really expect anything noticeable haha

I'm hearing a lot from people with new/small projects having zero issues. Haven't heard much about bigger projects yet.

gpt-michael-thiessen

Sometimes I will prompt a model specifically to probe the latent space, to figure out how much it knows about a topic.

Instead of saying, "write code like Michael Thiessen", I will first ask, "Who is Michael Thiessen?", "what code has Michael Thiessen written?" to determine if it actually knows.

You can also talk to it in a way that forces it to reveal it's own lack of understanding.

So, no leading questions or anything like that.

Newer things, especially if it replaces or contradicts older information, it tends to hallucinate on wildly.

eg. if a library has breaking changes, it will intermix v2 with v3 because versions aren't strongly linked to the code in it's training data.

For hallucinations in particular, after using a model for awhile you get a sense of what they know and don't know.

eg. things that most experts would agree on are solid, like laws of physics, medical best practices, general software engineering patterns etc.

Well, it's a learned skill like anything else.

I wish I could give a concise answer but it's like asking how to write good code. A lot of it is tacit knowledge.

Hard (impossible?) to do in 280 characters.

Yeah, it's how some people approach the latest todo app or productivity system as if it's somehow going to save them, when the main bottleneck is always in your head somewhere.

We seem to have very different experiences then.

I'm using it for fairly complex things (in addition to the mundane test writing, etc.) and hallucinations are very rare now when using the right tools in the right way.

What's your skepticism and why would it change a year from now?

Also how much fun I'm having building stuff I wouldn't have built otherwise