A lil' look at what's in the kitchen at the moment. Spent the day making this very high level visual of LLM inference.

Got to the part of "temperature" and I'm aware that a higher temperature == less predictable but never knew why.

Turns out it's very simple. Before the "score" for a set of tokens is turned into a probability distribution it's divided by the temperature. Higher values "flatten" the distribution.

One of the nice things about using Lit now is that all of my properties and state can be introspected, and I can automatically create Tweakpane entries for them that update in real-time. This required no extra code on the component, all the information I needed was already there.

Visual clarity is still lacking but I’m starting to add layers on top of the map. These are the 8 PoPs ngrok has around the world. Lines between them are just for testing.

TIL the word “graticule”

It’s not obvious to me what happens in this step. You say it “sorts the matrix” but I don’t see that at all. The two strings swap places and one completely changes to an order that is very much not sorted. What am I missing?

Is this fixable?

It’s not the specific source, this happens during the TV boot screen and on the TVs own menus. Factory reset the TV didn’t do anything.