jolios torng
@tarngerine.bsky.social
ty @purvigoel.bsky.social @ikauvar.bsky.social joshua batson and adam jermyn for all your work and support on getting this out the door. i learned so much and it's changed how i think about research rigor and communication
October 24, 2025 at 9:34 PM
ty @purvigoel.bsky.social @ikauvar.bsky.social joshua batson and adam jermyn for all your work and support on getting this out the door. i learned so much and it's changed how i think about research rigor and communication
Read the full writeup: transformer-circuits.pub/2025/october...
While it’s not a full paper, I’m proud to have been a major contributor. It’s a personal milestone from a non-academic bg, to investigate how LLMs visually reason with talented researchers
While it’s not a full paper, I’m proud to have been a major contributor. It’s a personal milestone from a non-academic bg, to investigate how LLMs visually reason with talented researchers
Circuits Updates – October 2025
Visual Features Across Modalities: SVG and ASCII Art Reveal Cross-Modal Understanding; Data Point Initialization for Dictionary Models
transformer-circuits.pub
October 24, 2025 at 9:34 PM
Read the full writeup: transformer-circuits.pub/2025/october...
While it’s not a full paper, I’m proud to have been a major contributor. It’s a personal milestone from a non-academic bg, to investigate how LLMs visually reason with talented researchers
While it’s not a full paper, I’m proud to have been a major contributor. It’s a personal milestone from a non-academic bg, to investigate how LLMs visually reason with talented researchers
And these steering gradients are meaningful in transition as well! See how this smile transforms to a :| face before becoming a frown as we steer negatively on the “say smile” motor feature we found above.
October 24, 2025 at 9:34 PM
And these steering gradients are meaningful in transition as well! See how this smile transforms to a :| face before becoming a frown as we steer negatively on the “say smile” motor feature we found above.
The coolest part is that just like Golden Gate Claude, we can steer with many of these features, transforming a smiley face to wrinkly face, an owl, or an eyeball!
October 24, 2025 at 9:34 PM
The coolest part is that just like Golden Gate Claude, we can steer with many of these features, transforming a smiley face to wrinkly face, an owl, or an eyeball!
And yes, we checked that this works for human-made SVGs too! I drew this (imo cuter) dog and found many of the same features as on the Claude-generated dog above (which honestly looks more like a bear!)
October 24, 2025 at 9:34 PM
And yes, we checked that this works for human-made SVGs too! I drew this (imo cuter) dog and found many of the same features as on the Claude-generated dog above (which honestly looks more like a bear!)
It gets richer as the models improve. Compared to Haiku 3.5, we find a trove of interesting features in the Sonnet 4.5 base model. From various animal body parts, to “motor” neuron features like “say smile” that activate ahead of the ASCII mouth, to features that perceive “size”!
October 24, 2025 at 9:34 PM
It gets richer as the models improve. Compared to Haiku 3.5, we find a trove of interesting features in the Sonnet 4.5 base model. From various animal body parts, to “motor” neuron features like “say smile” that activate ahead of the ASCII mouth, to features that perceive “size”!
This understanding is context dependent – the eyes feature light up as soon as you give enough characters to form the top of the head!
Only a single _ is needed, as well as a / \ forehead for the 2nd @ to activate the "eyes" feature above.
Only a single _ is needed, as well as a / \ forehead for the 2nd @ to activate the "eyes" feature above.
October 24, 2025 at 9:34 PM
This understanding is context dependent – the eyes feature light up as soon as you give enough characters to form the top of the head!
Only a single _ is needed, as well as a / \ forehead for the 2nd @ to activate the "eyes" feature above.
Only a single _ is needed, as well as a / \ forehead for the 2nd @ to activate the "eyes" feature above.
FWIW vercel owns svelte too, or rather they’re a major founder and employ rich harris
September 22, 2025 at 9:30 AM
FWIW vercel owns svelte too, or rather they’re a major founder and employ rich harris
I don’t add anyone I don’t know bc ppl do mass add to build legitimacy off their connections
May 11, 2025 at 1:18 PM
I don’t add anyone I don’t know bc ppl do mass add to build legitimacy off their connections
you can’t talk about 2x4s and then not show me the shelves!!!
April 27, 2025 at 2:39 PM
you can’t talk about 2x4s and then not show me the shelves!!!
good job application tbh
April 23, 2025 at 3:54 AM
good job application tbh
I like the phrase “design is making tradeoffs”
March 19, 2025 at 3:48 PM
I like the phrase “design is making tradeoffs”
look up in the sky at midnight and count the stars
March 18, 2025 at 11:19 PM
look up in the sky at midnight and count the stars
log off for a week go hiking the weather is beautiful
March 18, 2025 at 11:19 PM
log off for a week go hiking the weather is beautiful
he’s at ant w me buddy
also rip arc time to use horse
also rip arc time to use horse
March 18, 2025 at 11:18 PM
he’s at ant w me buddy
also rip arc time to use horse
also rip arc time to use horse
cruz-in usa down here
March 12, 2025 at 11:53 PM
cruz-in usa down here
no what’s a dem senator
March 12, 2025 at 11:52 PM
no what’s a dem senator