Lightnews — Scholar-powered news

Andromeda Yelton

@thatandromeda.bsky.social

3.5K followers 1.1K following 7.5K posts

Libraries, software, math, Latin, nonprofit governance, weightlifting, knitting, singing, my cats, Somerville (MA), planes planes planes. Hi! 👋 Skybrarians feed: https://bsky.app/profile/did:plc:a55ia2ojiv2cnshifmrc7wr6/feed/skybrarians

bsky.app

Posts Media Videos Starter Packs

Andromeda Yelton @thatandromeda.bsky.social · 4h

I am so hopeful that 50 years from now we will look back on today's immunology treatments the way today we look at, like, lobotomies -- people who were hopefully trying their best but had astonishingly poor tools at their disposal.

Andromeda Yelton @thatandromeda.bsky.social · 7h

Imagine how funny the eggplant emoji will not be to high schoolers a few hundred years hence

Reposted by Andromeda Yelton

Joan Allen @jallensf.bsky.social · 21h

Any time I don’t understand a line in Shakespeare, I just assume it’s a dirty joke and think up my own (bonus points if it fits the scansion)

1 1 29

Andromeda Yelton @thatandromeda.bsky.social · 7h

The Pioneer Girl stuff (annotated Little House on the Prairie). Mind. Blowing.

Reposted by Andromeda Yelton

Tim Onion @bencollins.bsky.social · 21h

If you're wondering whether or not to get a flu shot, I didn't get one in time, and I just had a fever dream where I was in the Drew Carey Show because several days ago I was on the Wikipedia page for the Drew Carey Show. You don't have to do this to yourself.

200 490 6.4K

Andromeda Yelton @thatandromeda.bsky.social · 23h

FTF, Carnegie Mellon. I’m sure it’ll livestream and have a hyperactive slack as usual.

Reposted by Andromeda Yelton

Tim Kellogg @timkellogg.me · 1d

Karpathy: nanochat

A small training+inference pipeline for creating your own LLM from scratch

$100 will get you a somewhat functional model

$1000 is more coherent & solves math

detailed walkthrough: github.com/karpathy/nan...

repo: github.com/karpathy/nan...

Andrej Karpathy & @karpathy
X.com
Excited to release new repo: nanochat! (it's among the most unhinged I've written).
Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single, dependency-minimal codebase. You boot up a cloud GPU box, run a single script and in as little as 4 hours later you can talk to your own LLM in a ChatGPT-like web Ul.
It weighs ~8,000 lines of imo quite clean code to:
- Train the tokenizer using a new Rust implementation
- Pretrain a Transformer LLM on FineWeb, evaluate CORE score across a number of metrics
- Midtrain on user-assistant conversations from SmolTalk, multiple choice questions, tool use.
- SFT, evaluate the chat model on world knowledge multiple choice (ARC-E/C, MMLU), math (GSM8K), code (HumanEval)
- RL the model optionally on GSM8K with
IPDDOI

- RL the model optionally on GSM8K with
"GRPO"
- Efficient inference the model in an Engine with
KV cache, simple prefill/ decode, tool use (Python interpreter in a lightweight sandbox), talk to it over CLI or ChatGPT-like WebUl.
- Write a single markdown report card, summarizing and gamifying the whole thing.
Even for as low as ~$100 in cost (~4 hours on an
8XH100 node), you can train a little ChatGPT clone that you can kind of talk to, and which can write stories/poems, answer simple questions.
About ~12 hours surpasses GPT-2 CORE metric.
As you further scale up towards ~$1000 (~41.6 hours of training), it quickly becomes a lot more coherent and can solve simple math/code problems and take multiple choice tests. E.g. a depth 30 model trained for 24 hours (this is about equal to FLOPs of GPT-3 Small 125M and 1/1000th of GPT-3) gets into 40s on MMLU and
70s on ARC-Easy, 20s on GSM8K, etc.
My goal is to get the full "strong baseline" stack into one cohesive, minimal, readable, hackable, maximally forkable repo. nanochat will be the capstone project of LLM101n (which is still being developed). I think it also has potential to grow

developed). I think it also has potential to grow into a research harness, or a benchmark, similar to nanoGPT before it. It is by no means finished, tuned or optimized (actually I think there's likely quite a bit of low-hanging fruit), but I think it's at a place where the overall skeleton is ok enough that it can go up on GitHub where all the parts of it can be improved.
Link to repo and a detailed walkthrough of the nanochat speedrun is in the reply.
nanochat

3 20 87

Reposted by Andromeda Yelton

Marisa Kabas @marisakabas.bsky.social · 1d

If you live in Everett, Mass. and have any information about the 13-year-old boy abducted by ICE, please message me on Signal at marisakabas.04

11 600 1.2K

Andromeda Yelton @thatandromeda.bsky.social · 1d

Hello there #code4lib! It's once again that glorious time of year where you can nominate keynote speakers for the conference ( #c4l26). Edit 'em in here: wiki.code4lib.org/2026_Keynote... 📚

2026 Keynote Speakers Nominations - Code4Lib

wiki.code4lib.org

1 2 3

Reposted by Andromeda Yelton

Frog Redemption Arc Enthusiast @mxlabradorite.bsky.social · 1d

I don't think they should copy it exactly, but I'd love to see Alex Winter and Keanu Reeves do a take on the tourist photos from when Sirs Patrick Stewart and Ian McKellen did Waiting for Godot in NYC.

Sirs Patrick Stewart and Ian McKellen, both wearing bowler hats, on the Wonder Wheel. McKellen has his arms around Stewart, and a terrified look on his face. Stewart is grinning.

Sirs Patrick Stewart and Ian McKellen, both wearing bowler hats, holding hands on the boardwalk.

Sirs Patrick Stewart and Ian McKellen, both wearing bowler hats, jogging over the Brooklyn Bridge.

Sirs Patrick Stewart and Ian McKellen, both wearing bowler hats, standing in front of Nathan's Hot Dogs.

3 19 150

Reposted by Andromeda Yelton

Phil Lewis @phillewis.bsky.social · 1d

Government workers 👇🏾

Lunch is on the house:

Being in the heart of downtown DC, we love that so many of our Federal employees stop by during lunch for a Donburi at China Chilcano or a Fútbol Club at Jaleo. And just because the government is shut down doesn't mean you have to miss out on your favorite lunch spot- because this time, its on us!
Join us for lunch from 11:30 AM to 3:00 PM at any of our participating restaurants and enjoy a free lunch item when you present your government ID-you heard that right! Dine in with us Monday through Friday and choose your favorite: a sandwich at Jaleo, a donburi at China Chilcano, a wrap or pita at Zaytinya, or a torta at Oyamel.
We've always believed in serving our community with open arms and good food-no shutdown can stop that.

36 680 1.7K

Andromeda Yelton @thatandromeda.bsky.social · 1d

haha, I love how two of you came back with that one, differently phrased @charlesolson.bsky.social

Reposted by Andromeda Yelton

Claire Willett @clairewillett.bsky.social · 2d

found exactly the one use of “evil recoils in the presence of Christ” I am willing to sign off on, HOOOOOOOOLY SHIT

Father Larry did not come here to fuck around

Rich Raho @richraho.bsky.social · 2d

Chicago priest Fr. Larry Dowling describes procession to ICE facility: “No one had the courage to speak directly to us. No one from Homeland Security could stand in the presence of the Monstrance holding the Blessed Sacrament. No wonder. Evil is repelled, recoils in the presence of Christ.”

25 980 3.8K

Andromeda Yelton @thatandromeda.bsky.social · 1d

That’s Columbia.

Columbus is the unit of electrical charge in the international system of units.

Helluva Bottom Carter @nicju.blacksky.app · 1d

That’s Columbo.

Columbus is an Ivy League University in Upper Manhattan.

malcoholic @lepetitereboot.bsky.social · 1d

that's Colombiana.

Columbus is a homicide detective who wears a shabby raincoat and brings his basset hound everywhere.

1 10

Reposted by Andromeda Yelton

Erin @biscuit.quest · 1d

A great time to switch! No regrets! Feels great! erinrwhite.com/goodbye-spot...

1 11 11

Reposted by Andromeda Yelton

Anthony Ryan @anthonyryan.bsky.social · 2d

Only when a robot can walk into a room, forget what it went in there for then leave looking befuddled and grumpy will they have achieved true sentience.

2 14 110

Andromeda Yelton @thatandromeda.bsky.social · 1d

Yyyyyeah if you can’t tell that’s a minor i dunno what to say

Andromeda Yelton @thatandromeda.bsky.social · 1d

You know about the unhinged situation with Warren Beatty and the rights, yeah?

Andromeda Yelton @thatandromeda.bsky.social · 1d

Yyyyyup. And also with the size of the humanities requirement at many engineering schools.

Reposted by Andromeda Yelton

Graham Platner for Senate @grahamformaine.bsky.social · 2d

We have armed secret police kidnapping people off the street based on the color of their skin.

When we win: we will haul them before a Senate committee. The masks will come off. There will be consequences.

790 6.9K 25K

Andromeda Yelton @thatandromeda.bsky.social · 2d

I've been waiting to hear a Democrat say this.

Andromeda Yelton @thatandromeda.bsky.social · 2d

Exactly what I was thinking.

1 3

Andromeda Yelton @thatandromeda.bsky.social · 2d

Once we were driving somewhere, and I was reading in the passenger seat, and said something about how I totally can’t hear music when I’m doing anything else so i had no idea what my husband had been playing, and he was like yeah but you’ve been singing along for half an hour

So. Could be anything

2 4

Reposted by Andromeda Yelton

Heidi Kitrosser @heidikitrosser.bsky.social · 3d

ICE is now pulling from a pool of applicants who see televised images of sobbing children in handcuffs, or masked men in tactical gear roughing up Latino laborers, and don't recoil in horror.
The administration is also doing its best to send all the worst possible signals to existing agents, from every level of the hierarchy. The president ominously declares we are engaged in a "war within" - with domestic urban populations cast as the enemy combatants.

11 130 330

Reposted by Andromeda Yelton

sarah jeong @sarahjeong.bsky.social · 3d

I have a theory www.theverge.com/policy/79849...

American politics has devolved into shitposting and aura farming

The Frog is owning the president.

www.theverge.com

93 650 3.2K