Lightnews — Scholar-powered news

Reposted by Torsten Goerke

pépé @pepe6502.bsky.social · Jan 27

« Nanobot Wedding Fair »

Atari 8-bits ASCII picture submitted at ATASCII Compo 2023 organised by @logiker.bsky.social , ranked 5th place.
#demoscene #atari #atari8bit #ascii #atascii

1 4 8

Torsten Goerke @tgoerke.bsky.social · 22m

Hi @pepe6502.bsky.social

Printed to paper wouldn't this bot ensemble look nice with some blinking leds. Wanted to check for your permission to use them in some workshops. Would that be OK?
bsky.app/profile/tgoe...

Torsten Goerke @tgoerke.bsky.social · 32m

This is the LED flasher PCB by elektro.turanis.de/html/prj001/... We can make several to them and mount them to groups of cardboard characters.

Torsten Goerke @tgoerke.bsky.social · 32m

This is the LED flasher PCB by elektro.turanis.de/html/prj001/... We can make several to them and mount them to groups of cardboard characters.

Torsten Goerke @tgoerke.bsky.social · 37m

100 battery clips and PCBs for our joyful seasonal craft workshops towards the end of the year.

1 1

Torsten Goerke @tgoerke.bsky.social · 22h

The @graze.social streams are a great data resource for computational social science. @lorenzspreen.bsky.social

Graze Social @graze.social · 2d

ATProto is a team sport - we build better together. That's why, effective today, we're opening up access to the enriched archive we use to power Graze, so anyone can build great services on top of ATProto without reinventing the wheel. Read more in the @leaflet.pub post below for details!

Announcing the Graze Archives

A brief tour of the S3 requestor-pays archives of the Graze turbostream and freshly-announced megastream

graze.leaflet.pub

1 7

Reposted by Torsten Goerke

Philipp Lorenz-Spreen @lorenzspreen.bsky.social · 15d

Now the official version (in German): www.youtube.com/watch?v=AtEQ...

1 4

Reposted by Torsten Goerke

nooki @nooki.me · 1d

Implementing OAuth was quite the headache 😩 I believe I’ve got it all working now, but if you run into anything strange, please do let me know.

13 4 110

Reposted by Torsten Goerke

Robin Berjon @robin.berjon.com · 1d

Infrastructure x Democracy — what could be more interesting? I'm very excited to be moderating this panel!

Open Future @openfuture.bsky.social · 1d

🗳️ Don't miss "The Future of Democracy" conference organized by @openmarkets.bsky.social and @article19.bsky.social. Tomorrow we will speak at the "Role of digital infrastructure in strengthening EU democracy" panel at 15:00 CEST.
Full program: www.openmarketsinstitute.org/publications...

The Future of Democracy: Speech, Thought, Sovereignty, and Power in the Age of Platforms and AI — Open Markets Institute

Join The Open Markets Institute and ARTICLE 19 on October 15th & 16th for a convening of high-level leading thinkers, lawmakers, technologists, and advocates to discuss the direct and growing…

www.openmarketsinstitute.org

5 17

Torsten Goerke @tgoerke.bsky.social · 1d

Great to see communities come together on a personal level, AP-AT interoperability under constant threat. Also the "letter to the dean" is actually answering letters from university staff. A claim they already made about private platforms. And possible answers we can provide.

1

Torsten Goerke @tgoerke.bsky.social · 1d

Thanks for sharing. We are working on a more regular meeting structure with @ronentk.me

2

Reposted by Torsten Goerke

Tim Kellogg @timkellogg.me · 2d

Karpathy: nanochat

A small training+inference pipeline for creating your own LLM from scratch

$100 will get you a somewhat functional model

$1000 is more coherent & solves math

detailed walkthrough: github.com/karpathy/nan...

repo: github.com/karpathy/nan...

Andrej Karpathy & @karpathy
X.com
Excited to release new repo: nanochat! (it's among the most unhinged I've written).
Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single, dependency-minimal codebase. You boot up a cloud GPU box, run a single script and in as little as 4 hours later you can talk to your own LLM in a ChatGPT-like web Ul.
It weighs ~8,000 lines of imo quite clean code to:
- Train the tokenizer using a new Rust implementation
- Pretrain a Transformer LLM on FineWeb, evaluate CORE score across a number of metrics
- Midtrain on user-assistant conversations from SmolTalk, multiple choice questions, tool use.
- SFT, evaluate the chat model on world knowledge multiple choice (ARC-E/C, MMLU), math (GSM8K), code (HumanEval)
- RL the model optionally on GSM8K with
IPDDOI

- RL the model optionally on GSM8K with
"GRPO"
- Efficient inference the model in an Engine with
KV cache, simple prefill/ decode, tool use (Python interpreter in a lightweight sandbox), talk to it over CLI or ChatGPT-like WebUl.
- Write a single markdown report card, summarizing and gamifying the whole thing.
Even for as low as ~$100 in cost (~4 hours on an
8XH100 node), you can train a little ChatGPT clone that you can kind of talk to, and which can write stories/poems, answer simple questions.
About ~12 hours surpasses GPT-2 CORE metric.
As you further scale up towards ~$1000 (~41.6 hours of training), it quickly becomes a lot more coherent and can solve simple math/code problems and take multiple choice tests. E.g. a depth 30 model trained for 24 hours (this is about equal to FLOPs of GPT-3 Small 125M and 1/1000th of GPT-3) gets into 40s on MMLU and
70s on ARC-Easy, 20s on GSM8K, etc.
My goal is to get the full "strong baseline" stack into one cohesive, minimal, readable, hackable, maximally forkable repo. nanochat will be the capstone project of LLM101n (which is still being developed). I think it also has potential to grow

developed). I think it also has potential to grow into a research harness, or a benchmark, similar to nanoGPT before it. It is by no means finished, tuned or optimized (actually I think there's likely quite a bit of low-hanging fruit), but I think it's at a place where the overall skeleton is ok enough that it can go up on GitHub where all the parts of it can be improved.
Link to repo and a detailed walkthrough of the nanochat speedrun is in the reply.
nanochat

3 20 89

Torsten Goerke @tgoerke.bsky.social · 2d

"adversarial interoperability: that’s when you create a new product or service that plugs into the existing ones without the permission of the companies that make them." I admit I find it difficult to understand that. .

Like, USB?

Torsten Goerke @tgoerke.bsky.social · 2d

👀“adversarial interoperability” (dang it, stop plugging your thing into my product!).

Paul Fuxjäger @cypherhippie.bsky.social · Sep 13

I wonder if @hennavirkkunen.bsky.social is aware that adversarial interoperability is key to tech sovereignty?

And if so, what is her plan to increase the chances of being able to enforce it against the power of giants?

www.eff.org/deeplinks/20...

Adversarial Interoperability

“Interoperability” is the act of making a new product or service work with an existing product or service: modern civilization depends on the standards and practices that allow you to put any dish int...

www.eff.org

1

Torsten Goerke @tgoerke.bsky.social · 2d

🥤"We can just train LLMs" #atproto huggingface.co/papers/2106....

Paper page - LoRA: Low-Rank Adaptation of Large Language Models

Join the discussion on this paper page

huggingface.co

1

Torsten Goerke @tgoerke.bsky.social · 2d

I must correct that. There were no shops in Feischergasse where goods could be offered collectively and the shared location could be exploited. The Fleischgasse was home to the respected butchers' guild in the 14th and 15th centuries, located in the city center close to public life and politics.

Cover photo of book by Günter Naumann. Stadtlexikon Meissen.

1

Torsten Goerke @tgoerke.bsky.social · 2d

Want to learn from guilds in trade (Gilde) and craft (Zunft) as well.

1 1

Torsten Goerke @tgoerke.bsky.social · 2d

🥤Public streams as a new data asset @erlend.sh

1 2

Torsten Goerke @tgoerke.bsky.social · 2d

Thanks for sharing. I also like your work on tracking the progress of the migration off-X

1

Torsten Goerke @tgoerke.bsky.social · 2d

@emily.space reminded us of the urgency of advancing open infrastructure in Europe. In the meeting there was a strong consensus that scholarly institutions must accelerate decentralization and reduce reliance on US-hosted infrastructure.

1 3

Torsten Goerke @tgoerke.bsky.social · 2d

Our next step will be to map out the different ATProto services and applications that scholarly institutions / communities are interested in and then to work on a shared roadmap.

3

Torsten Goerke @tgoerke.bsky.social · 2d

Last Friday, members of eurosky.social and the ATProto x Science Community met for a brief meeting. We explored the overlaps between these two initiatives and the people involved.

Meeting notes: discourse.atprotocol.community/t/meeting-no...

Meeting notes: eurosky.social x atproto x science

eurosky.social x atproto x science @tgoerke.bsky.social Scheduled 10 October 2025 08:00 am EDT ATProto Science is about using ATProto for science applications, such as publishing, curation, data s...

discourse.atprotocol.community

3 4 10

Torsten Goerke @tgoerke.bsky.social · 2d

>> arguing the streaming company has ruined the industry and turned listeners into “passive, uninspired consumers”.

>> “We just want everyone to think a little bit harder about the ways they listen to music, ...”

www.theguardian.com/technology/2...

‘Death to Spotify’: the DIY movement to get artists and fans to quit the music app

Musicians have long criticized the streaming service’s paltry payouts, but a new wave of boycotts is emerging

www.theguardian.com

5

Reposted by Torsten Goerke

Filecoin Foundation @fil.org · 4d

The things most people hate about the internet –– like misinformation, polarization, etc. –– are actually symptoms of structural problems.

E.g. Instead of fixing misinformation, we should focus on fixing data integrity, data permanence, and incentive design.

1 3

Reposted by Torsten Goerke

Aaron Parecki @aaronpk.com · 4d

I just finished adding BlueSky support to IndieLogin.com! Now you can log in to websites like indieweb.org with your BlueSky handle!

Adding Support for BlueSky to IndieLogin.com

Today I just launched support for BlueSky as a new authentication option in IndieLogin.com!

aaronparecki.com

5 19 80

Reposted by Torsten Goerke

bsky.check @bskycheck.com · 5d

@ec.europa.eu is the 16th trusted verifier on #bluesky

It just verified its first 5 users with blue check.

3 24 85