Thanks Xavier, really glad you like the site! 😄

If you’d like to check out some obscure islands that I find interesting... :)

Feels surreal seeing a creative project of mine in such a major publication!

If you'd like to run the visualization and play around with it, please feel free to check it out on my website: amanvir.com/gpt-2-attention!

I ended up writing an entire article on my website that explains what Dawkins' weasel is and how it can be used to create the cool effect you see in the video below: amanvir.com/blog/animati...

Feel free to check it out, and let me know what you think!

Haha, that sounds awesome! Truly a win-win 😄

If you want to check out the post, please visit: amanvir.com/blog/turning-my-esp32-into-a-dns-sinkhole

Currently, this is a pretty simple program, but I hope that I (or anyone else in the community!) can expand on it by adding functionality to tackle typos, gibberish text, and other issues found within public domain literature.

Here’s the GitHub repo for this project:
github.com/amanvirparha...

These indices are used to create a new ePub that *only* includes meaningful parts of the book's text - the parts that we're interested in reading!

The model is asked to respond with JSON that contains the indices for the first and last paragraphs of each chapter. Gemini is able to accurately return the index of any given paragraph, because each “paragraph” from the book’s raw text is wrapped with a numbered tag which the model can reference:

The script I ended up writing works like this: the model first takes in a prompt and the book’s content. It's not asked to return a corrected version of the entire book (output limit = ~8k toks), but is instead asked to return JSON that aligns with a provided schema (structured generation).

The model also performs pretty well at “needle In a haystack”-type tests, so it seemed like the perfect choice! (some tweets by @jeffdean.bsky.social!)

I started thinking about fixing some of these typesetting/formatting issues using an LLM, and I quickly realized that Gemini would be perfect for this project - the 1M+ token context window would allow me to paste the text for an entire book in one shot.

In my experience, most books on Project Gutenberg are unfortunately formatted in a non-standard way, and a lot of books are actually plagued with much bigger issues than the one I was looking for.

This is essentially the reason why initiatives like standardebooks.com exist.

The ePub I found wasn’t properly formatted: it contained a duplicate, malformed copy of the table of contents spanning several pages, and the worst part was that every single poem was displayed in monospace for some reason.

This project was born out of a personal need: I was looking for a poetry collection by Robert Frost on gutenberg.org, a repository with thousands of free eBooks, but when I downloaded the ePub for this particular book, I was rather disappointed.

Hey, I'm the creator of this site!

Thank you so much for your kind words, I really appreciate it!