Thanks so much! Truly appreciate it!

Thanks so much!

7/ Lastly, we’d love to hear your feedback on GovScape at [email protected]! For more updates on GovScape, follow: @govscape.bsky.social

7/ A particular thank-you to @kdeeds.bsky.social for leading this project with me and for making this possible! And to @yh-huang.bsky.social, who did an incredible job with the front-end and dev-ops!

6/ GovScape is the result of a multidisciplinary collaboration, co-led by myself and @kdeeds.bsky.social. We’re enormously grateful to the team: Ying-Hsiang Huang, Claire Gong, Shreya Shaji, Alison Yan, Leslie Harka, @tjowens.bsky.social, @vphill.bsky.social, @shannonshen.bsky.social, and SJ Klein!

5/ Interested in learning more? Visit GovScape at: www.govscape.net – try some searches and read the FAQ! You can also watch a demo video here: www.youtube.com/watch?v=mNda...

4/ What does visual search do? Here’s a visual search for “redacted documents”

3/ The full GovScape architecture is detailed in this figure, showing how the client interacts with the server, DBs, and indices. We utilize FAISS for text embeddings and for CLIP embeddings, and SQLite FTS5 for keyword indexing.

2/ The pre-processing pipeline ingests PDFs, renders them, generates CLIP and BGE embeddings of individual pages, and indexes the text. The total compute cost for GovScape's pre-processing pipeline for 10 million PDFs was approximately $1,500. Our code is available at: github.com/bcglee/govsc....

2/ GovScape is built on top of the End of Term Web Archive (eotarchive.org) and currently contains all renderable PDFs (50 pages or fewer) from the 2020 crawl, documenting the first Trump administration. An overview of GovScape’s search functionality can be found in this diagram.

Thanks so much, I appreciate it!

Thanks so much for your kind words - I really appreciate them, and I'm glad that the piece resonated with you! And thank you for your work, too, in having volunteered as a docent and being the family archivist!

Thanks so much, Scott - very kind of you to say!

I really appreciate your kind words, @dhutchinson.bsky.social!

Thanks so much, @jenserventi.bsky.social - I truly appreciate it!