justin
banner
jusrin00.bsky.social
justin
@jusrin00.bsky.social
the guy from twitter posting random stuff and some programming related things
Damn this actually used to be good
January 4, 2026 at 12:19 PM
Git sha just suck to use regardless
December 26, 2025 at 11:21 AM
Reposted by justin
Package managers keep using git as a database, it never works out.

https://nesbitt.io/2025/12/24/package-managers-keep-using-git-as-a-database.html
Package managers keep using git as a database, it never works out
Using git as a database is a seductive idea. You get version history for free. Pull requests give you a review workflow. It’s distributed by design. GitHub will host it for free. Everyone already knows how to use it. Package managers keep falling for this. And it keeps not working out. ## Cargo The crates.io index started as a git repository. Every Cargo client cloned it. This worked fine when the registry was small, but the index kept growing. Users would see progress bars like “Resolving deltas: 74.01%, (64415/95919)” hanging for ages, the visible symptom of Cargo’s libgit2 library grinding through delta resolution on a repository with thousands of historic commits. The problem was worst in CI. Stateless environments would download the full index, use a tiny fraction of it, and throw it away. Every build, every time. RFC 2789 introduced a sparse HTTP protocol. Instead of cloning the whole index, Cargo now fetches files directly over HTTPS, downloading only the metadata for dependencies your project actually uses. (This is the “full index replication vs on-demand queries” tradeoff in action.) By April 2025, 99% of crates.io requests came from Cargo versions where sparse is the default. The git index still exists, still growing by thousands of commits per day, but most users never touch it. ## Homebrew GitHub explicitly asked Homebrew to stop using shallow clones. Updating them was “an extremely expensive operation” due to the tree layout and traffic of homebrew-core and homebrew-cask. Users were downloading 331MB just to unshallow homebrew-core. The .git folder approached 1GB on some machines. Every `brew update` meant waiting for git to grind through delta resolution. Homebrew 4.0.0 in February 2023 switched to JSON downloads for tap updates. The reasoning was blunt: “they are expensive to git fetch and git clone and GitHub would rather we didn’t do that… they are slow to git fetch and git clone and this provides a bad experience to end users.” Auto-updates now run every 24 hours instead of every 5 minutes, and they’re much faster because there’s no git fetch involved. ## CocoaPods CocoaPods is the package manager for iOS and macOS development. It hit the limits hard. The Specs repo grew to hundreds of thousands of podspecs across a deeply nested directory structure. Cloning took minutes. Updating took minutes. CI time vanished into git operations. GitHub imposed CPU rate limits. The culprit was shallow clones, which force GitHub’s servers to compute which objects the client already has. The team tried various band-aids: stopping auto-fetch on `pod install`, converting shallow clones to full clones, sharding the repository. The CocoaPods blog captured it well: “Git was invented at a time when ‘slow network’ and ‘no backups’ were legitimate design concerns. Running endless builds as part of continuous integration wasn’t commonplace.” CocoaPods 1.8 gave up on git entirely for most users. A CDN became the default, serving podspec files directly over HTTP. The migration saved users about a gigabyte of disk space and made `pod install` nearly instant for new setups. ## Go modules Grab’s engineering team went from 18 minutes for `go get` to 12 seconds after deploying a module proxy. That’s not a typo. Eighteen minutes down to twelve seconds. The problem was that `go get` needed to fetch each dependency’s source code just to read its go.mod file and resolve transitive dependencies. Cloning entire repositories to get a single file. Go had security concerns too. The original design wanted to remove version control tools entirely because “these fragment the ecosystem: packages developed using Bazaar or Fossil, for example, are effectively unavailable to users who cannot or choose not to install these tools.” Beyond fragmentation, the Go team worried about security bugs in version control systems becoming security bugs in `go get`. You’re not just importing code; you’re importing the attack surface of every VCS tool on the developer’s machine. GOPROXY became the default in Go 1.13. The proxy serves source archives and go.mod files independently over HTTP. Go also introduced a checksum database (sumdb) that records cryptographic hashes of module contents. This protects against force pushes silently changing tagged releases, and ensures modules remain available even if the original repository is deleted. ## Beyond package managers The same pattern shows up wherever developers try to use git as a database. Git-based wikis like Gollum (used by GitHub and GitLab) become “somewhat too slow to be usable” at scale. Browsing directory structure takes seconds per click. Loading pages takes longer. GitLab plans to move away from Gollum entirely. Git-based CMS platforms like Decap hit GitHub’s API rate limits. A Decap project on GitHub scales to about 10,000 entries if you have a lot of collection relations. A new user with an empty cache makes a request per entry to populate it, burning through the 5,000 request limit quickly. If your site has lots of content or updates frequently, use a database instead. Even GitOps tools that embrace git as a source of truth have to work around its limitations. ArgoCD’s repo server can run out of disk space cloning repositories. A single commit invalidates the cache for all applications in that repo. Large monorepos need special scaling considerations. ## The pattern The hosting problems are symptoms. The underlying issue is that git inherits filesystem limitations, and filesystems make terrible databases. **Directory limits.** Directories with too many files become slow. CocoaPods had 16,000 pod directories in a single Specs folder, requiring huge tree objects and expensive computation. Their fix was hash-based sharding: split directories by the first few characters of a hashed name, so no single directory has too many entries. Git itself does this internally with its objects folder, splitting into 256 subdirectories. You’re reinventing B-trees, badly. **Case sensitivity.** Git is case-sensitive, but macOS and Windows filesystems typically aren’t. Check out a repo containing both `File.txt` and `file.txt` on Windows, and the second overwrites the first. Azure DevOps had to add server-side enforcement to block pushes with case-conflicting paths. **Path length limits.** Windows restricts paths to 260 characters, a constraint dating back to DOS. Git supports longer paths, but Git for Windows inherits the OS limitation. This is painful with deeply nested node_modules directories, where `git status` fails with “Filename too long” errors. **Missing database features.** Databases have CHECK constraints and UNIQUE constraints; git has nothing, so every package manager builds its own validation layer. Databases have locking; git doesn’t. Databases have indexes for queries like “all packages depending on X”; with git you either traverse every file or build your own index. Databases have migrations for schema changes; git has “rewrite history and force everyone to re-clone.” The progression is predictable. Start with a flat directory of files. Hit filesystem limits. Implement sharding. Hit cross-platform issues. Build server-side enforcement. Build custom indexes. Eventually give up and use HTTP or an actual database. You’ve built a worse version of what databases already provide, spread across git hooks, CI pipelines, and bespoke tooling. None of this means git is bad. Git excels at what it was designed for: distributed collaboration on source code, with branching, merging, and offline work. The problem is using it for something else entirely. Package registries need fast point queries for metadata. Git gives you a full-document sync protocol when you need a key-value lookup. If you’re building a package manager and git-as-index seems appealing, look at Cargo, Homebrew, CocoaPods, Go. They all had to build workarounds as they grew, causing pain for users and maintainers. The pull request workflow is nice. The version history is nice. You will hit the same walls they did.
nesbitt.io
December 24, 2025 at 4:49 PM
Northern country
November 10, 2025 at 11:53 AM
November
November 5, 2025 at 12:08 PM
my random opinion is that sram doubletap are so nice and i wish my shimano levers didnt let the entire fucking brake lever sponge around. the double tap release action is plasticky and whatnot but it sets all at once, whereas the gear action also feels mushy as hell even in the mid tier groupsets
October 29, 2025 at 4:54 AM
the year is 2025. i am still looking for ways to guarantee shit goes into the cabal store instead of dist-newstyle. if i ever need a job with more frustrating build tools and longer build times i'll find a rust job
October 29, 2025 at 3:55 AM
Text inputs that don’t trigger spell check 2025
October 28, 2025 at 11:14 PM
i posted 4 months ago
October 16, 2025 at 3:55 AM
i wrote about having to move away from trusty old nix-env recently, being unable to nix-profile at all in nix >2.9

github.com/justinwoo/my...
github.com
May 30, 2025 at 12:24 AM
annoying to have had to change my workflow from pedantic nixpkgs maintainers who don't put any effort in enriching the errors they throw. i could be convinced to change, but now i'm feeling like i should stop using nix more and more github.com/justinwoo/.d...
May 27, 2025 at 5:17 AM
i'm always amazed at how utterly forced monolingual google products are. so many people who work there are bilingual or have interest in learning languages (usually japanese) and yet you can't get away from having the most ridiculous settings forced on you
April 14, 2025 at 2:50 PM
I think Bluesky is all right but why does “Show less of this” do literally nothing in Discovery? How can I view what the categories of tweets are and mute them?
April 13, 2025 at 9:03 AM
Is the existence of morita chile salsa the easiest litmus test of knowing if a Mexican restaurant is any good or not?
March 21, 2025 at 10:33 AM
and every idiot for the last decade has been talking about how their framework/library/lang/toolchain has "evolved past" the need to debug and you rarely get real debugging or profiling anymore
I mean, sure, yes, you *could* use a debugger, or you could just do what I do which is print a lot of debug statements and then record a video of your application running and your debug statements being printed and then go frame-by-frame through the video to see what happened.
March 14, 2025 at 11:04 AM
Soups I’ve had recently
March 12, 2025 at 6:05 PM
My swing is too slow, I should lift weights and get coaching
March 9, 2025 at 4:32 PM
Mini chicken (bottle for scale
March 9, 2025 at 4:21 PM
as someone who actually read this book, i think this fairly ironic
February 26, 2025 at 3:22 PM
Reposted by justin
If you want to download all your Kindle ebooks before the Feb 26, 2025 deadline, you may find yourself wishing there were an easier way than having to click 100s of times. After 3 books I'd had enough, and I threw together this hacky Javascript to make it less tedious gist.github.com/danmactough/...
February 17, 2025 at 9:15 PM
i wrote about binding input source changing with hammerspoon, because the mac os input source menu is so disappointing github.com/justinwoo/my...
github.com
February 15, 2025 at 7:48 AM
how are people doing css debugging with next.js? how do you get it to generate correct sourcemaps?
February 14, 2025 at 1:33 PM
Anglophones are basically the only group who successfully absorb and convert newcomers into anglophones
February 12, 2025 at 4:05 PM
Reposted by justin
🚀 🆕 style-observer: A robust solution for observing CSS property changes in JS.

Developed with @d12n.me’s help over the last month.

Made possible by the pioneering work of @bram.us, Artem Godin, @janeori.propjockey.io and many others!

Blog post: lea.verou.me/blog/2025/st...
Docs: observe.style
Style-observer: JS to observe CSS property changes, for reals • Lea Verou
I cannot count the number of times in my career I wished I could run JS in response to CSS property changes, regardless of what triggered them: media queries, user actions, or even other JS. Use cases...
lea.verou.me
February 12, 2025 at 3:03 PM
the more i have to look at these stupid typescript library typings and the mess of builtin Classes, the more i miss working with simple constraints and functional dependencies in haskell. the type errors are almost the same level of awful anyway, and TS hasn't gotten any bettter over the years
February 10, 2025 at 9:59 PM