go follow prod for all the cool stuff they make and read about greenheat to make your own stuff heat.prod.kr.
toy a little proof of concept made in godot, and the model is a basic vrm with some extra weighed bones for the dragging points.

here's the build with a basic python server for the twitch message handling I setup in the linked gist. only limited tested done for this, see the ship of harkinian pages for all the standard setup stuff!
github.com/dannytaylor/...

building off the demo from Red in the harbour masters discord for modifying text messages on the fly

yep, for sure