It could also have been short for 蒙古篆

updated link: discord.gg/kDNWDhHv

All are welcome. Please make this space your own, and add channels at will.

Our first task is to massively expand SMOL through community contribution. Anyone who contributes significant volunteer translations or post-edits will get on the Arxiv paper in the next refresh!

this is a space for grassroots collaboration. It doubles as a directory of speakers of such languages, so you can directly talk with and collaborate with community members.

@colinacherry.bsky.social

By the way, GATITOS has now officially moved to the SMOL Huggingface repo

Finally, if you are a speaker of any SMOL languages, please take a look at the data and tell me what you think. Despite the quality checks, I am sure that some of the deliveries have quality issues, and I would love to understand and/or fix any affected sources. We are in this together!

I would also like to thank FAIR for being an academic leader in open-sourcing work with low-resource languages, including NLLB and Flores. Thank you for helping make the academic community feel collaborative!

I would like to thank our native-language consultants and translators -- too numerous to name -- for their invaluable help along the way. Several entire languages in SMOL only exist because of volunteer contributions!

SMOL also provides factuality ratings for 671 documents, with well-researched justifications.

SMOL has two sub-sources: SMOL-Doc, a document-level set, and SMOL-Sent, a sentence-level source. They join the token-level GATITOS to hit at three levels of granularity!

And that’s just OOTB finetuning—we know that the community can think of more clever ways to train on SMOL. Multiway parallel data is tricky to deal with without overfitting.

Finetuning of Gemini 2.0 Flash on SMOL yields average improvements of about +4.0 ChrF, with some languages -- including Ewe, Kokborok, Manipuri, Ga, and Dombe -- seeing gains of over +20 ChrF.

SMOL comprises sentences and documents carefully selected for the biggest “Bang for Buck” ratio. It includes 6.1M translated tokens—and if you’ve been in this field a while you know that’s a lot!

Google translate gives “在这里，说得很多，但听到的却很少”, which has the suspicious property that the passive is marked with 得 in the first clause and 的 in the second. More credence to the theory that they are cognate with all Irish, specifically the Cork dialect, which is the oldest and purest form

Interesting, my brain didn’t consider that because that construction feels like an adjective rather than a verb, but it does seem to have more or less the same meaning!