Local LLMs versus offline WikipediaTwo days ago, MIT Technology review published “How to run an LLM on your laptop”. It opens with an anecdote about using offline LLMs in an apocalypse scenario. “‘It’s like having a weird, condensed, faulty version of Wikipedia, so I can help reboot society with the help of my little USB stick,’ [Simon Willison] says.”This made me wonder: how do the sizes of local LLMs compare to the size of offline Wikipedia downloads?I compared some models from the Ollama library to various downloads on Kiwix. I chose models that could be run on some consumer-grade hardware, and Wikipedia bundles that didn’t have images for a better comparison. Here’s what I found, ordered by size:NameDownload sizeBest of Wikipedia (best 50K articles, no details)356.9MBSimple English Wikipedia (no details)417.5MBQwen 3 0.6B523MBSimple English Wikipedia915.1MBDeepseek-R1 1.5B1.1GBLlama 3.2 1B1.3GBQwen 3 1.7B1.4GBBest of Wikipedia (best 50K articles)1.93GBLlama 3.2 3B2.0GBQwen 3 4B2.6GBDeepseek-R1 8B5.2GBQwen 3 8B5.2GBGemma3n e2B5.6GBGemma3n e4B7.5GBDeepseek-R1 14B9GBQwen 3 14B9.3GBWikipedia (no details)13.82GBMistral Small 3.2 24B15GBQwen 3 30B19GBDeepseek-R1 32B20GBQwen 3 32B20GBWikipedia: top 1 million articles48.64GBWikipedia57.18GBThis comparison has many caveats:This is an apples-to-oranges comparison. Encyclopedias and LLMs have different purposes, strengths, and weaknesses. They are fundamentally different technologies!File size is not the only important detail. LLMs, even local ones, can use lots of memory and processor power. Offline Wikipedia will work better on my ancient, low-power laptop.Other entries might be more useful for a specific purpose. For example, you can download a selection of Wikipedia articles about chemistry, or an LLM that’s better tuned for your hardware. (And Kiwix has lots of other things you can download, like all of Stack Overflow.)I picked these entries based on vibes. Nothing rigorous about this comparison!Despite those caveats,...
First seen: 2025-07-19 20:30
Last seen: 2025-07-20 16:33