Wikipedia: Database Download

Summary

Downloading dumps of the wiki database Not to be confused with WP:DDD. Wikipedia offers free copies of all available content to interested users. These databases can be used for mirroring, personal use, informal backups, offline use or database queries (such as for Wikipedia:Maintenance). All text content is licensed under the Creative Commons Attribution-ShareAlike 4.0 License (CC-BY-SA), and most is additionally licensed under the GNU Free Documentation License (GFDL).[1] Images and other files are available under different terms, as detailed on their description pages. For our advice about complying with these licenses, see Wikipedia:Copyrights. Offline Wikipedia readers Some of the many ways to read Wikipedia while offline: Some of them are mobile applications – see "List of Wikipedia mobile applications". Where do I get the dumps? English-language Wikipedia Dumps from any Wikimedia Foundation project: dumps.wikimedia.org and the Internet Archive English Wikipedia dumps in SQL and XML: dumps.wikimedia.org/enwiki/ and the Internet Archive Download the data dump using a BitTorrent client (torrenting has many benefits and reduces server load, saving bandwidth costs). pages-articles-multistream.xml.bz2 – Current revisions only, no talk or user pages; this is probably what you want, and is over 19 GB compressed (expands to over 86 GB when decompressed). pages-meta-current.xml.bz2 – Current revisions only, all pages (including talk) abstract.xml.gz – page abstracts all-titles-in-ns0.gz – Article titles only (with redirects) SQL files for the pages and links are also available All revisions, all pages: These files expand to multiple terabytes of text. Please only download these if you know you can cope with this quantity of data. Go to Latest Dumps and look out for all the files that have 'pages-meta-history' in their name. To download a subset of the database in XML format, such as a specific category or a list of articles see: Special:Export, usage of which is descri...