Puella Magi Wiki:Public Backups: Difference between revisions

Revision as of 10:11, 3 November 2023

Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by Rsync.net (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. Public Backup is provided here in order to ensure the community effort can continue in such an event.

Wiki Backups

Full XML Dump

pmwiki.xml.gz (timestamp) (280MB, ~1.7GB uncompressed)

The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is update every midnight (UTC). A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check HEAD request and check Last-Modified-At the header before downloading.

Image Dump

The image dump is currently very large due to thumbnails (70 GB+). Please contact User:0x99 for an image dump for the time being.

External Backups

4chan Threads

See also: Threads

Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.

2ch Threads

See also: Puella Magi Archive

As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.

@@ Line 1: / Line 1: @@
-The [https://github.com/bibanon/bibanon/wiki Bibliotheca Anonoma] has selected the Puella Magi Wiki for monthly archival to protect its content. Archives made will be posted on this page as a public service.
+__NOTOC__
+Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by [https://www.rsync.net/ Rsync.net] (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. '''Public Backup''' is provided here in order to ensure the community effort can continue in such an event.
-If this page is no longer accessible, it can also be accessed at it's corresponding page at the [http://www.archiveteam.org/index.php?title=Puella_Magi Archive Team Wiki] or the Bibliotheca Anonoma. All the downloads are hosted on the [http://archive.org Internet Archive].
+==Wiki Backups==
-==Introduction==
+===Full XML Dump===
-Public backups are a crucial part of keeping the culture and folklife of the internet accessible for any length of time. In the spur of the moment, we often take the accessibility of the internet for granted. But websites and servers are not forever: The fall of Wikichan, the Insurgency Wiki and Encyclopedia Dramatica all show how quickly fortunes can turn. And when things go wrong, there is no hope with no backup.
+;[https://wiki.puella-magi.net/static/pmwiki.xml.gz pmwiki.xml.gz] ([https://wiki.puella-magi.net/static/pmwiki.updated timestamp]) (280MB, ~1.7GB uncompressed)
-==Dumps==
+The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is '''update every midnight (UTC)'''. A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check <code>HEAD</code> request and check <code>Last-Modified-At</code> the header before downloading.
-===XML Full History Dumps===
-''Easily importable XML dumps containing every edit on this Wiki.''
+===Image Dump===
-* '''Periodic Dumps''': [https://wiki.puella-magi.net/static/pmwiki.xml.gz pmwiki.xml.gz] ([https://wiki.puella-magi.net/static/pmwiki.updated timestamp]) - 280 MB, ~1.7 GB extracted
+The image dump is currently very large due to thumbnails (70 GB+). Please contact [[User:0x99]] for an image dump for the time being.
-** Full XML backups with all revisions and no user information.
-** Currently taken '''daily''', but please do check timestamp before making a request.
-===Image Dumps===
+==External Backups==
-Please contact [[User:0x99|0x99]] for image dumps. These are very large (70 GB+).
 ===4chan Threads===
-The 4chan threads are the ultimate origin for most of the content on this wiki.
+''See also: [[Threads]]''
-''Archivist's Note: I think we should simply wget the threads from foolz, since they only save thumbnails anyway.''
-* [[Threads]]
-===Misc.===
-Other stuff related in some form or manner.
-* [[Fanworks#Image Packs]] - Complete Image packs related to Madoka, possibly collected from 4chan. This needs to be put into the Internet Archive.
-==How can we help?==
-If you are a regular user, just downloading an XML dump is enough. If you want to keep the dumps updated, rerun the script below. If you are an admin, it would really help to get the wiki's images into the Internet Archive.
-===Making Dumps===
-Just download a Daily Dump from the site, and submit it to the Internet Archive. It would be nice if you 7ziped it up to save space.
-In the past used the Wikiteam [http://code.google.com/p/wikiteam/wiki/NewTutorial dumpgenerator python script] to create dumps.
+Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.
-Commands used for generating dumps are below:
+===2ch Threads===
-  python dumpgenerator.py --api=http://wiki.puella-magi.net/api.php --xml --images # Generates full dump using Mediawiki API
+''See also: [https://archive.puella-magi.net/ Puella Magi Archive]''
-When creating dump archives, it is strongly recommended to use 7zip for the highest compression rates.
+As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.
-==Archivists==
+==See also==
-* [[User:Iruel|Iruel]] - Tenshi Hinanawi. The head archivist of the Bibliotheca Anonoma.
+* [[Madoka Crate]] an archival effort by ''Bibliotheca Anonoma''.