Puella Magi Wiki:Public Backups: Difference between revisions

From Puella Magi Wiki
Jump to navigation Jump to search
(Created page with "Here is a list of monthly XML and image backups of this wiki, in case of future disaster. If this page is no longer accessible, it can also be accessed at it's corresponding ...")
 
m (I dunno why I put NOTOC there)
 
(23 intermediate revisions by 3 users not shown)
Line 1: Line 1:
Here is a list of monthly XML and image backups of this wiki, in case of future disaster.
Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by [https://www.rsync.net/ Rsync.net] (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. '''Public Backup''' is provided here in order to ensure the community effort can continue in such an event.


If this page is no longer accessible, it can also be accessed at it's corresponding page at the [http://www.archiveteam.org/index.php?title=Puella_Magi Archive Team Wiki] or the Bibliotheca Anonoma. All the downloads are hosted on the [http://archive.org Internet Archive].
==Wiki Backups==


==Introduction==
===Full XML Dump===


The Bibliotheca Anonoma has selected the Puella Magi Wiki for monthly archival to protect it's high quality content.  
The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is '''update every midnight (UTC)'''. A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check <code>HEAD</code> request and check <code>Last-Modified-At</code> the header before downloading.


The internet is vastly resilient, built to withstand censorship and even the worst nuclear holocausts. But in the spur of the moment, few have bothered to save the data that made the internet worth fighting for in the first place. The fall of Wikichan and Encyclopedia Dramatica, two wikis filled with valuable content thoughtlessly lost, sent me into action
;[https://wiki.puella-magi.net/static/pmwiki.xml.gz pmwiki.xml.gz] ([https://wiki.puella-magi.net/static/pmwiki.updated timestamp])
:280MB, ~1.7GB uncompressed


- [[Iruel|User:Iruel]], from the [https://github.com/bibanon/bibanon/wiki Bibliotheca Anonoma]
===Image Dump===


==Making Dumps==
The image dump is currently very large due to thumbnails (70 GB+). Please contact [[User:0x99]] for an image dump for the time being.


We currently use the Wikiteam [http://code.google.com/p/wikiteam/wiki/NewTutorial dumpgenerator python script] to create dumps.
==External Backups==


Commands used for generating dumps are below:
===4chan Threads===


  python dumpgenerator.py --api=http://wiki.puella-magi.net/api.php --xml --images # Generates full dump using Mediawiki API
''See also: [[Threads]]''


When creating dump archives, it is strongly recommended to use 7zip for the highest compression rates.
Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.


==XML Full History Dumps==
===2ch Threads===


* '''wikipuella_maginet-20120317-wikidump.7z''' - 3.3 MB. 430 MB extracted.
''See also: [https://archive.puella-magi.net/ Puella Magi Archive]''
** [http://archive.org/details/Wiki-Puella-magi.net Internet Archive]
** [http://www.mediafire.com/?v57hla8ebtdmi5m Mediafire]


==Image Dumps==
As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.


Images are crucial to the completeness of a wiki dump.
==See also==


''Archivist's Note: I'm still having some trouble automatically saving the images using the Wikiteam script, perhaps due to Cloudflare protection. Hopefully, the site admins might help us out...''
* [[Madoka Crate]] an archival effort by ''Bibliotheca Anonoma''.
 
==4chan Threads==
 
The 4chan threads are the ultimate origin for most of the content on this wiki.
 
''Archivist's Note: I think we should simply wget the threads from foolz, since they only save thumbnails anyway.''
 
* [[Threads]]
 
==Misc.==
 
Other stuff related in some form or manner.
 
* [[Fanworks#Image Packs]] - Complete Image packs related to Madoka, possibly collected from 4chan. This needs to be put into the Internet Archive.
 
==Archivists==
 
* [[Iruel|User:Iruel]] - The head archivist of the Bibliotheca Anonoma.

Latest revision as of 10:22, 3 November 2023

Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by Rsync.net (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. Public Backup is provided here in order to ensure the community effort can continue in such an event.

Wiki Backups

Full XML Dump

The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is update every midnight (UTC). A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check HEAD request and check Last-Modified-At the header before downloading.

pmwiki.xml.gz (timestamp)
280MB, ~1.7GB uncompressed

Image Dump

The image dump is currently very large due to thumbnails (70 GB+). Please contact User:0x99 for an image dump for the time being.

External Backups

4chan Threads

See also: Threads

Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.

2ch Threads

See also: Puella Magi Archive

As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.

See also