Puella Magi Wiki:Public Backups: Difference between revisions

From Puella Magi Wiki
Jump to navigation Jump to search
m (I dunno why I put NOTOC there)
 
(19 intermediate revisions by 3 users not shown)
Line 1: Line 1:
The [https://github.com/bibanon/bibanon/wiki Bibliotheca Anonoma] has selected the Puella Magi Wiki for monthly archival to protect it's high quality content. Archives made will be posted on this page as a public service.
Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by [https://www.rsync.net/ Rsync.net] (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. '''Public Backup''' is provided here in order to ensure the community effort can continue in such an event.


Public backups are a crucial part of keeping the culture and folklife of the internet accessible for any length of time. In the spur of the moment, we often take the accessibility of the internet for granted. But websites and servers are not forever: The fall of Wikichan, the Insurgency Wiki and Encyclopedia Dramatica all show how quickly fortunes can turn. And when things go wrong, there is no hope with no backup.
==Wiki Backups==


If this page is no longer accessible, it can also be accessed at it's corresponding page at the [http://www.archiveteam.org/index.php?title=Puella_Magi Archive Team Wiki] or the Bibliotheca Anonoma. All the downloads are hosted on the [http://archive.org Internet Archive].
===Full XML Dump===


==Making Dumps==
The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is '''update every midnight (UTC)'''. A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check <code>HEAD</code> request and check <code>Last-Modified-At</code> the header before downloading.


We currently use the Wikiteam [http://code.google.com/p/wikiteam/wiki/NewTutorial dumpgenerator python script] to create dumps.
;[https://wiki.puella-magi.net/static/pmwiki.xml.gz pmwiki.xml.gz] ([https://wiki.puella-magi.net/static/pmwiki.updated timestamp])
:280MB, ~1.7GB uncompressed


Commands used for generating dumps are below:
===Image Dump===


  python dumpgenerator.py --api=http://wiki.puella-magi.net/api.php --xml --images # Generates full dump using Mediawiki API
The image dump is currently very large due to thumbnails (70 GB+). Please contact [[User:0x99]] for an image dump for the time being.


When creating dump archives, it is strongly recommended to use 7zip for the highest compression rates.
==External Backups==


==XML Full History Dumps==
===4chan Threads===


Easily importable XML dumps containing every edit that any anon has ever made on this wiki.
''See also: [[Threads]]''


* '''wikipuella_maginet-20120317-wikidump.7z''' - 3.3 MB. ~430 MB extracted.
Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.
** [http://archive.org/details/Wiki-Puella-magi.net Internet Archive]
** [http://www.mediafire.com/?v57hla8ebtdmi5m Mediafire]
* '''wikipuella_maginet-20120315-wikidump.7z''' - 3.29 MB. ~430 MB extracted.
** [http://archive.org/details/Wiki-Puella-magi.net Internet Archive]
** [http://www.mediafire.com/?5167hofagc8ehpx Mediafire]


==Image Dumps==
===2ch Threads===


Images are crucial to the completeness of a wiki dump.
''See also: [https://archive.puella-magi.net/ Puella Magi Archive]''


''Archivist's Note: I'm still having some trouble automatically saving the images using the Wikiteam script, perhaps due to Cloudflare protection. Hopefully, the site admins might help us out...''
As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.


==4chan Threads==
==See also==


The 4chan threads are the ultimate origin for most of the content on this wiki.
* [[Madoka Crate]] an archival effort by ''Bibliotheca Anonoma''.
 
''Archivist's Note: I think we should simply wget the threads from foolz, since they only save thumbnails anyway.''
 
* [[Threads]]
 
==Misc.==
 
Other stuff related in some form or manner.
 
* [[Fanworks#Image Packs]] - Complete Image packs related to Madoka, possibly collected from 4chan. This needs to be put into the Internet Archive.
 
==Archivists==
 
* [[User:Iruel|Iruel]] - Tenshi Hinanawi. The head archivist of the Bibliotheca Anonoma.

Latest revision as of 10:22, 3 November 2023

Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by Rsync.net (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. Public Backup is provided here in order to ensure the community effort can continue in such an event.

Wiki Backups

Full XML Dump

The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is update every midnight (UTC). A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check HEAD request and check Last-Modified-At the header before downloading.

pmwiki.xml.gz (timestamp)
280MB, ~1.7GB uncompressed

Image Dump

The image dump is currently very large due to thumbnails (70 GB+). Please contact User:0x99 for an image dump for the time being.

External Backups

4chan Threads

See also: Threads

Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.

2ch Threads

See also: Puella Magi Archive

As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.

See also