Puella Magi Wiki:Public Backups: Difference between revisions

From Puella Magi Wiki
Jump to navigation Jump to search
m (I dunno why I put NOTOC there)
 
(20 intermediate revisions by 3 users not shown)
Line 1: Line 1:
The [https://github.com/bibanon/bibanon/wiki Bibliotheca Anonoma] has selected the Puella Magi Wiki for monthly archival to protect it's high quality content. Archives made will be posted on this page as a public service.
Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by [https://www.rsync.net/ Rsync.net] (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. '''Public Backup''' is provided here in order to ensure the community effort can continue in such an event.


Public backups are a crucial part of keeping the culture and folklife of the internet accessible for any length of time. In the spur of the moment, we often take the accessibility of the internet for granted. But websites and servers are not forever: The fall of Wikichan, the Insurgency Wiki and Encyclopedia Dramatica all show how quickly fortunes can turn. And when things go wrong, there is no hope with no backup.
==Wiki Backups==


If this page is no longer accessible, it can also be accessed at it's corresponding page at the [http://www.archiveteam.org/index.php?title=Puella_Magi Archive Team Wiki] or the Bibliotheca Anonoma. All the downloads are hosted on the [http://archive.org Internet Archive].
===Full XML Dump===


==Making Dumps==
The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is '''update every midnight (UTC)'''. A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check <code>HEAD</code> request and check <code>Last-Modified-At</code> the header before downloading.


We currently use the Wikiteam [http://code.google.com/p/wikiteam/wiki/NewTutorial dumpgenerator python script] to create dumps.
;[https://wiki.puella-magi.net/static/pmwiki.xml.gz pmwiki.xml.gz] ([https://wiki.puella-magi.net/static/pmwiki.updated timestamp])
:280MB, ~1.7GB uncompressed


Commands used for generating dumps are below:
===Image Dump===


  python dumpgenerator.py --api=http://wiki.puella-magi.net/api.php --xml --images # Generates full dump using Mediawiki API
The image dump is currently very large due to thumbnails (70 GB+). Please contact [[User:0x99]] for an image dump for the time being.


When creating dump archives, it is strongly recommended to use 7zip for the highest compression rates.
==External Backups==


==XML Full History Dumps==
===4chan Threads===


* '''wikipuella_maginet-20120317-wikidump.7z''' - 3.3 MB. 430 MB extracted.
''See also: [[Threads]]''
** [http://archive.org/details/Wiki-Puella-magi.net Internet Archive]
** [http://www.mediafire.com/?v57hla8ebtdmi5m Mediafire]


==Image Dumps==
Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.


Images are crucial to the completeness of a wiki dump.
===2ch Threads===


''Archivist's Note: I'm still having some trouble automatically saving the images using the Wikiteam script, perhaps due to Cloudflare protection. Hopefully, the site admins might help us out...''
''See also: [https://archive.puella-magi.net/ Puella Magi Archive]''


==4chan Threads==
As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.


The 4chan threads are the ultimate origin for most of the content on this wiki.
==See also==


''Archivist's Note: I think we should simply wget the threads from foolz, since they only save thumbnails anyway.''
* [[Madoka Crate]] an archival effort by ''Bibliotheca Anonoma''.
 
* [[Threads]]
 
==Misc.==
 
Other stuff related in some form or manner.
 
* [[Fanworks#Image Packs]] - Complete Image packs related to Madoka, possibly collected from 4chan. This needs to be put into the Internet Archive.
 
==Archivists==
 
* [[User:Iruel|Iruel]] - Tenshi Hinanawi. The head archivist of the Bibliotheca Anonoma.

Latest revision as of 10:22, 3 November 2023

Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by Rsync.net (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. Public Backup is provided here in order to ensure the community effort can continue in such an event.

Wiki Backups

Full XML Dump

The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is update every midnight (UTC). A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check HEAD request and check Last-Modified-At the header before downloading.

pmwiki.xml.gz (timestamp)
280MB, ~1.7GB uncompressed

Image Dump

The image dump is currently very large due to thumbnails (70 GB+). Please contact User:0x99 for an image dump for the time being.

External Backups

4chan Threads

See also: Threads

Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.

2ch Threads

See also: Puella Magi Archive

As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.

See also

Retrieved from "https://wiki.puella-magi.net/w/index.php?title=Puella_Magi_Wiki:Public_Backups&oldid=146476"