Puella Magi Wiki:Public Backups: Difference between revisions

From Puella Magi Wiki
Jump to navigation Jump to search
m (I dunno why I put NOTOC there)
 
(6 intermediate revisions by the same user not shown)
Line 1: Line 1:
The [https://github.com/bibanon/bibanon/wiki Bibliotheca Anonoma] has selected the Puella Magi Wiki for monthly archival to protect its content. Archives made will be posted on this page as a public service.
Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by [https://www.rsync.net/ Rsync.net] (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. '''Public Backup''' is provided here in order to ensure the community effort can continue in such an event.


If this page is no longer accessible, it can also be accessed at it's corresponding page at the [http://www.archiveteam.org/index.php?title=Puella_Magi Archive Team Wiki] or the Bibliotheca Anonoma. All the downloads are hosted on the [http://archive.org Internet Archive].
==Wiki Backups==


==Introduction==
===Full XML Dump===


Public backups are a crucial part of keeping the culture and folklife of the internet accessible for any length of time. In the spur of the moment, we often take the accessibility of the internet for granted. But websites and servers are not forever: The fall of Wikichan, the Insurgency Wiki and Encyclopedia Dramatica all show how quickly fortunes can turn. And when things go wrong, there is no hope with no backup.
The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is '''update every midnight (UTC)'''. A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check <code>HEAD</code> request and check <code>Last-Modified-At</code> the header before downloading.


==Dumps==
;[https://wiki.puella-magi.net/static/pmwiki.xml.gz pmwiki.xml.gz] ([https://wiki.puella-magi.net/static/pmwiki.updated timestamp])
===XML Full History Dumps===
:280MB, ~1.7GB uncompressed


''Easily importable XML dumps containing every edit that any anon has ever made on this wiki.''
===Image Dump===


* '''Daily Dumps''': [http://wiki.puella-magi.net/User:0x99/Maintenance_log#XMP_Dump] - Full XML backups built and downloadable from this wiki everyday at midnight. (A true step up from Wikichan or the Insurgency Wiki!)
The image dump is currently very large due to thumbnails (70 GB+). Please contact [[User:0x99]] for an image dump for the time being.


* '''wikipuella_maginet-20120317-wikidump.7z''' - 3.3 MB. ~430 MB extracted.
==External Backups==
** [https://archive.org/details/Wiki-Puella-magi.net Internet Archive]
* '''wikipuella_maginet-20120315-wikidump.7z''' - 3.29 MB. ~430 MB extracted.
** [http://archive.org/details/Wiki-Puella-magi.net Internet Archive]
 
===Image Dumps===
 
Images are crucial to the completeness of a wiki dump.
 
''Archivist's Note: I'm still having some trouble automatically saving the images using the Wikiteam script, perhaps due to Cloudflare protection. Hopefully, the site admins might help us out...''


===4chan Threads===
===4chan Threads===


The 4chan threads are the ultimate origin for most of the content on this wiki.
''See also: [[Threads]]''
 
''Archivist's Note: I think we should simply wget the threads from foolz, since they only save thumbnails anyway.''
 
* [[Threads]]
 
===Misc.===
 
Other stuff related in some form or manner.
 
* [[Fanworks#Image Packs]] - Complete Image packs related to Madoka, possibly collected from 4chan. This needs to be put into the Internet Archive.
 
==How can we help?==
 
If you are a regular user, just downloading an XML dump is enough. If you want to keep the dumps updated, rerun the script below. If you are an admin, it would really help to get the wiki's images into the Internet Archive.
 
===Making Dumps===
 
Just download a Daily Dump from the site, and submit it to the Internet Archive. It would be nice if you 7ziped it up to save space.


In the past used the Wikiteam [http://code.google.com/p/wikiteam/wiki/NewTutorial dumpgenerator python script] to create dumps.
Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.


Commands used for generating dumps are below:
===2ch Threads===


  python dumpgenerator.py --api=http://wiki.puella-magi.net/api.php --xml --images # Generates full dump using Mediawiki API
''See also: [https://archive.puella-magi.net/ Puella Magi Archive]''


When creating dump archives, it is strongly recommended to use 7zip for the highest compression rates.
As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.


==Archivists==
==See also==


* [[User:Iruel|Iruel]] - Tenshi Hinanawi. The head archivist of the Bibliotheca Anonoma.
* [[Madoka Crate]] an archival effort by ''Bibliotheca Anonoma''.

Latest revision as of 10:22, 3 November 2023

Puella Magi Wiki maintains an hourly snapshot of all data in the Wiki to a remote location provided by Rsync.net (unaffiliated). However, even with the backups, the Wiki can still be gone at any time by an unexpected circumstance. Public Backup is provided here in order to ensure the community effort can continue in such an event.

Wiki Backups

Full XML Dump

The Full XML dump contains all the contents of the wiki (including all revisions), but none of the user information. The dump is update every midnight (UTC). A timestamp file is provided as a way to do a small request to determine if the file was updated. Please check HEAD request and check Last-Modified-At the header before downloading.

pmwiki.xml.gz (timestamp)
280MB, ~1.7GB uncompressed

Image Dump

The image dump is currently very large due to thumbnails (70 GB+). Please contact User:0x99 for an image dump for the time being.

External Backups

4chan Threads

See also: Threads

Puella Magi Wiki has its root from Madoka Threads on 4chan. These threads are currently archived externally.

2ch Threads

See also: Puella Magi Archive

As 2ch also plays a large part in the popularity of the series in Japan, Puella Magi Wiki has 2ch archive up to February 2014.

See also

Retrieved from "https://wiki.puella-magi.net/w/index.php?title=Puella_Magi_Wiki:Public_Backups&oldid=146476"