Freotopia transfer

Fremantle

· Freopedia · wikis · archiving ·

I've been this evening to pick up the entire content dump of https://freotopia.org from Garry Gillard. He's donating it all to Wikimedia Australia so that we can incorporate it into https://freopedia.org (or rather, so Freopedia can expand to include a new wiki that will contain Freotopia and other material).

At first glance, there are 4,254 HTML files and 9,218 JPEGs (out of 28,476 all up). Here's a random sample:

./buildings/._federationwarehouse.html
./davidson/img/51.jpg
./schools/img/._.DS_Store
./fremantlewalks/porcelli.jpg
./river/melville/22.jpg
./society/newsletter/img/1975/3-3/._9.jpg
./readingroom/6.2/Richo2.html
./buildings/._primaries.html
./clubs/freoworkers/images/._DailyNews1928Aug21.jpg
./fhs/fs/2/img/straw2.jpg
./people/img/naylor.jpg
./clubs/freoworkers/images/._WorkersIzzy.jpg
./people/._greencharles.html
./readingroom/doco/ozdoco/ozdoco.htm
./hotels/._licensees1892.html
./society/newsletter/img/1974/jan/9.jpg
./fhs/fs/1/img/._harcourt1.jpg
./people/img/._scott.jpg
./clubs/freoworkers/images/conceptplan.jpg
./fhs/fs/7/contributors.html
./fhs/fs/5/img/statham4.jpg
./maylands/._index.html
./hotels/img/._oddfellows1851.jpg
./parks/img/oval1174C(1925).jpg
./society/newsletter/2004Aug.html
./park/img/hutchison2/16.jpg
./people/ingleknight/img/._inglemugshot2.jpg
./hotels/img/._freemasons.jpg
./fhs/fs/1/img/harcourt3.jpg

My plan of action is something along the lines of:

  • Upload an as-is zip file of the whole lot to the Internet Archive, as a point-in-time archive. (Edit: now done, see Freotopia_2024-06-17.)
  • Filter out all actual files that are part of Freotopia (e.g. there are lots of files, I think created by Dreamweaver, starting with ._ — and a few that don't relate to Fremantle at all).
  • Create a list of all the wanted files (HTML as well as images) on Freopedia, and map these to the page names that they'll end up with.
  • Use pandoc to convert the HTML to MediaWiki markup.
  • Upload all images.
  • Upload all pages, with a {{freotopia}} header that'll indicate their source and link to the project page.
  • Progressively go through all the pages, tidying things up and bringing it all up to date.