The combination of wget and the Export Cookies add-on for Firefox is useful for creating offline, complete, static archives of websites that are only accessible with a password:
- First log in to the site and export cookies.txt,
- Then run
wget \ --recursive \ --no-clobber \ --page-requisites \ --html-extension \ --convert-links \ --restrict-file-names=windows \ --domains example.com \ --no-parent \ --load-cookies cookies.txt \ --reject logout,admin* \ example.com/sub/dir
The rejection of logout URLs is especially useful, because otherwise one will probably be logged out by wget accessing the logout link.
[Keywords: archiving, cookies, Firefox, passwords, static web pages, websites, wget] [No comments] [Permanent link]
Comments: