Mirroring a website where you need to log in first

Mirroring a website where you need to log in first

I needed to make an complete offline copy of a website the other day but was having difficulties as you needed to login to the site to get the content.  Luckily, an firefox add-on plus the wonderful wget came to the rescue.

Export cookies (https://addons.mozilla.org/en-US/firefox/addon/export-cookies/?src=api) is a firefox add-on that lets you export cookies in a format that wget understands.

So here is the procedure:
1) Log in to the website
2) Export the cookies into a cookies.txt file
3) Run wget
wget --load-cookies cookies.txt -mkEp  http://website.com
4) Hey-presto
https://addons.mozilla.org/en-US/firefox/addon/export-cookies/?src=api

Comments

Popular posts from this blog

Search down those house prices

Nationwide statement to QIF Format

The generosity of google payments