Mirroring a website where you need to log in first

Mirroring a website where you need to log in first

I needed to make an complete offline copy of a website the other day but was having difficulties as you needed to login to the site to get the content.  Luckily, an firefox add-on plus the wonderful wget came to the rescue.

Export cookies (https://addons.mozilla.org/en-US/firefox/addon/export-cookies/?src=api) is a firefox add-on that lets you export cookies in a format that wget understands.

So here is the procedure:
1) Log in to the website
2) Export the cookies into a cookies.txt file
3) Run wget
wget --load-cookies cookies.txt -mkEp  http://website.com
4) Hey-presto


Popular posts from this blog

A census of amplified and overexpressed human cancer genes : Nature Reviews Cancer

RT @jburnmurdoch: Most useful thread I’ve read on the dynamics of Covid transmission. By an expert, and packed full of links to evidence. Indoor spaces and or prolonged face-to-face contact account for large majority of Covid transmission. Walking past someone in street/park much lower risk. https://t.co/fnMrDjAxfq