wget a page

wget -v -e robots=off --wait 1 --ask-password --user=[username] -r -p -k -A [extensions list] [url]
  • ignores robots.txt
  • prompts password with HTTP Basic Authentication
  • recursively crawl through accepted linked resources and saves onto local dir