use the following search parameters to narrow your results:
e.g.(and 'dog' reddit:'aww' site:'imgur.com')
(and 'dog' reddit:'aww' site:'imgur.com')
see the search faq for details.
advanced search: by author, community...
How can I download entire websites? (self.webdev)
submitted 4 months ago by Zitozu
Self-explainatory question. I'd really like to download for example the /sci/guide and other self-education sites, as well as alot of other websites. I'd greatly appreciate it if you'd give me serveral ways to do this.
[–][deleted] 4 months ago
[deleted]
[–]actionscripted 2 points3 points4 points 4 months ago
wget -r -p -U Mozilla http://www.somesite.com
[–]Ludonaut 10 points11 points12 points 4 months ago
Shorter and easier to memorize is the --mirror option:
wget --mirror http://domain.tld
[–]strangeelement 0 points1 point2 points 4 months ago
OP, listen to this man. Or woman. Or alien.
[–]LeonBo 8 points9 points10 points 4 months ago
http://www.httrack.com/ Looks awful, works great.
[–]magenta_placenta 1 point2 points3 points 4 months ago
I've used this before, works great from my experience.
[–]Zitozu[S] 0 points1 point2 points 4 months ago
I tried downloading /sci/ guide with this a couple days ago. After two hours of downloading the website, suddenly I see that it's downloading tons of other websites. I don't know, just made me doubt.
[–]yusit 2 points3 points4 points 4 months ago
SiteSucker for mac
[–]barlister 1 point2 points3 points 4 months ago
Most of these suggestions won't work on fully ajaxified sites, but most of the sites you're talking about probably aren't ajaxified.
So what suggestions would work on fully ajaxified sites?
[–]scootstah 1 point2 points3 points 4 months ago
Nothing, because you can't download the server side files.
[–]barlister 0 points1 point2 points 4 months ago
There is no good answer for that aside from fully automating a test suite for the entire site explicitely with something like watin.
Yeah, that's not quite an option I'd even consider. I just want lots of science and knowledge shit on my hard drive is all.
[–]karlpablo 5 points6 points7 points 4 months ago
You wouldn't download a website.
[–]proxylim 0 points1 point2 points 4 months ago
In almost all cases I use wget, but another great tool with a GUI is http://www.httrack.com/
[–]lemkepf 2 points3 points4 points 4 months ago
I've used MetaProducts Offline Explorer with great success. We use it to backup full versions of our ecommerce sites and then export them to a dvd for lawyer purposes. They can extract it then browse through it as if it was a live website.
Can it extract entire websites as a offline browser?
[–]lemkepf 0 points1 point2 points 4 months ago
Yup. You can download the demo and give it a try.
all it takes is a username and password
create account
is it really that easy? only one way to find out...
already have an account and just want to login?
login
[–][deleted] ago
[–]actionscripted 2 points3 points4 points ago
[–]Ludonaut 10 points11 points12 points ago
[–]strangeelement 0 points1 point2 points ago
[–]LeonBo 8 points9 points10 points ago
[–]magenta_placenta 1 point2 points3 points ago
[–]Zitozu[S] 0 points1 point2 points ago
[–]yusit 2 points3 points4 points ago
[–]barlister 1 point2 points3 points ago
[–]Zitozu[S] 0 points1 point2 points ago
[–]scootstah 1 point2 points3 points ago
[–]barlister 0 points1 point2 points ago
[–]Zitozu[S] 0 points1 point2 points ago
[–]karlpablo 5 points6 points7 points ago
[–]proxylim 0 points1 point2 points ago
[–]lemkepf 2 points3 points4 points ago
[–]Zitozu[S] 0 points1 point2 points ago
[–]lemkepf 0 points1 point2 points ago