• Welcome to DNForum.com - Domain Investor Forum, Free Domain Marketplace and a community for 45+ domain pros
    If you are new to domains and looking to buy, sell and learn about domains then you have come to the right place. DNForum is the oldest global domain name community on the internet and continues to grow every day. There are over 45,000 domainers on DNForum doing everything from buying domains, selling domains, using our free in-house built tools, learning about domains and discussing domains. Take a minute and Register.

Any tools out there to copy an ENTIRE website?

Status
Not open for further replies.

JuniperPark

New Member
The Originals
Legacy Exclusive Member
Joined
Aug 3, 2003
Messages
2,909
Reaction score
91
Can anyone point me to a tool that will copy an ENTIRE website? Hopefully free or at least low-cost?

Browsers used to do this, but not anymore. "Offline viewing" is now totally worthless, it does 1 page at a time. The site I want to copy to my hard drive has hundreds of photos spread among dozens of pages.

BTW, I'm not trying to steal a website, I'm trying to get a copy of it (esp the photos) before the site owner takes it down or revises it. It was a fundraising site for a dog hoarder, and as such there is a lot of evidence there that needs to be saved. I expect this person to be served with at least a couple of lawsuits so I need to do this quickly.

Thanks!
 
I used Website Extractor several years ago. Not sure about malware or the others.
 
Use firefox and under FILE SAVE AS - let me know if it works. It does save, i tried this couple years ago.

Can anyone point me to a tool that will copy an ENTIRE website? Hopefully free or at least low-cost?

Browsers used to do this, but not anymore. "Offline viewing" is now totally worthless, it does 1 page at a time. The site I want to copy to my hard drive has hundreds of photos spread among dozens of pages.

BTW, I'm not trying to steal a website, I'm trying to get a copy of it (esp the photos) before the site owner takes it down or revises it. It was a fundraising site for a dog hoarder, and as such there is a lot of evidence there that needs to be saved. I expect this person to be served with at least a couple of lawsuits so I need to do this quickly.

Thanks!
 
CureCancer: FireFox's 'Save As' only saves the 1 page that you are on. I want to save a big site with several hundred photos and about 100 pages. I need software that will crawl the site.

biggedon: Most of the photos are very large (3MB) and have a lot of detail. I want the max resolution because we want to be able to see all of the people in the background of the photos. This is important because some people declined to be photograph but can be seen in the background of others peoples' shots.

Just tried 'web extractor' and crawled the site, but didn't save the photos. Perhaps I need to read the manual on it more.
 
Once again, the Linux command line comes to the rescue:
Code:
wget \
     --recursive \
     --no-clobber \
     --page-requisites \
     --html-extension \
     --convert-links \
     --restrict-file-names=windows \
     --domains website.org \
     --no-parent \
         [url]www.website.org/tutorials/html/[/url]
http://www.linuxjournal.com/content/downloading-entire-web-site-wget
If you don't have a Linux machine it's a good opportunity to start using virtualization software like vmware :)
 
I like the linux command! Not sure I'm ready to tackle vmware tho!

No, archive.org does not store large photos.

The Yahoo answers thing is 4 years old so most of it doesn't work anymore, but it does make reference to the httrack product.

Thanks all!
 
Ok, tried several of these and HTTrack was BY FAR the best way to go.

Thanks all!
 
They have wget for Windows on Sourceforge (search Google for 'wget win32') use it w/ the same flags as stated above.
 
Status
Not open for further replies.
Back
Top Bottom