Membership is FREE – with unlimited access to all features, tools, and discussions. Premium accounts get benefits like banner ads and newsletter exposure. ✅ Signature links are now free for all. 🚫 No AI-generated (LLM) posts allowed. Share your own thoughts and experience — accounts may be terminated for violations.

Any tools out there to copy an ENTIRE website?

Status
Not open for further replies.

JuniperPark

Level 9
Legacy Exclusive Member
Joined
Aug 3, 2003
Messages
2,909
Reaction score
91
Can anyone point me to a tool that will copy an ENTIRE website? Hopefully free or at least low-cost?

Browsers used to do this, but not anymore. "Offline viewing" is now totally worthless, it does 1 page at a time. The site I want to copy to my hard drive has hundreds of photos spread among dozens of pages.

BTW, I'm not trying to steal a website, I'm trying to get a copy of it (esp the photos) before the site owner takes it down or revises it. It was a fundraising site for a dog hoarder, and as such there is a lot of evidence there that needs to be saved. I expect this person to be served with at least a couple of lawsuits so I need to do this quickly.

Thanks!
 

Theo

Account Terminated
Joined
Feb 28, 2004
Messages
30,306
Reaction score
2,216
I used Website Extractor several years ago. Not sure about malware or the others.
 

Biggie

DNForum Moderator
Legacy Exclusive Member
Joined
Sep 4, 2002
Messages
15,046
Reaction score
2,238
how bout using screen print

you can save those images to hard drive
 

DN BROKER

Level 10
Legacy Exclusive Member
Joined
Oct 12, 2005
Messages
5,697
Reaction score
235
Use firefox and under FILE SAVE AS - let me know if it works. It does save, i tried this couple years ago.

Can anyone point me to a tool that will copy an ENTIRE website? Hopefully free or at least low-cost?

Browsers used to do this, but not anymore. "Offline viewing" is now totally worthless, it does 1 page at a time. The site I want to copy to my hard drive has hundreds of photos spread among dozens of pages.

BTW, I'm not trying to steal a website, I'm trying to get a copy of it (esp the photos) before the site owner takes it down or revises it. It was a fundraising site for a dog hoarder, and as such there is a lot of evidence there that needs to be saved. I expect this person to be served with at least a couple of lawsuits so I need to do this quickly.

Thanks!
 

JuniperPark

Level 9
Legacy Exclusive Member
Joined
Aug 3, 2003
Messages
2,909
Reaction score
91
CureCancer: FireFox's 'Save As' only saves the 1 page that you are on. I want to save a big site with several hundred photos and about 100 pages. I need software that will crawl the site.

biggedon: Most of the photos are very large (3MB) and have a lot of detail. I want the max resolution because we want to be able to see all of the people in the background of the photos. This is important because some people declined to be photograph but can be seen in the background of others peoples' shots.

Just tried 'web extractor' and crawled the site, but didn't save the photos. Perhaps I need to read the manual on it more.
 

Biggie

DNForum Moderator
Legacy Exclusive Member
Joined
Sep 4, 2002
Messages
15,046
Reaction score
2,238
can you see same images you need on "web.archive.org"
 

katherine

Country hopper
Legacy Exclusive Member
Joined
Jul 9, 2005
Messages
8,427
Reaction score
1,291
Once again, the Linux command line comes to the rescue:
Code:
wget \
     --recursive \
     --no-clobber \
     --page-requisites \
     --html-extension \
     --convert-links \
     --restrict-file-names=windows \
     --domains website.org \
     --no-parent \
         [url]www.website.org/tutorials/html/[/url]
http://www.linuxjournal.com/content/downloading-entire-web-site-wget
If you don't have a Linux machine it's a good opportunity to start using virtualization software like vmware :)
 

JuniperPark

Level 9
Legacy Exclusive Member
Joined
Aug 3, 2003
Messages
2,909
Reaction score
91
I like the linux command! Not sure I'm ready to tackle vmware tho!

No, archive.org does not store large photos.

The Yahoo answers thing is 4 years old so most of it doesn't work anymore, but it does make reference to the httrack product.

Thanks all!
 

JuniperPark

Level 9
Legacy Exclusive Member
Joined
Aug 3, 2003
Messages
2,909
Reaction score
91
Ok, tried several of these and HTTrack was BY FAR the best way to go.

Thanks all!
 

kinesis

Level 1
Legacy Platinum Member
Joined
May 19, 2009
Messages
19
Reaction score
0
They have wget for Windows on Sourceforge (search Google for 'wget win32') use it w/ the same flags as stated above.
 
Status
Not open for further replies.

Who has viewed this thread (Total: 1) View details

Who has watched this thread (Total: 5) View details

The Rule #1

Do not insult any other member. Be polite and do business. Thank you!

Premium Members

Upcoming events

Latest Listings

Our Mods' Businesses

*the exceptional businesses of our esteemed moderators

Top Bottom