Membership is FREE – with unlimited access to all features, tools, and discussions. Premium accounts get benefits like banner ads and newsletter exposure. ✅ Signature links are now free for all. 🚫 No AI-generated (LLM) posts allowed. Share your own thoughts and experience — accounts may be terminated for violations.

Archive.org - Increase in Traffic?

Status
Not open for further replies.

theinvestor

Exclusive Lifetime Member
Legacy Gold Member
Joined
Nov 5, 2007
Messages
3,536
Reaction score
13
I was looking at the archive.org for a few of the domains i hold and i noticed after i was looking...and checked my parked visitors..the number shot up.

Although the sites on archive when i was looking are not connected to this site? Was this a coincidence or has anyone else found that after you look at archive the visitors goes up?
 

AustinWeb

Level 3
Legacy Exclusive Member
Joined
Feb 6, 2008
Messages
65
Reaction score
0
Archive bots scan your site each time you run a history search. Check your logs & you'll see the bot hit the site at the same time you were searching. This is a "feature" that enables the servers to analyze current site content & allow links to work if they are clicked in the archive version. This also queues up the bot so it will crawl sites that are getting historical requests.

If you edit your robots.txt to ban the archiver you'll immediately see that the bot is blocked when you research your old pages on archive.org

I am still amazed that people have made such a legal fuss over archived copies of their site being stored.
 

dcristo

Level 9
Legacy Exclusive Member
Joined
Feb 25, 2005
Messages
3,709
Reaction score
151
It would be the archive.org bot. Let me guess. No clicks?
 
Status
Not open for further replies.
Top Bottom