• Welcome to DNForum.com - Domain Investor Forum, Free Domain Marketplace and a community for 45+ domain pros
    If you are new to domains and looking to buy, sell and learn about domains then you have come to the right place. DNForum is the oldest global domain name community on the internet and continues to grow every day. There are over 45,000 domainers on DNForum doing everything from buying domains, selling domains, using our free in-house built tools, learning about domains and discussing domains. Take a minute and Register.

Archive.org - Increase in Traffic?

Status
Not open for further replies.

theinvestor

Exclusive Lifetime Member
Legacy Gold Member
Joined
Nov 5, 2007
Messages
3,536
Reaction score
13
I was looking at the archive.org for a few of the domains i hold and i noticed after i was looking...and checked my parked visitors..the number shot up.

Although the sites on archive when i was looking are not connected to this site? Was this a coincidence or has anyone else found that after you look at archive the visitors goes up?
 
Bot visits or a coincidence.
 
Archive bots scan your site each time you run a history search. Check your logs & you'll see the bot hit the site at the same time you were searching. This is a "feature" that enables the servers to analyze current site content & allow links to work if they are clicked in the archive version. This also queues up the bot so it will crawl sites that are getting historical requests.

If you edit your robots.txt to ban the archiver you'll immediately see that the bot is blocked when you research your old pages on archive.org

I am still amazed that people have made such a legal fuss over archived copies of their site being stored.
 
It would be the archive.org bot. Let me guess. No clicks?
 
Status
Not open for further replies.
Back
Top Bottom