It appears you have not yet registered with our community. To register please click here...

DNforum.com - Domain Sales, Domain Forum, Domain Appraisals
 
Register Now!
Register Now for FREE!
Our records show you have not yet registered to our forums. To sign up for your FREE account INSTANTLY fill out the form below!

Username: Password: Confirm Password: E-Mail: Confirm E-Mail:  
Birthday:       I agree to forum rules 

Go Back   DNForum - Domain Sales, Domain Forum, Domain Appraisals, Domain Registrars > Content Development > Search Engines and Traffic Building
Reply
 
LinkBack Thread Tools Display Modes
Old 06-24-2006, 12:11 PM   #1 (permalink)
Flash Nerd
 
Name: Aaron Harbaugh
Last Online: 06-04-2008 12:23 AM
iTrader: (10)
Join Date: Sep 2005
Posts: 321
DNF$: 1,171
Location: Home
Country:


Google Spider Question

I have a forum, and anyone can read the title of the posts, but not the content, unless that person is signed up as a member of the forum.

Is this the same for the Spiders, such as Google, that visit my Forum?
Or can they read the posts anyway.

If they cant read the content of the posts, then: Is there a way to set it so that when its a spider it gives it like an auto pass thing?
Rascagua is offline   Reply With Quote
Sponsored Links
Old 06-24-2006, 01:32 PM   #2 (permalink)
Platinum Lifetime Member
 
Coolalex's Avatar
 
Name: Alex Stenerson
Last Online: 01-29-2007 07:15 PM
iTrader: (15)
Join Date: Apr 2006
Posts: 292
DNF$: 43
Location: Behind You...
Country:


Re: Google Spider Question

use your spiders.txt to give google access
__________________
www.steners.net
Coolalex is offline   Reply With Quote
Old 06-24-2006, 07:44 PM   #3 (permalink)
Flash Nerd
 
Name: Aaron Harbaugh
Last Online: 06-04-2008 12:23 AM
iTrader: (10)
Join Date: Sep 2005
Posts: 321
DNF$: 1,171
Location: Home
Country:


Re: Google Spider Question

Could you explain that a little more please?
Rascagua is offline   Reply With Quote
Old 06-27-2006, 01:33 AM   #4 (permalink)
 
POLiSH's Avatar
 
Name: Ryan
Last Online: 08-24-2008 01:13 AM
iTrader: (28)
Join Date: Aug 2004
Posts: 2,247
DNF$: 12
Location: High Mountains
Country:


Re: Google Spider Question

Quote:
Originally Posted by Coolalex
use your spiders.txt to give google access
I have never heard of spiders.txt, but I have heard of robots.txt.
POLiSH is offline   Reply With Quote
Old 06-27-2006, 05:04 AM   #5 (permalink)
DNF Regular
 
clasione's Avatar
 
Name: John
Last Online: 09-04-2008 01:57 AM
iTrader: (38)
Join Date: May 2004
Posts: 1,023
DNF$: 1,539
Location: Long Island NY
Country:


Re: Google Spider Question

Quote:
Originally Posted by Rascagua
I have a forum, and anyone can read the title of the posts, but not the content, unless that person is signed up as a member of the forum.

Is this the same for the Spiders, such as Google, that visit my Forum?
Or can they read the posts anyway.

If they cant read the content of the posts, then: Is there a way to set it so that when its a spider it gives it like an auto pass thing?
Yes there is a way to do that but I highly recommend that you don't. There has been many discussion about this type of thing and if your forum is running vbulletin software, then you can find many of these discussions and solutions at www.vbulletin.org.

The problem with allowing the spider in and not the general visitor is that search engines, especially Google, will sometimes send unknown spiders to your site to see if it shows the same material to an unknown IP address verses an IP address known to be Google..... What they are doing is checking for cloaking and other attemps to serve seo pages to spiders and a redirect to a user...... You don't want to start getting into serving different pages based on user agent unless you really know what you are doing....

I know of only one site that has successfully done this and it is www.webmasterworld.com - that is the only successful case that I am aware of, but there are others.
__________________
Long Island's Largest Online Publication
Long Island Exchange ® Inc. by Searchen Networks ® Inc.
StrategicRevenue.com is for sale! PM offers...
clasione is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules

Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Newsletter for Google Adwords domaintalk Advanced SEO 13 06-25-2005 03:48 PM
Got an email from Fox B40 Legal Issues 32 04-24-2005 08:06 PM
Premium Domains $5+ Clearance clemzonguy Domains for Sale (Domain Sales) - Fixed Prices Above $100 0 04-20-2005 03:34 PM
Premium Domain Clearance Tax Sale $10+ clemzonguy Domains for Sale (Domain Sales) - Fixed Prices Above $100 11 04-11-2005 05:09 PM
GZ.com TopNames.com Domains for Sale (Domain Sales) - Fixed Prices Above $100 6 07-05-2004 11:06 AM


All times are GMT -4. The time now is 03:59 AM.
Copyright @2001-2008 DNForum.com

Learn Domains
Promote Domains
Research Domains
Buy Domains
Resell Domains
Park Domains
Sell Domains
Build Domains
Host Domains
Trademark Domains
Domain Domains
manage Domains
Appraise Domains