| The Google Spider Please exchange information on making your sites more appealing to the google spider resulting in a better google index.
I've found out some information which might be helpful to somebody
When your site is crawled, the bot constructs the page from scratch. First it writes the <tables> then fills them with content, apparently if you have 1 <table> <tr> <td> tag out of place the spider doesn't finish the table and your content within goes unread
This isn't the case with <div> they're read like text which is alot easier for the spider to read and eliminates chances of the bot timing out
also
Does robot.txt make a differerce? |