How did this get indexed in google ???????

[tas38]

Hello Everyone.....

I noticed I had some more pages from my arcade, indexed in google but then click on the link. And found it went to the game on my arcade, but it was in all of the browser full screen.

I do have it so people can add my games to their sites, by just placing some code on their site. But the code points to the whole pages, the game is on so they are on my site seeing my ads.

I put a new sitemap on my site, and got google to check it out right away. But would googles bot, go that deep into my site to pull just the games .swf file only then index it. I checked and see no url to the game file, on the sitemap I put on my site and got googles bot to check out. Googles bot should not be, getting .swf file and indexing them should it ?

So now what do I do if anything, it's a indexed page but it's just to some of the games on my site. Is this good or bad, is it the site sitemap, google or some one stealing my W/B. And what should I do, to fix it or do I just let it go ????

Googles indexed page here, see the 14th and 15th page of the returns you will see it goes to the game file .swf

http://www.google.com/search?q=inurl...UTF-8&filter=0

And the link to my site is in my siggy, to see the code to place games on people sites just click to play any game, the code is just below the games. I checked and the urls, in the code goes to my site with ads and all.

Plus the sitemap is arcadegamester.net/sitemap.xml but I checked, and there is not urls to just the games there. I'm lost at this point, as what happen and if it's good or bad ???
Thanks!

[dodo1]

Thread moved to proper forum.

[cursal]

Hey Tas,

All looks fine here. When I click on any of the links from 10-30 (three random per page) your whole page displayed.

Your site is intact

I am viewing this with FireFox 1.5.03.
What browser do you use?

[tas38]

Here is the url from google on page 15 of my index pages, it shows only the game on my site and nothing else it's full screen. Google has this indexed in it's returns......

http://www.arcadegamester.net/games/files/20244.swf

[cursal]

Here is the link I get for the 15 page in google from the link in your opening thread.

http://www.google.com/search?q=inurl...&sa=N&filter=0

I don't see it?

Hmm...

[tas38]

Yes they ask for the code letters to be matched, just to make sure you are not a computer. But once you do that, it will go to page 15 of the google returns.

I noticed on googles indexed url it has [FLASH] infront of the indexed url, on googles page 14 and 15 that goes to the game only. I'm now thinking it had to be googles bot, but I thought it would skip all .swf, popups and stuff like that but it must not be skipping .swf files.

All you have to do is typin the code letters and hit enter, I checked in both firefox and IE and they both then go to page 14 and 15 returns. The url to the flash game only is there, it has [FLASH] infornt of it then thge linked url.

[cursal]

Well,
1)Open up your robot.txt file
and
2)disallow* all robots into the directory where you keep your .swf files

That should keep those "individual" pages from getting indexed :-D

[tas38]

Do I do that like this, add this line to robot txt ???.....

disallow* .swf

Google added more indexs, to .swf files just a little bit ago.

[cursal]

Wouldn't hurt to do a search on any of the search engines,....

But
here is how you exclude a directory

User-agent: *
Disallow: /cgi-bin/

the * is wildcard for all robots that come looking for your robot.txt file
the Disallow: /cgi-bin/ is the directory that the robots SHOULD NOT index/crawl

so say all your swf files are in www. yoursite .com /swf-files/

then you would ad
User-agent: *
Disallow: /swf-files/

to your robots.txt file.

:-D

[tas38]

Ok thanks for all your help, I will add that to the robot.txt file right away.

Just one thing though, the files is in /games/files/

And if google indexed the images, I don't mind that at all. It's only the flash files I'm worried about, the images are in the games/images so putting it like games/files/ files being where the .swf files are. Will still let the robot index the images right ?

So I only need to add Disallow: /games/files/

Edited In: Here is what my robot/txt has in it right now, .......

User-agent: *

Disallow: /cig-bin/
Disallow: /tmp/
Disallow: /private/
Disallow: /admin/
Disallow: /games/files/

[cursal]

yep

User-agent: *
Disallow: /games/files/

Edit* Just saw your edit....Looks good
remember the * is wildcard for all bots, if you just want to single out a bot it would be

User-agent: googlebot
Disallow: /games/files/

[tas38]

Thanks! Tim