• Welcome to DNForum.com - Domain Investor Forum, Free Domain Marketplace and a community for 45+ domain pros
    If you are new to domains and looking to buy, sell and learn about domains then you have come to the right place. DNForum is the oldest global domain name community on the internet and continues to grow every day. There are over 45,000 domainers on DNForum doing everything from buying domains, selling domains, using our free in-house built tools, learning about domains and discussing domains. Take a minute and Register.

Can someone help me with a 404 Document Not Found error ?

Status
Not open for further replies.

BobDiGiTaL

Domain Lover
Legacy Exclusive Member
Joined
Aug 13, 2005
Messages
1,556
Reaction score
19
I noticed this section of cpanel that lets me see errors within my website.

404 Document Not Found

Required but not found URLs (HTTP code 404)
URL (1) Error Hits - Referers - /robots.txt - 32

Do I need to create a page " /robot.txt" so this error will not occur?
Or is it no big deal?
 
No, do not see a connection with robots.txt.

You could put 404 error code forwarding inside an htaccess file in the same folder where the index page is located and forward the 404's to it.
 
You can create a custom 404 error page, which you define in your .htaccess file.
 
You should create a blank robots.txt file, it aint accessed by users generally so wont make a difference setting up a 404 page, its search engines checking for crawling rules.
 
You should create a blank robots.txt file, it aint accessed by users generally so wont make a difference setting up a 404 page, its search engines checking for crawling rules.

robots.txt is to prevent certain pages/directories not being crawled. Not for 404 errors.
 
You can create a custom 404 error page and redirect it.
 
what does it mean?
Why is someone looking for a /robots.txt file ? Should I make a /robots.txt file so it can be found. What should be in it?
 
you don't NEED a robots.txt file, it will probably be something crawling your site.
Either ignore the error or create a robots file to stop the error, it doesn't really matter
 
Status
Not open for further replies.
Back
Top Bottom