SimplyWebHosting.com KnowledgeBase Glossary    Contact Us
Search  
   
Browse by Category
SimplyWebHosting.com KnowledgeBase .: Virtuozzo and OpenVz Based Accounts .: What is robots.txt?

What is robots.txt?

One way to limit what files and directories a search engine robot program scans is to create a robot.txt file. This file will tell properly configured web robots which files and directories to search and which not to search. For more information on the robots.txt file see the Web Robots FAQ at:

http://www.robotstxt.org/wc/faq.html

The default location of robots.txt in a VPS is:

/home/username/domainname.com/html/robots.txt

The default location of robots.txt on a Plesk based account (Upipe, MDH, OHP, WebPro) is:

/httpdocs/robots.txt

or

/httpsdocs/robots.txt

(for files accesses through https://).

You will need to substitute the actual user name for "username" and substitute the actual domain name for "domainname.com".


How helpful was this article to you?

User Comments

No comments have been posted.


.: Powered by Lore 1.5.4
Copyright 2005-2014 Advantagecom Networks, Inc.
SimplyWebHosting.com - Xen Linux Virtual Private Servers (VPS) - Paypal Accepted