|
|
#1
| ||||
| ||||
|
How do you have several sites coming into your site, and have one with different robots.txt file mail .htaccess file includes: [PHP]RewriteCond %{HTTP_HOST} domainb.com RewriteRule robots.txt robotsfff.txt [L] [/PHP] Then the robotsfff.txt file containing say a total exclusion: [PHP]User-agent: * Disallow: /[/PHP] this means that the domainb.com/robots.txt shows as [PHP]User-agent: * Disallow: /[/PHP] And no need to redirect the access for the robotsfff.txt file. You could do a 301 redirect back to the robots.txt file, not worth the effort. |
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | |
| |
| | ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| One domain or multiple domains? | T2DMan | 3 | 15th May 07 04:37 PM | |
| Googlebot: Valid meta robots content values | Plutonio | 1 | 15th Mar 07 08:38 AM | |
| Hotlink Protection Tutorial (Apache Server - .htaccess files) | sven | 0 | 26th Jul 06 12:08 AM | |