Time2Dine.co.nz is Online Restaurant Booking
 
Elusion Electronic Cigarette
 New Zealand Restaurants Forum
Restaurant Forum | Contact Time2Dine | Book Online & Save | About Time2Dine

Go Back   New Zealand Restaurants & Food Forum > Search Engine Optimisation > Google
Register

Reply
 
LinkBack Thread Tools
  #1  
Old 20th Mar 07, 12:02 AM
T2DMan's Avatar
Administrator
 
Join Date: Apr 2004
Location: Auckland, New Zealand
Posts: 7,839
T2DMan is on a distinguished road
Default Multiple Robots files

How do you have several sites coming into your site, and have one with different robots.txt file

mail .htaccess file includes:

[PHP]RewriteCond %{HTTP_HOST} domainb.com
RewriteRule robots.txt robotsfff.txt [L]

[/PHP]

Then the robotsfff.txt file containing say a total exclusion:

[PHP]User-agent: *
Disallow: /[/PHP]

this means that the domainb.com/robots.txt shows as
[PHP]User-agent: *
Disallow: /[/PHP]

And no need to redirect the access for the robotsfff.txt file. You could do a 301 redirect back to the robots.txt file, not worth the effort.
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
One domain or multiple domains? T2DMan Google 3 15th May 07 04:37 PM
Googlebot: Valid meta robots content values Plutonio Google 1 15th Mar 07 08:38 AM
Hotlink Protection Tutorial (Apache Server - .htaccess files) sven Google 0 26th Jul 06 12:08 AM



Powered by: vBulletin Copyright ©2000 -2012, Jelsoft Enterprises Limited.
Search Engine Friendly URLs by vBSEO 3.2.0
© 2010 Time2Dine