|Version 2 (modified by omry, 7 years ago) (diff)|
Serve a robots.txt file from Trac. Mostly useful to tracd users, but works on anything. Just put the data you want in the wiki page RobotsTxt.
If you have any issues, create a new ticket.
Download the zipped source from here.
[components] robotstxt.* = enabled
A typical RobotsTxt Wiki page will look like:
User-agent: * Disallow: /browser Disallow: /log Disallow: /changeset Disallow: /report Disallow: /newticket Disallow: /search