Robots.txt handler

Description

Serve a robots.txt file from Trac. Mostly useful to tracd users, but works on anything. Just put the data you want in the wiki page RobotsTxt.

Bugs/Feature Requests

Existing bugs and feature requests for RobotsTxtPlugin are here.

If you have any issues, create a new ticket.

Download

Download the zipped source from here.

Source

You can check out RobotsTxtPlugin from here using Subversion, or browse the source with Trac.

Example

To enable:

[components]
robotstxt.* = enabled

A typical RobotsTxt Wiki page will look like:

User-agent: *
Disallow: /browser
Disallow: /log
Disallow: /changeset
Disallow: /report
Disallow: /newticket
Disallow: /search

Recent Changes

[3416] by coderanger on 03/25/08 01:39:08

Change my email to avoid Yahoo, which decided to brake my scraper script recently.

[1486] by coderanger on 11/04/06 05:02:39

RobotsTxtPlugin:

Add package data.

[1485] by coderanger on 11/04/06 04:40:07

RobotsTxtPlugin:

Initial add.

[1484] by coderanger on 11/04/06 04:39:37

New hack RobotsTxtPlugin, created by coderanger

Author/Contributors

Author: coderanger
Contributors: