Robots.txt handler

Description

Serve a robots.txt file from Trac. Mostly useful to tracd users, but works on anything. Just put the data you want in the wiki page RobotsTxt.

Bugs/Feature Requests

Existing bugs and feature requests for RobotsTxtPlugin are here.

If you have any issues, create a new ticket.

Download

Download the zipped source from here.

Source

You can check out RobotsTxtPlugin from here using Subversion, or browse the source with Trac.

Example

To enable:

[components]
robotstxt.* = enabled

A typical RobotsTxt Wiki page will look like:

User-agent: *
Disallow: /browser
Disallow: /log
Disallow: /changeset
Disallow: /report
Disallow: /newticket
Disallow: /search

Recent Changes

[7204] by coderanger on 11/30/09 09:08:25

0.11 version of RobotsTxt?.

[7203] by coderanger on 11/30/09 08:51:15

Branch for 0.11.

[3416] by coderanger on 03/25/08 07:39:08

Change my email to avoid Yahoo, which decided to brake my scraper script recently.

[1486] by coderanger on 11/04/06 12:02:39

RobotsTxtPlugin:

Add package data.

Author/Contributors

Author: coderanger
Contributors: