memory error searching large repository using RepoSearchPlugin

[jeffrey.lyon@…]

How to Reproduce

While doing a GET operation on /search, Trac issued an internal error.

Ran a search after installing repoSearchPlugin on a repository containing 10GB in 2000 files). The computer has 110GB of free disk space and 3GB or RAM. The search ran for several minutes and then the memory error was reported. The error is repeatable with this repository, but searches run successfully on other smaller repositories.

Request parameters:

{'noquickjump': u'1', 'q': u'bla', 'repo': u'on'}

User Agent was: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7

System Information

Trac	0.11
Python	2.5.2 |EPD Py25 4.1.30101| (r252:60911, Dec 19 2008, 13:49:12) [MSC v.1310 32 bit (Intel)]
setuptools	0.6c9-s1
SQLite	3.3.4
pysqlite	2.3.2
Genshi	0.5
Pygments	0.10.0001
Subversion	1.5.4 (r33841)
jQuery:	1.2.3

Python Traceback

Traceback (most recent call last):
  File "C:\Python25\Lib\site-packages\trac\web\main.py", line 423, in _dispatch_request
    dispatcher.dispatch(req)
  File "C:\Python25\Lib\site-packages\trac\web\main.py", line 197, in dispatch
    resp = chosen_handler.process_request(req)
  File "C:\Python25\Lib\site-packages\trac\search\web_ui.py", line 106, in process_request
    results += list(source.get_search_results(req, terms, filters))
  File "build\bdist.win32\egg\tracreposearch\search.py", line 112, in get_search_results
    for node in walker(repo, query):
  File "build\bdist.win32\egg\tracreposearch\search.py", line 93, in full_walker
    content = to_unicode(content.read().lower(), node.get_content_type())
  File "C:\Python25\Lib\site-packages\trac\mimeview\api.py", line 789, in to_unicode
    return to_unicode(content, charset)
  File "C:\Python25\Lib\site-packages\trac\util\text.py", line 59, in to_unicode
    return unicode(text, charset, 'replace')
  File "C:\Python25\lib\encodings\iso8859_15.py", line 15, in decode
    return codecs.charmap_decode(input,errors,decoding_table)
MemoryError

[Ryan J Ollos]

Reassigning ticket after changing maintainer of plugin.

[Ryan J Ollos]

Since this report is over a year old I'm closing, but please reopen if you wish to work on solving the issue.