UnicodeDecodeError in iso-8859-15 encoded Trac installation...

[peter.krantz@…]

Hi!

I am using trac with default_encoding set to iso-8859-15 in Trac.ini. htmldoc 1.8.27 is installed and works fine together with the PageToPdf plugin. However, trying to export the same page in CombineWiki yields UnicodeDecodeError:

Traceback (most recent call last):
  File "/usr/lib/python2.3/site-packages/trac/web/main.py", line 387, in dispatch_request
    dispatcher.dispatch(req)
  File "/usr/lib/python2.3/site-packages/trac/web/main.py", line 238, in dispatch
    resp = chosen_handler.process_request(req)
  File "/usr/lib/python2.3/site-packages/TracWebAdmin-0.1.2dev_r4240-py2.3.egg/webadmin/web_ui.py", line 109, in process_request
    path_info)
  File "build/bdist.linux-i686/egg/combinewiki/web_ui.py", line 60, in process_admin_request
  File "build/bdist.linux-i686/egg/combinewiki/web_ui.py", line 124, in _page_to_file
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 19: ordinal not in range(128)

My trac.ini has the following relevant settings:

[pagetopdf]
size = A4
charset = iso-8859-15

[components]
combinewiki.* = enabled
webadmin.* = enabled
pagetopdf.* = enabled

[trac]
default_charset = iso-8859-15

[Noah Kantrowitz]

Please make sure you have the latest version from Subversion. This was likely fixed a few weeks ago.

[sander@…]

Hello, we got the same error with trac version 0.10.2.

What does the error have to do with subversion, we don't see the link here.

[peter.krantz@…]

After having upgrading CombineWiki from subversion many pages now work, but not all. There is still a problem:

Traceback (most recent call last):
  File "/usr/lib/python2.3/site-packages/trac/web/main.py", line 387, in dispatch_request
    dispatcher.dispatch(req)
  File "/usr/lib/python2.3/site-packages/trac/web/main.py", line 238, in dispatch
    resp = chosen_handler.process_request(req)
  File "/usr/lib/python2.3/site-packages/TracWebAdmin-0.1.2dev_r4240-py2.3.egg/webadmin/web_ui.py", line 109, in process_request
    path_info)
  File "build/bdist.linux-i686/egg/combinewiki/web_ui.py", line 60, in process_admin_request
  File "build/bdist.linux-i686/egg/combinewiki/web_ui.py", line 121, in _page_to_file
  File "/usr/lib/python2.3/encodings/iso8859_15.py", line 18, in encode
    return codecs.charmap_encode(input,errors,encoding_map)
UnicodeEncodeError: 'charmap' codec can't encode character u'\u030a' in position 359: character maps to <undefined>

[peter.krantz@…]

It seems as if Trac does not normalize encoding before saving information to the database. If I cut the text and paste it into VIm and then copy and paste it back into the wiki the page can be exported. This solves the problem for me.

[sander@…]

Replying to peter.krantz@gmail.com:

It seems as if Trac does not normalize encoding before saving information to the database. If I cut the text and paste it into VIm and then copy and paste it back into the wiki the page can be exported. This solves the problem for me.

We already had the latest version. The VIm trick did not work for me, I still got the same error message

Traceback (most recent call last):
  File "/usr/lib/python2.3/site-packages/trac/web/main.py", line 387, in dispatch_request
    dispatcher.dispatch(req)
  File "/usr/lib/python2.3/site-packages/trac/web/main.py", line 238, in dispatch
    resp = chosen_handler.process_request(req)
  File "/usr/lib/python2.3/site-packages/TracWebAdmin-0.1.2dev_r4240-py2.3.egg/webadmin/web_ui.py", line 109, in process_request
    path_info)
  File "build/bdist.linux-i686/egg/combinewiki/web_ui.py", line 60, in process_admin_request
  File "build/bdist.linux-i686/egg/combinewiki/web_ui.py", line 124, in _page_to_file
UnicodeDecodeError: 'ascii' codec can't decode byte 0xeb in position 152: ordinal not in range(128)

[Noah Kantrowitz]

Do the HTML and/or TiddlyWiki output formats work?

[sander@…]

Hello,
we got the newest version of combine wiki working now. It was a apache cache problem between version updates, sorry.