Subj : Re: Changes in golded+ sources
To   : Nicholas Boel
From : Vitaliy Aksyonov
Date : Sun Nov 05 2023 07:31 pm

Привет, Nicholas!

05 Nov 23 19:03, ты писал(а) мне:

 VA>> Hi. Yes. "Zero conversion" change broke it. Anyway it's used
 VA>> incorrectly now. Because in the code GoldED uses level from
 VA>> conversion table, but it has nothing to do with charset level
 VA>> itself.

 VA>> I'm still working on encoding conversions code and will do more
 VA>> changes. I will try to restore that behavior for backward
 VA>> compatibility.

 NB> Thank you!

My plan is to enhance conversion code which uses iconv in linux builds. And then you won't need any translation tables for charsets known by iconv. It will take some time, because changes are not so small.

 VA>> Just in case - you understand, that GoldEd can't properly work
 VA>> with UTF-8 local charset if any international character used?

 NB> Do you have any examples?

GoldEd charset translation code can translate one byte encodings to multibyte, but not the opposite.

So if you write your message in CP437 and export it to UTF-8 - it will work fine if such translation table exists.
Now imagine that your local charset is CP437 and message is in UTF-8. That won't work because translation tables size is only 256 bytes and UTF-8 code may have up to 6 bytes per code point.

 NB> As I mentioned, I'm using Golded with tmux, and besides CP437 ANSI or
 NB> 'high ascii' characters (which is a little better when I use
 NB> 'xlatimport CP437', I'm seeing characters like cyrillic, umlauts,
 NB> dieresis, etc just fine. Granted, once you get into Chinese or
 NB> Japanese, there may be issues. But I haven't seen much if any of that
 NB> in Fidonet, so I'm not too worried about it. When posting using an
 NB> external editor, I am only limited to what the font I use actually
 NB> supports. Otherwise I can write the previously mentioned things just
 NB> fine as well.

External editor solves some issues, but not all. Would be cool to have UTF-8 used for internal string representation, but that's huge work.

What is your XLatLocalSet, XLatImport, XLatExport?

Best regards,
Vitaliy Aksyonov.

--- GoldED+/LNX 1.1.5-b20231030
 * Origin: Aurora, Colorado (1:104/117)

.