descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
Moderators: XnTriq, helmut, xnview, Dreamer
-
- Posts: 11
- Joined: Sun Oct 13, 2019 6:44 pm
descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
I'm under Japan Windows and I have a folder with Simplified Chinese "蓝" where does not in JP fonts.
When I edit the description (by ctrl-d) of this folder, in descript.ion it shows "xx?xx" instead of "xx蓝xx", and cannot be showed in XnView MP.
When I edit the description (by ctrl-d) of this folder, in descript.ion it shows "xx?xx" instead of "xx蓝xx", and cannot be showed in XnView MP.
-
- Author of XnView
- Posts: 39392
- Joined: Mon Oct 13, 2003 7:31 am
- Location: France
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
by default, descript.ion doesn't use unicode, please create a descript.ion text file and save it as unicode...
Pierre.
-
- Moderator
- Posts: 8693
- Joined: Sun Oct 12, 2003 6:47 pm
- Location: Frankfurt, Germany
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
Hmm, I thought the big advantage of XnView MP compared to XnView Classic is its Unicode support. For descriptions (files) Unicode should be also supported, I think.
-
- Moderator & Librarian
- Posts: 6171
- Joined: Sun Sep 25, 2005 3:00 am
- Location: Ref Desk
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
My findings (so far):
xnview wrote: ↑Thu Oct 29, 2020 2:14 pmThis setting is for embedded comment.
By default, if descript.ion doesn't exist, ansi is used. You can force UTF8 by editingfrom xnview.iniCode: Select all
useUtf8ForDescription=true
- XnView Forum
- XnView Bug Tracker
- 0001399: Setting to create descript.ion in UTF8
- JP Software
- 4DOS/4NT Technical Note: Using DESCRIPT.ION
- Optima SC
-
- Moderator
- Posts: 8693
- Joined: Sun Oct 12, 2003 6:47 pm
- Location: Frankfurt, Germany
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
Thank you for your gathering valuable links and info, XnTriq.
This setting sounds very promising. AFAIK, UTF-8 has partial ASCII compatibility, so I wonder why UTF-8 isn't activated by default and why this should break compatibility. The way it is now (UTF-8 disabled) is pretty useless for many Asian users.
Code: Select all
useUtf8ForDescription=true
-
- Moderator & Librarian
- Posts: 6171
- Joined: Sun Sep 25, 2005 3:00 am
- Location: Ref Desk
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
Pierre's remarks on UTF-8 with BOM:
I'm assuming he refers to iptc.def and/or iptc.ini in this case.
https://en.wikipedia.org/wiki/UTF-8#Byte_order_mark wrote:If the UTF-16 Unicode byte order mark (BOM, U+FEFF) character is at the start of a UTF-8 file, the first three bytes will be 0xEF, 0xBB, 0xBF.
The Unicode Standard neither requires nor recommends the use of the BOM for UTF-8, but warns that it may be encountered at the start of a file trans-coded from another encoding. While ASCII text encoded using UTF-8 is backward compatible with ASCII, this is not true when Unicode Standard recommendations are ignored and a BOM is added. A BOM can confuse software that isn't prepared for it but can otherwise accept UTF-8, e.g. programming languages that permit non-ASCII bytes in string literals but not at the start of the file. Nevertheless, there was and still is software that always inserts a BOM when writing UTF-8, and refuses to correctly interpret UTF-8 unless the first character is a BOM (or the file only contains ASCII).
-
- Author of XnView
- Posts: 39392
- Joined: Mon Oct 13, 2003 7:31 am
- Location: France
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
it's to be compatible with old description file used by others apps
Pierre.
-
- Moderator
- Posts: 8693
- Joined: Sun Oct 12, 2003 6:47 pm
- Location: Frankfurt, Germany
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
O.k.. But couldn't there be a smart logic in XnView that recognizes if the user uses non-ASCII characters in the description and then saves description in UTF-8? There could be a message telling that description saved in UTF-8 might not be readable by older or other software but I guess most users won't care because they don't use other software than XnView for reading description files.
-
- Posts: 11
- Joined: Sun Oct 13, 2019 6:44 pm
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
That's right. Why I need to switch from XnView Classic to XnView MP? Because I want to build a totally Unicode environment. I don't care about the other apps which cannot handle Unicode, because I will also leave them.helmut wrote: ↑Wed Jul 27, 2022 8:19 pmO.k.. But couldn't there be a smart logic in XnView that recognizes if the user uses non-ASCII characters in the description and then saves description in UTF-8? There could be a message telling that description saved in UTF-8 might not be readable by older or other software but I guess most users won't care because they don't use other software than XnView for reading description files.
Unicode support is one of the most important selling points of XnView MP. XnView official page says "Compared to XnView Classic: World-Wide compatible. XnView MP offers Unicode support. Enhanced translations for many languages as well as a brand new and convenient modular interface." Make Unicode default like what OS does.
You still can leave the option for the non-Unicode app users. If they turn off Unicode, note them "The description/filename/folder name/content in zip file contains Unicode characters, please edit again" every time they type any Unicode char.
-
- Author of XnView
- Posts: 39392
- Joined: Mon Oct 13, 2003 7:31 am
- Location: France
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
do you have tried
Code: Select all
useUtf8ForDescription=true
Pierre.
-
- Posts: 11
- Joined: Sun Oct 13, 2019 6:44 pm
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
It "basically" works.xnview wrote: ↑Thu Jul 28, 2022 7:56 amdo you have tried?Code: Select all
useUtf8ForDescription=true
The problem is that even I use
Code: Select all
useUtf8ForDescription=true
-
- Author of XnView
- Posts: 39392
- Joined: Mon Oct 13, 2003 7:31 am
- Location: France
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
yes for compatibility
Pierre.
-
- Moderator
- Posts: 8693
- Joined: Sun Oct 12, 2003 6:47 pm
- Location: Frankfurt, Germany
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
If compatibility restricts users and usage that's no good. Perhaps an additional setting
Code: Select all
forceUtf8ForDescription=true
And XnView MP's default for setting "useUtf8ForDescription" should be "true" so that new users really benefit from UTF-8 and are not restricted.
From my point of view, software should be smart and support user in best way. As written in a post above there could be warning message whenever user uses UTF-8 characters and/or overwrites a non-UTF-8 description file. The way it is now is cumbersome.
-
- Author of XnView
- Posts: 39392
- Joined: Mon Oct 13, 2003 7:31 am
- Location: France
-
- Author of XnView
- Posts: 39392
- Joined: Mon Oct 13, 2003 7:31 am
- Location: France
Re: descript.ion does not support unicode, Version 1.0 64bits (Apr 28 2022)
See issue for current status and some details.
Pierre.