Raw view could not display Unicode correctly
Forum rules
When reporting a bug, please include the following information: your XYplorer version (e.g., v27.90.0047), your Windows version (e.g., Win 11), and your screen scaling percentage (e.g., 125%). We recommend adding your Windows version and screen scaling percentage to your profile or signature. This will make debugging much easier for us.
When reporting a bug, please include the following information: your XYplorer version (e.g., v27.90.0047), your Windows version (e.g., Win 11), and your screen scaling percentage (e.g., 125%). We recommend adding your Windows version and screen scaling percentage to your profile or signature. This will make debugging much easier for us.
Raw view could not display Unicode correctly
OS Language: Chinese
Don, I guess you didn't notice this bug before because it would not repro on English or German system.
When display the first character which ASCII code >= 0x80 in the Hex view, the character could not be displayed and all following characters are missing. As well as the ASCII code view, but it's only missing from the very next line: There is a screen-shot of another hex-view app which displays the same file correctly: It treats all characters as Western European (Windows) encoding and display them using corresponding font, and that's pretty much acceptable. Because if you try to honor the Unicode or MBCS in some systems like Chinese, Japan, the two font-size width characters or one character break into two line issue will totally mess up the hex-view.
Thanks!
Don, I guess you didn't notice this bug before because it would not repro on English or German system.
When display the first character which ASCII code >= 0x80 in the Hex view, the character could not be displayed and all following characters are missing. As well as the ASCII code view, but it's only missing from the very next line: There is a screen-shot of another hex-view app which displays the same file correctly: It treats all characters as Western European (Windows) encoding and display them using corresponding font, and that's pretty much acceptable. Because if you try to honor the Unicode or MBCS in some systems like Chinese, Japan, the two font-size width characters or one character break into two line issue will totally mess up the hex-view.
Thanks!
-
admin
- Site Admin
- Posts: 64882
- Joined: 22 May 2004 16:48
- Location: Win8.1, Win10, Win11, all @100%
- Contact:
Re: Raw view could not display Unicode correctly
Interesting, thanks! I think I could fix. Only you can test it...
FAQ | XY News RSS | XY X
Re: Raw view could not display Unicode correctly
My pleasure 
Re: Raw view could not display Unicode correctly
Still repro on v8.10.0021, did not see any change...
-
admin
- Site Admin
- Posts: 64882
- Joined: 22 May 2004 16:48
- Location: Win8.1, Win10, Win11, all @100%
- Contact:
Re: Raw view could not display Unicode correctly
Wow, shocking.nf_xp wrote:Still repro on v8.10.0021, did not see any change...
Could you please post a screenshot of the first lines of any PNG file as seen with your other hex-view app. It will tell me something about the character conversions happening in China...
FAQ | XY News RSS | XY X
Re: Raw view could not display Unicode correctly
i couldn't reproduce this on a Japanese system, but I will admit there is a few problems with multibyte charsets.
- Attachments
-
- Clip.jpg (95.19 KiB) Viewed 2750 times
Re: Raw view could not display Unicode correctly
There are screenshots of the same PNG file in two different other apps:
Hope this helps.
-
admin
- Site Admin
- Posts: 64882
- Joined: 22 May 2004 16:48
- Location: Win8.1, Win10, Win11, all @100%
- Contact:
Re: Raw view could not display Unicode correctly
Thanks! I assume both are taken on a Chinese system. Looks like both apps take different strategies for certain characters (e.g. the very first character). I would prefer doing it like the second app because I think that's the more common/expected way.nf_xp wrote:There are screenshots of the same PNG file in two different other apps: Hope this helps.
Anyway, it's really a buffling problem. I tried something else. Check out next beta version...
FAQ | XY News RSS | XY X
Re: Raw view could not display Unicode correctly
It almost get fixed in the latest release, all characters are displayed in most cases 
But there are still one or two bugs. To describe them, I prepared four test files and some screenshots. Repro steps:
1. Minimize info panel (Yes, this bug is raw view visible area related, with different size, it's behavior varies.)
2. Select files like this: Looks like deselect don't reset state
Select 1, then 4, display correctly
3. Select files like this: Select 2, then 4, display correctly
4. All other selecting orders display correctly (at least the first screen)
Minor issues:
1. Display incorrectly when treat two chars as one multi-bytes char. For example, C4 E3 21 21 21 21 21 21 21 21 21 21 21 21 21 21, will display one MB char, plus 14 '!', and plus one unexpected char which comes from the last char of the previous line. The number of unexpected chars is equals to the number of MB chars.
I know you don't plan to display any MB char, so it wouldn't be a problem in the future.
2. 0xFF displays in two font-size width in Chinese system (An old issue, also found in previous versions say v8.00.0000)
But there are still one or two bugs. To describe them, I prepared four test files and some screenshots. Repro steps:
1. Minimize info panel (Yes, this bug is raw view visible area related, with different size, it's behavior varies.)
2. Select files like this: Looks like deselect don't reset state
Select 1, then 4, display correctly
3. Select files like this: Select 2, then 4, display correctly
4. All other selecting orders display correctly (at least the first screen)
Minor issues:
1. Display incorrectly when treat two chars as one multi-bytes char. For example, C4 E3 21 21 21 21 21 21 21 21 21 21 21 21 21 21, will display one MB char, plus 14 '!', and plus one unexpected char which comes from the last char of the previous line. The number of unexpected chars is equals to the number of MB chars.
I know you don't plan to display any MB char, so it wouldn't be a problem in the future.
2. 0xFF displays in two font-size width in Chinese system (An old issue, also found in previous versions say v8.00.0000)
Re: Raw view could not display Unicode correctly
Attach the test files
- Attachments
-
- test_files.part3.rar
- (256 KiB) Downloaded 131 times
-
- test_files.part2.rar
- (256 KiB) Downloaded 130 times
-
- test_files.part1.rar
- (256 KiB) Downloaded 135 times
Re: Raw view could not display Unicode correctly
Thanks!
- Attachments
-
- test_files.part4.rar
- (55.33 KiB) Downloaded 127 times
-
admin
- Site Admin
- Posts: 64882
- Joined: 22 May 2004 16:48
- Location: Win8.1, Win10, Win11, all @100%
- Contact:
Re: Raw view could not display Unicode correctly
Welcome. Next version has fix #3. Let's see...nf_xp wrote:Thanks!
FAQ | XY News RSS | XY X
-
admin
- Site Admin
- Posts: 64882
- Joined: 22 May 2004 16:48
- Location: Win8.1, Win10, Win11, all @100%
- Contact:
Re: Raw view could not display Unicode correctly
Just to be sure: the first 4 screenshots where you printed "1 correct", "2 correct" etc. in red color -- are these errors (they look like errors) or correct results??nf_xp wrote:It almost get fixed in the latest release, all characters are displayed in most cases
But there are still one or two bugs. To describe them, I prepared four test files and some screenshots.
...
FAQ | XY News RSS | XY X
Re: Raw view could not display Unicode correctly
Sorry for the wrong color, they are correct results.
-
admin
- Site Admin
- Posts: 64882
- Joined: 22 May 2004 16:48
- Location: Win8.1, Win10, Win11, all @100%
- Contact:
Re: Raw view could not display Unicode correctly
But they look different on my system: no Chinese chars here.nf_xp wrote:Sorry for the wrong color, they are correct results.
So, if I got you right, the files display correctly the first time but not after you select and unselect some lines in the raw view? Or you mean select and unselect the files themselves?
FAQ | XY News RSS | XY X
XYplorer Beta Club