Bug 9659 - Character set issue in progress status of music scan
: Character set issue in progress status of music scan
Status: NEW
Product: Logitech Media Server
Classification: Unclassified
Component: Display
: 7.3.0
: PC Ubuntu Linux
: P5 minor with 2 votes (vote)
: 7.7.x
Assigned To: Andy Grundman
: charset_issues, perl5.10, SQLite
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2008-10-04 12:33 UTC by bitli
Modified: 2011-09-26 22:59 UTC (History)
4 users (show)

See Also:
Category: ---


Attachments
looking ok here (8.28 KB, image/png)
2008-10-06 06:16 UTC, Michael Herger
Details
save of html page file with the problem (223.30 KB, application/gzip)
2008-10-06 10:16 UTC, bitli
Details
screen shot (11.44 KB, image/jpeg)
2008-11-10 17:24 UTC, Ross Levine
Details
wrong character (3.69 KB, image/png)
2008-12-16 13:41 UTC, Ross Levine
Details
Encoding of Media::Scan progress is wrong (last line) (11.09 KB, image/png)
2011-09-26 22:59 UTC, Michael Herger
Details

Note You need to log in before you can comment on or make changes to this bug.
Description bitli 2008-10-04 12:33:19 UTC
The status page of the music scan show wrong characters on Ubuntu (utf-8) for non latin fodler / file names.  This seems related to #9430, just at a different place.

The operations are not impacted.  It is easy to reproduce if you put a non latin character in a top level folder.

Here is what is shown in page named Etat (french):

Analyse du répertoire   (1669  de  2013)   En cours d'exécution  00:02:22

/music/flac/Thèmes/Cor de Baselglia Müstair/07 La sera.flac
Comment 1 Michael Herger 2008-10-05 11:53:16 UTC
What exact build are you using? There have been changes to this behaviour in recent 7.2.1 builds.
Comment 2 bitli 2008-10-05 22:58:01 UTC
This is after 23382 but before 23398 (I am not home now, but I will check and post tonight). I update whenever there is a new update for Ubuntu, I have not found what triggered the creation of new Ubuntu kits, seems more frequent than numbered releases.
Comment 3 Michael Herger 2008-10-06 06:16:50 UTC
Created attachment 4111 [details]
looking ok here

Screenshot taken on Ubuntu 8.04. What locale are you using? Would you mind uploading a small sample file?
Comment 4 bitli 2008-10-06 08:53:33 UTC
The exact version is

Version du SqueezeCenter : 7.2.1 - 23384 @ Fri Oct 3 02:08:01 PDT 2008 - Debian - FR - utf8

The LANG is

LANG=fr_CH.UTF-8

The text I mentioned in the original report was taken from the screen (I need to figure out how to make a screenshot)

Analyse du répertoire   (1669  de  2013)   En cours d'exécution  00:02:22

/music/flac/Thèmes/Cor de Baselglia Müstair/07 La sera.flac

I may look in the patch since 23384 and see if one of them may solve the problem.

Comment 5 Michael Herger 2008-10-06 09:01:24 UTC
what browser are you using? (BTW: shouldn't this be "Baselgia" without the additional L? :-))
Comment 6 bitli 2008-10-06 10:16:25 UTC
Created attachment 4112 [details]
save of html page file with the problem

This is a Save As during the a complete idnex rebuild while the problem occured on the screen.
Comment 7 bitli 2008-10-06 10:22:14 UTC
>BTW: shouldn't this be "Baselgia" without the
>additional L? :-)
Yes.  Now this is support ! thanks

I am using 
Mozilla/5.0 (X11; U; Linux i686; fr; rv:1.9.0.3) Gecko/2008092510 Ubuntu/8.04 (hardy) Firefox/3.0.3

The system just updated to 23422, and the problem persists.I have attached a save as of the page when the problem occurred,

There is a line 
					<div id="Info0">/music/flac/Thèmes/Virtuoso Vengerov/04 Schön Rosmarin.flac</div>

in status.html

I hope this helps.


Comment 8 James Richardson 2008-11-05 12:26:47 UTC
Michael: please assign back to QA if you need us to do any further investigation on this one.
Comment 9 Michael Herger 2008-11-05 23:58:20 UTC
I'm sorry James, but I can't find any of your test results. I wasn't able to reproduce this. Are you?
Comment 10 James Richardson 2008-11-06 11:24:48 UTC
Ross: can you give this a go at reproducing the error?
Comment 11 Ross Levine 2008-11-10 17:24:32 UTC
Created attachment 4228 [details]
screen shot

I just reproduced this. Simple steps:

/music folder/Ä/large library that takes at least a few minutes to scan

Clear and rescan, then look at the scanning progress on the information tab of settings. The Ä directory shows a strange character. Possibly this is just the character the Ubuntu GUI shows when it doesn't recognize a character? I'm attaching a screen shot because I'm not describing what I'm seeing well. Note this is only reproducible while SC is scanning a directory with utf8 characters.
Comment 12 Michael Herger 2008-11-11 00:36:17 UTC
Ross - what exact server configuration (perl version, distro etc.) are you using?

Bitli/Ross - what browser are you using? I think there was an issue with Safari 2.x. 
Comment 13 Ross Levine 2008-11-11 12:12:58 UTC
SC 7.3 - 23875, Perl 5.10.0, Ubuntu 8.10. I'm using firefox 3.0.3
Comment 14 Michael Herger 2008-11-11 14:29:17 UTC
Ross - running FF3 on the same machine as squeezecenter?
Comment 15 Ross Levine 2008-11-11 14:48:55 UTC
(In reply to comment #14)
> Ross - running FF3 on the same machine as squeezecenter?
> 

Yes. Did you want me to try seeing how it looks from another machine?
Comment 16 Michael Herger 2008-11-11 14:59:55 UTC
Well... feel free to do so. Always good to have a data point. I just wanted to be sure I have all the information needed to reproduce the issue. Haven't installed Ubuntu 8.10 yet.
Comment 17 Michael Herger 2008-12-16 01:51:38 UTC
Ross - could you please give this another try. I've checked in a few more fixes to the utf8 handling.
Comment 18 Ross Levine 2008-12-16 13:41:49 UTC
Created attachment 4461 [details]
wrong character

Tried an umlaut over a lower case a, the screen shot shows what I see. It's different than it was, but still appears wrong.
Comment 19 Michael Herger 2009-01-08 02:02:51 UTC
> Tried an umlaut over a lower case a, the screen shot shows what I see. It's
> different than it was, but still appears wrong. 

How did you create that folder?

I'll have to test this on Perl 5.10
Comment 20 Ross Levine 2009-01-08 15:31:58 UTC
Using Gnome gui, created a directory and named it with an umlaut character I copied from the web. 
Comment 21 Chris Owens 2009-03-16 09:38:08 UTC
We are now planning to make a 7.3.3 release.  Please review your bugs (all marked open against 7.3.3) to see if they can be fixed in the next few weeks, or if they should be retargeted for 7.4 or future.

Thanks!
Comment 22 Michael Herger 2009-03-17 07:31:50 UTC
I'm sorry, this has to wait.
Comment 23 Michael Herger 2009-06-08 11:09:01 UTC
Andy - can't test this issue, as the filenames do not show up on the progress page any more. Is this by design?
Comment 24 Andy Grundman 2009-06-08 11:11:20 UTC
I think I left that out of the new scanner progress stuff, will see if I can add it back.
Comment 25 Andy Grundman 2009-07-29 14:40:40 UTC
Moving all SQLite-related bugs to 8.0.
Comment 26 Keith Briscoe 2009-10-07 16:46:20 UTC
I can repro this on 7.4 -- looks like the filenames are back on the scanner page.
Comment 27 Andy Grundman 2011-01-12 12:08:27 UTC
SQLite bugs need to go back to 7.6 target.
Comment 28 Keith Briscoe 2011-01-31 16:52:20 UTC
Filenames don't display during the scan progress on the 7.6 branch, so this bug is fixed there already.  If this is being targetted to 7.6, we may as well mark it fixed.
Comment 29 Andy Grundman 2011-09-19 06:25:37 UTC
Can anyone confirm if this still happens?
Comment 30 Michael Herger 2011-09-26 12:03:01 UTC
I think I've still seen it on my Linux box during the image scan. Will monitor more closely during next scan.
Comment 31 Michael Herger 2011-09-26 22:59:52 UTC
Created attachment 7481 [details]
Encoding of Media::Scan progress is wrong (last line)