Bugzilla – Bug 9969
Squeezecenter does not play ALAC tracks with accents in tags
Last modified: 2009-07-31 10:31:46 UTC
Ticket ref #081110-000694 **Please note that this could be related to bug 9659 or 9430*** Environment: Squeezecenter 7.2.1, Ubuntu Linux 8.10 Problem: Squeezecenter does not play ALAC tracks with accents (à, é, ö, etc.)in their tags. The Server.log fills up with the following message (ten a second): [08-11-08 15:19:32.0372] Slim::Utils::Misc::msg (1398) Warning: [15:19:32.0357] Use of uninitialized value in hash element at /usr/share/perl5/Slim/Player/Squeezebox.pm line 1215. For example, Squeezecenter does not play the tracks from the 'Zauberflöte', or 'Bleu pétrole' albums (but iTunes does).
Right... all these bugs are reported against ubuntu 8.10? do you see the same issue with eg. bitrate limiting or other transcoded streams?
Hello! I mostly have ALAC tracks, and I haven't had problems with MP3 tracks. What is bitrate limiting? How do I find out? Thank you, and regards, JC
QA to verify
Can't reproduce. I played an alac file with an ñ in the artist tag, works fine with Ubuntu 8.10. Maybe we should get a sample file? (In reply to comment #2) > What is bitrate limiting? How do I find out? From the SqueezeCenter web interface go to Settings - Player - Audio, you'll see Bitrate Limiting there. JC, are you LaRon's customer?
JC, LaRon tells me you're the customer in Ticket ref #081110-000694. Would you mind attaching a file of yours that doesn't play so I can have a look? I can't seem to reproduce this with the file I created, maybe there is something different about yours. Let me know if you need a hand, you can email me privately if you prefer.
Hello, I have sent a file to Ross via e-mail. Thank you for support, and regards, JC
Hello! 1. I have tried to reinstall SC 7.2.1 on Ubuntu 8.0 Server: SC won't start (SC died. Restarting.). 2. I have reinstalled Ubuntu 8.0 from scratch, then reinstalled SC 7.2.1: SC won't start (SC died. Restarting.) 3. I have replaced SC 7.2.1 with the current unstable SC 7.3: SC won't start (SC died. Restarting.). Starting SC-server 7.3 with --d_startup shows that the following modules fail to load: GD. By the way, SC 7.2 does not ALAC under Linux (i.e. all my music). None of the stable/testing/unstable version of squeezecenter is working here, I am at a loss, and all I would like is to listen to some music, instead of fixing software. Please assist. Regards, Jean-Charles
This is not a valid bug, I'll close it now. JC, email me back I think I can help.
Ross, The problem. Maybe the accents in the tags is not the issue, but rather the fact that the filename contains the accents. I wanted to have SC scan only the Zauberflöte directory, but the SC interface would not let me select the Zauberflöte directory. In fact, it seems that SC won't let me select directories whose names contain accentuated characters. Could you please check that hypothesis. Regards, JC
Created attachment 4327 [details] log that shows that the problem is related to SC 7.2.1
Created attachment 4329 [details] pathfromfileurl behaviour
Added log files as per Michael's request. The bug is closed though :-(
JC points out in an email to me there does seem to be an issue on line [08-11-23 12:21:19.2310], the path of the file is truncated when SC uses ALAC. Michael is this a charset_issue bug?
Ross - you had mentioned not being able to reproduce? Did you only test with an accented tag, or with a filename too? JC - are you importing iTunes .xml file? How does the filename look on that Linux box? How did you transfer it to the linux box?
Hello all, I am using the latest version of iTunes on Windows XP to manage my files. I then manually backup the files to an server running Ubuntu 8.10 using rsync. After the backup, I scan the updated files, without using the iTunes option. rsync did not change recently, with respect to accents (a backup of the files with special characters would have been huge and I would have noticed it). alac plays the files correctly from the command line, when accented characters are typed in (as "Vénus" for example). I am not in front of my Linux box right now. I am not sure about what you mean by "how does the filename look on the Linux box". Could you please be more specific and maybe give me a list of commands I could type (e.g ls -alR /iTunes > michael.txt). Thank you for your patience, and regards, JC
> ls -alR /iTunes > michael.txt That would be great. Plus a copy of what you see in Settings/Information. And if you have a GUI, whether those characters look ok in your file manager.
Hello, Here is some information about SC: Version du SqueezeCenter : 7.2.1 - 23630 @ Mon Oct 20 19:54:08 PDT 2008 - Debian - FR - utf8 Adresse IP serveur : 192.168.1.13 Version de Perl : 5.10.0 i486-linux-gnu-thread-multi Version de MySQL : 5.0.67-0ubuntu6 Architecture de la plate-forme : i686-linux Nom d'hôte : server Port serveur : 9000 Platines identifiées : 1 Here is the output of the locale command: LANG=en_US.UTF-8 LC_CTYPE="en_US.UTF-8" LC_NUMERIC="en_US.UTF-8" LC_TIME="en_US.UTF-8" LC_COLLATE="en_US.UTF-8" LC_MONETARY="en_US.UTF-8" LC_MESSAGES="en_US.UTF-8" LC_PAPER="en_US.UTF-8" LC_NAME="en_US.UTF-8" LC_ADDRESS="en_US.UTF-8" LC_TELEPHONE="en_US.UTF-8" LC_MEASUREMENT="en_US.UTF-8" LC_IDENTIFICATION="en_US.UTF-8" LC_ALL= I will send ls of a subtree of my music folder as well as an image of the corresponding SC web interface. Regards, JC
Created attachment 4340 [details] ls -alR "/music/folder/subtree/Alain Bashung/" > bug9969-ls.txt
Created attachment 4341 [details] File names with accents are truncated :-(
I don't have Gimp on this machine. Would you mind uploading a .jpg or .png? > ls -alR "/music/folder/subtree/Alain Bashung/" > bug9969-ls.txt This doesn't look good to me. Do you see those characters in the shell?
> This doesn't look good to me. Do you see those characters in the shell? yes
Created attachment 4342 [details] File names with accents are truncated :-(
> > This doesn't look good to me. Do you see those characters in the shell? > yes I meant to ask: do you see them correctly?
dj@server:~$ sudo ls -alR "/srv/iTunes/iTunes Music/Alain Bashung/" ... /srv/iTunes/iTunes Music/Alain Bashung/Bleu p?trole: total 331952 drwxr-xr-x 2 media media 4096 2008-05-10 21:08 . drwxr-xr-x 5 media media 4096 2008-05-10 21:04 .. -rw-r--r-- 1 media media 59689494 2008-05-10 21:07 Comme un l?go.m4a -rw-r--r-- 1 media media 30487986 2008-05-10 21:07 Hier ? Sousse.m4a -rw-r--r-- 1 media media 21909658 2008-05-10 21:07 Il voyage en solitaire.m4a -rw-r--r-- 1 media media 26697764 2008-05-10 21:07 Je t'ai manqu?.m4a -rw-r--r-- 1 media media 45213547 2008-05-10 21:07 Je tuerai la pianiste.m4a -rw-r--r-- 1 media media 24023752 2008-05-10 21:07 Le secret des banquises.m4a -rw-r--r-- 1 media media 23789498 2008-05-10 21:07 R?sidents de la r?publique.m4a -rw-r--r-- 1 media media 27858803 2008-05-10 21:07 Sur un trap?ze.m4a -rw-r--r-- 1 media media 24245969 2008-05-10 21:07 Suzanne.m4a -rw-r--r-- 1 media media 29972698 2008-05-10 21:07 Tant de nuits.m4a -rw-r--r-- 1 media media 25595588 2008-05-10 21:07 V?nus.m4a
Hello! The file names in my music library are (and always were) coded in ISO-8859-1. Until now it never had been a problem. Ubuntu and SqueezeCenter are (and always were) configured in UTF-8. Just to test, I have configured Ubuntu and SqueezeCenter to use ISO-8859-1: the web interface displays the file names correctly, but files whose names contain accents still do not play. I will try to provide a log about this. Regards, JC
Created attachment 4347 [details] SC using ISO-8859-1 trying to play an ISO-8859 filename as UTF-8 SC (Version du SqueezeCenter : 7.2.1 - 23630 @ Mon Oct 20 19:54:08 PDT 2008 - Debian - FR - iso-8859-1) accesses ISO-8859-1 filenames as UTF-8 filenames
Hello! I found the cause of the problem! It is the following change: http://svn.slimdevices.com/7.2/trunk/server/Slim/Player/TranscodingHelper.pm?r1=23157&r2=23382 To summarize: with the fix to bug 9488, SC is unable to play files with ISO filenames containing special characters (whether Ubuntu/SC are configured to use ISO or UTF). without the fix to bug 9488, SC is able to play files with ISO filenames containing special characters when Ubuntu/SC are configured to use UTF (but not when Ubuntu/SC are configured to use ISO). I hope you will be able to find a solution to both bugs 9488 and 9969. Please tell me if I should test a fix. In the mean time, I will be enjoying some of the music SC 7.2.1 had lost. Regards, JC
BTW Once the fix is reverted, the music plays fine. In the WUI tracks appear correctly from the DB (i.e. Music>Artist>...) but file names are truncated when seen as files (i.e. Music>Music Folder>...). Not a problem here: I do not use the Music Folder view, and I'd rather listen to my music files, than display their name ;-) JC
I still don't know whether you see umlauts and accented characters correctly on your Linux box. IMHO they're corrupted during rsync transfer.
Michael, I do not see the accents correctly on my Linux server, because the filenames are coded in ISO-8859 and my Linux server is configured in UTF-8. The filenames are not corrupted by rsync, they are simply not converted from ISO-8859 (Windows) into UTF-8 (Ubuntu). This is not a problem for Linux: shell commands work fine for example (ls "Bleu pétrole", alac -r "Vénus", etc.). This was not a problem for SC, until version 7.2.1. According to the code of TranscodingHelper, SC 7.2.1 always utf8decodes a file name, even when the file name is not UTF-8. This is the problem, IMHO. Furthermore, it seems that the WUI of SC 7.2.1 also always utf8decodes a file name in order to display it, even when the file name is not UTF-8. This is also a problem, IMHO. Finally, I remember being able to play MP3 files whose title contains an accent. I will try to reproduce and document that tonight. Regards, JC.
> I do not see the accents correctly on my Linux server, because the filenames > are coded in ISO-8859 and my Linux server is configured in UTF-8. JC - don't get me wrong. But this is too much of an edge case to be fixed on our side. We do our best to read files from the disc in whatever encoding they are. And while the internal handling of the file names is correct, it will fail when we send it back to the OS, as we know it's expecting utf8 - what we will give it. In the long term you'd be winning if you fixed the encoding issues on your system.
BTW: did you try to run SC with "--charset=iso-8859-1" instead of "--charset=utf8"? (somewhere in the squeezecenter startup script)
Michael, I had already switched Ubuntu/SC to ISO-8859-1, see comments 25 and 26: The file names display correctly, but SC 7.2.1 does not play the file. As is now obvious from the code of TranscodingHelper, and confirmed by attachment 4347 [details] in comment 26, SC always utf8decodes file names, even when SC is configured with CHARSET=ISO-8859-1. This inconsistency causes my problem, and is likely to produce similar problems on other Debian/Ubuntu boxes. In fact, to be coherent: On my box Ubuntu and SC should be configured to use ISO-8859-1 (consider it done), AND TranscodingHelper should be modified in such a way that a filename is utf8decoded under Debian/Ubuntu only if SC is configured with CHARSET=UTF-8 (and not if SC is configured with CHARSET=ISO-8859-1). I would have proposed a fix, if only I could program this language. I therefore propose you to improve the test in TranscodingHelper (i.e. currently Slim::Utils::OSDetect::isDebian()) accordingly. Thank you for your patience and understanding. Regards, JC
Reduce number of active targets for SC