Bugzilla – Bug 16662
Incorrect UTF8 encoding returned by CLI
Last modified: 2011-05-18 14:05:37 UTC
When making a CLI musicfolder query, accented characters in the response are often wrongly encoded; i.e. the response is NOT correct UTF8. Oddly, some accented characters are correctly encoded and some are not (see two examples below) Correct: the string "Dvořák" is correctly returned as "Dvo%C5%99%C3%A1k" Incorrect: the string "André" is WRONGLY returned as "Andr%C3%83%C2%89" Running on Windows XP with NTFS
Unfortunately it appears that the problem also exist on other platforms... I seem to have the same problem on a Fedora 13 server. All of the problemfiles do have accented characters. scanning is ok, but the url in the database doesn't properly translate back to the filename, which results in an server can't find file message... filelist: /mnt/data/audio/data/Flac/Sigur Rós/()/01 - Untitled #1 (Vaka).flac /mnt/data/audio/data/Flac/Sigur Rós/()/02 - Untitled #2 (Fyrsta).flac /mnt/data/audio/data/Flac/Sigur Rós/()/03 - Untitled #3 (Samskeyti).flac /mnt/data/audio/data/Flac/Sigur Rós/()/04 - Untitled #4 (Njósnavélin).flac /mnt/data/audio/data/Flac/Sigur Rós/()/05 - Untitled #5 (Álafoss).flac /mnt/data/audio/data/Flac/Sigur Rós/()/06 - Untitled #6 (E-Bow).flac /mnt/data/audio/data/Flac/Sigur Rós/()/07 - Untitled #7 (Dauðalagið).flac /mnt/data/audio/data/Flac/Sigur Rós/()/08 - Untitled #8 (Popplagið).flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/01 - Takk....flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/02 - Glósóli.flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/03 - Hoppípolla.flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/04 - Með Blóðnasir.flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/05 - Sé Lest.flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/06 - Sæglópur.flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/07 - Mílanó.flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/08 - Gong.flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/09 - Andvari.flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/10 - Svo Hljótt.flac /mnt/data/audio/data/Flac/Sigur Rós/Takk/11 - Heysátan.flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/01 - Intro.flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/02 - Svefn-G-Englar.flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/03 - Starálfur.flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/04 - Flugufrelsarinn.flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/05 - Ný Batterí.flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/06 - Hjartað Hamast (Bamm Bamm Bamm).flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/07 - Viðrar Vel Til Loftárasa.flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/08 - Olsen Olsen.flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/09 - Ágætis Byrjun.flac /mnt/data/audio/data/Flac/Sigur Rós/Ágætis Byrjun/10 - Avalon.flac /mnt/data/audio/data/Flac/Various Artists/Oorgasm 11/01 - Sigur Rós - ().flac database data: (table tracks, column url) +----------------------------------------------------------------------------------------------------------------------------------------+ | url | +----------------------------------------------------------------------------------------------------------------------------------------+ | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/()/01%20-%20Untitled%20%231%20(Vaka).flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/()/02%20-%20Untitled%20%232%20(Fyrsta).flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/()/03%20-%20Untitled%20%233%20(Samskeyti).flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/()/04%20-%20Untitled%20%234%20(Nj%C3%B3snav%C3%A9lin).flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/()/05%20-%20Untitled%20%235%20(%C3%81lafoss).flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/()/06%20-%20Untitled%20%236%20(E-Bow).flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/()/07%20-%20Untitled%20%237%20(Dau%C3%B0alagi%C3%B0).flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/()/08%20-%20Untitled%20%238%20(Popplagi%C3%B0).flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/01%20-%20Takk....flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/02%20-%20Gl%C3%B3s%C3%B3li.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/03%20-%20Hopp%C3%ADpolla.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/04%20-%20Me%C3%B0%20Bl%C3%B3%C3%B0nasir.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/05%20-%20S%C3%A9%20Lest.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/06%20-%20S%C3%A6gl%C3%B3pur.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/07%20-%20M%C3%ADlan%C3%B3.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/08%20-%20Gong.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/09%20-%20Andvari.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/10%20-%20Svo%20Hlj%C3%B3tt.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/Takk/11%20-%20Heys%C3%A1tan.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/01%20-%20Intro.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/02%20-%20Svefn-G-Englar.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/03%20-%20Star%C3%A1lfur.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/04%20-%20Flugufrelsarinn.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/05%20-%20N%C3%BD%20Batter%C3%AD.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/06%20-%20Hjarta%C3%B0%20Hamast%20(Bamm%20Bamm%20Bamm).flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/07%20-%20Vi%C3%B0rar%20Vel%20Til%20Loft%C3%A1rasa.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/08%20-%20Olsen%20Olsen.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/09%20-%20%C3%81g%C3%A6tis%20Byrjun.flac | | file:///mnt/data/audio/data/Flac/Sigur%20R%C3%B3s/%C3%81g%C3%A6tis%20Byrjun/10%20-%20Avalon.flac | | file:///mnt/data/audio/data/Flac/Various%20Artists/Oorgasm%2011/01%20-%20Sigur%20R%C3%B3s%20-%20().flac | +----------------------------------------------------------------------------------------------------------------------------------------+ I'll also add this to the bug filed...
Please try 7.6, we are cleaning up various UTF8 things in that version.
(In reply to comment #0) > Correct: the string "Dvořák" is correctly returned as "Dvo%C5%99%C3%A1k" > Incorrect: the string "André" is WRONGLY returned as "Andr%C3%83%C2%89" Interestingly, this is because the UTF-8 encoding of Dvořák will not be guessed as being 8859-1 because %99 is not a valid 8859-1 character. André however, only contains characters which, when encoded in UTF-8, has individual bytes which are all valid 8859-1 character encodings. Perl has asymetric behaviour with respect to character-set encoding which, sometimes, causes it to guess that a byte-string which contains bytes with the top bit set, is 8859-1. It could, in fact be any encoding. The work that Andy mentioned is trying to ensure that such guessing does not happen when SbS is dealing with filesystem pathnames.
(In reply to comment #2) > Please try 7.6, we are cleaning up various UTF8 things in that version. I'm now running 7.6 and the problem seems to be fixed.
What exact version are you running?
(In reply to comment #5) > What exact version are you running? I downloaded and installed squeezeboxserver-7.6.0-0.1.31564.noarch.rpm
Great, thanks for the report.
== Auto-comment from SVN commit #31566 to the slim repo by ayoung == == http://svn.slimdevices.com/slim?view=revision&revision=31566 == Fixed bug 16662: Incorrect UTF8 encoding returned by CLI bug 16683: Non-ASCII characters in file and directory names
Closing due to confirm fixed.