Bug 8196 - Problem Reading M3U Playlist with Unicode Generated by MediaMonkey
: Problem Reading M3U Playlist with Unicode Generated by MediaMonkey
Status: RESOLVED WONTFIX
Product: Logitech Media Server
Classification: Unclassified
Component: Scanner
: 7.4.0
: PC Windows XP
: -- enhancement with 1 vote (vote)
: Future
Assigned To: Andy Grundman
: charset_issues
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2008-05-19 14:27 UTC by APB
Modified: 2011-02-17 06:22 UTC (History)
5 users (show)

See Also:
Category: ---


Attachments
The playlist with unicode characters (8.47 KB, audio/mpegurl)
2008-05-19 14:50 UTC, APB
Details
playlist that can't be read because of unicode characters. (23.84 KB, application/octet-stream)
2008-09-03 23:35 UTC, APB
Details
Windows Failure (12.02 KB, image/png)
2008-12-16 13:32 UTC, James Richardson
Details
MAC Success (12.47 KB, image/png)
2008-12-16 13:32 UTC, James Richardson
Details
Minimal test playlist with unicode characters. (1.51 KB, application/octet-stream)
2008-12-16 20:46 UTC, APB
Details
Zipped (highly compressed) music files with unicode characters (deleted)
2008-12-16 20:53 UTC, APB
Details

Note You need to log in before you can comment on or make changes to this bug.
Description APB 2008-05-19 14:27:17 UTC
I have an issue with Squeeze Center not being able to read playlists with unicode characters generated by MediaMonkey.

************************************************** *********

The error I in the scanner log looks like:

08-05-19 13:48:53.4119] Slim::Formats::Playlists::Base::playlistEntryIsVal id (122) Warning: file:///C:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/08%20Slavonic%20Dances%20Op.46%20No.8%20-%20Furiant-%20Presto.wav found in playlist:
file:///C:/music/playlists/Whimsical.m3u doesn't exist on disk - skipping!

************************************************** **********

The relevant part of the playlist looks like:

#EXTINFUTF8:247,Dvořák, AntonÃ*n; Chamber Orchestra of Europe; Harnoncourt, Nikolaus - Slavonic Dances, Op.46: No.8. Furiant: Presto
#EXTINF:247,Dvorák, Antonín; Chamber Orchestra of Europe; Harnoncourt, Nikolaus - Slavonic Dances, Op.46: No.8. Furiant: Presto
#UTF8:..\wav\Dvořák, AntonÃ*n (1841-1904)\Dvořák - Slavonic Dances Op.46 & 72\08 Slavonic Dances Op.46 No.8 - Furiant- Presto.wav
..\wav\Dvorák, Antonín (1841-1904)\Dvorák - Slavonic Dances Op.46 & 72\08 Slavonic Dances Op.46 No.8 - Furiant- Presto.wav



The actual path should be:
..\wav\Dvořák, Antonín (1841-1904)\Dvořák - Slavonic Dances Op.46 & 72\08 Slavonic Dances Op.46 No.8 - Furiant- Presto.wav


Anyone know how to fix this? Many of my music files contain unicode characters, and this is causing much pain 8-(.

Btw, I'm using Squeeze Center 7.0.1.
Comment 1 APB 2008-05-19 14:50:52 UTC
Created attachment 3360 [details]
The playlist with unicode characters
Comment 2 James Richardson 2008-05-19 15:17:50 UTC
QA to investigate
Comment 3 Sébastien Phélep 2008-06-14 09:47:59 UTC
Same problem with SC 7.0.1 on both MacOS and Linux.
Comment 4 Sébastien Phélep 2008-06-14 09:50:25 UTC
(In reply to comment #3)
> Same problem with SC 7.0.1 on both MacOS and Linux.
> 

Playlists have been generated (exported to .m3u files) by MusicIP 1.8 running on MacOS.
Comment 5 Chris Owens 2008-06-19 10:50:24 UTC
This is a reminder that this bug is to QA for 7.1.  Please review these bugs!
Comment 6 James Richardson 2008-08-05 22:58:12 UTC
Andy: is this a problem with MusicIP or some other issue?
Comment 7 Andy Grundman 2008-08-06 06:50:17 UTC
It's likely a bug in our playlist handling, can QA reproduce?
Comment 8 James Richardson 2008-08-06 09:01:35 UTC
I have not been able to reproduce this error with either the attached playlist, or ones I have created with UTF-8 characters.

Please download and test 7.2 located at: http://downloads.slimdevices.com/nightly/latest/7.2/

If you still see the issue, please post your results here.
Comment 9 Blackketter Dean 2008-08-06 12:17:17 UTC
Please reopen the bug if it's still reproduceable in 7.2.
Comment 10 APB 2008-09-03 23:33:48 UTC
I still can't get it to read files with unicode characters. I created a new playlist and no results. Even worse, the playlist name Dvořák.m3u gets read and displayed in Squeeze Center 7.2 as "DVOK~1".


Here is the output from the scanner:

	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2069] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/05%20Slavonic%20Dances%20Op.46%20No.5%20-%20Skocn%E1-%20Allegro%20vivace.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2098] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/06%20Slavonic%20Dances%20Op.46%20No.6%20-%20Sousedsk%E1-%20Allegretto%20scherzando.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2119] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/07%20Slavonic%20Dances%20Op.46%20No.7%20-%20Skocn%E1-%20Allegro%20assai.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2143] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/08%20Slavonic%20Dances%20Op.46%20No.8%20-%20Furiant-%20Presto.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2176] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/09%20Slavonic%20Dances%20Op.72%20No.1%20-%20Odzemek-%20Molto%20vivace.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2198] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/10%20Slavonic%20Dances%20Op.72%20No.2%20-%20Starod%E1vn%FD-%20Allegretto%20grazioso.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2221] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/11%20Slavonic%20Dances%20Op.72%20No.3%20-%20Skocn%E1-%20Allegro.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2244] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/12%20Slavonic%20Dances%20Op.72%20No.4%20-%20Dumka-%20Allegretto%20grazioso.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2269] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/13%20Slavonic%20Dances%20Op.72%20No.5%20-%20Spacirka-%20Poco%20adagio.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2298] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/14%20Slavonic%20Dances%20Op.72%20No.6%20-%20Starod%E1vn%FD-%20Moderato,%20quasi%20minuetto.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2320] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/15%20Slavonic%20Dances%20Op.72%20No.7%20-%20Srbske%20Kolo-%20Allegro%20vivace.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2343] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/16%20Slavonic%20Dances%20Op.72%20No.8%20-%20Sousedsk%E1-%20Lento%20grazioso,%20quasi%20tempo%20di%20valse.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2363] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/01%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Moderato.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2384] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/02%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Tempo%20di%20Valse.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2404] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/03%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Scherzo%20(Vivace).wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2425] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/04%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Larghetto.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2447] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/05%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Finale.%20Allegro%20vivace.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2469] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/06%20Serenade%20in%20D%20minor%20for%20Wind%20Ensemple%20op%2044%20-%20Moderato%20quasi%20marcia.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2489] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/07%20Serenade%20in%20D%20minor%20for%20Wind%20Ensemple%20op%2044%20-%20Menuetto%20e%20Trio.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2509] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/08%20Serenade%20in%20D%20minor%20for%20Wind%20Ensemple%20op%2044%20-%20Andante%20con%20moto.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2537] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Complete%20Symphonic%20Poems%20(CD%202%20of%202)/03%20The%20Hero%27s%20Song,%20Symphonic%20Poem%20Op.111.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2558] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Complete%20Symphonic%20Poems%20(CD%201%20of%202)/01%20My%20Home,%20Overture%20Op.62.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:29.2581] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Complete%20Symphonic%20Poems%20(CD%201%20of%202)/03%20The%20Golden%20Spinning%20Wheel,%20Symphonic%20Poem%20Op.109.wav found in playlist:
	file:///E:/music/playlists/DVOK~1.M3U doesn't exist on disk - skipping!
[08-09-04 01:23:30.1528] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/08%20Slavonic%20Dances%20Op.46%20No.8%20-%20Furiant-%20Presto.wav found in playlist:
	file:///E:/music/playlists/Whimsical.m3u doesn't exist on disk - skipping!


I'll add the m3u file next.
Comment 11 APB 2008-09-03 23:35:55 UTC
Created attachment 3941 [details]
playlist that can't be read because of unicode characters.
Comment 12 James Richardson 2008-09-04 09:20:02 UTC
Michael: Any comments?
Comment 13 Michael Herger 2008-09-23 03:00:22 UTC
QA - can you reproduce this issue? I'm having troubles with the Dvorak.m3u file: I can't even rename or delete(!) it in Windows, nor open with some text editor (pspad). There must be more to this filename than just the accented "a".
Comment 14 Michael Herger 2008-09-23 03:02:40 UTC
Heh... Windows Explorer can handle it, but none of the other apps I've tried (random selection: Powerdesk, PSPad, mp3tag, WinZip). Don't know what's wrong with it.
Comment 15 APB 2008-09-23 18:34:34 UTC
>>> There must be more to this filename than just the accented "a".

The r with the circumflex-like mark in "Dvořák.m3u" is the 
only real unicode character in the file name. I am able to open, edit
in wordpad, rename and delete the original file on my computer.
Comment 16 Michael Herger 2008-09-24 05:35:17 UTC
Tony - you created that playlist using MediaMonkey, didn't you? What's your Windows' language?

QA - can you handle this latest file (dvorak.m3u)? Open, edit etc. in some playlist manager or tagger?
Comment 17 APB 2008-09-24 19:59:25 UTC
I'm using Windows Vista Ultimate 64bit with Service Pack 1. English is the default language and there are no language packs installed.

Just a note, I regenerated the file and named it just Dvorak.m3u with no unicode or special characters in the playlist title (but many unicode characters in the music file names) and I still get the exactly the same problem as described in my initial bug report. So it looks like there are 2 issues:

1. Scanning .m3u files generated by Media monkey where there are unicode characters in the file names of the music files causes the files not to scanned with the following error message:

[08-09-24 21:51:37.5826] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/02%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Tempo%20di%20Valse.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!

2. .m3u files with unicode characters in the file name of the playlist itself is not displayed properly. For instance Dvořák.m3u shows up as DVOK~1 in the SqueezeCenter playlist listing.


Comment 18 APB 2008-09-24 20:04:52 UTC
Also, I'm currently using MediaMonkey 3.0.4.1185 to do all my playlist generations.
Comment 19 James Richardson 2008-10-01 13:10:00 UTC
Tested with SC 7.2.1-23353 on MAC OSX and Windows Vista, both were able to import and read/edit the play lists as attached to this bug.

Please re-test with 7.2.1-23353 or later.
Comment 20 James Richardson 2008-10-01 15:46:16 UTC
Possible duplicate of bug 4578
Comment 21 Chris Owens 2008-10-02 15:25:53 UTC
So what James is saying is we think this has now been fixed, possibly as a side-effect of some other bug.

Please let us know if 7.2.1 beta (or release when it's available) does indeed fix this problem.
Comment 22 James Richardson 2008-10-09 10:18:55 UTC
Marking this bug as FIXED for 7.2.1, please re-test with that version, if you still see the issue please reopen the bug and add your comments.
Comment 23 APB 2008-10-29 21:04:50 UTC
Exact same behavior in 7.2.1 as in my original description of the problem. Absolutely no change.
Comment 24 James Richardson 2008-11-05 11:43:05 UTC
Will investigate post 7.3.1
Comment 25 James Richardson 2008-12-12 12:32:41 UTC
Mac OSX 10.5 -- works

Windows XP -- fails

Windows Vista -- fails

Comment 26 James Richardson 2008-12-15 10:30:55 UTC
James to check with tomorrows 7.3.1 buils
Comment 27 James Richardson 2008-12-16 13:31:00 UTC
Tested with 7.3.1 r24324

Windows still fails
MAC still works

Both English Language

See attached images
Comment 28 James Richardson 2008-12-16 13:32:20 UTC
Created attachment 4459 [details]
Windows Failure
Comment 29 James Richardson 2008-12-16 13:32:51 UTC
Created attachment 4460 [details]
MAC Success
Comment 30 APB 2008-12-16 20:43:41 UTC
Just to let you know I've tested this out with 7.3 and am experiencing both issues unchanged. It looks like you've managed to reproduce one issue. I'll attach one more m3u along with the music files that the scanner misses, hopefully this will allow you to track down the other issue.
Comment 31 APB 2008-12-16 20:46:17 UTC
Created attachment 4463 [details]
Minimal test playlist with unicode characters.
Comment 32 Michael Herger 2008-12-17 01:10:03 UTC
Tony - in MediaMonkey there's an option to save playlists as utf8 or not. What is it set to on your system? What if you used the other setting?
Comment 33 Michael Herger 2008-12-17 01:13:06 UTC
As for the "DVOK~1": this is very likely the "short name" (aka 8.3 name) of your playlist file. There's a limitation in some of Perl's file system access functions causing this. We'll have to investigate a work around for this (see https://bugs-archive.lyrion.org/show_bug.cgi?id=10009#c13 ).
Comment 34 APB 2008-12-17 07:18:59 UTC
I've always had the UTF-8 option selected in MediaMonkey. You can tell since all my m3u's posted to this bug have #UTF8 lines in them when viewed as plain text. I just turned off the option and resaved a playlist. I verified that the playlist does not have the #UTF8 lines and tried a rescan. This didn't help and I got exactly the same error messages.
Comment 35 James Richardson 2008-12-17 07:47:53 UTC
(In reply to comment #33)
> As for the "DVOK~1": this is very likely the "short name" (aka 8.3 name) of
> your playlist file. There's a limitation in some of Perl's file system access
> functions causing this. We'll have to investigate a work around for this (see
> https://bugs-archive.lyrion.org/show_bug.cgi?id=10009#c13 ).
> 

The file name is "" Dvořák.m3u ""
Comment 36 Michael Herger 2008-12-17 08:19:25 UTC
Ok, some notes for myself. We have two issues here: 

1. "crippled" playlist name
2. playlist items can't be read

The reason the mentioned utf8 option doesn't make a change is because it doesn't influence the way the file path is stored in the playlist. But MM will simply add its proprietary #EXTINFUTF8 and #UTF8 comments. #EXTINF and the file path itself will still be cp1250 (or whatever Windows uses).
Comment 37 APB 2008-12-17 09:33:20 UTC
(In reply to comment #36)
But MM will
> simply add its proprietary #EXTINFUTF8 and #UTF8 comments. #EXTINF and the file
> path itself will still be cp1250 (or whatever Windows uses).


Does SqueezeCenter support m3u8 files? If so, in a worse case situation, I can try to write my own converter from MM m3u to generic m3u8. Given the popularity of MM though, a bit of extra support for the MediaMonkey-specific UTF-8 comments would certainly be handy.



Comment 38 Michael Herger 2009-01-06 00:51:00 UTC
reading .m3u8 isn't supported so far. Changing this bug to an enhancement to be discussed for future inclusion.

The file name issue should be covered by bug 10361
Comment 39 APB 2009-01-06 20:25:11 UTC
So does this mean there is currently no possible mechanism for reading play lists with unicode characters? If so, that would be a pretty major oversight.
Comment 40 Michael Herger 2009-01-06 23:45:13 UTC
> So does this mean there is currently no possible mechanism for reading play
> lists with unicode characters? 

Sure we do. The problem is that MM isn't storing the file path as utf8, but is _always_ using cp1255 (see my comment #36). It only stores additional proprietary comments in utf8. But we don't parse comments.
Comment 41 APB 2009-01-07 01:00:55 UTC
(In reply to comment #40)
> > So does this mean there is currently no possible mechanism for reading play
> > lists with unicode characters? 
> 
> Sure we do. The problem is that MM isn't storing the file path as utf8, but is
> _always_ using cp1255 (see my comment #36). It only stores additional
> proprietary comments in utf8. But we don't parse comments.
> 

I thought the spec for m3u stated an encoding scheme that is *not* unicode? Is it a version of non-standard m3u's that you support? Do you have any documentation or a spec that you could point me to please?
Comment 42 Michael Herger 2009-01-07 01:30:48 UTC
> I thought the spec for m3u stated an encoding scheme that is *not* unicode? Is
> it a version of non-standard m3u's that you support? Do you have any
> documentation or a spec that you could point me to please?

As we can't rely on standards (too many applications don't follow them) we use whatever is there. If a .m3u is utf8, we'll use it, whether it's standard conform or not. But the .m3u files created by MM are _not_ utf8, but cp1255.
Comment 43 APB 2009-01-07 01:59:29 UTC
(In reply to comment #42)
> > I thought the spec for m3u stated an encoding scheme that is *not* unicode? Is
> > it a version of non-standard m3u's that you support? Do you have any
> > documentation or a spec that you could point me to please?
> 
> As we can't rely on standards (too many applications don't follow them) we use
> whatever is there. If a .m3u is utf8, we'll use it, whether it's standard
> conform or not. But the .m3u files created by MM are _not_ utf8, but cp1255.
> 

Great thanks for the info! That was the missing piece of information that was preventing me from writing my own MM-specific m3u to SC-specific m3u converter. I just wish someone could have mentioned it 7 months ago when I opened the bug 8-).
Comment 44 James Richardson 2009-01-07 14:09:39 UTC
Tony: Can we close this bug now? do you have a solution to the specific issue in mind?
Comment 45 Michael Herger 2009-01-08 00:30:42 UTC
James - no, we still have an issue reading wide characters on Windows. I doubt this will be fixed in 7.3.2 though. That's why I've removed the target (which you added again later :-)). 

This bug here might very well be related to bug 7966: Perl has fundamental problems handling wide characters in file names on _Windows_ (only!). We'll probably have to add some very Windows specific code to fix this issue. See also bug 10361.

I'd target this for 7.4/8. I'm trying to come up with a proposal in the next few days.
Comment 46 Michael Herger 2009-01-08 03:45:13 UTC
change 24558 - create full file name from Windows' short version when guessing title from playlist name.

This should fix the mangled playlist name issue
Comment 47 James Richardson 2009-06-17 09:35:12 UTC
This bug has been fixed in the 7.3.3 release version of SqueezeCenter!

If you haven't already. please download the new version from http://www.logitechsqueezebox.com/support/download-squeezecenter.html 

If you are still experiencing this problem, feel free to reopen the bug with your new comments and we'll have another look.
Comment 48 APB 2009-10-01 08:06:12 UTC
I'd just like to state the the original 2 bugs exist:

 1. Squeeze Center can't read utf8 files generated be Media Monkey. In comment 42 you state that SqueezeCenter reads whatever is there, yet Media Monkey is "there" and producing utf8 files that SqueezeCenter won't parse. It may be a proprietary format, yet it is one that makes sense and the other formats of UTF8 file that you do parse are proprietary as well since the don't conform to the standards. Can we finally get support for MediaMonkey UTF8 files?
 
  2. The playlist Dvořák.m3u shows up as Dvorak in the playlist. What happened to the accent characters? Every other web site that I browse to is able to display the correct accent characters. See: http://en.wikipedia.org/wiki/Anton%C3%ADn_Dvo%C5%99%C3%A1k


********************************************************************************

[09-10-01 09:45:23.7809] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/14%20Slavonic%20Dances%20Op.72%20No.6%20-%20Starod%E1vn%FD-%20Moderato,%20quasi%20minuetto.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7833] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/15%20Slavonic%20Dances%20Op.72%20No.7%20-%20Srbske%20Kolo-%20Allegro%20vivace.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7851] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Slavonic%20Dances%20Op.46%20&%2072/16%20Slavonic%20Dances%20Op.72%20No.8%20-%20Sousedsk%E1-%20Lento%20grazioso,%20quasi%20tempo%20di%20valse.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7868] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/01%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Moderato.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7887] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/02%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Tempo%20di%20Valse.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7905] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/03%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Scherzo%20(Vivace).wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7930] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/04%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Larghetto.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7949] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/05%20Serenade%20in%20E%20major%20for%20String%20Orchestra%20op%2022%20%20-%20Finale.%20Allegro%20vivace.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7965] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/06%20Serenade%20in%20D%20minor%20for%20Wind%20Ensemple%20op%2044%20-%20Moderato%20quasi%20marcia.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7981] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/07%20Serenade%20in%20D%20minor%20for%20Wind%20Ensemple%20op%2044%20-%20Menuetto%20e%20Trio.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.7998] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Serenades/08%20Serenade%20in%20D%20minor%20for%20Wind%20Ensemple%20op%2044%20-%20Andante%20con%20moto.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.8019] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Complete%20Symphonic%20Poems%20(CD%202%20of%202)/03%20The%20Hero%27s%20Song,%20Symphonic%20Poem%20Op.111.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.8036] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Complete%20Symphonic%20Poems%20(CD%201%20of%202)/01%20My%20Home,%20Overture%20Op.62.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
[09-10-01 09:45:23.8053] Slim::Formats::Playlists::Base::playlistEntryIsValid (120) Warning: file:///E:/music/wav/Dvor%E1k,%20Anton%EDn%20(1841-1904)/Dvor%E1k%20-%20Complete%20Symphonic%20Poems%20(CD%201%20of%202)/03%20The%20Golden%20Spinning%20Wheel,%20Symphonic%20Poem%20Op.109.wav found in playlist:
	file:///E:/music/playlists/Dvorak.m3u doesn't exist on disk - skipping!
Comment 49 Michael Herger 2009-10-05 13:10:11 UTC
Is this still an issue at all? We've changed quite a bit how we handle  
filenames when reading playlists. ABP - can you still reproduce this with  
7.4?
Comment 50 Jon Keane 2010-12-02 22:05:29 UTC
(In reply to comment #49)
> Is this still an issue at all? We've changed quite a bit how we handle  
> filenames when reading playlists. ABP - can you still reproduce this with  
> 7.4?

I'm having a similar, if not the same issue on 7.5.1:


[10-12-02 23:41:15.2917] Slim::Utils::Scanner::scanDirectory (333) Scanning: /foo/Shostakovich.m3u
[10-12-02 23:41:15.7416] Slim::Formats::Playlists::parseList (85) Error: While running $playlistClass->read(): [Cannot decode string with wide characters at /usr/lib/perl/5.10/Encode.pm line 174, <GEN12> line 72.
Comment 51 Dave Syer 2011-02-17 05:35:50 UTC
This is a major issue for me with Slim Server 7.5.3 (r38185), which is pretty up to date I think.  I can't see any reason why the server can't be fixed.  Please can we bump the priority on this?  Or please advise if I have a different issue that needs to be reported separately (or is a duplicate of another).

For me the problem is with file and directory names, not necessarily playlists and meta tags.  If I rename a directory (and all files it contains if necessary) with a special character in it and rescan changes it plays just fine.  Otherwise the server craps out with an error if you try to play a track from such a directory.  The error doesn't show up in any server logs as far as I can tell, but shows on the screen of a player.

The server shows the correct characters from the meta tags and will play the tracks just fine once the file names are "clean".
Comment 52 Andy Grundman 2011-02-17 06:22:11 UTC
MediaMonkey 3.x writes bad M3U files.  Version 4 will support m3u8: http://www.ventismedia.com/mantis/view.php?id=4242

So this is a won't fix, we won't support the hackish 3.x format.