Bugzilla – Bug 1786
Problem with accented character
Last modified: 2009-09-08 09:17:40 UTC
I have a SB2 and am running the July 6th evening build of 6.1b slimserver on a Windows XP SP2 machine. I also have installed AlienBBC 0.97 and MPlayer 1.0pre7. I am using the iTunes library as the source of music & playlists. My problem is the following: Any audio file that has an accented character (for example �, � or �) anywhere in the path (i.e., "D:\My_Music\iTunes\Smetana_Dvorak\Smetana_ M� vlast_Dvorak_ Symphony No.4") shows up as "EMPTY" when browsing or searching; and crashes the server with a "Problem: Can't open file" if the song is selected from a playlist.
Created attachment 617 [details] iTunes Library
Created attachment 618 [details] Example Song
I have almost the same problem, but I'm running Slimserver on a linux dist. Server does not crash but almost always get a "Problem: Can't open file for". All directories and files with accented characters (or in my case swedish characters like � � �) are just skipped during scanning according do my debugs.
I have a similar problem, on OS X 10.3.9. The server does not crash, and I don't get any "Problem: Can't open file for" messages. The files seem to be picked up when I scan, since I can see them and add them to the playlist. The song will not play, and then be deleted from the library. That is, if I search for the songs again, they cannot be found. If the accent is in the artist name or the album name, all tracks in the heirarchy will dissappear. I had no problem with these tracks in 5.x or 6.0.2, just when I tried 6.1b2 and also when I back up to the 6.1 nightly as of July 5th (I believe - the version string is: SlimServer Version: 6.1b1 - trunk - Mac OS X 10.3.9 (7W98) - EN - utf8) I am using iTunes. I tag the files with iTunes exclusively and iTunes creates the file and directory names. Please let me know what I can do to help diagnose this (send files, etc.) Here is an example of the message in the log, when I try to play one of these tracks. 2005-07-10 10:49:28.4024 CacheItem: Checking status of file:///Users/allan/Music/iTunes/iTunes% 20Music/Farin%20Urlaub/Am%20Ende%20der%20Sonne/12%20Kein%20Zuru%CC%88ck.mp3 (TTL: 0). 2005-07-10 10:49:28.4035 deleting file:///Users/allan/Music/iTunes/iTunes%20Music/Farin% 20Urlaub/Am%20Ende%20der%20Sonne/12%20Kein%20Zuru%CC%88ck.mp3 from cache as it no longer exists 2005-07-10 10:49:42.4117 DBI: Periodic commit - 7 dirty items 2005-07-10 10:49:42.7754 cleared file:///Users/allan/Music/iTunes/iTunes%20Music/Farin% 20Urlaub/Am%20Ende%20der%20Sonne/12%20Kein%20Zuru%CC%88ck.mp3 from database 2005-07-10 10:49:42.7761 forceCommit: syncing to the database. 2005-07-10 10:49:50.0588 Scanning with 0 import plugins or 2005-07-10 10:47:23.2007 CacheItem: Checking status of file:///Users/allan/Music/iTunes/iTunes% 20Music/Farin%20Urlaub/Am%20Ende%20der%20Sonne/06%20Wie%20ich%20den%20Marilyn-Manson-A %CC%88hnlichke$ 2005-07-10 10:47:23.2026 deleting file:///Users/allan/Music/iTunes/iTunes%20Music/Farin% 20Urlaub/Am%20Ende%20der%20Sonne/06%20Wie%20ich%20den%20Marilyn-Manson-A%CC% 88hnlichkeitswettbewerb%20verlo$ 2005-07-10 10:47:23.2056 Converting file:///Users/allan/Music/iTunes/iTunes%20Music/Farin% 20Urlaub/Am%20Ende%20der%20Sonne/06%20Wie%20ich%20den%20Marilyn-Manson-A%CC% 88hnlichkeitswettbewerb%20ver$ 2005-07-10 10:47:23.2090 mp3 file type for file:///Users/allan/Music/iTunes/iTunes%20Music/Farin% 20Urlaub/Am%20Ende%20der%20Sonne/06%20Wie%20ich%20den%20Marilyn-Manson-A%CC% 88hnlichkeitswettbewer$ 2005-07-10 10:47:23.2446 CacheItem: Checking status of file:///Users/allan/Music/iTunes/iTunes% 20Music/Farin%20Urlaub/Am%20Ende%20der%20Sonne/07%20Unsichtbar.mp3 (TTL: 0). 2005-07-10 10:47:23.4610 cleared file:///Users/allan/Music/iTunes/iTunes%20Music/Farin% 20Urlaub/Am%20Ende%20der%20Sonne/06%20Wie%20ich%20den%20Marilyn-Manson-A%CC% 88hnlichkeitswettbewerb%20verlor$ 2005-07-10 10:47:23.4617 forceCommit: syncing to the database.
*** Bug 1829 has been marked as a duplicate of this bug. ***
Should we consider this for 6.1.2?
I would very much appreciate it if you could consider it for 6.1.2! I am stuck on 6.0.2 until this is fixed since many of my favorite songs & artists have "accents". Please!
Allan - can you please upgrade to 6.1.1, and let me know if it's still an issue? Thanks
I upgraded to 6.1.1 and did a full rescan (well, I deleted the database before upgrading). The files don't appear in the library at all, so at least there isn't the problem of them appearing and then disappearing when I try to play them. So, with 6.1.1, I still can't listen to my die �rzte albums...
Can you use 'Browse Music Folder' to find them? What do you see?
I don't have a music folder defined, since I used iTunes exclusively for my music source. Unless that is something that has changed with 6.1
Ok. Would you mind setting a music folder, to the same folder that your iTunes is located at? Thanks.
For those of you on Windows - can you please try the 6.2 builds? There's been some changes regarding iTunes & Windows that should help. On Linux - please make sure your LC_CTYPE is set to the correct character set. This should be the one that the files are ripped to / the machine the iTunes xml file is coming from. If it's Windows, then you might have an issue if your Linux box defaults to UTF-8
My music folder is arranged: Artist / Album / Tracks When I set up a music folder, and browse to it, the folders for "Die �rzte" or "Einst�rzende Neubauten" or "Sin�ad O'Connor" etc. do not appear. Similarly, albums with accents do not appear when I select an artist folder without an accent. If I select an artist folder and album folder without accents, the tracks with accents are missing, while the other tracks are not. I dont know if this is related, but when I start the server after deleting the database file, I get several of these messages during the rescan process: 2005-07-29 07:07:34.4074 SlimServer done start... substr outside of string at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/CPAN/MP3/Info.pm line 735, <$fh> line 1. Use of uninitialized value in multiplication (*) at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/CPAN/MP3/Info.pm line 737, <$fh> line 1. Use of uninitialized value in multiplication (*) at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/CPAN/MP3/Info.pm line 737, <$fh> line 1. Use of uninitialized value in multiplication (*) at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/CPAN/MP3/Info.pm line 737, <$fh> line 1. Use of uninitialized value in multiplication (*) at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/CPAN/MP3/Info.pm line 737, <$fh> line 1. Use of uninitialized value in length at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/CPAN/MP3/Info.pm line 748, <$fh> line 1. Size mismatch on RIFF at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/Slim/Formats/MP3.pm line 32 What is the next step???
Created attachment 680 [details] Directory dump tool Allan - can you download this tool, and using the Terminal application, run it against the the directory that contains the artist names with accented characters? From the terminal window: perl ~/Desktop/opendir.pl "~/Music/iTunes/iTunes Music" And send me the output from that? Thanks.
Created attachment 681 [details] gzipped output of opendir.pl Here is the output you requested. I gzipped it to reduce size.
Alan - can you attach your iTunes.xml file as well? Thanks.
Created attachment 683 [details] iTunes Music Librarz.xml file As requested, my iTunes Music Library.xml file.
I've checked in a few changes which might fix this. If you are using Subversion, please sync your tree. Otherwise, they'll be in the 07-30-2005 nightly build. You'll want to wipe your db and rescan. Thanks.
I tried the 7.30 nightly and I still do not see the accented tracks, artists and albums. One very intersting thing... I do see Sin�ad O'Connor, but only the tracks on compilation CDs with other artists and the compilation flag is checked in iTunes. Similarly, Die �rzte shows up in the artist list, but only the one tracks where the artist credit is shared... Again, for this track, the compilation flag is set. Output while scanning is different now. 2005-07-30 11:17:35.0334 SlimServer done start... Size mismatch on RIFF at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/Slim/Formats/MP3.pm line 32 this repeats 8 times 2005-07-30 11:39:39.0556 wipeAllData: Wiped all in-memory caches. Size mismatch on RIFF at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/Slim/Formats/MP3.pm line 32 again, 8 repeats Size mismatch on RIFF at /Library/PreferencePanes/SlimServer.prefPane/Contents/server/Slim/Music/Info.pm line 1691 repeats 4 times
Allan - can you try the recent 6.2 nightly? http://www.slimdevices.com/downloads/nightly/latest/6.2/ Thanks
When I download that one and trz to start the server, I get the following error in my slimserver.log just before it dies dyld: perl can't open library: /usr/local/lib/libfreetype.6.dylib (No such file or directory, errno = 2) So, in other words, I cant even start the server with tonights nightly
Allan - to get up and running, remove the GD.bundle and GD.pm files from the CPAN directory. I'll fix this for tomorrow's nightly.
Just tried the August 10th nightly, still not working.
Allan - I've checked in a fix for this as subversion change 3931. It will be available in the 6.2 nightlies, or if you want to sync your svn tree.
Allan - please confirm when you get a chance. I'm moving the target to 6.2, as this isn't as easily fixed in 6.1.x
Hi Dan, I just checked the 12 August 2005 8.2 nightly, and I still do not see the accented artists, albums and tracks.
OK, let me backpedal a little.... I just stopped the server, installed the iTunes Update plugin to check on bug 1625, and after restarting the server SlimServer seems to be rescanning, and now Accented artists, albums and tracks are showing up. But.... When I add songs with accents in their name or path to the playlist, they will not play.
Ok - can you send me the output of --d_source when you try and play one of those songs? And / or open up the ssh port again? Thanks.
Created attachment 768 [details] log with d_source on I haven't heard anything in a while about this, so I thought I would include the output of d_source. Hopefully it will help. An interesting point... I navigated to this album via the "browse music folder" and pressed play, adding the whole album. The first song played, but subsequent songs didn't. It is not possible to replay the first song now either, and the artist is no longer available while browsing music folder. It seems SO close!!! Also, I turned of d_source_v in the middle of the first song, since it seemed VERY verbose.
Allan - are you keeping up with the latest nightlies?
On Sept 10 I tried the nightly download. Slimserver will play the Empire album from Queensryche but will not play any other Queensryche albums or songs.
Which nightly? 6.2 or 6.1.2?
6.1.2
Please try the 6.2 nightlies.
Just uploaded the 6.2 nightly. Appears the issue is resolved.