Bug 7966 - SqueezeCenter does not recognize wide characters if using iTunes
: SqueezeCenter does not recognize wide characters if using iTunes
Status: CLOSED FIXED
Product: Logitech Media Server
Classification: Unclassified
Component: iTunes
: 7.2.1
: PC Windows XP
: P2 normal with 2 votes (vote)
: 7.x
Assigned To: Michael Herger
: charset_issues
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2008-04-24 11:26 UTC by Julius Dauz
Modified: 2009-07-31 10:20 UTC (History)
4 users (show)

See Also:
Category: ---


Attachments
Sample non-ascii file (1.69 MB, audio/m4a)
2008-04-24 11:26 UTC, Julius Dauz
Details
File with Greek Characters, Non-Ascii (4.46 MB, audio/mpeg)
2008-11-06 11:03 UTC, Julius Dauz
Details
SqueezeCenter scanner log file (20.31 KB, application/octet-stream)
2009-01-09 19:06 UTC, gcattelino
Details
Scanner log file (27.93 KB, application/octet-stream)
2009-01-10 17:01 UTC, gcattelino
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Julius Dauz 2008-04-24 11:26:14 UTC
Created attachment 3286 [details]
Sample non-ascii file

If using the "Use iTunes" option for your music library, SqueezeCenter does not recognize files with non-ascii characters. If you do not use "Use iTunes" and just specify your music folder in Basic Settings of SC, it SqueezeCenter/Scanner will scan the songs in and you can view and play these files without issues. 

I have included a sample file from a customer that I have been working with.
Comment 1 Michael Herger 2008-04-24 23:20:39 UTC
Please test the very latest 7.0.1 release. And add some details about the configuration (OS, version, platform etc.)
Comment 2 James Richardson 2008-05-01 09:20:12 UTC
QA to investigate
Comment 3 James Richardson 2008-05-15 18:40:07 UTC
(In reply to comment #1)
> Please test the very latest 7.0.1 release. And add some details about the
> configuration (OS, version, platform etc.)
> 

Please re-test with 7.0.1 - 19705 (new release version)
Comment 4 Julius Dauz 2008-11-06 11:03:10 UTC
Created attachment 4210 [details]
File with Greek Characters, Non-Ascii
Comment 5 Julius Dauz 2008-11-06 11:07:45 UTC
Reopening bug because this does not work in SqueezeCenter 7.2.1.

I have attached a file with Greek characters. The file will not show up in the SqueezeCenter Music Library if the iTunes Integration option is selected. It will show up in the Music Library if you configure SqueezeCenter to use the Music Folder option. 

Comment 6 Michael Herger 2008-11-06 23:41:54 UTC
*** Bug 9616 has been marked as a duplicate of this bug. ***
Comment 7 Michael Herger 2008-11-06 23:43:02 UTC
More specifically than non-ascii, it's about wide characters. German umlauts, French accents etc. imho work fine. But not Greek, Chinese etc.
Comment 8 Chris Owens 2008-11-17 09:11:24 UTC
Is this an issue a customer reported?  What OS was this on?  In general, character-set issues will almost always be OS-dependent?
Comment 9 Julius Dauz 2008-11-21 15:31:22 UTC
Well, the issue wasn't reported by a customer, but I ran into it while answering a customer inquiry. The inquiry was whether or not Greek Chracters will display on a Jive. I received a file from the customer and when I was trying to configure SqueezeCenter 7.2.1 to use iTunes with that file containing Greek characters in my iTunes Library, I could not find the file in SqueezeCenter. When I configured SqueezeCenter to use a Music Folder and disabled the iTunes integration option, the file is visable and playable through SqueezeCenter. 

I informed the customer that there may be a bug in SqueezeCenter when using the iTunes integration option if your files have Greek characters in it and he expressed that in SqueezeCenter and on his SB3, he is able to see and play files with Greek characters when using the iTunes integration option.

I reopened this bug on the premise that it could be broken again with the current production build as the customer is running SqueezeCenter 7.0 on a Mac Leopard 10.5.5 machine with iTunes 8.0.1.12.

I did my test on a Windows Machine with SC 7.2.1 and iTunes 8.0.
Comment 10 James Richardson 2008-12-12 12:05:20 UTC
QA confirmed:

When attached samples are the only item in the Music Library (not iTunes) then then SC Web UI, Player UI, SBC UI will display with no issues

When attached samples are NOT in the Music Library, but are only found in iTunes Library (and iTunes is checked in SC Settings) then SC Web UI, Player UI, SBC can not display them.
Comment 11 Michael Herger 2008-12-12 14:19:35 UTC
James - what platform did you test on?
Julius - you saw it on Windows, the customer on OSX?
Comment 12 James Richardson 2008-12-12 14:55:17 UTC
(In reply to comment #11)
> James - what platform did you test on?

OSX 10.5 (English) + SC 7.3.0 24282
Comment 13 James Richardson 2008-12-12 15:03:08 UTC
Vista SP1 (English) + SC 7.3.0 24282

Also has the same issue.  One key to this bug that I found during testing, the iTunes Library has to be moved from the default Music Library folder.

I.E.
     users\james\music = SC Music Library
     users\shared\music\iTunes = iTunes Library

If the iTunes library is found IN the Music Library, then the error will not manifest, at least, it didn't for me.
Comment 14 Peter Walker 2009-01-05 19:54:04 UTC
I can confirm that spanish characters such ¿ ¡ á in the filename are not recognised but they do show up within the tags.
Comment 15 Michael Herger 2009-01-06 05:45:58 UTC
I'm sorry, but I can't reproduce this issue on OSX. I can not only read the attached two files, but a bunch of other test cases I have lying around, Chinese, Cyrillic, whatever. It just works on OSX.

But admittedly none of these are imported on Windows.

QA: you said you saw this issue on OSX. Can you confirm this?
Comment 16 Walker LaRon 2009-01-07 13:51:31 UTC
Ticket 090103-002829

Enviornment:

SqueezeCenter 7.3.1 
Windows XP
iTunes version is 8.0.2.20

Symptom:

Customer is experiencing issues with Accents in Artist, Album or Title

*****
I am having him try Beta Version of SC 7.3.2, to see if it resolves this issue.
*****


Below is his Information

I’m a new Squeezebox Duet user, and have been trying to load all my albums from iTunes into SqueezeCenter.  SqueezeCenter loaded all of my albums except nine that contain non-English characters in either the Artist or Album Title(Spanish accent mark, German umlaut, etc.). These characters are in my iTunes database, but they are rejected by SqueezeCenter.  Is this a bug?  Is there a workaround, other than removing these special characters from the Artist or Album Title in iTunes?

It would be really nice if SqueezeCenter could recognize these special characters, as this is exactly how the Album and Artist information appears on the original recording.

These albums could not be loaded to SqueezeCenter from iTunes:

Artist:  Andrés Segovia
Album:  The Segovia Collection, Vol. 4 - The Baroque Guitar

Artist:  Fiestas Patrias
Album:  Viva México! Las 20 canciones que no deben faltar en tus FIESTAS PATRIAS

Artist:  Kurt Masur: New York Philharmonic Orchestra
Album:  Dvořák: Symphony #9, Slavonic Dances

Artist:  Leon Spierer, Ernst Gröschl
Album:  Beethoven: Violin Sonatas #5 & 9

Artist:  Mariss Jansons: Oslo Philharmonic Orchestra
Album:  Dvořák: Symphony #9; Smetana: The Moldau

Artist:  Mötley Crüe
Album:  Decade of Decadence

Artist:  Mötley Crüe
Album:  Dr. Feelgood

Artist:  Motörhead
Album:  The Best Of Motörhead

Artist:  Queensrÿche
Album:  Empire

Another issue I noticed when loading my iTunes database into SqueezeCenter is that SqueezeCenter added disc notations that are not in iTunes. For example (Disc 2 of 3) is not in the iTunes album title, but is listed in the SqueezeCenter album title.  Where did SqueezeCenter get this information from?  Can I remove these extra disc notations from the SqueezeCenter album title?  How?


Albums with disc notations in SqueezeCenter, but not in iTunes:

Artist:  Itzhak Perlman; James Levine: Vienna Philharmonic Orchestra
Album:  Mozart: Violin Concertos #2 & 4 (Disc 2 0f 3)

Artist:  London Symphony Orchestra
Album:  Victoria's Secret - Classics By Request, Vol. 4 (Disc 4 of 4)

Artist:  Vladimir Horowitz
Album:  Favorite Chopin (Disc 1 of 4)


Finally, I downloaded a set of mp3 files from a live Metallica concert. The concert was almost two hours in length. The concert was split into two albums in SqueezeCenter, but not in iTunes.  It appears that SqueezeCenter can’t handle an album that’s longer than a standard CD and will split it into two albums. Once again, iTunes handles this situation correctly and SqueezeCenter doesn’t.

Artist:  Metallica
Album:  2008/12/12 Ontario, CA (Disc 1)
Album:  2008/12/12 Ontario, CA (Disc 2)
Comment 17 gcattelino 2009-01-07 22:00:28 UTC
I’m a new Squeezebox Duet user, and have been trying to load all my albums from iTunes into SqueezeCenter. SqueezeCenter loaded all of my albums except nine that contain non-English characters in either the Artist or Album Title(Spanish accent mark, German umlaut, etc.).

It would be really nice if SqueezeCenter could recognize these special characters, as this is exactly how the Album and Artist information appears on the original recording.

These albums could not be loaded to SqueezeCenter from iTunes:

Artist:  Andrés Segovia
Album:  The Segovia Collection, Vol. 4 - The Baroque Guitar

Artist:  Fiestas Patrias
Album:  Viva México! Las 20 canciones que no deben faltar en tus FIESTAS PATRIAS

Artist:  Kurt Masur: New York Philharmonic Orchestra
Album:  Dvořák: Symphony #9, Slavonic Dances

Artist:  Leon Spierer, Ernst Gröschl
Album:  Beethoven: Violin Sonatas #5 & 9

Artist:  Mariss Jansons: Oslo Philharmonic Orchestra
Album:  Dvořák: Symphony #9; Smetana: The Moldau

Artist:  Mötley Crüe
Album:  Decade of Decadence

Artist:  Mötley Crüe
Album:  Dr. Feelgood

Artist:  Motörhead
Album:  The Best Of Motörhead

Artist:  Queensrÿche
Album:  Empire
Comment 18 Michael Herger 2009-01-08 00:44:43 UTC
LaRon - is this user running SC and iTunes both on the same Windows machine? This is working fine for me. I have tons of tracks with German umlauts (obviously) as well as some other accented characters (Spanisch, French, Portuguese). Tag should scan correctly. If they don't, then this is a different issue - this bug is about non-latin stuff in filenames, not tags. Please open a new bug if your customer is seeing issues with tag values.
Comment 19 Michael Herger 2009-01-08 02:52:14 UTC
change 24555 - the fix for the missing unicode filenames actually was pretty simple: use the good old DOS style 8.3 filename on Windows instead... 

This is a fallback if all other measures fail. Please not that the tags will be read correctly. Using the short file name only can be seen in the track information menu. 

I'm closing this bug. Please reopen if you still have problems reading _files_ with non-latin characters in their _path_ or _filenames_. Do not re-open if it's about reading tags. Thanks.
Comment 20 gcattelino 2009-01-08 11:16:49 UTC
(In reply to comment #18)
> LaRon - is this user running SC and iTunes both on the same Windows machine?
> This is working fine for me. I have tons of tracks with German umlauts
> (obviously) as well as some other accented characters (Spanisch, French,
> Portuguese). Tag should scan correctly. If they don't, then this is a different
> issue - this bug is about non-latin stuff in filenames, not tags. Please open a
> new bug if your customer is seeing issues with tag values.

Yes, I'm running SqueezeCenter and iTunes on the same computer. Can I provide any log files or any other information that would help to determine why these albums aren't able to load into SqueezeCenter?
Comment 21 Michael Herger 2009-01-08 12:25:09 UTC
> Yes, I'm running SqueezeCenter and iTunes on the same computer. Can I provide
> any log files or any other information that would help to determine why these
> albums aren't able to load into SqueezeCenter?

Yes, please upload scanner.log (see Settings/Information)
Comment 22 gcattelino 2009-01-09 19:06:20 UTC
Created attachment 4612 [details]
SqueezeCenter scanner log file

Here's my scanner log file. Hopefully it will show why SqueezeCenter couldn't load nine of my albums.
Comment 23 gcattelino 2009-01-09 23:32:10 UTC
(In reply to comment #22)
> Created an attachment (id=4612) [details]
> SqueezeCenter scanner log file
> Here's my scanner log file. Hopefully it will show why SqueezeCenter couldn't
> load nine of my albums.

I removed the information from the "iTunes Music Folder" and did a complete rescan. Initially, I did not see any album artwork and noticed the scan was hung during a merge operation. I tried it again, and it completed. Here's my latest results:

iTunes has 2939 songs and 211 albums (Metallica concert = 1 album)
SqueezeCenter has 2927 songs and 210 albums (Metallica concert = 2 albums)

I found the missing two ablums that did not get loaded into SqueezeCenter:

Artist:  Kurt Masur: New York Philharmonic Orchestra
Album:  Dvořák: Symphony #9, Slavonic Dances
Songs: 7

Artist:  Mariss Jansons: Oslo Philharmonic Orchestra
Album:  Dvořák: Symphony #9; Smetana: The Moldau
Songs: 5

Notice the symbol over the r in Dvořák. The ř character is part of the Checkosolvakian language. Is this character addressed in bug report 7966?
Comment 24 Michael Herger 2009-01-10 02:43:27 UTC
Re. your log: looks as if your antivirus program (McAfee?) is blocking access to our DB. Please configure it to ignore *.my* files. If in doubt please contact support. They can guide you through the procedure. This is _not_ related to iTunes import, but a very well known issue mostly with McAfee (but some others, too).

> Notice the symbol over the r in Dvořák. The ř character is part of the
> Checkosolvakian language. Is this character addressed in bug report 7966?

That's exactly what this bug is about. Do you still see the issue with the very latest nightly build?
Comment 25 gcattelino 2009-01-10 16:56:51 UTC
(In reply to comment #24)
> Re. your log: looks as if your antivirus program (McAfee?) is blocking access
> to our DB. Please configure it to ignore *.my* files. If in doubt please
> contact support. They can guide you through the procedure. This is _not_
> related to iTunes import, but a very well known issue mostly with McAfee (but
> some others, too).
> > Notice the symbol over the r in Dvořák. The ř character is part of the
> > Checkosolvakian language. Is this character addressed in bug report 7966?
> That's exactly what this bug is about. Do you still see the issue with the very
> latest nightly build?

I just installed SqueezeCenter 7.3.2-24612 and did a rescan. It worked!! I now see all of my albums in SqueezeCenter. I tried to configure my McAfee virus scan software, but am not sure if I was successful. I've uploaded my latest scan log. Please let me know if you still see the DB connection issues.
Comment 26 gcattelino 2009-01-10 17:01:07 UTC
Created attachment 4614 [details]
Scanner log file

I've attempted to configure my McAfee virus scan software to ignore *.my* files. Can you please check my latest scanner.log file to see if I'm still getting DB connection errors?  Thanks!
Comment 27 James Richardson 2009-01-22 09:58:05 UTC
Fixed - Closed Message (SC)

This bug has been fixed in the 7.3.3 release version of SqueezeCenter!

Please download the new version from http://www.slimdevices.com/su_downloads.html if you haven't already.  

If you are still experiencing this problem, feel free to reopen the bug with your new comments and we'll have another look.
Comment 28 James Richardson 2009-01-22 13:53:26 UTC
Correction: SqueezeCenter version is 7.3.2
Comment 29 Chris Owens 2009-07-31 10:20:07 UTC
Reduce number of active targets for SC