Bug 11459 - browse music folder & special characters
: browse music folder & special characters
Status: CLOSED FIXED
Product: Logitech Media Server
Classification: Unclassified
Component: Database
: 7.4.0
: Other Linux (other)
: -- normal (vote)
: 7.4.0
Assigned To: Michael Herger
http://forums.slimdevices.com/showthr...
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2009-03-24 14:33 UTC by luny
Modified: 2009-10-05 14:36 UTC (History)
4 users (show)

See Also:
Category: ---


Attachments
ssods sysinfo logging (35.43 KB, text/plain)
2009-03-25 00:22 UTC, luny
Details

Note You need to log in before you can comment on or make changes to this bug.
Description luny 2009-03-24 14:33:57 UTC
Since installation of 7.4 - 24801, file names with special characters do not work anymore (é) when using the music folder browse. Both in the webinterface of the squeezecenter or on the duet, bmf doesn't show any file if I browse via "music folder" and then the folder containing the special character.

The SB3 shows the full filenames (file:///volume1.........flac) but when I press play, it says: "Problem: can't open file for...". In the log file
 is the following: Slim::Formats::readTags (161) File missing: /volume1/music/FLAC/Nils Petter Molvær - [2005] - Er/Nils Petter Molvær - Er - 01 - Hover.flac

They play fine via artist or album as they are correctly picked up by the scan. Also, if I ssh to my server, the file names looks alright and also if sftp to it.

And also if use one the offending files via artists (or any other tagged search path) If I then go to "more info" about that file and chooses to view location, the whole path including file name is correct ! including weird Icelandic characters .

So SC is Internally aware of the file and can show the names properly, but not with the bmf function (and you can not choose and play such a file with bmf ) .
Comment 1 Mikael Nyberg 2009-03-24 20:46:41 UTC
also see this tread:

http://forums.slimdevices.com/showthread.php?t=59183
Comment 2 Alan Young 2009-03-24 23:41:32 UTC
The following would be helpful information:

(a) The operating system, filesystem-type and locale of the server hosting the files.
(b) If different from (a), The operating system, and locale of the server running SC and the network filesystem protocol (SMB, NFS).
(b) If different from (a) or (b), The operating system, and locale of the computer used to manage (rip, tag) and the transfer protocol used (SMB, NFS, ftp, scp).
Comment 3 luny 2009-03-25 00:22:47 UTC
Created attachment 4968 [details]
ssods sysinfo logging

I use a Synology diskstation with SSODS. Attached is the logfile from SSODS.
Comment 4 Michael Herger 2009-03-25 00:31:15 UTC
Did you read the FAQ about setting locale on SSODS?

http://oinkzwurgl.org/ssods_faq#toc24
Comment 5 Mikael Nyberg 2009-03-25 09:44:41 UTC
My server a headless CC4.2 mini-itx.


Version: 7.4 - 25665 @ Sun Mar 22 01:04:56 PDT 2009
Hostname: hal.home.lan
Server IP Address: 192.168.1.5
Server HTTP Port Number: 9000
Operating system: Red Hat - EN - utf8
Platform Architecture: i686-linux
Perl Version: 5.8.8 - i686-linux-thread-multi
MySQL Version: 4.1.20-log
Total Players Recognized: 3

This server also hold the files on an internal drive.

It's locale:

[root@hal ~]# locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=

My Björk files was ripped on my old Win-XP partition with EAC.
Then some months later moved from a NTSF disc to my server with the Help Of Ubuntu 7.10 which then was my desktop os on the same desktop, transfer was with the Help of SMB , My Ubuntu Machine has the same locale as my server.
Comment 6 Mikael Nyberg 2009-03-25 09:49:56 UTC
If I browse BMF in SC you see the file path in th upper left.

Example:
Home > Music Folder > My CD > Air > AIR - Moon Safari  

But if I bmf to a non working album i get.

Home > Song Info   at the top and no Artwork and no songs.
Comment 7 mbo2 2009-03-25 12:13:52 UTC
The following would be helpful information:

(a) The operating system, filesystem-type and locale of the server hosting the
files.
(b) If different from (a), The operating system, and locale of the server
running SC and the network filesystem protocol (SMB, NFS).
(b) If different from (a) or (b), The operating system, and locale of the
computer used to manage (rip, tag) and the transfer protocol used (SMB, NFS,
ftp, scp).

a)
Version: 7.4 - 25674 @ Tue Mar 24 01:32:09 PDT 2009
Operating system: Debian - EN - utf8
Platform Architecture: x86_64-linux
Perl Version: 5.10.0 - x86_64-linux-gnu-thread-multi
MySQL Version: 5.0.51a-24

cat /proc/version
Linux version 2.6.26-1-amd64 (Debian 2.6.26-13) (waldi@debian.org) (gcc version 4.1.3 20080704 (prerelease) (Debian 4.1.2-24)) #1 SMP Sat Jan 10 17:57:00 UTC 2009
mount
/dev/md1 on /home type ext3 (rw)
locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=

b) same as a)

c) Vista Home Premium with NTFS (swedish) access via samba
Comment 8 Mikael Nyberg 2009-03-25 12:46:54 UTC
Just for kicks i reripped one off the Björk CD's on my Ubuntu machine (same locale as server )
And transfered it to my server with first smb then sftp.
No difference the same problem, directories with Björk looks like Björk.

further test i ssh'd to my server and [root@hal Björk]# mkdir Björk_test
created an empty dir directly on the disk it's still wrong.
Weird thing is that the directory above the albums named only Björk looks ok ?

Therefore i made another empty dir one level up named "Björk_test2", that one looks perfect in SC
inside that dir I made another one "Björk_test3"
This one looks c***p so the problem depends on how deep the file tree is ?

full path
/mnt/music1/My CD/Björk_test2/Björk_test3

Down under a certain level you can't use nordic letters  Å Ö Ä if you use them in file names the files get invisible to SC

SC finds the files when scanning and they play without problem ?
And correct path is displayed under info ? so the scanner finds them.
Comment 9 Mikael Nyberg 2009-03-25 21:38:59 UTC
I made the wrong conclusion from my last experiment.

I did a further test i moved even higher up in my file tree and made more empty directories:

/mnt/music1/Björk1/Björk2

(SC music dir is set as /mnt/music1 btw )

You still got the problem.

But the problem is that one directory who's name has a special characters
can not contain more directories with special characters.

Then i put a file in to them and:

one directory who's name has a special characters
can not contain a file with special characters, the file gets invisible for SC in browse music folder (scan picks up just fine)

A directory without a special characters in it's name can have files with special characters, the are seen by music folder function.
Comment 10 Michael Herger 2009-04-09 06:04:25 UTC
Luny/mbo2 - are you both accessing a Windows share from a Linux box, running SC on the Linux box?
Comment 11 Michael Herger 2009-04-09 06:12:47 UTC
The thread linked in comment #1 mentions change 24594 causing this issue.
Comment 12 luny 2009-04-09 06:27:09 UTC
to clarify, this issue exists since 24594 on all nightly versions.

I run SC on linux (Synology with SSODS).
The issue occurs both when I browse in SC on my windows vista leaptop, but also on the duet controller.
Comment 13 Michael Herger 2009-04-09 06:28:16 UTC
I've attached a patch to related bug 10199 which might help this issue. Please
give it a try.
Comment 14 mbo2 2009-04-09 06:51:15 UTC
For me: Music files stored on local disk on Linux server where SC is running. Files originally created on Windows and transfered via SMB.
Comment 15 luny 2009-04-09 11:42:02 UTC
eh, stupid question

how do I apply the patch?
Comment 16 Michael Herger 2009-04-09 13:39:04 UTC
> how do I apply the patch?

Don't worry - it doesn't work :-(
Comment 17 Mikael Nyberg 2009-04-09 23:35:55 UTC
Michael , did you read my comments ? specially the last one.

do i need to clarify it a little more ?
Comment 18 Michael Herger 2009-04-10 07:11:04 UTC
> Michael , did you read my comments ? specially the last one.

Thanks, I have to spend some more time reproducing this issue.
Comment 19 Michael Herger 2009-06-08 11:18:36 UTC
Mikael - could you please test the latest 7.4 nightly build? We've not only replaced the scanning code, but the filename handling too.
Comment 20 luny 2009-06-08 12:10:57 UTC
(In reply to comment #19)
> Mikael - could you please test the latest 7.4 nightly build? We've not only
> replaced the scanning code, but the filename handling too.

After a quick test with 7.4-26940 it seems to be solved here.
Browsing folders with special characters works, also adding files with special characters to the playlist etc. wotks here.
Comment 21 Mikael Nyberg 2009-06-08 17:13:14 UTC
Hmm the feedback on the forum reports this.
"The "SQLite-scanner" ignores all tracks containing any special character like ä,ö,ü,ß"
and similar experiences is this fixed ? I rather have BMF broken and a working scanner than functioning BMF and a broken scanner.
Theres a lot of experiences out there claiming that the scanner does not work properly yet ? people are missing tracks compared to the old system.

So i'll wait on the sideline a while until rudimentary stability is restored :) then I'll jump on the almost daily beta upgrades again.

I use the rpm build and my system has  perl 5.8.8 which is said to work ok but some claims are made that this is not entirely true ?
Comment 22 Michael Herger 2009-06-08 17:24:24 UTC
> "The "SQLite-scanner" ignores all tracks containing any special  
> character like
> ä,ö,ü,ß"

Is there a bug filed against this issue?

> So i'll wait on the sideline a while until rudimentary stability is  
> restored :)

Well, that won't help us ensure this bug is fixed!
Comment 23 Mikael Nyberg 2009-06-08 17:46:48 UTC
Probably not reported, but it is a very basic thing ? I'm a little surprised that such things slips trough the cracks.I'm also surprised by the deja-vu quality of some bugs they seems to come back again ?

I'm happy to try new version but I'm always assumed that some kind of testing is done even with beta versions not only community testing.
Meaning that even the latest beta works in some fashion, people like me are to find the more odd issues, that may slip trough your normal test routines.

How do I return to the MYsql 7.4 if the sqlite version fails ? I have some locally saved rpm packages but i never installed that way.

Can be time consuming to track issues if a couple of hundred of my >18000 files are missing ?
Comment 24 Mikael Nyberg 2009-06-09 10:15:36 UTC
Loaded the latest 7.4 this bug is now fixed however I'm now suffering from another bug

https://bugs-archive.lyrion.org/show_bug.cgi?id=12149

Version: 7.4 - 26954 @ Tue Jun 9 01:09:23 PDT 2009
Hostname: hal.home.lan
Server IP Address: 192.168.1.5
Server HTTP Port Number: 9000
Operating system: Red Hat - EN - utf8
Platform Architecture: i686-linux
Perl Version: 5.8.8 - i686-linux-thread-multi
Total Players Recognized: 4
 
Library Statistics
Total Tracks: 0
Total Albums: 0
Total Artists: 0
Total Genres: 0
Total Playing Time: 0:00:00

After a completed scan SC see no files at all ?
If I use BMF these albums get added to the dB ?
Comment 25 Mikael Nyberg 2009-06-09 10:49:54 UTC
Loaded the latest 7.4 this bug is now fixed however I'm now suffering from another bug

https://bugs-archive.lyrion.org/show_bug.cgi?id=12149

Version: 7.4 - 26954 @ Tue Jun 9 01:09:23 PDT 2009
Hostname: hal.home.lan
Server IP Address: 192.168.1.5
Server HTTP Port Number: 9000
Operating system: Red Hat - EN - utf8
Platform Architecture: i686-linux
Perl Version: 5.8.8 - i686-linux-thread-multi
Total Players Recognized: 4
 
Library Statistics
Total Tracks: 0
Total Albums: 0
Total Artists: 0
Total Genres: 0
Total Playing Time: 0:00:00

After a completed scan SC see no files at all ?
If I use BMF these albums get added to the dB ?
Comment 26 luny 2009-06-09 22:35:35 UTC
BMF is working here with latest 7.4 but also suffering from
bug https://bugs-archive.lyrion.org/show_bug.cgi?id=12149 now
Comment 27 Michael Herger 2009-06-10 04:49:58 UTC
Thanks guys. Let's follow up on the other bugs.
Comment 28 James Richardson 2009-10-05 14:36:30 UTC
This bug has been marked as fixed in the 7.4.0 release version of SqueezeBox Server!
    * SqueezeCenter: 28672
    * Squeezebox 2 and 3: 130
    * Transporter: 80
    * Receiver: 65
    * Boom: 50
    * Controller: 7790
    * Radio: 7790  

Please see the Release Notes for all the details: http://wiki.slimdevices.com/index.php/Release_Notes

If you haven't already, please download and install the new version from http://www.logitechsqueezebox.com/support/download-squeezebox-server.html

If you are still experiencing this problem, feel free to reopen the bug with your new comments and we'll have another look.