Bug 3889 - Browse playlists section is empty after rescan music library
: Browse playlists section is empty after rescan music library
Status: RESOLVED FIXED
Product: Logitech Media Server
Classification: Unclassified
Component: Playlists
: 6.3.1
: PC Ubuntu Linux
: P2 minor (vote)
: ---
Assigned To: Dan Sully
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2006-08-08 12:01 UTC by David Regtien
Modified: 2008-12-18 11:11 UTC (History)
2 users (show)

See Also:
Category: ---


Attachments
a playlist saved by the slimserver gui (6.66 KB, text/plain)
2006-08-17 13:19 UTC, David Regtien
Details
foobar generated playlist (687 bytes, text/plain)
2006-08-23 13:42 UTC, David Regtien
Details
slimserver generated playlist (1.29 KB, text/plain)
2006-08-23 13:43 UTC, David Regtien
Details

Note You need to log in before you can comment on or make changes to this bug.
Description David Regtien 2006-08-08 12:01:18 UTC
The browse playlist section contains no playlists anymore after a rescan (look for new and changed music / only playlist). 
I'm not able to browse the playlists again via the web based gui or via SB2. However, the playlist files are created in the playlist folder (side notice: the playlist filenames encodes spaces to the %20 character eg. vijfde%20playlist.m3u ). 

How to reproduce?
The initial playlists are all created in the web GUI (save option in the music player section). I am able to browse them. After the rescan, the playlist section is empty.

This problem does not occur in my previous slimserver installation (version 6.2.2)

My system environment:
Ubuntu server (dapper, kernel 2.6.15.26-386)
Slimserver 6.3.1
playlist folder has 777 rights (data/public/music/playlists) and contains playlists only (no links etc.)
music folder: data/public/music/flac
playlist folder can be accessed from windows environment (samba). 
text file properties for generated playlists: filetype = UNIX codeset = utf-8

debug information during the steps to reproduce the above bug:

2006-08-08 20:12:43.5992 currentPlaylistChangeTime : Tue Aug  8 20:10:12 2006
2006-08-08 20:12:43.5996 currentPlaylistRender     : Tue Aug  8 20:10:13 2006
2006-08-08 20:12:43.5998 currentPlaylistRenderSkin : 
2006-08-08 20:12:43.6000 currentPlaylistRenderStart: 0
2006-08-08 20:12:43.6001 skinOverride: 
2006-08-08 20:12:43.6002 start: 0
2006-08-08 20:12:43.6005 Skipping playlist build - not modified.
2006-08-08 20:13:13.2641 currentPlaylistChangeTime : Tue Aug  8 20:13:13 2006
2006-08-08 20:13:13.2645 currentPlaylistRender     : Tue Aug  8 20:10:13 2006
2006-08-08 20:13:13.2647 currentPlaylistRenderSkin : 
2006-08-08 20:13:13.2649 currentPlaylistRenderStart: 0
2006-08-08 20:13:13.2650 skinOverride: 
2006-08-08 20:13:13.2651 start: 0
2006-08-08 20:13:36.6337 Reshuffling, current song index: -1, preserve song? yes
2006-08-08 20:13:36.9041 currentPlaylistChangeTime : Tue Aug  8 20:13:36 2006
2006-08-08 20:13:36.9044 currentPlaylistRender     : Tue Aug  8 20:10:13 2006
2006-08-08 20:13:36.9046 currentPlaylistRenderSkin : 
2006-08-08 20:13:36.9048 currentPlaylistRenderStart: 0
2006-08-08 20:13:36.9049 skinOverride: 
2006-08-08 20:13:36.9050 start: 0
2006-08-08 20:13:37.2303 End playlist build. 12 items
2006-08-08 20:13:50.1190 Not writing out untitled playlist.
2006-08-08 20:14:07.0324 currentPlaylistChangeTime : Tue Aug  8 20:13:36 2006
2006-08-08 20:14:07.0328 currentPlaylistRender     : Tue Aug  8 20:13:37 2006
2006-08-08 20:14:07.0330 currentPlaylistRenderSkin : 
2006-08-08 20:14:07.0332 currentPlaylistRenderStart: 0
2006-08-08 20:14:07.0333 skinOverride: 
2006-08-08 20:14:07.0335 start: 0
2006-08-08 20:14:07.0337 Skipping playlist build - not modified.
2006-08-08 20:14:37.1534 currentPlaylistChangeTime : Tue Aug  8 20:13:36 2006
2006-08-08 20:14:37.1538 currentPlaylistRender     : Tue Aug  8 20:13:37 2006
2006-08-08 20:14:37.1540 currentPlaylistRenderSkin : 
2006-08-08 20:14:37.1542 currentPlaylistRenderStart: 0
2006-08-08 20:14:37.1544 skinOverride: 
2006-08-08 20:14:37.1545 start: 0
2006-08-08 20:14:37.1548 Skipping playlist build - not modified.
2006-08-08 20:15:07.2674 currentPlaylistChangeTime : Tue Aug  8 20:13:36 2006
2006-08-08 20:15:07.2679 currentPlaylistRender     : Tue Aug  8 20:13:37 2006
2006-08-08 20:15:07.2680 currentPlaylistRenderSkin : 
2006-08-08 20:15:07.2682 currentPlaylistRenderStart: 0
2006-08-08 20:15:07.2683 skinOverride: 
2006-08-08 20:15:07.2685 start: 0
2006-08-08 20:15:07.2687 Skipping playlist build - not modified.
2006-08-08 20:15:37.3835 currentPlaylistChangeTime : Tue Aug  8 20:13:36 2006
2006-08-08 20:15:37.3839 currentPlaylistRender     : Tue Aug  8 20:13:37 2006
2006-08-08 20:15:37.3841 currentPlaylistRenderSkin : 
2006-08-08 20:15:37.3842 currentPlaylistRenderStart: 0
2006-08-08 20:15:37.3844 skinOverride: 
2006-08-08 20:15:37.3845 start: 0
2006-08-08 20:15:37.3848 Skipping playlist build - not modified.
2006-08-08 20:15:55.0355 Playlist: Jumping to song index: 0
2006-08-08 20:15:55.1779 currentPlaylistChangeTime : Tue Aug  8 20:15:55 2006
2006-08-08 20:15:55.1785 currentPlaylistRender     : Tue Aug  8 20:13:37 2006
2006-08-08 20:15:55.1787 currentPlaylistRenderSkin : 
2006-08-08 20:15:55.1788 currentPlaylistRenderStart: 0
2006-08-08 20:15:55.1790 skinOverride: 
2006-08-08 20:15:55.1791 start: 0
2006-08-08 20:16:06.0055 Reshuffling, current song index: -1, preserve song? yes
2006-08-08 20:16:06.2130 currentPlaylistChangeTime : Tue Aug  8 20:16:06 2006
2006-08-08 20:16:06.2134 currentPlaylistRender     : Tue Aug  8 20:13:37 2006
2006-08-08 20:16:06.2136 currentPlaylistRenderSkin : 
2006-08-08 20:16:06.2138 currentPlaylistRenderStart: 0
2006-08-08 20:16:06.2139 skinOverride: 
2006-08-08 20:16:06.2141 start: 0
2006-08-08 20:16:06.2379 End playlist build. 1 items
2006-08-08 20:16:14.9200 Not writing out untitled playlist.
2006-08-08 20:16:36.3330 currentPlaylistChangeTime : Tue Aug  8 20:16:06 2006
2006-08-08 20:16:36.3334 currentPlaylistRender     : Tue Aug  8 20:16:06 2006
2006-08-08 20:16:36.3336 currentPlaylistRenderSkin : 
2006-08-08 20:16:36.3338 currentPlaylistRenderStart: 0
2006-08-08 20:16:36.3339 skinOverride: 
2006-08-08 20:16:36.3341 start: 0
2006-08-08 20:16:36.3550 End playlist build. 1 items
2006-08-08 20:17:05.0732 currentPlaylistChangeTime : Tue Aug  8 20:17:04 2006
2006-08-08 20:17:05.0737 currentPlaylistRender     : Tue Aug  8 20:16:36 2006
2006-08-08 20:17:05.0739 currentPlaylistRenderSkin : 
2006-08-08 20:17:05.0741 currentPlaylistRenderStart: 0
2006-08-08 20:17:05.0742 skinOverride: 
2006-08-08 20:17:05.0745 start: 0
2006-08-08 20:17:19.4660 Reshuffling, current song index: -1, preserve song? yes
2006-08-08 20:17:19.7414 currentPlaylistChangeTime : Tue Aug  8 20:17:19 2006
2006-08-08 20:17:19.7418 currentPlaylistRender     : Tue Aug  8 20:16:36 2006
2006-08-08 20:17:19.7420 currentPlaylistRenderSkin : 
2006-08-08 20:17:19.7421 currentPlaylistRenderStart: 0
2006-08-08 20:17:19.7423 skinOverride: 
2006-08-08 20:17:19.7424 start: 0
2006-08-08 20:17:20.1236 End playlist build. 14 items
2006-08-08 20:17:30.0447 Not writing out untitled playlist.
2006-08-08 20:17:49.8671 currentPlaylistChangeTime : Tue Aug  8 20:17:19 2006
2006-08-08 20:17:49.8675 currentPlaylistRender     : Tue Aug  8 20:17:20 2006
2006-08-08 20:17:49.8677 currentPlaylistRenderSkin : 
2006-08-08 20:17:49.8679 currentPlaylistRenderStart: 0
2006-08-08 20:17:49.8681 skinOverride: 
2006-08-08 20:17:49.8683 start: 0
2006-08-08 20:17:49.8687 Skipping playlist build - not modified.
2006-08-08 20:18:19.9864 currentPlaylistChangeTime : Tue Aug  8 20:17:19 2006
2006-08-08 20:18:19.9870 currentPlaylistRender     : Tue Aug  8 20:17:20 2006
2006-08-08 20:18:19.9872 currentPlaylistRenderSkin : 
2006-08-08 20:18:19.9874 currentPlaylistRenderStart: 0
2006-08-08 20:18:19.9876 skinOverride: 
2006-08-08 20:18:19.9877 start: 0
2006-08-08 20:18:19.9880 Skipping playlist build - not modified.
Comment 1 KDF 2006-08-08 12:12:31 UTC
consider trying 6.5.  no further development is going on with 6.3.1
Comment 2 Chris Owens 2006-08-08 12:19:59 UTC
David, if you do a clear library and rescan everything do the playlists show back up?
Comment 3 David Regtien 2006-08-08 14:25:03 UTC
(In reply to comment #1)
> consider trying 6.5.  no further development is going on with 6.3.1

This is unfortunately no option for me. I need a stable version.

(In reply to comment #2)
> David, if you do a clear library and rescan everything do the playlists show
> back up?

Christopher, I tried a clear library and a complete rescan. It took more than one hour to rescan everything (180 GB data, 1 GHz EPIA ). After the rescan again no playlists.
I can imagine this behaviour is hard to reproduce. For the time being, I guess it's better to stick to 6.2.2.
Comment 4 Chris Owens 2006-08-08 14:47:51 UTC
Well I'm still certainly interested in trying to figure this problem out.  Is it possible you could attach one of your playlists to this bug using the "Create a New Attachment" link, above?
Comment 5 KDF 2006-08-08 15:31:12 UTC
the clip from the log above shows only detail for teh current playlist rendering.  This only applies to the current player playlist http page.  If you want to take a look at what is going on in regard to the playlist scanning, turn on d_import, d_scan and d_parse before initiating a scan or at the command line.  The log will then show much greater detail from the playlist scanning.
Comment 6 David Regtien 2006-08-09 07:15:51 UTC
(In reply to comment #4)
> Well I'm still certainly interested in trying to figure this problem out.  Is
> it possible you could attach one of your playlists to this bug using the
> "Create a New Attachment" link, above?

I think i've figured it out. Yesterday I decided to install the 6.5beta version. I entered the playlist location (data/public/music/playlists) in the server settings. An error message appeared saying the choosen directory didn't exist. I changed the path to /data/public/music/playlists (please notice the leading forward slash) and everything worked fine. 
In Windows I went back to my vmware snapshot (slimserver 6.3.1) and did the same (changing the path by entering the forward slash at the begin). Now the playlists did show up again. 
My conclusion: In 6.3.1 there is no error message in case a path doesn't exist (a missing forward slash at the begin, in my case).

Now I've got another related problem (It would be great if you got any clue). In 6.5beta the playlists will not disappear if i delete the files from the playlist directory and a rescan (I've checked this out only with playlists only option because of the time it takes to do a complete rescan and cleaning the library). Exactly the opposite problem. Now I want them to disappear but they won't disappear :=(
Seems the playlists are also stored in a cache or in the mysql database??

Thanks anyway for your time.

David 
Comment 7 David Regtien 2006-08-17 13:16:38 UTC
(In reply to comment #5)
> the clip from the log above shows only detail for teh current playlist
> rendering.  This only applies to the current player playlist http page.  If you
> want to take a look at what is going on in regard to the playlist scanning,
> turn on d_import, d_scan and d_parse before initiating a scan or at the command
> line.  The log will then show much greater detail from the playlist scanning.

I still can't figure it out. I thought I solved it (see one of my latest replies to Chris). 
It works correctly in my VMware environment but not on my linux server.
As you suggested I've turned on the debugging settings. The only result after a rescan (playlist, look for
new music) in the log file :
2006-08-17 22:03:55.1412 Import: Wiped all in-memory caches.

B.t.w I did a test with the 6.5beta release on my server. This particular problem didn't occur (although 
the where other problems).
Comment 8 David Regtien 2006-08-17 13:19:43 UTC
Created attachment 1439 [details]
a playlist saved by the slimserver gui
Comment 9 Chris Owens 2006-08-17 16:25:08 UTC
That appears to be a valid .m3u file.

Very strange.  I tried it on my debian 6.3.1 platform (under vmware, I have to admit) and it seemed to work okay with similarly-named folders for playlists and music.

I'm really wracking my brain now.  is your data/public/music directory on the local filesystem?  Or is it mounted from somewhere else?

Comment 10 David Regtien 2006-08-18 00:41:10 UTC
(In reply to comment #9)
> That appears to be a valid .m3u file.
> Very strange.  I tried it on my debian 6.3.1 platform (under vmware, I have to
> admit) and it seemed to work okay with similarly-named folders for playlists
> and music.
> I'm really wracking my brain now.  is your data/public/music directory on the
> local filesystem?  Or is it mounted from somewhere else?
It is on the local filesystem.
A friend of mine (he uses a similar configuration) has the same problem. He uses slimserver 6.2.1.
Could it be a user rights/owner issue. The data/public/music directory is created as root with 777 rights. Shouldn't the owner be slimserver?


Comment 11 Chris Owens 2006-08-18 11:59:31 UTC
The best I can do at the moment is work to make sure this doesn't happen in the 6.5 release.
Comment 12 David Regtien 2006-08-19 23:28:16 UTC
(In reply to comment #11)
> The best I can do at the moment is work to make sure this doesn't happen in the
> 6.5 release.

Actually, this doesn't happen in 6.5 (see comment #7). In 6.5 I encountered a lot of other problems. For instance: digital noise at my external DAC after turning off the SB2, playlists that won't be removed form cache, for each song in a multi disc album a separate album entry in the browse by album section etc.

Have you got any idea when the 6.5 will officially be released or an indaction on which term? Must I think in weeks, months or quarter years?).

I will post this particular problem to the forum.

Thanks anyway.

David

 
Comment 13 Chris Owens 2006-08-21 10:42:54 UTC
The Transporter product requires Slimserver 6.5, and it's slated to ship on Sep 18th, so Slimserver 6.5 will almost certainly be out on or before that date.
Comment 14 David Regtien 2006-08-23 06:38:46 UTC
For some reason (I really don't know how) playlists now appear in the playlist section after a rescan (slimserver 6.3.1). I haven't changed a bit.
Still some strange things:
1.
I can not browse playlists I've created outside the slimserver web GUI. For instance playlists generated
with foobar2000 in windows, saved as m3u, in unix format and utf8 codepage still won't appear.
2.
Playlists-songs with non-ASCII characters won't show-up in the playlists after a rescan. I can browse them as long as I don't start the rescan.

Debug info:
ists/Chopin%20favourites.m3u made file:///data/public/music/flac/Chopin,%20Fr%E9d%E9ric/Nocturnes%20[Moravec]%20(disc%202)/03-C%20minor,%20Op.%2048,%20No.%201.flac
2006-08-23 15:18:55.9334 isList(file:///data/public/music/flac/Chopin,%20Fr%E9d%E9ric/Nocturnes%20[Moravec]%20(disc%202)/03-C%20minor,%20Op.%2048,%20No.%201.flac) == 0
2006-08-23 15:18:55.9349 not a list: file:///data/public/music/flac/Chopin,%20Fr%E9d%E9ric/Nocturnes%20[Moravec]%20(disc%202)/03-C%20minor,%20Op.%2048,%20No.%201.flac
2006-08-23 15:18:55.9366 adding single item: file:///data/public/music/flac/Chopin,%20Fr%E9d%E9ric/Nocturnes%20[Moravec]%20(disc%202)/03-C%20minor,%20Op.%2048,%20No.%201.flac, type flc
2006-08-23 15:18:56.0008 [/data/public/music/flac/Chopin, Fr�d�ric/Nocturnes [Moravec] (disc 2)/03-C minor, Op. 48, No. 1.flac] does not exist or cannot be read: No such file or directory at /usr/local/SlimServer_v6.3.1/CPAN/Audio/FLAC/Header.pm line 59.
2006-08-23 15:18:56.0030 ERROR: Couldn't open file: [/data/public/music/flac/Chopin, Fr�d�ric/Nocturnes [Moravec] (disc 2)/03-C minor, Op. 48, No. 1.flac] for reading: No such file or directory

Have you got any clue?
Thanks in advance,

David

Comment 15 Chris Owens 2006-08-23 11:05:57 UTC
One or both of these remaining issues may be related to bug 2475, a perl bug that prevents us from reading non-ASCII filenames at the moment.

I'd be happy to have a look at your troublesome Foobar-generated playlist file if you'd upload it.
Comment 16 David Regtien 2006-08-23 13:41:19 UTC
(In reply to comment #15)
> One or both of these remaining issues may be related to bug 2475, a perl bug
> that prevents us from reading non-ASCII filenames at the moment.
> I'd be happy to have a look at your troublesome Foobar-generated playlist file
> if you'd upload it.
I'm not sure it's related to that bug. I have no problems with these filenames in a windows environment.
Please find enclosed two playlists:

1. Chopin favorites.m3u
This playlist is generated by slimserver. It contains non ascii characters in the filename but
these are not exotic ones like japanese characters. Extended ascii characters only. After a rescan the
filenames with extended ascii characters won't shop up in the playlist.
If I open the file in textpad (window app) I noticed the playlist is extended m3u and the codepage
used is utf-8(signature). I'm not sure if it is required to use extended m3u and a utf-8(signature) codepage
for slimserver in Linux (once again, no problems in a windows environment).

2. foobarplaylist.m3u
I've created a simple playlist with a few songs. I saved the playlist as a m3u file. 
Furthermore I did some manipulation with TextPad (like replacement of \ to / etc.) and finally saved the
file as a UNIX format and utf-8 codepage. FYI: In TextPad you can also choose the Unicode of Unicode(Big endian)
codepage but not the utf-8(signature) codepage. This playlist won't show up in the playlist section (for 
song with or without extended ascii characters in their filenames)

Good luck with it.
David


Comment 17 David Regtien 2006-08-23 13:42:56 UTC
Created attachment 1467 [details]
foobar generated playlist
Comment 18 David Regtien 2006-08-23 13:43:45 UTC
Created attachment 1468 [details]
slimserver generated playlist
Comment 19 Dan Sully 2006-09-02 16:39:56 UTC
David - can you try a recent nightly?

I've fixed a similar problem with iTunes playlists not showing up (it had nothing to do specifically with iTunes).

I believe this may be the same.

If you're running on Linux, you can start SlimServer up, then in another shell, run:

./scanner --wipe --d_import --progress

Thanks
Comment 20 Chris Owens 2006-09-08 12:02:03 UTC
ping David
Comment 21 David Regtien 2006-09-11 10:55:40 UTC
(In reply to comment #19)
> David - can you try a recent nightly?
> I've fixed a similar problem with iTunes playlists not showing up (it had
> nothing to do specifically with iTunes).
> I believe this may be the same.
> If you're running on Linux, you can start SlimServer up, then in another shell,
> run:
> ./scanner --wipe --d_import --progress
> Thanks

Sorry for the late reply. I was on holiday.
Have you fixed it in 6.3.x or in the 6.5 version.
The 6.5 I guess?

Comment 22 Dan Sully 2006-09-11 10:56:41 UTC
Subject: Re:  Browse playlists section is empty after rescan music library

6.5 only. Beta2 was released today. http://slimdevices.com/dev_nightly.html

Comment 23 Dan Sully 2006-09-17 14:56:24 UTC
Yes, 6.5 only.

beta3 was released last week. We'll be releasing 6.5.0 officially on the 18th
Comment 24 Blackketter Dean 2006-09-18 10:47:06 UTC
David:  Is this happening in the 6.5 release for you still?

Moving to 6.5.1 pending David reproducing this in 6.5.
Comment 25 Dan Sully 2006-10-03 16:06:19 UTC
David? We're preparing to release 6.5.1 shortly - would like to know if this is fixed for you in 6.5.0 or the 6.5.1 nightlies.

Thanks
Comment 26 David Regtien 2006-10-04 00:37:18 UTC
(In reply to comment #25)
> David? We're preparing to release 6.5.1 shortly - would like to know if this is
> fixed for you in 6.5.0 or the 6.5.1 nightlies.
> Thanks
Hi Dan,
I have not tested it on my linux box because I've got some problems installing 6.5.0. I've installed a beta version of 6.5.0 earlier (deb package), removed it and installed the official release. Installing it went succesful but I can not start the server. The slimserver script in /etc/init.d/ is not installed or disappeared.
Probably this is no bug so I won't bother you with this problem. Have to sort it out using the forums.

Anyway, I've tested it in vmware (clean ubuntu session without previous slimserver versions). Installation ok, and the bug did not appear. So I assume it is fixed although there might be a little chance the problem still exists in a non-virtual environment.

Is it possible to reopen this bug as soon as I'm able to get 6.5.0 running on my Linux box and the bug reappears?

Thanks anyway for the excellent support.

David


Comment 27 Dan Sully 2006-10-04 09:21:50 UTC
Yes, it is possible to reopen a bug if you see it again.

Thanks