Bug 17478 - Zero artists reported in library statistics after a scan
: Zero artists reported in library statistics after a scan
Status: RESOLVED FIXED
Product: Logitech Media Server
Classification: Unclassified
Component: Web Interface
: 7.6.0
: PC Other
: P3 normal with 5 votes (vote)
: 7.6.x
Assigned To: Unassigned bug - please assign me!
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2011-08-20 08:51 UTC by Sébastien Phélep
Modified: 2011-08-31 08:07 UTC (History)
1 user (show)

See Also:
Category: Bug


Attachments
server.log (7.25 KB, text/x-log)
2011-08-20 09:08 UTC, Mikael Nyberg
Details
scanner.log (38.80 KB, text/x-log)
2011-08-20 09:09 UTC, Mikael Nyberg
Details
screenshot (2.27 KB, image/png)
2011-08-20 09:09 UTC, Mikael Nyberg
Details
home page screensnip (4.92 KB, image/jpeg)
2011-08-27 06:00 UTC, Ian Pallfreeman
Details
info page screensnip (51.79 KB, image/jpeg)
2011-08-27 06:01 UTC, Ian Pallfreeman
Details
scanner.log (65.98 KB, application/octet-stream)
2011-08-27 06:04 UTC, Ian Pallfreeman
Details
server.log (42.00 KB, application/octet-stream)
2011-08-27 06:05 UTC, Ian Pallfreeman
Details
br1.jpg (106.48 KB, image/jpeg)
2011-08-28 09:50 UTC, Ian Pallfreeman
Details
br2.jpg (191.62 KB, image/jpeg)
2011-08-28 09:51 UTC, Ian Pallfreeman
Details
osx screenshot (102.80 KB, image/jpeg)
2011-08-30 04:22 UTC, Ian Pallfreeman
Details
same again (204.03 KB, image/jpeg)
2011-08-30 04:22 UTC, Ian Pallfreeman
Details
latest scanner.log (72.58 KB, application/octet-stream)
2011-08-31 08:04 UTC, Ian Pallfreeman
Details
latest server.log (5.25 KB, application/octet-stream)
2011-08-31 08:05 UTC, Ian Pallfreeman
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Sébastien Phélep 2011-08-20 08:51:50 UTC
Some people encountered a bug with 7.6.1 RC releases where after a scan, the web UI will display zero artists in the library at the home page and information tab.

See for example:
http://forums.slimdevices.com/showthread.php?p=651152#post651152
http://forums.slimdevices.com/showthread.php?p=651376#post651376

Refreshing the browser won't help.
Navigating to the Artists menus lists shows there are artists in the database.

A server restart solves the problem.
Comment 1 Mikael Nyberg 2011-08-20 09:08:15 UTC
Yep this was the case when the mandatory scan of the 7.6 33110 RC finished

Seph has linked our comments but i will attach scanner and server logs to

"
Total Tracks: 31,712
Total Albums: 2,652
Total Artists: 0
Total Genres: 221
Total Playing Time: 2445:12:24

Home menu reports 1 song 1 album 0 artist

However going in to the artist menu gives 1205 artist, which seems about right ?
"

Scan for new and changed does not seems to bring this issue.
Comment 2 Mikael Nyberg 2011-08-20 09:08:54 UTC
Created attachment 7405 [details]
server.log
Comment 3 Mikael Nyberg 2011-08-20 09:09:19 UTC
Created attachment 7406 [details]
scanner.log
Comment 4 Mikael Nyberg 2011-08-20 09:09:45 UTC
Created attachment 7407 [details]
screenshot
Comment 5 Ian Pallfreeman 2011-08-20 09:53:09 UTC
I see very similar, repeatably. Except I get "0 albums with 0 songs by 0 artists" in the home page. 

The big clue is the "Artists: 0" in library statistics, both in the web GUI and on an attached Touch.
Comment 6 Mike Cappella 2011-08-20 09:56:36 UTC
Reported here too:
http://forums.slimdevices.com/showpost.php?p=650126&postcount=2
Comment 7 Michael Herger 2011-08-22 01:03:43 UTC
You're all running some unix/linux flavour? Can't confirm...

Are you using any importer plugins (eg. Erlands, iTunes, MIP)?
Comment 8 Ian Pallfreeman 2011-08-22 01:11:26 UTC
Using FreeBSD. No plugins other than those shipped out-of-the-box. rm *.db done before the wipe scan.

I've not restarted SBS on my FitPC2 since seeing this on Friday (I just wanted to see how long the poor little thing would take to scan).

http://virgin.xenopsyche.net:9000
Comment 9 Michael Herger 2011-08-22 02:56:42 UTC
Could you please verify this still happens with r33136? I've fixed bug 17479 which might have been the cause for this failure too.
Comment 10 Ian Pallfreeman 2011-08-22 05:35:21 UTC
r33138 seems to have fixed this for a subset (19k files) of my collection. Ta!

I had to restart the browser (Opera/XP) to see the numbers displayed in the home page. Library Statistics was fine. 

Is this fix not being included in 7.6.1-RELEASE? That's the impression I get from reading the changelog.
Comment 11 Mike Cappella 2011-08-22 08:17:41 UTC
Windows here.
Comment 12 Mikael Nyberg 2011-08-22 09:07:01 UTC
No mip no itunes, some of erlands plugins but not custom scan or custombrowse trackstat ?
Linux yes, I will upgrade and do a clear and rescan everything, scan for new or playlist did not show these problems.
Comment 13 Mikael Nyberg 2011-08-22 10:25:47 UTC
Ok tried  a rescan without upgrading, it worked just fine ?

This bug may only be provoked when SBS does it forced rescan after install for your schema change.

But that means that a lot of users installing RC3 is going to see this and assume that the scan is broken, not every one will be thinking " thats it's only a visual glitch" lets restart sbs and see if it goes away :-/ Can something be done after that one off initial scan

You are planning to release 33110 RC3 as 7.6.1 without the improvements you done the last day ?
Comment 14 Bill Waldron 2011-08-22 10:29:15 UTC
I upgraded to RC3 from 7.5.6 this morning and experienced this. After restarting the server, all the displayed totals were fine. Windows 7 box, BTW.
Comment 15 Ian Pallfreeman 2011-08-22 10:49:42 UTC
Full scan completed successfully (r33139). Browser displays correct counts after a refresh (not restart) with Opera/FreeBSD. 

I'm eagerly anticipating the release announcement. "We bust a gut squishing bugs over the last few days, please use the version without these fixes". :)
Comment 16 Mikael Nyberg 2011-08-26 13:42:34 UTC
http://forums.slimdevices.com/showpost.php?p=653112&postcount=15

an example of user still having this issue, so it's not solved
Comment 17 Ian Pallfreeman 2011-08-27 06:00:10 UTC
Sigh. Updated my prod SBS to r33223 and got this again.

What I did: stop SBS, rm cache/*.db, reinstall, restart. 

After full scan completes, browsing Albums, Genres, Years and New Music works, but browsing Artists puts SBS into a loop consuming most of one core. I guess it then times out the request.
Comment 18 Ian Pallfreeman 2011-08-27 06:00:48 UTC
Created attachment 7430 [details]
home page screensnip
Comment 19 Ian Pallfreeman 2011-08-27 06:01:17 UTC
Created attachment 7431 [details]
info page screensnip
Comment 20 Ian Pallfreeman 2011-08-27 06:04:34 UTC
Created attachment 7432 [details]
scanner.log
Comment 21 Ian Pallfreeman 2011-08-27 06:05:00 UTC
Created attachment 7433 [details]
server.log
Comment 22 Ian Pallfreeman 2011-08-28 09:50:17 UTC
I've been thinking about what Mikael wrote in comment 13.

My prod server was upgraded from 7.6.1 r33094. Each of the others have been upgraded from something much more recent, and have been fine. What's different between a forced wipe scan and one triggered from the GUI?

The prod server was running fine after a restart. This morning I looked to see how the scheduled new/changed scan had gone. Attachment br1.jpg. Note the (5785 of 2) at the bottom. And the Information page, attachment br2.jpg. Bug 17452?

I tried, but failed, to get anything useful from debug logging. A second wipe scan seems to have cured the problem, a new/changed scan now runs OK. 

Very strange.
Comment 23 Ian Pallfreeman 2011-08-28 09:50:55 UTC
Created attachment 7435 [details]
br1.jpg
Comment 24 Ian Pallfreeman 2011-08-28 09:51:23 UTC
Created attachment 7436 [details]
br2.jpg
Comment 25 SVN Bot 2011-08-29 01:15:14 UTC
 == Auto-comment from SVN commit #33234 to the slim repo by mherger ==
 == http://svn.slimdevices.com/slim?view=revision&revision=33234 ==

Fixed Bug: 17478
Description: as long as counts are zero or undefined, don't cache values, but re-evaluate. If they're zero indeed, this shouldn't hurt.
Comment 26 Ian Pallfreeman 2011-08-29 15:46:50 UTC
Probable duplicate of bug 14465 and bug 14817?
Comment 27 Mike Walsh 2011-08-29 17:43:21 UTC
bug 9037

bug 9704
Comment 28 Ian Pallfreeman 2011-08-30 04:20:57 UTC
Bah.

This all came about by accident, it's not "systematic testing". One of the boxes I was using to test scanner performance a few weeks ago had two identical copies of OS+SBS r33094 on two drives. I'd been testing using a slow drive, I wanted to test a faster one. 

I booted the fast drive, stopped SBS, installed r33242, and restarted. Several hours later the wipe scan completed showing exactly what was expected. Even the cats were happy; justifiable pride at Herger Mansions, even made the scary backtrace vanish!

Why, I'll never know, but I booted the slow drive, stopped SBS, installed r33242, rm *.db and restarted. Went to bed. 

You guessed. Screenshots attached. Same numbers when I looked from a Touch.
Comment 29 Ian Pallfreeman 2011-08-30 04:22:17 UTC
Created attachment 7441 [details]
osx screenshot
Comment 30 Ian Pallfreeman 2011-08-30 04:22:49 UTC
Created attachment 7442 [details]
same again
Comment 31 Mike Walsh 2011-08-30 10:47:24 UTC
possibly this?

bug 16112
Comment 32 SVN Bot 2011-08-31 05:26:37 UTC
 == Auto-comment from SVN commit #33262 to the slim repo by mherger ==
 == http://svn.slimdevices.com/slim?view=revision&revision=33262 ==

Bug: 17478
Description: wipe _all_ caches on a "rescan done" event
Comment 33 Michael Herger 2011-08-31 05:47:29 UTC
Ian - hard to tell what happened to your tests, unless you could provide us your scanner.log. But I found a case where I ended up with the results of the previous scan in the cache. This involved a crash of the scanner though.

The changes I've applied now are to improve handling of the caches in case the scanner fails.
Comment 34 Ian Pallfreeman 2011-08-31 08:04:44 UTC
Created attachment 7443 [details]
latest scanner.log
Comment 35 Ian Pallfreeman 2011-08-31 08:05:07 UTC
Created attachment 7444 [details]
latest server.log
Comment 36 Ian Pallfreeman 2011-08-31 08:07:51 UTC
I haven't restarted it yet, been messing with FreeNAS. :)

I doubt if they'll tell you anything -- they look just like the successful scans -- but server and scanner.log attached.