Bugzilla – Bug 14975
Scanner needs to be faster, smaller and more-reliable for TinySC
Last modified: 2010-04-08 17:24:23 UTC
Catch-all task for TinySC scanner work
== Auto-comment from SVN commit #29036 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29036 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Don't use memory for temp DB files.
== Auto-comment from SVN commit #29041 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29041 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Add profiling hooks
== Auto-comment from SVN commit #29042 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29042 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Data::Dump only available when DEBUGLOG true
== Auto-comment from SVN commit #29046 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29046 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Cascade valid-types RE through folderFilter()
== Auto-comment from SVN commit #29091 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29091 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Make sure --noinfolog & --nodebuglog arguments get consumed.
== Auto-comment from SVN commit #29095 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29095 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Make maintenance of TrackPersistence optional (controlled by --nostatistics).
== Auto-comment from SVN commit #7979 to the jive repo by ayoung == == https://svn.slimdevices.com/jive?view=revision&revision=7979 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Make maintenance of TrackPersistence optional (controlled by --nostatistics).
== Auto-comment from SVN commit #29096 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29096 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Make maintenance of TrackPersistence optional (controlled by --nostatistics).
== Auto-comment from SVN commit #29097 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29097 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Various optimizations, including caching the DB-handle in Slim::Schema.
== Auto-comment from SVN commit #29098 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29098 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Fix extra stuff in last checkin
== Auto-comment from SVN commit #29104 to the slim repo by andy == == https://svn.slimdevices.com/slim?view=revision&revision=29104 == Bug 14975, port mergeVA code to native DBI
== Auto-comment from SVN commit #29108 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29108 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Keep artwork cache with library (possibly actually slower because of sync mount).
== Auto-comment from SVN commit #29112 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29112 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Pass trackId instead of Track to Slim::Schema::Genre->add(); Use _preCheckAttributes for RemoteTracks objects - should resolve the tag-mapping issues. Various small changes.
== Auto-comment from SVN commit #29113 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29113 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Pass track-id instead of Track to Slim::Schema::Contributor->add().
== Auto-comment from SVN commit #29121 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29121 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Abstract genre-creation into a separate method. Separate the process of creating Contributor objects from that of the ContributorAlbum and ContributorTrack links. Lots of other small refactoring in _postCheckAttrinutes.
== Auto-comment from SVN commit #29138 to the slim repo by andy == == https://svn.slimdevices.com/slim?view=revision&revision=29138 == Bug 14975, some fixes to the artwork caching so all tracks on an album get the same coverid. Switched to native DBI for precaching code
== Auto-comment from SVN commit #29139 to the slim repo by andy == == https://svn.slimdevices.com/slim?view=revision&revision=29139 == Bug 14975, Add series resizing mode where a single image is resized to sequentially smaller thumbnails, speeding up thumbnail creation by 3-4x for our set of 5 thumbnails. Still need to hook this up to the Artwork code
== Auto-comment from SVN commit #29141 to the slim repo by andy == == https://svn.slimdevices.com/slim?view=revision&revision=29141 == Bug 14975, move precacheArtwork to use ImageResizer's series mode directly, no more going through Web::Graphics
Update hours.
== Auto-comment from SVN commit #29151 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29151 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Significant refactoring - can no create a new track without instantiating a Track object. _createOrUpdate album need to be updated so that Album objects do not need to be instantiated and the scanner need to use updateOrCreateBase()
== Auto-comment from SVN commit #29174 to the slim repo by andy == == https://svn.slimdevices.com/slim?view=revision&revision=29174 == Bug 14975, large scanner performance boost by not creating/updating DBIC objects in Scanner::Local
== Auto-comment from SVN commit #29175 to the slim repo by andy == == https://svn.slimdevices.com/slim?view=revision&revision=29175 == Bug 14975, another huge improvement by moving TrackPersistent code during _createTrack to native DBI
== Auto-comment from SVN commit #29178 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29178 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Add main::DEBUGLOG to some debug statements.
== Auto-comment from SVN commit #29179 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29179 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Use filepath instead of URL for type cache to improve cache hit rate.
== Auto-comment from SVN commit #29180 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29180 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Use filepath instead of URL for type cache to improve cache hit rate (missed a line).
== Auto-comment from SVN commit #29181 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29181 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Small performance fix in readTags.
== Auto-comment from SVN commit #29183 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29183 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Numerous small optimizations
== Auto-comment from SVN commit #29189 to the slim repo by andy == == https://svn.slimdevices.com/slim?view=revision&revision=29189 == Bug 14975, another huge performance boost by porting album code to native DBI. There should now be *no* DBIC used while scanning new tracks
== Auto-comment from SVN commit #29194 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29194 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Allow $_unknownAlbum to get id 0.
== Auto-comment from SVN commit #29252 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29252 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Add demon for scanner resizing.
== Auto-comment from SVN commit #29253 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29253 == bug 14975: gdresized Tidy up termination. Make executable.
== Auto-comment from SVN commit #29255 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29255 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Rename ImageResizer to GDResizer
Just a little more optimization to do.
== Auto-comment from SVN commit #29262 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29262 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Try going back to in-process resizing.
== Auto-comment from SVN commit #29264 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29264 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Use copy of some code from Slim::bootstrap and don't use Getopt::Long to cut down on memory overhead.
== Auto-comment from SVN commit #29312 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29312 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Use periodic commits to reduce unnecessary memory growth.
== Auto-comment from SVN commit #29314 to the slim repo by ayoung == == https://svn.slimdevices.com/slim?view=revision&revision=29314 == bug 14975: Scanner needs to be faster, smaller and more-reliable for TinySC Precache fewer artwork images for TinySC.
== Auto-comment from SVN commit #29365 to the slim repo by michael == == https://svn.slimdevices.com/slim?view=revision&revision=29365 == Bug: 14975 Description: add some of Windows' bulky system folders to the ignore list. We don't want them to be scanned. Unfortunately we can't add Recycler and some of the other special folders, as bands with that name exist...
No more planned in this area
== Auto-comment from SVN commit #29416 to the slim repo by michael == == https://svn.slimdevices.com/slim?view=revision&revision=29416 == Bug: 14975 Description: add all uppercase RECYCLER folder to blacklist. This is XP's recycle bin. If you love the group called Recycler, don't spell it all uppercase.
This bug has been marked fixed in a released version of Squeezebox Server or the accompanying firmware or mysqueezebox.com release. If you are still seeing this issue, please let us know!