Unable to attach WAV files, as they appear to be too large.

Have discovered a 3rd WAV file that causes the scanner to error with "unable to read more than 10 bytes from file"

Please indicate if there is a way for you to receive large files and I will supply the three WAV files for testing.

A Dropbox account ? https://www.dropbox.com .

There was an FTP once but it is discontinued .

Anything special with those files which software created them ?
How did you tag them ? are these BWF files ?

Hi Mikael,

I've uploaded the 3 files mentioned in previous comments to a dropbox account and shared the folder with your e-mail address.  Let me know if you get them ok.

The files are Microsoft/IBM RIFF compliant files (tested with riffwalk), that support the RIFF tagging format.  Indeed all the files play and display tag information correctly in Windows 7.  The files were originally proven to work with Squeezebox Server in earlier versions (v7.5.0), please see bugs 11789 and in particular 11803.

What you might consider unusual about these files is that the WAV files contain both an ID3 tag AND a WAV tag - however, as we know this is supported by Squeezebox Server as evidenced by the above bugs.

The files were created by my own software.  And are tagged by said software and tested compliant with Windows 7, riffwalk and Squeezebox Server v7.5.0 (my current installation).

These files are not Broadcast Wave Files.

Let me know if you need to know anything else.

Merry Christmas!

Best,

Robert

I'm off at holliday but did you also share with mherger ?
Our single developer ? he probably knows more and can actually do something.
I did ask in the forum , the old ftp server was actually Andy's own server , and he is not working for logitech anymore.

What i can provide (as another curious user ) is to test with my Linux install , to single out if this is somewhat OS or perl version dependent .

https://bugs-archive.lyrion.org/show_bug.cgi?id=11789

https://bugs-archive.lyrion.org/show_bug.cgi?id=11803

Ok so you been trough this before .

Ok with my server.

Logitech Media Server Version: 7.8.0 - 1387542508 @ Tue Dec 24 19:01:25 PST 2013
Hostname: nostromo.home.lan
Server IP Address: 192.168.1.50
Server HTTP Port Number: 9000
Operating system: Red Hat - EN - utf8
Platform Architecture: i686-linux
Perl Version: 5.10.1 - i386-linux-thread-multi
Database Version: DBD::SQLite 1.34_01 (sqlite 3.7.7.1)
Total Players Recognized: 4

The server did not crash , but it only managed to extract tags properly from:

02 Tears in the morning .

Artist: Beach Boys, The
Album: Good Vibrations: Thirty Years Of The Beach Boys (Disc 5)
Genre: Pop
Year: 1993 

It did not extreact tags from the other 2 files .

This is the scanner log output .

[13-12-25 12:08:47.3526] main::main (202) Starting Logitech Media Server scanner (v7.8.0, 1387542508, Tue Dec 24 19:01:25 PST 2013) perl 5.010001
[13-12-25 12:08:48.0860] Slim::Schema::forceCommit (2130) Warning: Trying to commit transactions before DB is initialized!
[13-12-25 12:08:48.7752] Slim::Music::Import::runImporter (488) Starting Slim::Media::MediaFolderScan scan
[13-12-25 12:08:48.7761] Slim::Utils::Scanner::Local::rescan (174) Discovering audio files in /media/music1
[13-12-25 12:09:34.0065] Slim::Utils::Scanner::Local::__ANON__ (257) Removing deleted audio files (0)
[13-12-25 12:09:34.0069] Slim::Utils::Scanner::Local::__ANON__ (335) Scanning new audio files (3)
[13-12-25 12:09:34.8970] Audio::Scan::scan (64) Warning: Error: Unable to read at least 10 bytes from file.
[13-12-25 12:09:35.3176] Slim::Formats::readTags (182) Error: While trying to ->getTag(/media/music1/test_files/18062/08 Blur.wav) : buffer_append_space: len 33258496 too large (max 20971520) at /usr/share/squeezeboxserver/CPAN/Audio/Scan.pm line 64.
[13-12-25 12:09:35.3182] Slim::Formats::readTags (182) Backtrace:

   frame 0: Slim::Utils::Log::logBacktrace (/usr/lib/perl5/vendor_perl/Slim/Formats.pm line 182)
   frame 1: Slim::Formats::readTags (/usr/lib/perl5/vendor_perl/Slim/Schema.pm line 1516)
   frame 2: Slim::Schema::_newTrack (/usr/lib/perl5/vendor_perl/Slim/Schema.pm line 1863)
   frame 3: Slim::Schema::updateOrCreateBase (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 789)
   frame 4: Slim::Utils::Scanner::Local::__ANON__ (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 854)
   frame 5: Slim::Utils::Scanner::Local::new (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 375)
   frame 6: Slim::Utils::Scanner::Local::__ANON__ (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 405)
   frame 7: Slim::Utils::Scanner::Local::__ANON__ (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local/Async.pm line 84)
   frame 8: Slim::Utils::Scanner::Local::Async::__ANON__ (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local/Async.pm line 165)
   frame 9: Slim::Utils::Scanner::Local::Async::find (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 102)
   frame 10: Slim::Utils::Scanner::Local::find (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 520)
   frame 11: Slim::Utils::Scanner::Local::rescan (/usr/lib/perl5/vendor_perl/Slim/Media/MediaFolderScan.pm line 64)
   frame 12: Slim::Media::MediaFolderScan::startScan (/usr/lib/perl5/vendor_perl/Slim/Music/Import.pm line 490)
   frame 13: Slim::Music::Import::runImporter (/usr/lib/perl5/vendor_perl/Slim/Music/Import.pm line 327)
   frame 14: Slim::Music::Import::runScan (/usr/libexec/squeezeboxserver-scanner line 324)
   frame 15: (eval) (/usr/libexec/squeezeboxserver-scanner line 318)
   frame 16: main::main (/usr/libexec/squeezeboxserver-scanner line 496)

[13-12-25 12:09:35.6385] Slim::Formats::readTags (182) Error: While trying to ->getTag(/media/music1/test_files/18062/08 Bye, Bye Baby.wav) : buffer_append_space: len 27785392 too large (max 20971520) at /usr/share/squeezeboxserver/CPAN/Audio/Scan.pm line 64.
[13-12-25 12:09:35.6391] Slim::Formats::readTags (182) Backtrace:

   frame 0: Slim::Utils::Log::logBacktrace (/usr/lib/perl5/vendor_perl/Slim/Formats.pm line 182)
   frame 1: Slim::Formats::readTags (/usr/lib/perl5/vendor_perl/Slim/Schema.pm line 1516)
   frame 2: Slim::Schema::_newTrack (/usr/lib/perl5/vendor_perl/Slim/Schema.pm line 1863)
   frame 3: Slim::Schema::updateOrCreateBase (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 789)
   frame 4: Slim::Utils::Scanner::Local::__ANON__ (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 854)
   frame 5: Slim::Utils::Scanner::Local::new (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 375)
   frame 6: Slim::Utils::Scanner::Local::__ANON__ (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 405)
   frame 7: Slim::Utils::Scanner::Local::__ANON__ (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local/Async.pm line 84)
   frame 8: Slim::Utils::Scanner::Local::Async::__ANON__ (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local/Async.pm line 165)
   frame 9: Slim::Utils::Scanner::Local::Async::find (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 102)
   frame 10: Slim::Utils::Scanner::Local::find (/usr/lib/perl5/vendor_perl/Slim/Utils/Scanner/Local.pm line 520)
   frame 11: Slim::Utils::Scanner::Local::rescan (/usr/lib/perl5/vendor_perl/Slim/Media/MediaFolderScan.pm line 64)
   frame 12: Slim::Media::MediaFolderScan::startScan (/usr/lib/perl5/vendor_perl/Slim/Music/Import.pm line 490)
   frame 13: Slim::Music::Import::runImporter (/usr/lib/perl5/vendor_perl/Slim/Music/Import.pm line 327)
   frame 14: Slim::Music::Import::runScan (/usr/libexec/squeezeboxserver-scanner line 324)
   frame 15: (eval) (/usr/libexec/squeezeboxserver-scanner line 318)
   frame 16: main::main (/usr/libexec/squeezeboxserver-scanner line 496)

But the scanner process did not crash it excited normally and did it's other stuff.

Regards Mikael .

Btw .
Try the latest 7.8 beta .

Btw 2.
Is this way of making files really necessary ? a more well supported format could save you some grief .
Especially considering the current reality of extremely limited support .

I understand this if you try to maintain compatibility with various other softwares , you usually ends up with wav or aiff , with their not so well supported tags , meaning the tag suport is in the file format but not many other softwares gets this.

For example no tagging software on my linux machine could read this and only half of the players where able to .

I'll start my windows partition to check them out .

I did a test with the two other files removed the comment tag and resaved with dBpowerAmp tageditor .

Then they worked ? what probably really happened was that i removed one of the tagging formats either the RIFF or Id3v .

mp3tag or puddletag cant read these files so I dont really have the knowledge to figure it out .

But this is the intresting part :

[13-12-25 12:09:35.6385] Slim::Formats::readTags (182) Error: While trying to ->getTag(/media/music1/test_files/18062/08 Bye, Bye Baby.wav) : buffer_append_space: len 27785392 too large (max 20971520) at /usr/share/squeezeboxserver/CPAN/Audio/Scan.pm line 64.

Hi Mikael,

Thanks for looking into this; I've added Michael (Slimdevices) to the shared dropbox folder to acquire the test files.

You are getting the same problems as me with the tags in the files; I use Windows 8 and Windows 7 and get: the scanner terminates unexpectedly.

You are correct that the problem is that there are two types of tag in the WAV files; if you remove either one of them, then the scanner works fine.  The problem seems to lie with the getTag() function, which must somehow confuse the two tags and ends up reading field information (e.g., a track name) as 'length' information.  As you can see from the error you have posted, it thinks that one of the fields is 27MB long!

Squeezebox Server has always supported multiple tags in files and it is useful as you say, it allows compatibility between software packages and in this case Windows 7/8.

I'm a programmer myself and have tried to debug it, but Perl is not something I understand :-( (and of course I don't have the development environment).

mherger: Any chance these files can be run through your debugger?

Cheers,

Robert

To clarify I'm not getting exactly the same problem .

One file scans just fine .

The other two don’t scan , they produce an error msg .

The scanner does not terminate unexpectedly .
It continues and does it things .

So there is differences .

Thats why I asked if you tried the latest 7.8 version .

Robert,

just wanted to respond (after testing your files), when I saw Mikael already mentioned what I'm experiencing: error messages, but no crash. And please provide some information about your system and LMS configuration.

(In reply to comment #10)
> To clarify I'm not getting exactly the same problem .
> 
> One file scans just fine .
> 
> The other two don’t scan , they produce an error msg .
> 
> The scanner does not terminate unexpectedly .
> It continues and does it things .
> 
> So there is differences .
> 
> Thats why I asked if you tried the latest 7.8 version .

Hi Michael,

Thanks for testing the files I uploaded.

I've created a mini-installation (separate from my main server) to reproduce the problem.  I downloaded the latest version from http://www.mysqueezebox.com/download which installed:

Logitech Media Server Version: 7.7.3 - 1375965195 @ Mon Aug 12 11:14:33 CUT 2013

I put the three test files in a single folder and set the media server to scan just that folder and got this in the 'information' tab:


Discovering files/directories: M:\Squeezebox Server Fault\Erroneous\Erroneous - Original   (7 of 7)   Complete  00:00:01

Scanning new music files: M:\Squeezebox Server Fault\Erroneous\Erroneous - Original   (1 of 6)   Complete  00:00:02

Media scan terminated unexpectedly (Scanning Progress)
Total Time: 00:00:03 (Tuesday, January 7, 2014 / 11:28 AM)


As you can see the media scan terminates unexpectedly.


My installation is running on Windows 7 32 bit, Service Pack 1, all latest updates installed.

For reference, the information from the media server:

Logitech Media Server Version: 7.7.3 - 1375965195 @ Mon Aug 12 11:14:33 CUT 2013
Hostname: Whitestar
Server IP Address: 192.168.42.37
Server HTTP Port Number: 9000
Operating system: Windows 7 - EN - cp1252
Platform Architecture: 586
Perl Version: 5.14.1 - MSWin32-x86-multi-thread
Database Version: DBD::SQLite 1.34_01 (sqlite 3.7.7.1)
Total Players Recognized: 0

Note that the above media files work fine (and all their tags are correctly read) in Squeezebox Server version 7.5.0 r30464.

Let me know if you need anything else.

Cheers,

Robert

And if you try 7.8 on your mini install instead of 7.7.3 ?

Please enable debugging for the scanner and run a full wipe & rescan. Then upload the resulting scanner..log. Thanks!

Hi Michael,

Please find below the scanner log from 7.7.3.  Would you like me to also install 7.8 and do the same?

[14-01-10 22:38:08.2925] Audio::Scan::scan (64) Warning: Error: Unable to read at least 10 bytes from file.
[14-01-10 22:38:08.3303] Slim::Music::Artwork::findStandaloneArtwork (158) Using 0
[14-01-10 22:38:08.4667] Slim::Utils::Scanner::Local::new (773) Handling new audio track file:///M:/Squeezebox%20Server%20Fault/Erroneous/Erroneous%20-%20Original/05%20Blues%20In%20The%20Gutter.wav
[14-01-10 22:38:09.3607] Slim::Formats::readTags (177) Error: While trying to ->getTag(M:\Squeezebox Server Fault\Erroneous\Erroneous - Original\05 Blues In The Gutter.wav) : buffer_append_space: len 36722992 too large (max 20971520) at /<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Audio/Scan.pm line 64.
[14-01-10 22:38:09.3620] Slim::Formats::readTags (177) Backtrace:

   frame 0: Slim::Utils::Log::logBacktrace (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Formats.pm line 177)
   frame 1: Slim::Formats::readTags (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1510)
   frame 2: Slim::Schema::_newTrack (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1857)
   frame 3: Slim::Schema::updateOrCreateBase (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 784)
   frame 4: Slim::Utils::Scanner::Local::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 849)
   frame 5: Slim::Utils::Scanner::Local::new (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 372)
   frame 6: Slim::Utils::Scanner::Local::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 402)
   frame 7: Slim::Utils::Scanner::Local::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local/Async.pm line 84)
   frame 8: Slim::Utils::Scanner::Local::Async::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local/Async.pm line 165)
   frame 9: Slim::Utils::Scanner::Local::Async::find (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 102)
   frame 10: Slim::Utils::Scanner::Local::find (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 515)
   frame 11: Slim::Utils::Scanner::Local::rescan (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Media/MediaFolderScan.pm line 68)
   frame 12: Slim::Media::MediaFolderScan::startScan (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 487)
   frame 13: Slim::Music::Import::runImporter (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 327)
   frame 14: Slim::Music::Import::runScan (scanner.pl line 322)
   frame 15: (eval) (scanner.pl line 316)
   frame 16: main::main (scanner.pl line 494)

[14-01-10 22:38:09.3683] Slim::Utils::Scanner::Local::new (773) Handling new audio track file:///M:/Squeezebox%20Server%20Fault/Erroneous/Erroneous%20-%20Original/07%20Sad%20Memory.wav
[14-01-10 22:38:10.3807] Slim::Formats::readTags (177) Error: While trying to ->getTag(M:\Squeezebox Server Fault\Erroneous\Erroneous - Original\07 Sad Memory.wav) : buffer_append_space: len 32265952 too large (max 20971520) at /<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Audio/Scan.pm line 64.
[14-01-10 22:38:10.3819] Slim::Formats::readTags (177) Backtrace:

   frame 0: Slim::Utils::Log::logBacktrace (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Formats.pm line 177)
   frame 1: Slim::Formats::readTags (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1510)
   frame 2: Slim::Schema::_newTrack (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1857)
   frame 3: Slim::Schema::updateOrCreateBase (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 784)
   frame 4: Slim::Utils::Scanner::Local::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 849)
   frame 5: Slim::Utils::Scanner::Local::new (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 372)
   frame 6: Slim::Utils::Scanner::Local::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 402)
   frame 7: Slim::Utils::Scanner::Local::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local/Async.pm line 84)
   frame 8: Slim::Utils::Scanner::Local::Async::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local/Async.pm line 165)
   frame 9: Slim::Utils::Scanner::Local::Async::find (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 102)
   frame 10: Slim::Utils::Scanner::Local::find (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 515)
   frame 11: Slim::Utils::Scanner::Local::rescan (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Media/MediaFolderScan.pm line 68)
   frame 12: Slim::Media::MediaFolderScan::startScan (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 487)
   frame 13: Slim::Music::Import::runImporter (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 327)
   frame 14: Slim::Music::Import::runScan (scanner.pl line 322)
   frame 15: (eval) (scanner.pl line 316)
   frame 16: main::main (scanner.pl line 494)

[14-01-10 22:38:10.3884] Slim::Utils::Scanner::Local::new (773) Handling new audio track file:///M:/Squeezebox%20Server%20Fault/Erroneous/Erroneous%20-%20Original/08%20Blur.wav
[14-01-10 22:38:10.5903] Slim::Utils::SQLiteHelper::updateProgress (398) Notify to server: ["exit"]
[14-01-10 22:38:11.8207] Slim::Utils::SQLiteHelper::updateProgress (422) Notify to server OK

Hi Michael,

Managed to install 7.8.  Here is the scanner log - NOTE that I still get the unexpected termination:

-- Version Information --

Logitech Media Server Version: 7.8.0 - 1388931871 @ Fri Jan 10 03:04:55 CUT 2014
Hostname: Whitestar
Server IP Address: 192.168.0.6
Server HTTP Port Number: 9000
Operating system: Windows 7 - EN - cp1252
Platform Architecture: 586
Perl Version: 5.14.1 - MSWin32-x86-multi-thread
Database Version: DBD::SQLite 1.34_01 (sqlite 3.7.7.1)
Total Players Recognized: 0
 
-- Media Scan Details --

Discovering files/directories: M:\Squeezebox Server Fault\Erroneous\Erroneous - Original   (7 of 7)   Complete  00:00:00

Scanning new music files: M:\Squeezebox Server Fault\Erroneous\Erroneous - Original   (1 of 6)   Complete  00:00:05

Media scan terminated unexpectedly (Scanning Progress)
Total Time: 00:00:05 (Friday, January 10, 2014 / 10:47 PM)

-- Scanner Log --

[14-01-10 22:47:22.4410] Slim::Schema::wipeAllData (2116) Wiped the database.
[14-01-10 22:47:22.4895] Slim::Music::Import::runImporter (488) Starting Slim::Media::MediaFolderScan scan
[14-01-10 22:47:22.4909] Slim::Media::MediaFolderScan::startScan (62) Starting audio-only scan in: [
  "M:\\Squeezebox Server Fault\\Erroneous\\Erroneous - Original",
]
[14-01-10 22:47:22.4920] Slim::Utils::Scanner::Local::rescan (150) Rescanning M:\Squeezebox Server Fault\Erroneous\Erroneous - Original
[14-01-10 22:47:22.4928] Slim::Utils::Scanner::Local::rescan (174) Discovering audio files in M:\Squeezebox Server Fault\Erroneous\Erroneous - Original
[14-01-10 22:47:22.5125] Slim::Utils::SQLiteHelper::updateProgress (398) Notify to server: [
  "progress:1389394042.50386||importer||M:\\Squeezebox Server Fault\\Erroneous\\Erroneous - Original|discovering_directory||1||0||",
]
[14-01-10 22:47:22.7026] Slim::Utils::SQLiteHelper::updateProgress (422) Notify to server OK
[14-01-10 22:47:22.7086] Slim::Utils::Scanner::Local::Async::__ANON__ (79) Async scanner found 7 files/dirs in 0.21 sec
[14-01-10 22:47:22.7097] Slim::Utils::SQLiteHelper::updateProgress (398) Notify to server: [
  "progress:1389394042||importer||M:\\Squeezebox Server Fault\\Erroneous\\Erroneous - Original|discovering_directory||7||7||1389394042.70897",
]
[14-01-10 22:47:22.7145] Slim::Utils::SQLiteHelper::updateProgress (422) Notify to server OK
[14-01-10 22:47:22.7161] Slim::Utils::Scanner::Local::__ANON__ (257) Removing deleted audio files (0)
[14-01-10 22:47:22.7165] Slim::Utils::Scanner::Local::__ANON__ (335) Scanning new audio files (6)
[14-01-10 22:47:22.7183] Slim::Utils::SQLiteHelper::updateProgress (398) Notify to server: [
  "progress:1389394042.71687||importer||M:\\Squeezebox Server Fault\\Erroneous\\Erroneous - Original|directory_new||1||6||",
]
[14-01-10 22:47:22.7230] Slim::Utils::SQLiteHelper::updateProgress (422) Notify to server OK
[14-01-10 22:47:22.7242] Slim::Utils::Scanner::Local::new (778) Handling new audio track file:///M:/Squeezebox%20Server%20Fault/Erroneous/Erroneous%20-%20Original/02%20Tears%20In%20The%20Morning.wav
[14-01-10 22:47:22.7851] Audio::Scan::scan (64) Warning: Error: Unable to read at least 10 bytes from file.
[14-01-10 22:47:22.8040] Slim::Utils::Scanner::Local::new (778) Handling new audio track file:///M:/Squeezebox%20Server%20Fault/Erroneous/Erroneous%20-%20Original/05%20Blues%20In%20The%20Gutter.wav
[14-01-10 22:47:22.9559] Slim::Formats::readTags (182) Error: While trying to ->getTag(M:\Squeezebox Server Fault\Erroneous\Erroneous - Original\05 Blues In The Gutter.wav) : buffer_append_space: len 36722992 too large (max 20971520) at /<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Audio/Scan.pm line 64.
[14-01-10 22:47:22.9571] Slim::Formats::readTags (182) Backtrace:

   frame 0: Slim::Utils::Log::logBacktrace (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Formats.pm line 182)
   frame 1: Slim::Formats::readTags (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1516)
   frame 2: Slim::Schema::_newTrack (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1863)
   frame 3: Slim::Schema::updateOrCreateBase (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 789)
   frame 4: Slim::Utils::Scanner::Local::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 854)
   frame 5: Slim::Utils::Scanner::Local::new (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 375)
   frame 6: Slim::Utils::Scanner::Local::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 405)
   frame 7: Slim::Utils::Scanner::Local::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local/Async.pm line 84)
   frame 8: Slim::Utils::Scanner::Local::Async::__ANON__ (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local/Async.pm line 165)
   frame 9: Slim::Utils::Scanner::Local::Async::find (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 102)
   frame 10: Slim::Utils::Scanner::Local::find (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Utils/Scanner/Local.pm line 520)
   frame 11: Slim::Utils::Scanner::Local::rescan (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Media/MediaFolderScan.pm line 64)
   frame 12: Slim::Media::MediaFolderScan::startScan (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 490)
   frame 13: Slim::Music::Import::runImporter (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 327)
   frame 14: Slim::Music::Import::runScan (scanner.pl line 324)
   frame 15: (eval) (scanner.pl line 318)
   frame 16: main::main (scanner.pl line 496)

[14-01-10 22:47:22.9634] Slim::Utils::Scanner::Local::new (778) Handling new audio track file:///M:/Squeezebox%20Server%20Fault/Erroneous/Erroneous%20-%20Original/07%20Sad%20Memory.wav
[14-01-10 22:47:23.2951] Slim::Utils::SQLiteHelper::updateProgress (398) Notify to server: ["exit"]
[14-01-10 22:47:23.5462] Slim::Utils::SQLiteHelper::updateProgress (422) Notify to server OK

-- End --

there is a setting to keep the debug settings between boots and did you enable the debug in 7.8 too ?

More of interest did the scanner actually crash in 7.8 vs 7.7.3 or did it survive ?
 And did it fail on all 3 files or just 2 .

My result was that one file of yours worked and the other 2 failed .


you get the same error as me in your 7.7.3 scan:

[14-01-10 22:38:10.3807] Slim::Formats::readTags (177) Error: While trying to ->getTag(M:\Squeezebox Server Fault\Erroneous\Erroneous - Original\07 Sad Memory.wav) : buffer_append_space: len 32265952 too large (max 20971520) at /<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Audio/Scan.pm line 64.

I don’t know if this is enough info ?

But Michael has the files to now .

Thanks Robert. Unfortunately I don't see where it crashes: the scan does complain about some data being wrong, but continues. It's only crashing at some later state.

I'll have to run this myself when I get around to it. I still do have some Windows somewhere...

I see it on My Linux install so it's cross plattform .

Hi Mikael,

In response to your comment:

- I did enable all of the debug for logging in each of the scanner's 4 components, in 7.8 too.

- It crashed (terminated unexpectedly) in both 7.7.3 and 7.8.

- One files causes it to terminate unexpectedly and the other two make it continue, but it doesn't extract the tags.  For more details, see the original description and Comment #1.

Thanks for testing on Linux.

Hi Michael,

In response to your comment: thanks for doing this.  My two-pence worth as a programmer is that I'm guessing that the tag reader is somehow confusing actual data with a length field.

The fact that the WAV files contain two tags might be a clue - as when I delete the ID3 tag from the WAV file, it scans with no problems.

Anyway, there's no substitute for running it up in the debugger!

Thanks again for looking at this, I really appreciate it.  I'm heavily invested in Logitech devices and LMS and would love to move on from 7.5.0.

Cheers,

Robert

(In reply to comment #21)
> Hi Michael,
> 
> In response to your comment: thanks for doing this.  My two-pence worth as a
> programmer is that I'm guessing that the tag reader is somehow confusing
> actual data with a length field.
> 
> The fact that the WAV files contain two tags might be a clue - as when I
> delete the ID3 tag from the WAV file, it scans with no problems.
> 
> Anyway, there's no substitute for running it up in the debugger!
> 
> Thanks again for looking at this, I really appreciate it.  I'm heavily
> invested in Logitech devices and LMS and would love to move on from 7.5.0.
> 
> Cheers,
> 
> Robert

What you can do is removing one tag field at the time and try the scan, it's not unknown to the scanner to barf on for example comment fields with strange chars or embedded artwork .

And two difference is established it does not crash in Linux it just fails and it actually reads one of the files .
My system perl is 5.10 if that makes a difference

Hi Michael,

I'll give this a go; but please bear with me as I don't have a WAV tag editor that can add or remove single fields in the tags: I'll need to manually adjust my program to do it and experiment.

There is no embedded artwork or special characters in the fields - part of my system involves a program I wrote to make sure that the tags only contain A-Z,a-z,0-9 and basic ASCII characters (i.e., 32-127 of the ASCII table); so there is definitely nothing exotic in there.

If you can run it up in your debugger in the meantime, I suspect that might find the culprit much more quickly.

Cheers,

Robert

Ok, I can reproduce the crash. It's actually only the "08 Blur.wav" file which crashes the scanner on Windows (only) with an "out of memory" error. The other files cause some warnings, but wouldn't crash.

> I'll give this a go; but please bear with me as I don't have a WAV tag
> editor that can add or remove single fields in the tags: I'll need to
> manually adjust my program to do it and experiment.

How did you tag your files then?

Hi Michael,

I think there is a single cause of the fault for all the files, it's just (as you say) that "08 Blur.wav" causes a crash by trying to allocate too much memory.

My guess is that the scanner is getting confused somewhere and reading part of the tag which is actually data as a length field.  Hence it then tries to allocate memory based on the tag length, but can't.  In the case of "08 Blur.wav" it just so happens that the data results in a huge 'length' field, but in the case of the others, it doesn't.

I tag the files using my own program, but I can assure you that it is RIFF compliant (in the case of the WAV block) and ID3 tag compliant (in the case of the ID3 tag block.  As I say, these files all used to scan without any kind of error in Squeezebox Server version 7.5.0, which I currently run on my main server.

If you have the debugger up, can you set a break point on the line that generates the error seen in the log file and see what part of the tag it is reading as the length field and why it should do that?

I think you should find the error in the ID3 block as if I remove that entire block from "08 Blur.wav" then the file scans okay.

Cheers,

Robert