Author Topic: access violation, high CPU & memory leak  (Read 4161 times)

Offline trfb516

  • Contributor
  • ***
  • Posts: 16
access violation, high CPU & memory leak
« on: October 14, 2009, 06:42:33 pm »
hi

i am using 0.31.2 on win 7 x64 RC.
for a long time i got no problem and i am very pleased with it.

about 2 weeks ago i tried to add a few very large items to the download queue
these are very large nzb with lots of items inside each with a total size of 50-150 gb.
they were created using binsearch.info where i used the search field with a topic results with lots of item, than i selected all results and created an nzb file.

after that:
1. when i opened abz, it started with a high memory footprint (above 100mb)
2. the memory kept growing to nearly 1gb very quickly, even when most of these items were in pause mode.
3. cpu was around 50% most of the time (using intel e8500)
4. from time to time i got a message box with an "access violation" error.
5. i tried to close abz and reopen it, the log tab get filled with lots red  lines with "access violation" (at some address)
6. even when i tried to delete these large items from the queue and leave it empty the problems still persisted.

the only way to overcome these problems was to close abz and delete the queue.abz and queue.abz.prevcopy which got to a size of about 8mb each.

now everything seems to works fine as it should be.

my concern is that it seems the abz can't seem to handle very large queue items, and there is some code running at the background handling items in the queue even when they are paused, allocating memory for them without releasing it.


here is just an example from the log file (the start of it):

[13/10/2009 21:41:22] [Main] Alt.Binz 0.31.2 [03.09.2009] started.
[13/10/2009 21:41:22] [Main] Windows Vista detected
[13/10/2009 21:41:22] [Main] NLSS search results ageing done in 0ms
[13/10/2009 21:41:22] [Main] Download queue list ageing done in 0ms
[13/10/2009 21:41:22] [Main] 17994 items loaded into download history list in 93ms.
[13/10/2009 21:41:22] [Main] 0 outdated items removed from download history list in 16ms.
[13/10/2009 21:41:22] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Main]  [RSS] Refreshing http://www.tvnzb.com/tvnzb_new.rss
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:23] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [T1] Hello
[13/10/2009 21:41:24] [T3] Hello
[13/10/2009 21:41:24] [T5] Hello
[13/10/2009 21:41:24] [T7] Hello
[13/10/2009 21:41:24] [T9] Hello
[13/10/2009 21:41:24] [T3] Connecting (astraweb secure)
[13/10/2009 21:41:24] [T7] Connecting (astraweb secure)
[13/10/2009 21:41:24] [T1] Connecting (astraweb secure)
[13/10/2009 21:41:24] [T5] Connecting (astraweb secure)
[13/10/2009 21:41:24] [T9] Connecting (astraweb secure)
[13/10/2009 21:41:24] [T2] Hello
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [T2] Connecting (astraweb secure)
[13/10/2009 21:41:24] [T4] Hello
[13/10/2009 21:41:24] [T4] Connecting (astraweb secure)
[13/10/2009 21:41:24] [T6] Hello
[13/10/2009 21:41:24] [T6] Connecting (astraweb secure)
[13/10/2009 21:41:24] [T8] Hello
[13/10/2009 21:41:24] [T8] Connecting (astraweb secure)
[13/10/2009 21:41:24] [T10] Hello
[13/10/2009 21:41:24] [T10] Connecting (astraweb secure)
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:24] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:25] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:26] [T7] Connected & Authenticated (astraweb secure)
[13/10/2009 21:41:26] [T7] Article started 27/72 [4459]-[FULL]-[#a.b.teevee@EFNet]-[ House.S06E04.720p.HDTV.x264-SiTV ]-[31/32] - "house.604.instant.karma-sitv.vol07+8.par2" yEnc
[13/10/2009 21:41:27] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:27] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:27] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:27] [T3] Connected & Authenticated (astraweb secure)
[13/10/2009 21:41:27] [T5] Connected & Authenticated (astraweb secure)
[13/10/2009 21:41:27] [T3] Article started ............

...
...

[13/10/2009 21:41:28] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:28] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:28] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:28] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:28] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:29] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:29] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:29] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000
[13/10/2009 21:41:29] [Dec] Exception Access violation at address 0053BE2E in module 'altbinz.exe'. Write of address 00000000

...
...


and on and on and on....



how to reproduce:
just got to binsearch.info, search for something that return lots of results, select all and create an nzb. monitor abz memory usage and cpu usage, look in the log for errors.....

Offline davidq666

  • Contributor
  • ***
  • Posts: 1302
  • Watashi Wa Ero Desu!
Re: access violation, high CPU & memory leak
« Reply #1 on: October 14, 2009, 07:48:49 pm »
i am not a developer but my guess would be:

the error isn't the result of a huge collection, but from a to long filepath. because all errors are decoding errors and windows has a limit of about 260 characters for the complete path. if that limit is reached the file can't be created and is getting stuck in the temp dir wich is blow out of proportion causing alt.binz to consume more cpu and memory in the process...

Edith: tested it with a 164 GB collection resulting in no error:

[14.10.2009 20:07:23] [Dec] Yenc file ...001.rar decoded in .....ms
« Last Edit: October 14, 2009, 08:11:17 pm by davidq666 »

Offline reznor

  • Contributor
  • ***
  • Posts: 8
Re: access violation, high CPU & memory leak
« Reply #2 on: December 10, 2009, 02:12:23 am »
i just had this issue and had a look at the file i was currently downloading (or paused due to scheduler) and it was continuously trying to decode the file and failing so i deleted that file from the queue (just the single file not the whole collection) and it stopped.