Author Topic: my wish list  (Read 12437 times)

Offline madshi

  • Contributor
  • ***
  • Posts: 25
    • http://www.madshi.net
my wish list
« on: October 18, 2007, 08:44:25 pm »
Here's my personal wish list:

(1) I still often have "some.rarxxxx" files, which is quite annoying and which is my main wish for improvement. Being a programmer myself here are some thoughts on why this problem might happen:

- I think alt.binz opens a file (let's call it file "A") with write access, then it writes something to the file, then it closes file A again.

- The AV software sees what alt.binz has done and thinks: "Oh, file A was modified, so I have to check if there's a virus in that file now." So of course the AV software now opens the file with read access (probably with FILE_SHARE_READ/FILE_SHARE_WRITE set) and reads it.

- Before the AV software is done with checking the file, alt.binz decides to open file A again with write access, to do some further manipulation to the file. But opening the file with write access fails, because the AV software has already opened the file and alt.binz probably doesn't use FILE_SHARE_READ.

Of course I'm only guessing. But if I'm right with these guesses, I've two suggestions on how to solve this problem:

- alt.binz should use FILE_SHARE_READ when opening files for write access. This might already fix the problem, if we have luck.

- Additionally, alt.binz might want to keep the file handles open, until everything is done. This might also fix the problem. And it might also improve decoding performance as a side effect.

(2) Once download + par2 + unraring was completed successfully for a specific NZB, I'd like two things to happen: (a) The remaining items in the "download queue" und "par2" tabs for this NZB should automatically be cleaned up. And (b) I'd like altbinz to call a specific batch file or exe which I'd like to specify in the options. The bat/exe should be called with the first parameter set to the file path of the folder in which the finished download is located. This way I could write my own exe which takes the fully unrared download and does some further automated processing to it.

(3) In the "download queue" those files which were fully downloaded are automatically removed from the list. However, in the "par2" tab those files which were successfully tested (green) stay in the list. I'd like it if those files which were tested to be fine would automatically be removed from the "par2" tab. So if everything is alright, only the main "par2" entry would remain in the "par2" tab. Or if there are problems, only those files which needs to be repaired would still be listed in the "par2" tab. This is not really important, though.

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Re: my wish list
« Reply #1 on: October 18, 2007, 09:20:20 pm »
Quote from: "madshi"
Here's my personal wish list:

(1) I still often have "some.rarxxxx" files, which is quite annoying and which is my main wish for improvement. Being a programmer myself here are some thoughts on why this problem might happen:

- I think alt.binz opens a file (let's call it file "A") with write access, then it writes something to the file, then it closes file A again.

- The AV software sees what alt.binz has done and thinks: "Oh, file A was modified, so I have to check if there's a virus in that file now." So of course the AV software now opens the file with read access (probably with FILE_SHARE_READ/FILE_SHARE_WRITE set) and reads it.

- Before the AV software is done with checking the file, alt.binz decides to open file A again with write access, to do some further manipulation to the file. But opening the file with write access fails, because the AV software has already opened the file and alt.binz probably doesn't use FILE_SHARE_READ.

Of course I'm only guessing. But if I'm right with these guesses, I've two suggestions on how to solve this problem:

- alt.binz should use FILE_SHARE_READ when opening files for write access. This might already fix the problem, if we have luck.

- Additionally, alt.binz might want to keep the file handles open, until everything is done. This might also fix the problem. And it might also improve decoding performance as a side effect.


Filestreams for articles(parts) are opened with fmOpenread or fmShareDenyWrite right. Filestream for final file is opened with fmCreate or fmShareDenyWrite and is closed after all operations are done. New article caching can only help in resolving conflict with avp software cause articles(parts) in best case scenario never land on HD.

Quote from: "madshi"
(2) Once download + par2 + unraring was completed successfully for a specific NZB, I'd like two things to happen: (a) The remaining items in the "download queue" und "par2" tabs for this NZB should automatically be cleaned up. And (b) I'd like altbinz to call a specific batch file or exe which I'd like to specify in the options. The bat/exe should be called with the first parameter set to the file path of the folder in which the finished download is located. This way I could write my own exe which takes the fully unrared download and does some further automated processing to it.


(a) is already possible (setup->misc) Cleanup option.
(b) is reasonable request. Specific batch/exe per collection. It will be executed once par2 set checks ok and alt.binz has finished all jobs on specific set(par2 cleanup & similar... if set) or after unrar if it was set for that collection/par2 set (again after all alt.binz jobs after unrar, if any)

Quote from: "madshi"
(3) In the "download queue" those files which were fully downloaded are automatically removed from the list. However, in the "par2" tab those files which were successfully tested (green) stay in the list. I'd like it if those files which were tested to be fine would automatically be removed from the "par2" tab. So if everything is alright, only the main "par2" entry would remain in the "par2" tab. Or if there are problems, only those files which needs to be repaired would still be listed in the "par2" tab. This is not really important, though.


I guess switch could be implemented. When enabled only 'red files' would be visible. That would do the job.

Offline madshi

  • Contributor
  • ***
  • Posts: 25
    • http://www.madshi.net
Re: my wish list
« Reply #2 on: October 18, 2007, 09:51:43 pm »
Quote from: "Rdl"
Filestreams for articles(parts) are opened with fmOpenread or fmShareDenyWrite right. Filestream for final file is opened with fmCreate or fmShareDenyWrite and is closed after all operations are done.

Sounds about right. What is your guess where those some.rarxxxx files are coming from? I have them even with AV disabled! Not with every download, but I have them in about 1 out of 5 downloads. Most of the time they're not too bad (they just waste space) but sometimes unraring fails if there are such files...

Quote from: "Rdl"
New article caching can only help in resolving conflict with avp software cause articles(parts) in best case scenario never land on HD.

The files I'm downloading are too big for such a cache. Multi-GB.

Quote from: "Rdl"
is already possible (setup->misc) Cleanup option.

Missed that - thanks...  :oops:

Quote from: "Rdl"
is reasonable request. Specific batch/exe per collection. It will be executed once par2 set checks ok and alt.binz has finished all jobs on specific set(par2 cleanup & similar... if set) or after unrar if it was set for that collection/par2 set (again after all alt.binz jobs after unrar, if any)

Sounds good!!  :)

Quote from: "Rdl"
I guess switch could be implemented. When enabled only 'red files' would be visible. That would do the job.

Yep, that should do exactly what I'm looking for.

--------------------------------------

Thank you!!   :D

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Re: my wish list
« Reply #3 on: October 18, 2007, 10:32:41 pm »
Quote from: "madshi"
Quote from: "Rdl"
Filestreams for articles(parts) are opened with fmOpenread or fmShareDenyWrite right. Filestream for final file is opened with fmCreate or fmShareDenyWrite and is closed after all operations are done.

Sounds about right. What is your guess where those some.rarxxxx files are coming from? I have them even with AV disabled! Not with every download, but I have them in about 1 out of 5 downloads. Most of the time they're not too bad (they just waste space) but sometimes unraring fails if there are such files...


I'm not sure. What AV are you using?(version also) I guess KAV cause it's known that even when disabled it causes problems. Either uninstall or makeing exception for altbinz.exe (This must be done for every single version, probably checks md5 of the exe)

Quote from: "madshi"
Quote from: "Rdl"
New article caching can only help in resolving conflict with avp software cause articles(parts) in best case scenario never land on HD.

The files I'm downloading are too big for such a cache. Multi-GB.

There are not much files on the usenet that are larger then 100mb? So setting max cache to 250mb should be enough (it all depends on your download speed and decoding speed)

Offline madshi

  • Contributor
  • ***
  • Posts: 25
    • http://www.madshi.net
Re: my wish list
« Reply #4 on: October 19, 2007, 10:26:39 am »
Quote from: "Rdl"
I'm not sure. What AV are you using?(version also) I guess KAV cause it's known that even when disabled it causes problems.

Yes, it's Kaspersky Internet Security 6.0.

Quote from: "Rdl"
Either uninstall or makeing exception for altbinz.exe (This must be done for every single version, probably checks md5 of the exe)

But why does no other program have problems with Kaspersky? There must be something specific to altbinz? Before I've used GrabIt. It never had any problems with Kasperksy. altbinz is better in every other way, though.

Quote from: "madshi"
There are not much files on the usenet that are larger then 100mb? So setting max cache to 250mb should be enough (it all depends on your download speed and decoding speed)

You're right. The single rar files are usually about 100mb. Unfortunately I'm short on RAM (1GB only). So I'm afraid of slowing the OS down too much when using too much cache...

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
my wish list
« Reply #5 on: October 19, 2007, 10:39:34 am »
I'll implement few more changes in 0.26.1 Lets see how that goes and we will work from there.

Offline madshi

  • Contributor
  • ***
  • Posts: 25
    • http://www.madshi.net
my wish list
« Reply #6 on: October 19, 2007, 10:42:05 am »
Great - thank you...  :)

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Re: my wish list
« Reply #7 on: October 19, 2007, 01:29:55 pm »
Quote from: "Rdl"

Quote from: "madshi"
(3) In the "download queue" those files which were fully downloaded are automatically removed from the list. However, in the "par2" tab those files which were successfully tested (green) stay in the list. I'd like it if those files which were tested to be fine would automatically be removed from the "par2" tab. So if everything is alright, only the main "par2" entry would remain in the "par2" tab. Or if there are problems, only those files which needs to be repaired would still be listed in the "par2" tab. This is not really important, though.


I guess switch could be implemented. When enabled only 'red files' would be visible. That would do the job.


Added

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Re: my wish list
« Reply #8 on: October 20, 2007, 11:50:12 pm »
Quote from: "Rdl"

Quote from: "madshi"
(2) Once download + par2 + unraring was completed successfully for a specific NZB, I'd like two things to happen: (a) The remaining items in the "download queue" und "par2" tabs for this NZB should automatically be cleaned up. And (b) I'd like altbinz to call a specific batch file or exe which I'd like to specify in the options. The bat/exe should be called with the first parameter set to the file path of the folder in which the finished download is located. This way I could write my own exe which takes the fully unrared download and does some further automated processing to it.


(a) is already possible (setup->misc) Cleanup option.
(b) is reasonable request. Specific batch/exe per collection. It will be executed once par2 set checks ok and alt.binz has finished all jobs on specific set(par2 cleanup & similar... if set) or after unrar if it was set for that collection/par2 set (again after all alt.binz jobs after unrar, if any)


Added. There is a default execute command under setup->NZB #2, but command can be specified separatly for any collection.

Format for command is:
full_path_to_exe_bat_or_whatever "parameters"

Use $d for full download path without a trailing delimiter
Use $u for full unrar path without a trailing delimiter

Examples:

c:\util\MyCleanupRoutine.exe "-a $d"
c:\util\CleanupAfterUnrar.bat "$d $u"