Author Topic: Par2 failed - number of repair blocks incorrect  (Read 9851 times)

Offline afdad

  • Contributor
  • ***
  • Posts: 71
Par2 failed - number of repair blocks incorrect
« on: October 17, 2007, 09:03:37 pm »
During the download, ABZ correctly identified all broken files as well as the number of blocks missing for each file. (I verified the output in the PAR2 tab with Quickpar and got the same results. See also the log below.) In the end, however, ABZ downloaded one repair block too few. As a result, the repair failed. Once I manually unpaused another repair block, the repair/unrar process finished without problems.

Could the problem have occurred because the very last file in the download queue had a block missing? Maybe this last missing block was not taken into account when calculating the number of required repair blocks.

Using version 0.25.6.

Quote
[17.10.2007 20:20:41] [PAR2&Unrar] "d:\alt.binz\shrek.the.third-apathy\apathy-st3.par2" Par2 repair failed
[---]
[17.10.2007 20:20:41] [PAR2&Unrar] Loading "apathy-st3.par2".
[17.10.2007 20:20:41] [PAR2&Unrar] Loaded 116 new packets
[17.10.2007 20:20:41] [PAR2&Unrar] Loading "apathy-st3.vol000+01.par2".
[17.10.2007 20:20:41] [PAR2&Unrar] Loaded 1 new packets including 1 recovery blocks
[17.10.2007 20:20:41] [PAR2&Unrar] Loading "apathy-st3.vol001+02.par2".
[17.10.2007 20:20:41] [PAR2&Unrar] Loaded 2 new packets including 2 recovery blocks
[17.10.2007 20:20:41] [PAR2&Unrar] Loading "apathy-st3.vol031+25.par2".
[17.10.2007 20:20:41] [PAR2&Unrar] Loaded 25 new packets including 25 recovery blocks
[17.10.2007 20:20:41] [PAR2&Unrar]
[17.10.2007 20:20:41] [PAR2&Unrar] There are 57 recoverable files and 0 other files.
[17.10.2007 20:20:41] [PAR2&Unrar] The block size used was 2856076 bytes.
[17.10.2007 20:20:41] [PAR2&Unrar] There are a total of 1999 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] The total size of the data files is 5549352056 bytes.
[17.10.2007 20:20:41] [PAR2&Unrar]
[17.10.2007 20:20:41] [PAR2&Unrar] Verifying source files:
[17.10.2007 20:20:41] [PAR2&Unrar]
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.nfo" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part01.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part02.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part03.rar" - damaged. Found 35 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part04.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part05.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part06.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part07.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part08.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part09.rar" - damaged. Found 34 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part10.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part11.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part12.rar" - damaged. Found 35 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part13.rar" - damaged. Found 35 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part14.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part15.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part16.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part17.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part18.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part19.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part20.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part21.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part22.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part23.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part24.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part25.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part26.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part27.rar" - damaged. Found 34 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part28.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part29.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part30.rar" - damaged. Found 35 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part31.rar" - damaged. Found 34 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part32.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part33.rar" - damaged. Found 34 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part34.rar" - damaged. Found 35 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part35.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part36.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part37.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part38.rar" - damaged. Found 34 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part39.rar" - damaged. Found 35 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part40.rar" - damaged. Found 33 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part41.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part42.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part43.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part44.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part45.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part46.rar" - damaged. Found 33 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part47.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part48.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part49.rar" - damaged. Found 32 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part50.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part51.rar" - damaged. Found 35 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part52.rar" - damaged. Found 35 of 36 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part53.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part54.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part55.rar" - found.
[17.10.2007 20:20:41] [PAR2&Unrar] Target: "apathy-st3.part56.rar" - damaged. Found 17 of 18 data blocks.
[17.10.2007 20:20:41] [PAR2&Unrar]
[17.10.2007 20:20:41] [PAR2&Unrar] Scanning extra files:
[17.10.2007 20:20:41] [PAR2&Unrar]
[17.10.2007 20:20:41] [PAR2&Unrar]
[17.10.2007 20:20:41] [PAR2&Unrar] Repair is required.
[17.10.2007 20:20:41] [PAR2&Unrar] 17 file(s) exist but are damaged.
[17.10.2007 20:20:41] [PAR2&Unrar] 40 file(s) are ok.
[17.10.2007 20:20:41] [PAR2&Unrar] You have 1970 out of 1999 data blocks available.
[17.10.2007 20:20:41] [PAR2&Unrar] You have 28 recovery blocks available.
[17.10.2007 20:20:41] [PAR2&Unrar] Repair is not possible.
[17.10.2007 20:20:41] [PAR2&Unrar] You need 1 more recovery blocks to be able to repair.

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Par2 failed - number of repair blocks incorrect
« Reply #1 on: October 17, 2007, 09:08:50 pm »
What par2.exe version? Internal or par2 multicore? What file exactly was one block short (alt.binz par2 tab/quickpar vs par2.exe console dump in log) Also whole subject for that file is needed.

Offline afdad

  • Contributor
  • ***
  • Posts: 71
Par2 failed - number of repair blocks incorrect
« Reply #2 on: October 17, 2007, 09:25:55 pm »
I'm using version 0.25.6. I haven't copied the multicore par2 file in the misc-folder since I upgraded. So I guess it was still the 'old' internal version. The file date of the par2.exe in the misc folder is February 5, 2007. I was under the wrong impression that the multicore version would be included starting with this version.

I will download and check again. I will let you know whether the problem also occurs with the multicore version.

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Par2 failed - number of repair blocks incorrect
« Reply #3 on: October 17, 2007, 09:36:11 pm »
Ok, I found the post. What file EXACTLY was a mismatch? (100mb files :) )

Offline afdad

  • Contributor
  • ***
  • Posts: 71
Par2 failed - number of repair blocks incorrect
« Reply #4 on: October 17, 2007, 09:41:38 pm »
Sorry, I missed an inconsistency. Comparing the log and the output in the par2 tab showed that the file with the following header was in fact one block short:

Code: [Select]
(4338) [#alt.binaries.games.xbox360@efnet] Shrek.The.Third.NTSC.XBOX360-APATHY [42/68] - "apathy-st3.part40.rar" yEnc

In the par2 tab, it said 34/36 blocks available. However, in the log and using QuickPar, the same file is marked as only having 33/36 blocks available.

Note: I'm using Astranews. Hopefully, the file has the same problems on your server. ;)

Offline afdad

  • Contributor
  • ***
  • Posts: 71
Par2 failed - number of repair blocks incorrect
« Reply #5 on: October 17, 2007, 09:57:31 pm »
Logs are really useful, if you know how to read them.  :oops:   I guess I was using the multicore par 2 version, after all:

Quote
[17.10.2007 20:20:41] [PAR2&Unrar] "d:\alt.binz\shrek.the.third-apathy\apathy-st3.par2" Par2 repair failed
[17.10.2007 20:20:41] [PAR2&Unrar] par2cmdline version 0.4, Copyright (C) 2003 Peter Brian Clements.
[17.10.2007 20:20:41] [PAR2&Unrar] Modified for Alt.Binz by Rdl (v.0.4b)


If you need any further information or if I can test something for you, please let me know.

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Par2 failed - number of repair blocks incorrect
« Reply #6 on: October 17, 2007, 10:26:38 pm »
No, that's old internal par2.exe

Internal = 233472 bytes

Multicore = 184320 bytes

BTW are you sure PAR2 tab identifies 34 blocks but par2.exe AND Quickpar only 33? If that's the case that's a new case. First time that alt.binz has recognized one block more then Quickpar.

Offline afdad

  • Contributor
  • ***
  • Posts: 71
Par2 failed - number of repair blocks incorrect
« Reply #7 on: October 17, 2007, 10:40:39 pm »
OK. I just re-downloaded the mentioned file, definitely having the multicore par2 version in the misc folder (184'320 bytes).

Result: In the par2 tab, alt.binz says 34/36 blocks available. Checking the same file with QuickPar, however, says only 33/36 blocks available. So, yes indeed, alt.binz seems to think there is one block more than QuickPar.

If the file in question is not corrupted on your server, I can re-post it for you (zipped, in order to make sure you have the exact same file).

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Par2 failed - number of repair blocks incorrect
« Reply #8 on: October 17, 2007, 10:58:42 pm »
No, it is 2 bytes short. Famous Diablo bug :)

Offline afdad

  • Contributor
  • ***
  • Posts: 71
Par2 failed - number of repair blocks incorrect
« Reply #9 on: October 17, 2007, 11:14:02 pm »
Hm, "Diablo Bug". That sounds ominous. But hopefully resolvable. ;)

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Par2 failed - number of repair blocks incorrect
« Reply #10 on: October 18, 2007, 12:49:56 am »
Diablo is a software used by some of the usenet providers

Offline Jesus

  • Contributor
  • ***
  • Posts: 45
Par2 failed - number of repair blocks incorrect
« Reply #11 on: October 18, 2007, 03:47:49 am »
The Diablo Bug drops whole lines, but the file was posted to Giganews, and Giganews does not run Diablo software.  These files were damaged by the Newsmangler yenc-vanilla bug, which occasionally drops the first byte of an article.  In part40.rar, segments (113/131) and (131/131) were damaged by the yenc-vanilla encoder.  Segment 131 is supposed to be 160k but it is 159,999 bytes.

Source block size = 2,856,076
Article size = 768,000
1 block consists of 3.718849 articles

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Par2 failed - number of repair blocks incorrect
« Reply #12 on: October 18, 2007, 09:35:23 am »
I thought that also, but one of the developers of Diablo idles @#alt.binz@EFnet and says one byte drop is Diablos fault under heavy load.

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Par2 failed - number of repair blocks incorrect
« Reply #13 on: October 18, 2007, 02:05:37 pm »
Quote from: "afdad"
OK. I just re-downloaded the mentioned file, definitely having the multicore par2 version in the misc folder (184'320 bytes).

Result: In the par2 tab, alt.binz says 34/36 blocks available. Checking the same file with QuickPar, however, says only 33/36 blocks available. So, yes indeed, alt.binz seems to think there is one block more than QuickPar.

If the file in question is not corrupted on your server, I can re-post it for you (zipped, in order to make sure you have the exact same file).


No way to reproduce it here. I'll need that file.

Offline Jesus

  • Contributor
  • ***
  • Posts: 45
Par2 failed - number of repair blocks incorrect
« Reply #14 on: October 18, 2007, 05:37:30 pm »
Quote from: "Rdl"
I thought that also, but one of the developers of Diablo idles @#alt.binz@EFnet and says one byte drop is Diablos fault under heavy load.


The developers of Diablo discussed the bug on their mailing list which is archived, and they spoke in terms of whole lines dropped.  Heavy load, highspeed posts and running Diablo on Linux instead of FreeBSD is thought to unleash the bug.