Author Topic: Duplicate detection and avoid multiple downloads  (Read 2721 times)

Offline therealjoeblow

  • Contributor
  • ***
  • Posts: 87
Duplicate detection and avoid multiple downloads
« on: April 06, 2019, 06:08:03 pm »
Hi,

I've automated Alt.Binz to grab .nzb's from a RSS feed, and my filters generally look like:

*tvshow*s01*1080p*web*264*

This works fine, EXCEPT, the indexer that I use has a lot of multiple posts of the same episode but with various naming conventions that look like:

TV.Show.S01E01.Episode.Name.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group
TV.Show.S01E01.Episode.Name.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group-postbot
TV.Show.S01E01.Episode.Name.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group-obfuscated
TV.Show.S01E01.Episode.Name.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group-whiterev
TV.Show.S01E01.Episode.Name.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group-rakuv
TV.Show.S01E01.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group
TV.Show.S01E01.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group-postbot
TV.Show.S01E01.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group-obfuscated
TV.Show.S01E01.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group-whiterev
TV.Show.S01E01.1080p.AMZN.WEB-DL.DDP5.1.H.264-Group-rakuv
TV.Show.S01E01.Episode.Name.1080p.Amazon.WEB-DL.DDP5.1.H.264-Group
TV.Show.S01E01.Episode.Name.1080p.Amazon.WEB-DL.DDP5.1.H.264-Group-postbot
TV.Show.S01E01.Episode.Name.1080p.Amazon.WEB-DL.DDP5.1.H.264-Group-obfuscated
TV.Show.S01E01.Episode.Name.1080p.Amazon.WEB-DL.DDP5.1.H.264-Group-whiterev
TV.Show.S01E01.Episode.Name.1080p.Amazon.WEB-DL.DDP5.1.H.264-Group-rakuv

... well, you get the idea, and have likely seen the same thing depending on the indexer you use.

I guess the reason for the multiple posts and reposts from this particular indexer is that it gives you a better chance to grab at least one complete copy, however when automating with the RSS feed, it results in *numerous* copies of the same episode being downloaded, often filling the harddrive unexpectedly.

Problem is that every variant of the posting name is NOT always posted, so its not as simple as putting say *obfuscated* at the end of my filter to only grab those ones, because sometimes that particular variant doesn't show up.  Same thing with adding the unwanted variants to the "don't download" part of the filter list (| D).

Would it be possible to add some additional automation to Alt.Binz, so that if any variant of the following is grabbed and successfully downloaded:

*tvshow*s01*1080p*web*264*

...Then Alt.Binz will stop adding additional variants?

Cheers
TRJB