Author Topic: 0.39.3 Duplicate listings in RSS  (Read 2553 times)

Offline Atamido

  • Contributor
  • ***
  • Posts: 14
0.39.3 Duplicate listings in RSS
« on: December 19, 2011, 04:12:14 am »
I've been using an RSS feed for a long time without issue, but I recently added another feed in to make my matching more efficient and to pick up more shows.  But every now and again (maybe once a week or so), entries that had appeared previously will reappear at the top and be downloaded again.  However, when I look at the RSS feed directly, the entries don't appear.  Searching the site doesn't show the new duplicate entries.  And the files listed in the download queue are dated from the previous entry.  

So it looks like Alt.Binz is intermittently misinterpreting the one RSS feed and adding duplicate entries (but it's also possible the site is randomly returning a bad feed, but how would I tell?).

Both RSS feeds are from the same service, but the first has never had an issue.  I've tried placing both URLs under the same name, and under separate names, but the result was the same.

The RSS URL that works fine is:
Code: [Select]
http://www.nzbindex.nl/rss/?q=teevee+efnet+720p&g[]=175&g[]=687&age=30&sort=agedesc&minsize=100&max=250&more=1The RSS URL with the issue is:
Code: [Select]
http://www.nzbindex.nl/rss/?q=720p.WEB-DL+-nl&g[]=117&g[]=524&g[]=122&age=30&sort=agedesc&poster=thisis%40foryou.tv+%28enjoy%29&max=100&more=1Here is an entry from the log:
Code: [Select]
[12/18/2011 12:00:10 AM] [Main] [RSS] [ThisIs@ForYou.TV (Enjoy) 720p.WEB-DL -nl] Refreshing http://www.nzbindex.nl/rss/?q=720p.WEB-DL+-nl&g[]=117&g[]=524&g[]=122&age=30&sort=agedesc&poster=thisis%40foryou.tv+%28enjoy%29&max=100&more=1
[12/18/2011 12:00:10 AM] [Main] [RSS] [ThisIs@ForYou.TV (Enjoy) 720p.WEB-DL -nl] Filter hit:[ NameRemoved.SxxExx.720p.WEB-DL.DD5.1.H.264 ]-[1/1] - "NameRemoved.SxxExx.720p.WEB-DL.DD5.1.H.264.nzb" yEnc
This entry has shown up previously in the RSS screen, and the files in the queue that were grabbed with the filter have a date of 8.3d ago.  

Please let me know if there's anything more I can do to help with this problem.  I'd really like to still have stuff automatically download without risking downloading the same thing several times.

Windows Home Server SP2
Firewall off
Alt.Binz 0.39.3 2011-10-14
« Last Edit: December 19, 2011, 04:16:59 am by Atamido »

Offline davidq666

  • Contributor
  • ***
  • Posts: 1302
  • Watashi Wa Ero Desu!
Re: 0.39.3 Duplicate listings in RSS
« Reply #1 on: December 19, 2011, 10:16:07 am »
At first glace i can't say why it's not happening with the first feed, but the easiest way to eleminate that problem is to reduce the allowed age of the feed to something under 7-8 days. Altbinz recyles the feed history after about 8 days, so if the post is still part of the feed it will be reimported and redownloaded if u haven't enabled "pause/skip already downloaded".

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Re: 0.39.3 Duplicate listings in RSS
« Reply #2 on: December 19, 2011, 10:59:14 am »
Or one could edit 'rssdb.abz' (use sqlite3 editor) and set column 'recycle_items_days' to more then 7 in the 'main' table.

Offline Atamido

  • Contributor
  • ***
  • Posts: 14
Re: 0.39.3 Duplicate listings in RSS
« Reply #3 on: December 19, 2011, 05:23:53 pm »
Okay, I've set the 'recycle_items_days' on that row to 21.

So, just to make sure I understand this correctly, Alt.Binz imports an RSS feed and attaches a date to each entry it imports.  If the entry is still in the RSS feed after the number of days specified in the 'recycle_items_days' column, it reimports the entry and adds the entry to the top of the list.  So one could make the RSS feed contain less history and/or increase the number of days that it stores an entry for.

Is that correct?

Offline Rdl

  • Administrator
  • *****
  • Posts: 4050
Re: 0.39.3 Duplicate listings in RSS
« Reply #4 on: December 19, 2011, 05:27:49 pm »
Yes

Offline Atamido

  • Contributor
  • ***
  • Posts: 14
Re: 0.39.3 Duplicate listings in RSS
« Reply #5 on: December 19, 2011, 05:29:12 pm »
Excellent, thanks for the help and a product.

I guess this thread can be moved to fixed.  :)