[WIP] AniDB.net Anime Video Scraper - Printable Version
+- XBMC Community Forum (http://forum.xbmc.org)
+-- Forum: Help and Support (/forumdisplay.php?fid=33)
+--- Forum: Add-ons Help and Support (/forumdisplay.php?fid=27)
+---- Forum: Metadata scrapers (/forumdisplay.php?fid=147)
+---- Thread: [WIP] AniDB.net Anime Video Scraper (/showthread.php?tid=64587)
- ZERO <ibis> - 2011-07-02 09:29
I am out of town for a few days (normally update every few days with new anime) and the scrapper is brokeded
Hopefully there will be an update soon, thanks for the hard work!
- musera - 2011-07-04 12:52
I'm starting to really feel the lack of this scraper. Without a doubt it is the most important part of xbmc for me.
Hopefully you get the update out soon.
- bambi73 - 2011-07-04 14:22
Added: Actors thumbnail
Added: Store AniDB.net ID in database (maybe it'll be useful in future )
Changed: Episodes list correction (unexpected change in xml returned from AniDB.net)
Changed: 1->2 episode mapping correction
Changed: Small plot filtering improvement
Should be available soon from both XBMC repos
- salival - 2011-07-05 14:52
I think it now queries anidb too much, because the scraper gets temporarily banned and puts loads of xml files in the cache folder (270, about the number of anime series I have on the share). This is with a regular scan for new files, not for a complete rescan.
- bambi73 - 2011-07-06 01:50
Unfortunatelly, it has IMHO nothing to do with scraper (additionally nothing related to AniDB.net data loading changed), it's controled by XBMC if directory is scraped for changes. XBMC stores hash keys for each path/directory in DB and when this hash change then it means it needs to update/scrape it. Few weeks ago XBMC cleared all hashes in DB (don't ask me why, really have no idea ) and results was same like yours, it scraped every single anime in my library and i got temp-banned. To solve this problem i modifed scraper related code to not allow more than one request per 10sec, but it's only my local change so it doesn't help you so much. From my point of view it'll be best to scrape your anime from scratch, right now i have no better idea (or you can do it one by one manualy).
- ZERO <ibis> - 2011-07-06 09:16
I assume this is only an issue if your set up to auto update the database on load. I have yet to run into any issues but I manually scrap everything but with a few thousand gig database with tens of thousands of files I have found it best to update each item manually when I add stuff so that I know that it is entered correctly.
On that note I am slowly manually refreshing the data for each of my series so I can get the actors data. It may take a few months but it is going to be worth it
Thanks again for your work on this scrapper!
- musera - 2011-07-11 02:35
just curious on something, if you look at an anime entry often they will have a variety of other episodes that aren't part of the series or specials. Is the scraper able to pick those up and if so how do we name the file?
An example of what I mean (taken from the Naruto entry as I knew it would have heaps) is:
S1 Jump Festa 2003 - Find the Crimson Four-leaf Clover!
OP1 Rocks (1-25)
ED1 Wind (1-25)
C6 Ending 5
T1 Commercials (aired with ep100 & 94)
P1 (Parody of ep 1!) Enter! Uzumaki Naruto
I know s1 we would name the file s00e01 but for something like C1? (wondering especially for that since I have a series with a number of those)
oh I just did a big add and found the scraper still wasn't functioning correctly. it seemed to randomly skip all the episodes of a series and then happily move to the next and add them. I checked filenames were correct and they weren't an issue. Some of the series it skipped were: Papuwa, Memories Off, Memories Off 2, Memories Off 3.5, Blue Tears, Del Power X, Basquatch (a few others that I can't remember) but remember others were added (including full seasons) while these were being skipped. I do add an nfo with the correct name and anidb link in every series, checked a couple of the link were correct and they were.
- aoaaron - 2011-07-11 12:56
when I press "i" for information, no poster/artwork is shown on the left handside. info is still there like actors etc...
any fix for this please? thanks.
i am using Aeon and would appreciate some kind of fix or advice please. if i use TVDB, I'm able to get a new poster/banner but using anidb.net as the scraper, i can only get fanart.
- salival - 2011-07-11 19:09
XBMC, and so this scraper, only understands two types of episodes: specials and normal episodes.
specials are every season 0 episode (s00e01) the rest of the normal episodes are put in their respective season (s01e##, s02e##).
If you want the ops, eds etc. you will have to put them in season 0. You will not have any plot info etc., since that will be scraped of the tvdb, but at least you will see them as a special in the library view.
- bambi73 - 2011-07-11 21:21
@musera, @aoaaron: please enable debuging, scrape anime what cause you problem and post debug logs here (i mean links to pastebin of course )
More details about debuging and logs on Wiki