[WIP] AniDB.net Anime Video Scraper

salival · 2010-05-31 21:34

I have a small problem.

When I scan a folder for the first time, it finds all episode in a series.
When I scan the folder for new content it doesn't find the newly added files.
It gives me the following error in the log file:

Code:

12:56 T:3132 M:787607552  NOTICE: My Videos: Scanning for video info using worker thread, operation took 00:11

17:51 T:2532 M:782712832 WARNING: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 3

17:51 T:2532 M:782712832   ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.

17:51 T:2532 M:782712832   ERROR: CIMDB::InternalGetEpisodeList: Unable to retrieve web site

19:21 T:3136 M:805322752 WARNING: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 3

19:21 T:3136 M:805322752   ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.

19:21 T:3136 M:805322752   ERROR: CIMDB::InternalGetEpisodeList: Unable to retrieve web site

19:21 T:3136 M:804753408  NOTICE: My Videos: Scanning for video info using worker thread, operation took 00:00

(the first few lines are from when I call the episode info, the last few lines are when I scan the folder for new content.)

xbmc log (not entirely the same log as above, but the same error)

Besides this it's a great scraper.

on another note:
It does find more anime than the ann scraper, but the ann scraper does seem to find the cast info more easily. But that's aa minor gripe I can live without. Big Grin

bambi73 · 2010-06-06 21:21

I'm aware of this bug, or at least i think it's same problem what i solved month ago. Unfortunately even if i release it right now you will need to go thru your whole library and rescan all your anime because there is wrong/partial episode list link in your database (if you still interested PM me).
Right now i'm waiting for some 10.05 beta/rc to release AniDB scraper under new addon structure.

gates · 2010-06-06 22:59

Hi,

First, thx Bambi for your great job.

I have the same bug ("scan for new content" doesnt get the new files)
What can I do to fix it ?
maybe, the simplest way is to wait your next scrapper version (with 10.05).

PS : apologise my poor english
/a french guy Smile

ZERO <ibis> · 2010-06-07 02:07

Also it would be cool if there was a way for it to detect an nfo file with the page id for any particular anime we are scraping as to save time with look ups or if the database is recreated.

chojin · 2010-06-18 23:54

Just bumped into this scraper. Finaly an AniDB scraper, and it seems it is even a very good one! Besides the above mentioned bug, it works great!

As I am a long time anidb user myself it would be a great feature if the scraper could sync the watched status of my anime in the library and the 'seen' state in my personal mylist. But I assume a scraper is not really fit to make changes on a web-service?

Anyway, keep up the good work!

Scorpius · 2010-06-30 22:25

This is a great scraper. I don't know if I have the latest version, I think I have 2010-04-29 or something.

I modified it and wrote a settings.xml so it works with the latest SVN builds and also fixed a couple of syntax errors that were avoiding the load in ScraperXMLEditor.

A way to avoid the "scan for new content" bug is to click on "TV Show Information" and then click refresh and it'll download info of all the episodes again.

Some episodes are not detected using the Google search but disabling it just for those specific shows works great.

I still haven't figured out a way to recognize the specials though. Great work!

ZERO <ibis> · 2010-07-03 00:30

The specials work fine for me using s00exx just make sure that the exx is the specal on the site.

I wish that it could somehow read the other things like previews ect.

Scorpius · 2010-07-03 03:30

Hmm... I want to avoid renaming as much as possible but it seems there is no other option (nfo file maybe?)

What about multiepisodes? The wiki says:

Code:

NOTE: for multi-episode matching to work, there needs to be a third set of parentheses on the end. This part is fed back into the regexp engine.

Will that work with this scraper?

salival · 2010-07-15 13:23

bambi73 Wrote:Right now i'm waiting for some 10.05 beta/rc to release AniDB scraper under new addon structure.

Care to release it yet? Or do you prefer to wait a little longer? Laugh

I ask this, since the settings won't work with just an addon.xml and it seems to not get the fanart based on prequels. (to my recollection it used to get the fanart of the prequel if a show didn't have any itself)

bambi73 · 2010-07-17 01:11

Sorry for no responses lately but i was quite busy at work for last 2 months and had no time for anything related to XBMC (even to use it only as player). Now my time schedule slowly returns back to normal so i hope i'll be able to continue work on AniDB scrapper and prepare it for 10.05 soon.

salival Wrote:Care to release it yet? Or do you prefer to wait a little longer?

Give me few days Cool

gates Member Posts: 67 Joined: Jun 2010 Reputation: 0	2010-06-06 22:59 Post: #73 Hi, First, thx Bambi for your great job. I have the same bug ("scan for new content" doesnt get the new files) What can I do to fix it ? maybe, the simplest way is to wait your next scrapper version (with 10.05). PS : apologise my poor english /a french guy
	find quote

ZERO <ibis> Senior Member Posts: 246 Joined: May 2010 Reputation: 1	2010-06-07 02:07 Post: #74 Also it would be cool if there was a way for it to detect an nfo file with the page id for any particular anime we are scraping as to save time with look ups or if the database is recreated.
	find quote

ZERO <ibis> Senior Member Posts: 246 Joined: May 2010 Reputation: 1	2010-07-03 00:30 Post: #77 The specials work fine for me using s00exx just make sure that the exx is the specal on the site. I wish that it could somehow read the other things like previews ect.
	find quote

Scorpius Junior Member Posts: 35 Joined: Jun 2010 Reputation: 0	2010-07-03 03:30 Post: #78 Hmm... I want to avoid renaming as much as possible but it seems there is no other option (nfo file maybe?) What about multiepisodes? The wiki says: Code: `NOTE: for multi-episode matching to work, there needs to be a third set of parentheses on the end. This part is fed back into the regexp engine.` Will that work with this scraper?
	find quote