XBMC Community Forum
[WIP] AniDB.net Anime Video Scraper - Printable Version

+- XBMC Community Forum (http://forum.xbmc.org)
+-- Forum: Help and Support (/forumdisplay.php?fid=33)
+--- Forum: Add-ons Help and Support (/forumdisplay.php?fid=27)
+---- Forum: Metadata scrapers (/forumdisplay.php?fid=147)
+---- Thread: [WIP] AniDB.net Anime Video Scraper (/showthread.php?tid=64587)



- pathw - 2011-02-26 13:30

I already wrote a small script to generate the nfo files using the udp api, so I can share that Smile.

I have 100% correct results on anime detection at the moment. Right now the only problems I have are specials and movie parts because xbmc only allows numeric episode numbers, so it doesnt support anidb's format. I've filed a report for that, but I have no idea if it will be picked up.


The other problem is fanart come's from tvdb, so it's sometimes wrong. The mediaInfo 2 view seems to use fanart instead of scaling the images from anidb :/


- Finalspace - 2011-02-26 15:00

pathw Wrote:I already wrote a small script to generate the nfo files using the udp api, so I can share that Smile.
:/

That would be great if you can share your script =)

I checked the documentations for the tvshow.nfo at it seems that every episode filename must contain a .nfo also which contains the actual episode infos... is that correct?

I thought that all episode infos are stored in a single xml/nfo file :-(


- pathw - 2011-02-26 15:10

so for tv shows there is one nfo for the filename and one nfo for each episode. But this doesnt matter. As long as your files are named correctly, the problem you have with it not recognising episodes has nothing to do with the scraper. It's because of an issue in xbmc.

I have filed a ticket which hopefully will be fixed. Otherwise the only way to fix it is to number specials as Season 0 Episode (special number). And this only takes into account specials which start with S. Not Trailers, or Openings and such.

Its possible to change the tracker to take all these files into account without the xbmc bug being fixed. but it will require renaming all specials according to some retarded convention that we will have to come up with. Which will suck, but will atleast work I guess :/.

I hope the bug gets fixed though. I'm not keen on renaming my files.

I'll upload my script to github today Smile.
Edit: Here you go. https://github.com/pathsny/anidb-ruby


- Finalspace - 2011-02-27 18:32

pathw Wrote:so for tv shows there is one nfo for the filename and one nfo for each episode. But this doesnt matter. As long as your files are named correctly, the problem you have with it not recognising episodes has nothing to do with the scraper. It's because of an issue in xbmc.

I have filed a ticket which hopefully will be fixed. Otherwise the only way to fix it is to number specials as Season 0 Episode (special number). And this only takes into account specials which start with S. Not Trailers, or Openings and such.

Its possible to change the tracker to take all these files into account without the xbmc bug being fixed. but it will require renaming all specials according to some retarded convention that we will have to come up with. Which will suck, but will atleast work I guess :/.

I hope the bug gets fixed though. I'm not keen on renaming my files.

I'll upload my script to github today Smile.
Edit: Here you go. https://github.com/pathsny/anidb-ruby

I checked out your script and looked over the code... but i dont think this script would help me.

Because i have an issue with xbmc that not all tv series folder are used for the scrapper. Some folders are simply skipped and if i "detect" this folders manually it works. Almost every folder which are detected manually or automatic seems to be correct, with some exceptions like anime "Burn up" which are not detected as an anime :-( There seems to be a US TV show called burn up and this is returned from TVDB.

Of course the specials does not appear, because all special files are renamed to epS1, epS2... and you have already tracked a bug for this and we can simply go to the files folders from within xbmc and start the special from the non-database mode, so i think i can live with that for now.

The issue with movies, it seems i dont have that problem.
All my movies are renamed as ep1-x and for movies which contains several parts it starts with ep2 instead of ep1, because animes mostly have a complete version of that movie (ep1) and parted movies (ep2-x).

This is the way i got the data from the anidb udp api.

Sometimes i got a C1, or T1 as episodes names and does are not detected as well. I think T stands for trailers but i dont know what C stands for.

But, thanks for sharing =)


Some tip for your rubi anidb client. Add some local caching to your application. Files which are already renamed and all infos was scanned should be saved in a database like system and skipped if not forced for rescan.


- pathw - 2011-02-27 20:43

Finalspace Wrote:I checked out your script and looked over the code... but i dont think this script would help me.

Because i have an issue with xbmc that not all tv series folder are used for the scrapper. Some folders are simply skipped and if i "detect" this folders manually it works. Almost every folder which are detected manually or automatic seems to be correct, with some exceptions like anime "Burn up" which are not detected as an anime :-( There seems to be a US TV show called burn up and this is returned from TVDB.


if you have the nfo files, it uses the nfo files for lookup. So I'm surprised you have this problem. I dont.

Finalspace Wrote:Of course the specials does not appear, because all special files are renamed to epS1, epS2... and you have already tracked a bug for this and we can simply go to the files folders from within xbmc and start the special from the non-database mode, so i think i can live with that for now.

The issue with movies, it seems i dont have that problem.
All my movies are renamed as ep1-x and for movies which contains several parts it starts with ep2 instead of ep1, because animes mostly have a complete version of that movie (ep1) and parted movies (ep2-x).

This is the way i got the data from the anidb udp api.

oh ok. For movies, I used the "name" to rename them from the udp api.


Finalspace Wrote:Some tip for your rubi anidb client. Add some local caching to your application. Files which are already renamed and all infos was scanned should be saved in a database like system and skipped if not forced for rescan.

hehe. The reason I havent done caching is my script moves files that are recognised. So I keep all identified files in a separate physical location Smile.


- Finalspace - 2011-02-28 20:08

I found the cause of my issue with the anidb scrapper.

There was two folders which are named as:

Bishoujo Senshi Sailor Moon R
Bishoujo Senshi Sailor Moon R (1993)

If i search for content for that folders, it crashes xbmc silently and i have to kill -9 to get to my x server again...

It seems to be creating an infinite loop by detecting the fanart/banners from TVDB (not anidb!) which always returns some false data.

I think i can fix that problem by creating .nfo files for that two folders right?
Currently i dont have nfo files yet.


- pathw - 2011-02-28 22:17

I'm afraid not. The nfo files are only to fix accidental misidentification on anidb. (which happens a few times because of problems with the search api and xml). But fanart is always looked up on tvdb


- Finalspace - 2011-03-01 21:52

That issue for infinte loop and crashes xbmc scrapping process is definitly annoying and i want to do something to get this thing working.

I can simply reproduce that for the following folders:

"Bishoujo Senshi Sailor Moon R"
"Bishoujo Senshi Sailor Moon R (1993)"
"To Heart 2 ad"

Therefore i think it happens for all animes which dont exists by the anidb name in TVDB.

If i disable every TVDB option in the anidb scaper settings it works, but only the thumbs are downloaded but no fanart/posters.

Is there some way if i can add some fanarts/banner/posters manually to an tv show? Maybe images with the same name as the show which are used as postersConfused


- d3us - 2011-03-02 23:05

does anyone know how to name naruto shippuden season 10 episodes to get info about them? it used to work fine till season 10 (episode 197)


- Finalspace - 2011-03-03 10:12

d3us Wrote:does anyone know how to name naruto shippuden season 10 episodes to get info about them? it used to work fine till season 10 (episode 197)

I can recommend using an anime file rename tool which are based on anidb UDP api.

From the anidb client page you can find an simply java client for uses that for renaming files/adding to anidb.
http://anidb.net (you need an acc to use the java client)

Therefore you can rename all your files in an format which can be read by xbmc.

Check xbmc wiki page (TVShow) for more details.