Clean scraping API

Just like some of the comments here:
http://xbmc.org/topfs2/2012/06/20/gsoc-2...gathering/
I couldn´t install the script through the addon browser.
After downloading it manually from here:
http://mirrors.xbmc.org/addons/eden/scri...2.scraper/

This is the error I got after starting the script:
xbmc log

Same error as above for me.

Downloading the script should work now but there are two bugs in the script. I've let someone know but it might take a bit till it's updated.

Btw once it starts working don't be surprised if there's no visual feedback on which control is focued. You'll start on the topmost control for movie data collection. By pressing Enter you can see the toggle button change it's state. Just navigate with the arrow keys up and down and when you're down, once right and click enter. It's not very user-friendly but you'll only use it once anyway.

(2012-06-20 10:08)Hitcher Wrote:  Same error as above for me.

Darn i thought i fixed the correct one. Will ask some one to push a fix.

Edit:
Correct version has been pushed to repo

(2012-06-17 01:19)Maxoo Wrote:  I'd suggest the ability to only update 1 field, like 'update every ratings of every movie', without rescraping anything else. (that would also mean bypass the search and directly use the ID in the db).

+1

I hate it when scrape a movie just at the beginning of its release as the user ratings are usually quite wrong then when only 10-20 people have voted to give their rating, so it would be great to rescrape the rating again once a month or there about when more people have given their rating.

There is already an addon available that does update IMDb user ratings, but that is only for IMDb and it would be better if XBMC could do it for any movie site source.
http://forum.xbmc.org/showthread.php?tid=107331

I made an add-on for Frodo that exactly does such a thing

http://forum.xbmc.org/showthread.php?tid=132714

@topfs2
I saw this reply on the blog post at xbmc.org:

Quote:June 20th, 2012 at 08:42 | #13

I’d tried the plugin, but on the screen on which you have to select which source directories you want to submit the list of directories is too long for my display (running 1080p res) and the list isn’t scrollable. This has to be solved otherwise at least my data will be useless/counterproductive.

topfs2 is on holiday for the next 2 weeks.

If someone else could please take the script and fix it up it would be much appreciated.

(2012-06-16 11:30)topfs2 Wrote:  I'm not 100% I follow, I'd love some more examples. What I'm not sure is if you want the cnfiguration as an xbmc user or as xbmc (code using this engine) or as a scraper developer? I haven't 100% decided what will trigger the scanning, what I'm focusing on mostly now is when you know file X exist and want to gather data on it what to do. I'd love some thoughts on the actual scanning process too if its of interest in this project.

I think the file scanning process should be completely decoupled from the scraping process. Hence the process would be as follows:

1) "Something" finds a file (this something might be an addon, it might be an external tool which notifies xbmc via e.g. JSON or it might be the integrated xbmc file scanner)

2) The path to the file or directory is pushed to the scraper which starts the process to gather meta data via xml scrapers etc.

Therefore, the important part imo is to create a good/easy to use api to push paths/directories to the scraper. The same api should probably also allow the deletion of data from the library.

I think this would really open up the file scanning process to third party addon/tool developers. Hope this helps at all.

i've posted a comment to the article at xbmc.com.
and even though i have version 0.0.4 of the script (stated working) the script fails for me..
i'd love to contribute my data if it gets fixed.

my log: http://xbmclogs.com/show.php?id=4280