[Release] Universal Movie Scraper

Well, even if you re-scrape the trailers in EMM, you will need to re-scan everything in XBMC to import those links, so it's almost the same.

(2012-07-01 14:07)olympia Wrote:  Well, even if you re-scrape the trailers in EMM, you will need to re-scan everything in XBMC to import those links, so it's almost the same.

EMM will tell me which trailers are missing so won't have to rescrape all the info/posters/fanart for each movie. I can just rescrape trailers only.

I just want to update all the trailers only, ill have to re-scan the movies into XBMC again but will have no choice but to do it!

It is kinda of my fault really, i should of just grabbed trailers from the start, mark it down as a lesson learned!

so..i'm having huge trouble with xbmc, as far as getting info and working it into a "media center"...
the videos play fine...but the library will not work for the life of me

i added the folder/source without a problem, but i wanted the rotten tomatoes rating, along with the imdb info (plot, cast, running time, etc)...so i set up the options as such in the universal scraper addon
the problem is that it won't even get the info...it just does nothing. The first time i loaded the source, it still got the imdb rating..it basically showed up as how it was before i installed the addon..so i disabled the default addon and used the universal scraper one instead, with the settings i chose
i added the content..and nothing happens, no info, nothing shows up..
i've tried deleting the source, readding it...nothing happens...thet "movies" options under videos doesn't even appear anymore...so..can anyone help me out...


thanks...

edit: nevermind, got it to work...had to reset a few things to get it to work....it now shows the imdb info + rt ratings...woohoo!

Hi all.
I've just started using XBMC, and I immediately found this great scraper that allows me to scrape rotten tomatoes scores. I've seen in previous posts, though, that the RT scraping part is not perfect due to some problems on RT side not directly correctable by the scraper.
I read the documentation on the wiki on the creation of scrapers and I see that some things cannot be done (like showing a second selection window only for RT), but I got some ideas while reading and I was wondering if one of these solutions may actually help in retrieving the correct result (perhaps letting the users decide in scarper settings which RT scraping method to use).


Method 1 - Use RT directly:
- get the usual stuff from IMDB
- query RT the standard way (i.e. http://www.rottentomatoes.com/search/?search={title + optionally year})
- on the resulting page, check all presented results through regexp looking for the one that matches the title AND the year (or whose year is closest - not sure this can be done)
- get the actual movie url and scrape data as usual

I'm not sure this is a viable option, it's a variation (simplification?) of what has already been proposed and said not possible. I was wondering though if, using nested regexp and custom functions, the whole searching-in-results thing was possible...



Method 2 - Use good, old google:
- get the usual stuff from IMDB
- search google for title, year and site (with site:rottentomatoes.com, something like: http://www.google.com/#hl=en&q={title}+{year} +site:rottentomatoes.com)
- get the very first result and hope for the best

I'm a bit more confident about the viability of this second option, even though I'm not sure the "double jump" (google first, RT later) is doable with the current framework. I wasn't able to find enough documentation on the wiki regarding this possibility...

IIRC this was already discussed and the outcome was that RT just needs to fix their site.
If we are gonna create difficult workaround they will never get things done.

At least the viability of these ones are better

Can you open another thread for your mod/fork please and modify your above post and have only the link in their for your new thread?
Thanks!

There you go

Thanks Martijn!
We almost overlapped in the edit!

I am yet to try this out but I do have one question; is it possible to have a scraper use more than one source for a field;
If the film name is not found on IMDB, it will then search RT etc......

If so could a local database be specified as a final source?

I have short movies and various other bits and pieces that will never be on IMDB etc. and it's irritating that they cannot be in the library.