Rotten Tomatoes Scraper

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
muzzakus Offline
Senior Member
Posts: 103
Joined: Dec 2004
Reputation: 1
Post: #16
redtapemedia Wrote:Thanks for the support. I've submitted the first fully working version to trac and at the moment it's all info from RT, extra fields would be needed to be added to enable multiple ratings which is more than likely not the way the devs would like to go. I'm not so
sure about it either. However some feature I would like to get going in the future are a "tomatometer" type bar for skins and the ability to see if a movie is "fresh", "rotten" or "certified fresh". Bit one step at a time Wink

The box ofice taking is a good idea for my taste. Sometimes I like to find a mindless 50% blockbuster to watch vs. some mind bending art house movie scoring 100%
find quote
redtapemedia Offline
UMM Project
Posts: 551
Joined: Mar 2009
Post: #17
muzzakus Wrote:The box ofice taking is a good idea for my taste. Sometimes I like to find a mindless 50% blockbuster to watch vs. some mind bending art house movie scoring 100%

There would need to be changes made to XBMC itself in order to accomodate this. There is no field in the database for box office take.

I have a question for the devs regarding this though: I would like to incorporate the verdict (i.e, rotten, fresh, certified fresh) into the scraper. Is there a field that could be appropriated for this purpose already or would a new field need to be created?

I was thinking maybe the <top250> field might be appropriate, but I'm not sure what the limitations are.
find quote
shadylog Offline
Junior Member
Posts: 27
Joined: Dec 2009
Reputation: 0
Post: #18
The scraper fails to scrape from rottentomatoes (and instead scrapes from themoviedb) when you have a nfo next to your movie with a imdb link in it!
Can this be fixed? I have alot of movies with nfo's which i don't like to remove.
find quote
mkortstiege Offline
Team-XBMC Developer
Posts: 2,922
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #19
Scraper was missing needed regexp to match on imdb-ids. Fixed in SVN r25783.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
redtapemedia Offline
UMM Project
Posts: 551
Joined: Mar 2009
Post: #20
vdrfan Wrote:Scraper was missing needed regexp to match on imdb-ids. Fixed in SVN r25783.

Oops. Thanks vdrfan. Big Grin
find quote
shadylog Offline
Junior Member
Posts: 27
Joined: Dec 2009
Reputation: 0
Post: #21
The fanart/thumb messes up and uses the same art as the previous movie when your movie directories are not named "Movie (Year)".

For example
i have "Crank High Voltage (2009)", Finding Nemo, Sin City
It gives finding nemo and sin city the same art/thumb as crank. Refreshing individual movies does help but is not an option for 200 movies..
find quote
mkortstiege Offline
Team-XBMC Developer
Posts: 2,922
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #22
I am unable to reproduce. Please post a full debug log of that scan.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
teddy6565 Offline
Junior Member
Posts: 39
Joined: Nov 2008
Reputation: 1
Post: #23
I have same problem, same cover art for every movie with latest build and latest rotten tomatoes scraper? Everything else comes through, descriptions etc, I can see the cover art is being downloaded but then defauts to display the same art for first movie in folder. Any suggestions?
find quote
teddy6565 Offline
Junior Member
Posts: 39
Joined: Nov 2008
Reputation: 1
Post: #24
If noone can help with problem, could anybody please advise if they have rotten tomotoes working as default scraper on windows?? I have tried everything but always get the cover art / fanart of first scanned movie for all movies, regardless of folder / file structure.
find quote
redtapemedia Offline
UMM Project
Posts: 551
Joined: Mar 2009
Post: #25
Just so everyone knows, I'm working on getting this fixed for Dharma. It was majorly borked when Rotten Tomatoes did an overhaul on their website recently.

I've set up a project on my Github for this scraper and when it's ready I'll post a link and do a "pull" request for the admins.
find quote
redtapemedia Offline
UMM Project
Posts: 551
Joined: Mar 2009
Post: #26
I'm beginning to wonder if it is worthwhile continuing having this as a stand-alone scraper, for a few reasons:
  • The newer entries for movies on the RT site are light on actual movie information. Classification and any information bar cast and director is missing from many new entries.
  • Because not all of this information is available on all pages, it makes it far more difficult to successfully scrape. The layout of the HTML from page to page, making it harder to create a regex to cover all situations, as there are a lack of "hooks" in the underlying HTML.

There's a couple of solutions:
  • Keep the RT scraper as stand alone and pull information from other "common" scrapers OR
  • Pare it down to just ratings and maybe some other info, creating a common scraper for other scrapers to use RT ratings. This would mean the RT would not be stand alone, and would be used in conjunction with IMDB or TMDB for example.

Any thoughts?
find quote
rausch101 Offline
Fan
Posts: 582
Joined: Sep 2006
Reputation: 1
Location: Washington D.C.
Post: #27
redtapemedia Wrote:I'm beginning to wonder if it is worthwhile continuing having this as a stand-alone scraper, for a few reasons:

Any thoughts?

I think widdling it down to just ratings makes sense. I think IMDB and TMDB handle the plot/other info pretty well, but the RT ratings are still worthwhile.

Have a question? First try the XBMC online-manual and FAQ. Also: How to submit a debug log
find quote
kneufeld Offline
Junior Member
Posts: 6
Joined: Apr 2010
Reputation: 0
Post: #28
I agree, keep things simple. Use IMDB and TVDB as regular scrapers, and RT for ratings.

Here's an example of RT being used in AppleTV.

http://www.apple.com/ca/appletv/#movie-rentals-swap-4
find quote
gabbott Offline
Team-Kodi Member
Posts: 1,545
Joined: Jul 2007
Reputation: 27
Post: #29
Yeah, I'd love to be able to use IMDB for scraping with RT ratings.
find quote
olympia Offline
Team-Kodi Member
Posts: 2,502
Joined: May 2008
Reputation: 32
Post: #30
I see slight chance we would approve this in the official scrapers(IMDb, tmdb). I mean going out and grab the rating from somewhere else (eg. RT).
find quote