[DEPRECATED]Rotten Tomatoes ratings scraper

aweome plugin, thanks alot mortstar. loving the UK classifications. Added it to our blogski (google hd420p)

lefty420 Wrote:aweome plugin, thanks alot mortstar. loving the UK classifications. Added it to our blogski (google hd420p)

Hey lefty, found your blog. Thanks for the kind words. Just FYI - the 'average rating' is not an average across IMDb and RT scores, it is data taken from the Rotten Tomatoes website. Have a look at the example in the first post

Thanks so much, Mortstar. I was enjoying RT goodness the whole time and was just too naive to know it. I was expecting it in percentages (and maybe a ripe or rotten tomato gif), but I guess that is handled by the skin? In any case, awesome scraper. I scoured the web looking for something like this and it couldn't have been easier. Thanks for taking time out to reply and for your patience.

Boo. Such an awesome scraper but all my media has NFOs (new ones with just an imdb link) and is stored in a shared mysql db. it doesn't look like there is any way this can work for me?

FreakinAye Wrote:Boo. Such an awesome scraper but all my media has NFOs (new ones with just an imdb link) and is stored in a shared mysql db. it doesn't look like there is any way this can work for me?

The scraper uses the same Nfo retrieval as the Team XBMC IMDb scraper. If you want, you can set the scraper as IMDb + RT on your movies source and refresh the info on one of your movies. I imagine it will work.

EDIT: Just updated to 1.3.7 to match Team XBMC's scraper changes i.e. "fixed: missing imdb ID in search results due to site changes"

Mortstar, this addon sounds awesome -- however, I can't get it to work for some odd reason. IMDB+RT installs and scrapes fine, for everything BUT the RT ratings. The logs even seem to show it grab everything fine from RT except for the ratings:

---
22:37:20 T:3572 DEBUG: ------ Window Init (DialogProgress.xml) ------
22:37:21 T:3572 DEBUG: CVideoDatabase::GetMovieId (smb://XBMC/Videos/Temp/Movies/About Schmidt/About Schmidt.avi), query = select idMovie from movie where idFile=55
22:37:21 T:3572 DEBUG: CAnnouncementManager - Announcement: OnRemove from xbmc
22:37:21 T:3572 DEBUG: GOT ANNOUNCEMENT, type: 8, from xbmc, message OnRemove
22:37:21 T:2652 DEBUG: msg: PICTURE::LoadImage: Unable to open image: special://masterprofile/Thumbnails/Video/Fanart/b5817e47.tbn Error: (2)
22:37:21 T:2652 ERROR: Texture manager unable to load file: special://masterprofile/Thumbnails/Video/Fanart/b5817e47.tbn
22:37:21 T:2652 DEBUG: msg: PICTURE::LoadImage: Unable to open image: special://masterprofile/Thumbnails/Video/b/b5817e47.tbn Error: (2)
22:37:21 T:2652 ERROR: Texture manager unable to load file: special://masterprofile/Thumbnails/Video/b/b5817e47.tbn
22:37:23 T:3572 DEBUG: CVideoDatabase::GetMovieId (smb://XBMC/Videos/Temp/Movies/About Schmidt/About Schmidt.avi), query = select idMovie from movie where idFile=55
22:37:23 T:3572 DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'smb://XBMC/Videos/Temp/Movies/About Schmidt/About Schmidt.avi'
22:37:23 T:3024 DEBUG: Thread CVideoInfoDownloader start, auto delete: 0
22:37:23 T:3024 DEBUG: ADDON::CScraper::GetVideoDetails: Reading movie 'http://akas.imdb.com/title/tt0257360/' using IMDb + RT scraper (file: 'C:\Users\Administrator\AppData\Roaming\XBMC\addons\metadata.imdbrt.com', content: 'movies', version: '1.3.9')
22:37:23 T:3024 DEBUG: FileCurl::Open(0014B190) http://akas.imdb.com/title/tt0257360/
22:37:23 T:3024 DEBUG: scraper: GetDetails returned <details><id>tt0257360</id><originaltitle>About Schmidt</originaltitle><chain function="GetIMDBAKATitlesById">tt0257360</chain><year>2002</year><mpaa>Rated R for some language and brief nudity</mpaa><chain function="GetIMDBCert">tt0257360</chain><tagline>Schmidt Happens</tagline><runtime>125</runtime><chain function="GetRTRatingById">tt0257360</chain><genre>Comedy</genre><genre>Drama</genre><country>USA</country><studio>New Line Cinema</studio><outline>A man upon retirement embarks on a journey to his estranged daughter&#x27;s wedding only to discover more about himself and life than he ever expected.</outline><plot>A man upon retirement embarks on a journey to his estranged daughter&#x27;s wedding only to discover more about himself and life than he ever expected.</plot><chain function="GetRTOutlineById">tt0257360</chain><chain function="GetIMDBPlotById">tt0257360</chain><chain function="GetIMDBScaledCastById">tt0257360</chain><chain function="GetIMDBDirectorsById">tt0257360</chain><chain function="GetIMDBWritersById">tt0257360</chain><chain function="GetTMDBThumbsByIdChain">tt0257360</chain><chain function="GetTMDBFanartByIdChain">tt0257360</chain><chain function="GetHDTrailersnet480p">About Schmidt</chain><chain function="GetIMDBThumbsById">tt0257360</chain></details>
22:37:23 T:3024 DEBUG: scraper: GetIMDBAKATitlesById returned <details><url cache="tt0257360-combined.html" function="ParseIMDBAKATitles">http://akas.imdb.com/title/tt0257360/combined</url></details>
22:37:23 T:3024 DEBUG: FileCurl::Open(0014B190) http://akas.imdb.com/title/tt0257360/combined
22:37:24 T:3024 DEBUG: scraper: ParseIMDBAKATitles returned <details><title>About Schmidt</title></details>
22:37:24 T:3024 ERROR: ADDON::CScraper::Run: Unable to parse web site
22:37:24 T:3024 DEBUG: scraper: GetRTRatingById returned <details><url function="ParseRTTomAll" cache="0257360-rt.html">http://www.rottentomatoes.com/alias?type=imdbid&s=0257360</url></details>
22:37:24 T:3024 DEBUG: FileCurl::Open(0014B190) http://www.rottentomatoes.com/alias?type...&s=0257360
22:37:26 T:3024 ERROR: ADDON::CScraper::Run: Unable to parse web site
22:37:26 T:3024 DEBUG: scraper: GetRTOutlineById returned <details><url function="ParseRTOutline" cache="0257360-rt.html">http://www.rottentomatoes.com/alias?type=imdbid&s=0257360</url></details>
22:37:26 T:3024 DEBUG: scraper: ParseRTOutline returned <details><outline>In this funny, touching character study, Nicholson gives one of the best performances of his career.</outline></details>
---

It seems to throw "Unable to parse web site" when trying to grab RT ratings. Any clue what might be going on?

Platform is Windows, XBMC is the latest nightly build as of 3 nights ago, using default Confluence skin.

If there's some way to debug this offline with you, let me know -- it would be appreciated!

I don't think this is unique to me -- I tried another computer with a fresh install of the last official stable release and see the same problem.

However, it ONLY fails if set to Tomatometer + All Critics.

These work fine: Tomato + Top, Average + All, Average + Top.

Figured it out.

In rt.xml, the two lines that have this:

---
<expression noclean="1">v:average&quot;&gt;.*?([0-9]+).*?count&quot;&gt;([0-9]+)</expression>
---

Need to change to:

---
<expression noclean="1">&quot;all-critics-numbers&quot;.*?([0-9]+).*?Count&quot;&gt;([0-9]+)</expression>
---

Everything works fine now!

Thanks for the heads-up freakshow, looks like RottenTomatoes have changed their website and so broken the ratings scraping. I've not had a lot of free time since your post to look in to this, but I'll try and get a fix done today.

EDIT: Just seen your fix, that'll save me plenty of time - good man

EDIT 2: Common scraper functions are now grabbing the proper values again.