2011-01-21, 19:27
I am attempting to modify TheMovieDB scraper TMDB.xml to pickup additional MPAA rating information from IMDB (i.e. Rated R "for excessive violence"). I can get the "Rated R" portion from the certification tag on TMDB, but when I try and append the additional information from IMDB using a custom function, nothing shows up. I have beat my head against this for a couple of days so I thought I would ask for some help since documentation of scraper development is scarce at best. I have tested in ScraperXMLEdition using the movie "2012", and everything seems to be working correctly. Certification is read from TMDB and additional info is read from IMDB and appended. It just doesn't show up in XBMC as "MPAA Rating" as it should. What is it that I am doing wrong? Any help would be appreciated.
Note: I am using Camelot as Dharma is randomly crashing on me.
Here is my full tmdb.xml file:
The specific portions I have added in GetDetails. First, copy the TMDB page into buffer 6 for use in my custom function. Then call custom function to get MPAA rating + additional information:
Then my custom function. Build up something like "<details><mpaa>Rated R for excessive violence</mpaa></details>":
Note: I am using Camelot as Dharma is randomly crashing on me.
Here is my full tmdb.xml file:
Code:
<?xml version="1.0" encoding="utf-8"?><scraper framework="1.1" date="2011-01-20" name="themoviedb.org" content="movies" thumb="tmdb.png" language="en">
<include>common/tmdb.xml</include>
<include>common/dtrailer.xml</include>
<GetSettings dest="3">
<RegExp input="$$5" output="<settings>\1</settings>" dest="3">
<RegExp input="$$1" output="<setting label="Enable Fanart" type="bool" id="fanart" default="true"></setting>" dest="5+">
<expression />
</RegExp>
<RegExp input="$$1" output="<setting label="Enable Trailers from Dtrailer.com" type="bool" id="dtrailer" default="false"></setting>" dest="5+">
<expression />
</RegExp>
<RegExp input="$$1" output="<setting label="Enable additional MPAA Ratings info from IMDB.com" type="bool" id="imdbmpaa" default="true"></setting>" dest="5+">
<expression />
</RegExp>
<expression noclean="1" />
</RegExp>
</GetSettings>
<CreateSearchUrl dest="3">
<RegExp input="$$1" output="<url>http://api.themoviedb.org/2.1/Movie.search/en/xml/57983e31fb435df4df77afb854740ea9/\1</url>" dest="3">
<RegExp input="$$2" output="%20(\1)" dest="4">
<expression clear="yes">(.+)</expression>
</RegExp>
<expression noclean="1" />
</RegExp>
</CreateSearchUrl>
<NfoUrl dest="3">
<RegExp input="$$1" output="<url>http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/\2</url><id>\2</id>" dest="3">
<expression clear="yes" noclean="1">(themoviedb.org/movie/)([0-9]*)</expression>
</RegExp>
<RegExp input="$$1" output="<url function="GetTMDBId">http://api.themoviedb.org/2.0/Movie.imdbLookup?imdb_id=tt\2&amp;api_key=57983e31fb435df4df77afb854740ea9</url>" dest="3+">
<expression>(imdb.com/title/tt)([0-9]*)</expression>
</RegExp>
<RegExp input="$$1" output="<url function="GetTMDBId">http://api.themoviedb.org/2.0/Movie.imdbLookup?imdb_id=tt\2&amp;api_key=57983e31fb435df4df77afb854740ea9</url>" dest="3+">
<expression>(imdb.com/)Title\?([0-9]+)</expression>
</RegExp>
</NfoUrl>
<GetTMDBId dest="3">
<RegExp input="$$1" output="<url cache="tmdb-\1.xml">http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/\1</url><id>\1</id>" dest="3+">
<expression><id>([0-9]*)</id></expression>
</RegExp>
</GetTMDBId>
<GetSearchResults dest="8">
<RegExp input="$$3" output="<results>\1</results>" dest="8">
<RegExp input="$$1" output="<entity><title>\1</title><id>\2</id><url cache="tmdb-\2.xml">http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/\2</url></entity>" dest="3">
<expression repeat="yes"><movie>.*?<name>([^<]*)</name>.*?<id>([^<]*)</id>.*?</movie></expression>
</RegExp>
<expression noclean="1" />
</RegExp>
</GetSearchResults>
<GetDetails clearbuffers="no" dest="3">
<RegExp input="$$5" output="<details>\1</details>" dest="3">
<RegExp input="$$1" output="\1" dest="6">
<expression noclean="1"></expression>
</RegExp>
<RegExp input="$$1" output="<title>\1</title>" dest="5">
<expression><name>([^<]*)</name></expression>
</RegExp>
<RegExp input="$$1" output="<year>\1</year>" dest="5+">
<expression><released>([0-9]+)-</expression>
</RegExp>
<RegExp input="$$1" output="<runtime>\1</runtime>" dest="5+">
<expression><runtime>([^<]*)</runtime></expression>
</RegExp>
<RegExp input="$$1" output="<rating>\1</rating>" dest="5+">
<expression><rating>([^<]*)</rating></expression>
</RegExp>
<RegExp input="$$1" output="<genre>\1</genre>" dest="5+">
<expression repeat="yes"><category type="genre".*?name="([^"]*)"</expression>
</RegExp>
<RegExp input="$$1" output="<studio>\1</studio>" dest="5+">
<expression repeat="yes"><studio.*?name="([^"]*)"</expression>
</RegExp>
<RegExp input="$$1" output="<plot>\1</plot>" dest="5+">
<expression><overview>([^<]*)</overview></expression>
</RegExp>
<RegExp input="$$1" output="<overview>\1</overview>" dest="5+">
<expression><overview>([^<]*)</overview></expression>
</RegExp>
<RegExp input="$$1" output="<director>\1</director>" dest="5+">
<expression repeat="yes"><person.*?name="([^"]*)" character="" job="Director"</expression>
</RegExp>
<RegExp input="$$1" output="<credits>\1</credits>" dest="5+">
<expression repeat="yes"><person.*?name="([^"]*)" character="" job="Author"</expression>
</RegExp>
<RegExp input="$$1" output="<actor><name>\1</name><role>\2</role></actor>" dest="5+">
<expression repeat="yes"><person.*?name="([^"]*)" character="([^"]*)" job="Actor"</expression>
</RegExp>
<RegExp input="$$1" output="<actor><name>\1</name><role>\2</role><thumb>http://\4\5</thumb></actor>" dest="5+">
<expression repeat="yes"><person.*?name="([^"]*)" character="([^"]*)" job="Actor" id="([0-9]+)" thumb="http://(.*?)_thumb([^"]*)"</expression>
</RegExp>
<!--Get the MPAA info from IMDB.com if the IMDBmpaa setting is set to true-->
<RegExp input="$$1" output="<url cache="\1-mpaa.html" function="GetIMDBMPAAInfo">http://www.imdb.com/title/\1</url>" dest="5+">
<expression noclean="1"><imdb_id>([^<]*)</imdb_id></expression>
</RegExp>
<RegExp input="$$1" output="<url cache="tmdb-$$2.xml" function="GetTMDBThumbsById">$$3</url>" dest="5+">
<expression />
</RegExp>
<RegExp conditional="fanart" input="$$1" output="<url cache="tmdb-$$2.xml" function="GetTMDBFanartById">$$3</url>" dest="5+">
<expression />
</RegExp>
<RegExp conditional="dtrailer" input="$$6" output="<url function="GetDTrailerLink">http://en.dtrailer.com/movies/search/\1</url>" dest="5+">
<RegExp input="$$4" output="\1-" dest="6">
<RegExp input="$$1" output="\1" dest="4">
<expression><name>([^<]*)</name></expression>
</RegExp>
<expression repeat="yes">([a-zA-Z0-9]+)</expression>
</RegExp>
<expression />
</RegExp>
<expression noclean="1" />
</RegExp>
</GetDetails>
<GetIMDBMPAAInfo clearbuffers="no" dest="8">
<RegExp input="$$6" output="<details><mpaa>Rated \1 " dest="8">
<expression><certification>([^<]*)</certification></expression>
</RegExp>
<RegExp input="$$1" output="\1</mpaa></details>" dest="8+">
<expression>MPAA</a>\)</h4>\nRated [PGRNC\-137]{1,5} ([^\.*]*)</expression>
</RegExp>
</GetIMDBMPAAInfo>
</scraper>The specific portions I have added in GetDetails. First, copy the TMDB page into buffer 6 for use in my custom function. Then call custom function to get MPAA rating + additional information:
Code:
<RegExp input="$$5" output="<details>\1</details>" dest="3">
<RegExp input="$$1" output="\1" dest="6">
<expression noclean="1"></expression>
</RegExp>
...
<!--Get the MPAA info from IMDB.com if the IMDBmpaa setting is set to true-->
<RegExp input="$$1" output="<url cache="\1-mpaa.html" function="GetIMDBMPAAInfo">http://www.imdb.com/title/\1</url>" dest="5+">
<expression noclean="1"><imdb_id>([^<]*)</imdb_id></expression>
</RegExp>Then my custom function. Build up something like "<details><mpaa>Rated R for excessive violence</mpaa></details>":
Code:
<GetIMDBMPAAInfo clearbuffers="no" dest="8">
<RegExp input="$$6" output="<details><mpaa>Rated \1 " dest="8">
<expression><certification>([^<]*)</certification></expression>
</RegExp>
<RegExp input="$$1" output="\1</mpaa></details>" dest="8+">
<expression>MPAA</a>\)</h4>\nRated [PGRNC\-137]{1,5} ([^\.*]*)</expression>
</RegExp>
</GetIMDBMPAAInfo>
