2009-01-31, 14:19
Hello folks,
I have a scraper issue. When scanning for movies (scraper set for parent dir: tmdb.org), some of them aren't correctly fetched, meaning I'm getting "OFDB: <title>" as movie title and nothing else as meta data. When I delete the movie from the library and run a scan for new content, I'm getting this (movie in question is Birthday Girl):So it finds the .nfo, but obivously doesn't use the imdb-URL in it, but queries tmdb.org for it, which (weirdly) returns a ofdb.de URL instead of imdb, resulting in ofdb.de getting scraped instead of imdb.com.
So there seem to be two issues (bugs?):
Build is 17419. Comments/suggestions welcome
Cheers,
-freezy.
I have a scraper issue. When scanning for movies (scraper set for parent dir: tmdb.org), some of them aren't correctly fetched, meaning I'm getting "OFDB: <title>" as movie title and nothing else as meta data. When I delete the movie from the library and run a scan for new content, I'm getting this (movie in question is Birthday Girl):
Code:
DEBUG: Sort, sorting took 0 millis
DEBUG: DoScan Scanning dir 'smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY/' as not in the database
DEBUG: Hash[movies,smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY/]:DB=[],Computed=[361B0D095D7BAAA13D48AC11379E3E86]
DEBUG: GetMovieId (smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY/cpy-bdg.avi), query = select idMovie from movie where idFile=98
DEBUG: Found matching nfo file: smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY/cpy-bdg.nfo
DEBUG: CFileSMB::Open - opened media/divx/_all/Birthday.Girl.DVDivX-CPY/cpy-bdg.nfo, fd=10000
DEBUG: CFileSMB::Close closing fd 10000
DEBUG: Not a proper xml nfo file (Error document empty., col 0, row 0)
INFO: Get URL: http://api.themoviedb.org/2.0/Movie.imdbLookup?imdb_id=tt0188453&api_key=57983e31fb435df4df77afb854740ea9
INFO: Get URL: http://api.themoviedb.org/2.0/Movie.imdbLookup?imdb_id=tt0188453&api_key=57983e31fb435df4df77afb854740ea9
INFO: Get URL: http://api.themoviedb.org/2.0/Movie.imdbLookup?imdb_id=tt0188453&api_key=57983e31fb435df4df77afb854740ea9
INFO: Get URL: http://www.ofdb.de/view.php?SText=0188453&Kat=IMDb&page=suchergebnis&sourceid=mozilla-search
DEBUG: -- nfo-scraper: ofdb.xml
DEBUG: -- nfo url: http://www.ofdb.de/film/18703,
INFO: Get URL: http://www.ofdb.de/film/18703,
INFO: Get URL: http://www.ofdb.de/plot/18703,73247,
INFO: Get URL: http://www.ofdb.de/view.php?page=fassung&fid=18703&vid=132962
INFO: Get URL: http://www.ofdb.de/view.php?page=fassung&fid=18703&vid=132962
INFO: Get URL: http://www.imdb.com/title/tt0188453/
INFO: Get URL: http://www.imdb.com/title/tt0188453/fullcredits#cast
INFO: Get URL: http://api.themoviedb.org/2.0/Movie.imdbLookup?imdb_id=tt0188453&api_key=57983e31fb435df4df77afb854740ea9
INFO: Get URL: http://www.movieposterdb.com/browse/search?title=0188453
INFO: Get URL: http://www.movieposterdb.com/movie/0188453/Birthday-Girl.html
ERROR: InternalGetDetails: Unable to parse web site [http://www.movieposterdb.com/movie/0188453/Birthday-Girl.html]
INFO: Get URL: http://www.ofdb.de/film/18703,
INFO: Get URL: http://www.ofdb.de/film/18703,
DEBUG: Adding new item to movies:smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY/cpy-bdg.avi
DEBUG: OpenDir - Using authentication url smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY
DEBUG: GetMovieId (smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY/cpy-bdg.avi), query = select idMovie from movie where idFile=98
DEBUG: GetMovieId (smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY/cpy-bdg.avi), query = select idMovie from movie where idFile=98
DEBUG: OpenDir - Using authentication url smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY
INFO: Creating thumb from: smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY/cpy-bdg.tbn as: /home/xbmc/.xbmc/userdata/Thumbnails/Video/a/ada628d5.tbn
DEBUG: SECTION:LoadDLL(Q:\system\ImageLib-i486-linux.so)
DEBUG: Loading: /usr/local/share/xbmc/system/ImageLib-i486-linux.so
DEBUG: CFileSMB::Open - opened media/divx/_all/Birthday.Girl.DVDivX-CPY/cpy-bdg.tbn, fd=10000
DEBUG: CFileSMB::Close closing fd 10000
INFO: Get URL: http://ia.media-imdb.com/images/M/MV5BMTIwNTkyOTcwMl5BMl5BanBnXkFtZTcwOTk3NTYyMQ@@._V1._SX_SY_.jpg
INFO: Creating album thumb from memory: /home/xbmc/.xbmc/userdata/Thumbnails/Video/7/77df3ab5.tbn
INFO: Get URL: http://ia.media-imdb.com/images/M/MV5BMTM1NzcyMjYyNV5BMl5BanBnXkFtZTcwNDA1NzQxMQ@@._V1._SX_SY_.jpg
INFO: Creating album thumb from memory: /home/xbmc/.xbmc/userdata/Thumbnails/Video/1/1625091a.tbn
INFO: Get URL: http://ia.media-imdb.com/images/M/MV5BMTIzNzg2MzczOF5BMl5BanBnXkFyZXN1bWU@._V1._SX_SY_.jpg
INFO: Creating album thumb from memory: /home/xbmc/.xbmc/userdata/Thumbnails/Video/1/17a9f8b4.tbn
INFO: Get URL: http://ia.media-imdb.com/images/M/MV5BMTg5MzU4NDI0NF5BMl5BanBnXkFtZTcwODY3NjkxMQ@@._V1._SX_SY_.jpg
INFO: Creating album thumb from memory: /home/xbmc/.xbmc/userdata/Thumbnails/Video/4/4072f0df.tbn
INFO: Get URL: http://ia.media-imdb.com/images/M/MV5BMTYzMTYxMjc5NV5BMl5BanBnXkFtZTYwMjQ3MjM4._V1._SX_SY_.jpg
INFO: Creating album thumb from memory: /home/xbmc/.xbmc/userdata/Thumbnails/Video/6/6a77f631.tbn
INFO: Get URL: http://ia.media-imdb.com/images/M/MV5BMjAzMzA4NzExOF5BMl5BanBnXkFtZTcwMTkwMjMyMg@@._V1._SX_SY_.jpg
INFO: Creating album thumb from memory: /home/xbmc/.xbmc/userdata/Thumbnails/Video/2/2dae02bc.tbn
INFO: Get URL: http://ia.media-imdb.com/images/M/MV5BMTM0ODU0MzA1MV5BMl5BanBnXkFtZTcwNjk3MjA4MQ@@._V1._SX_SY_.jpg
INFO: Creating album thumb from memory: /home/xbmc/.xbmc/userdata/Thumbnails/Video/a/a6a4146f.tbn
DEBUG: DoScan - Finished dir: smb://user:pass@server/divx/Birthday.Girl.DVDivX-CPY/
DEBUG: OpenDir - Using authentication url smb://user:pass@server/divx/Black.Hawk.Down.SCREENER.DVDrip.DiVX-JAR
DEBUG: Sort, sorting took 0 millis
So there seem to be two issues (bugs?):
- I read somewhere that independently of the scraper, an URL found in the .nfo file always overwrites the scraper, ie an "allocine.fr" URL should scrape data from allocine, although the scraper of the parent folder may be set to imdb. Is this not valid anymore? Does the .nfo file HAVE to be an xml file with the correct structure so the URL gets parsed?
- Even though the .nfo file and the URL are obviously found, why does the tmdb scraper still query the tmdb website? And why does it return the ofdb URL?
Build is 17419. Comments/suggestions welcome
Cheers,
-freezy.