Scraping movies to MYSQL database fails.
#1
I'm trying to move the databases to a central place, and I've got no problems with the music database. The Video database however isn't working. I've read that using UNC ("\\") gave problems, but with smb:// it still doesn't work for me. The paths table is the only one that get's filled.

idPath strPath strContent strScraper strHash scanRecursive useFolderNames strSettings noUpdate exclude
1 smb://qnap/video/ movies metadata.themoviedb.org NULL 2147483647 1 <settings><setting id="TrailerQ" value="480p" /><s... 0 0
2 smb://qnap/video/Brooklyns Finest (2009)/BDMV/ NULL NULL NULL NULL NULL NULL

XBMC 10.0, MYSQL 5.1.36

<advancedsettings>
<videodatabase>
<type>mysql</type>
<host>QNAP</host>
<port>3306</port>
<user>xbmc</user>
<pass>*******</pass>
<name>xbmc_video</name>
</videodatabase>

<musicdatabase>
<type>mysql</type>
<host>QNAP</host>
<port>3306</port>
<user>xbmc</user>
<pass>*******</pass>
<name>xbmc_music</name>
</musicdatabase>
</advancedsettings>

13:55:13 T:5636 M:2043510784 DEBUG: CIMDB::InternalFindMovie: Searching for 'brooklyns finest' using The MovieDB scraper (path: 'C:\Program Files (x86)\XBMC\addons\metadata.themoviedb.org', content: 'movies', version: '1.2.0')
13:55:13 T:5636 M:2043510784 DEBUG: scraper: CreateSearchUrl returned <url>http://api.themoviedb.org/2.1/Movie.search/en/xml/57983e31fb435df4df77afb854740ea9/brooklyns%20finest</url>
13:55:13 T:5636 M:2043510784 DEBUG: FileCurl::Open(0644F16C) http://api.themoviedb.org/2.1/Movie.sear...s%20finest
13:55:13 T:5636 M:2043486208 INFO: XCURL:Big GrinllLibCurlGlobal::easy_aquire - Created session to http://api.themoviedb.org
13:55:14 T:5636 M:2043404288 DEBUG: FileCurl::Close(0644F16C) http://api.themoviedb.org/2.1/Movie.sear...s%20finest
13:55:14 T:5636 M:2043404288 DEBUG: scraper: GetSearchResults returned <results><entity><title>Brooklyn's Finest</title><id>26390</id><year>2009</year><url cache="tmdb-en-26390.xml">http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/26390</url></entity><entity><title>Brooklyn's Finest</title><id>26390</id><year>2009</year><url cache="tmdb-en-26390.xml">http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/26390</url></entity><entity><title>Gesetz der Straße</title><id>26390</id><year>2009</year><url cache="tmdb-en-26390.xml">http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/26390</url></entity></results>
13:55:14 T:5636 M:2043404288 DEBUG: FileCurl::Open(0644F168) http://api.themoviedb.org/2.1/Movie.getI...0ea9/26390
13:55:14 T:5636 M:2043416576 DEBUG: FileCurl::Close(0644F168) http://api.themoviedb.org/2.1/Movie.getI...0ea9/26390
13:55:14 T:5636 M:2043416576 DEBUG: scraper: GetDetails returned <details><id>tt1210042</id><title>Brooklyn's Finest</title><originaltitle>Brooklyn's Finest</originaltitle><year>2009</year><runtime>133</runtime><rating>6.6</rating><votes>7</votes><tagline>This is War. This is Brooklyn.</tagline><mpaa>Rated
[...]
.themoviedb.org/profiles/193/4bd715e2017a3c21f1000193/don-cheadle-original.jpg</thumb></actor><actor><name>Ethan Hawke</name><role>Sal</role><thumb>http://cf1.themoviedb.org/profiles/2d2/4bd9a252017a3c1bfb0002d2/ethan-hawke-original.jpg</thumb></actor><actor><name>Wesley Snipes</name><role>Caz</role><thumb>http://cf1.themoviedb.org/profiles/de3/4bfecd1a017a3c7036000de3/wesley-snipes-original.jpg</thumb></actor><chain function="GetTMDBThumbsByIdChain">26390</chain><chain function="GetTMDBFanartByIdChain">26390</chain><chain function="GetHDTrailersnet480p">Brooklyn's Finest</chain></details>
13:55:14 T:5636 M:2043416576 DEBUG: scraper: GetTMDBThumbsByIdChain returned <details><url function="ParseTMDBThumbs" cache="tmdb-images-26390.xml">http://api.themoviedb.org/2.1/Movie.getImages/en/xml/57983e31fb435df4df77afb854740ea9/26390</url></details>
13:55:14 T:5636 M:2043416576 DEBUG: FileCurl::Open(0644F168) http://api.themoviedb.org/2.1/Movie.getI...0ea9/26390
13:55:14 T:5636 M:2043416576 DEBUG: FileCurl::Close(0644F168) http://api.themoviedb.org/2.1/Movie.getI...0ea9/26390
13:55:14 T:5636 M:2043416576 DEBUG: scraper: ParseTMDBThumbs returned <details><thumb preview="http://cf1.themoviedb.org/posters/aef/4bc967ea017a3c57fe02faef/brooklyn-s-finest-mid.jpg">http://cf1.themoviedb.org/posters/aef/4bc967ea017a3c57fe02faef/brooklyn-s-finest-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/posters/408/4c29337c7b9aa1446c000408/brooklyn-s-finest-mid.jpg">http://cf1.themoviedb.org/posters/408/4c29337c7b9aa1446c000408/brooklyn-s-finest-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/posters/a70/4ccdcaf15e73d65025000a70/brooklyn-s-finest-mid.jpg">http://cf1.themoviedb.org/posters/a70/4ccdcaf15e73d65025000a70/brooklyn-s-finest-original.jpg</thumb></details>
13:55:14 T:5636 M:2043416576 DEBUG: scraper: GetTMDBFanartByIdChain returned <details><url function="ParseTMDBFanart" cache="tmdb-images-26390.xml">http://api.themoviedb.org/2.1/Movie.getImages/en/xml/57983e31fb435df4df77afb854740ea9/26390</url></details>
13:55:14 T:5636 M:2043416576 DEBUG: scraper: ParseTMDBFanart returned <details><fanart><thumb preview="http://cf1.themoviedb.org/backdrops/0e4/4c21d6a37b9aa136940000e4/brooklyn-s-finest-poster.jpg">http://cf1.themoviedb.org/backdrops/0e4/4c21d6a37b9aa136940000e4/brooklyn-s-finest-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/2d9/4c21d4ec7b9aa130e50002d9/brooklyn-s-finest-poster.jpg">http://cf1.themoviedb.org/backdrops/2d9/4c21d4ec7b9aa130e50002d9/brooklyn-s-finest-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/2de/4c21d6257b9aa130e50002de/brooklyn-s-finest-poster.jpg">http://cf1.themoviedb.org/backdrops/2de/4c21d6257b9aa130e50002de/brooklyn-s-finest-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/aeb/4bc967ea017a3c57fe02faeb/brooklyn-s-finest-poster.jpg">http://cf1.themoviedb.org/backdrops/aeb/4bc967ea017a3c57fe02faeb/brooklyn-s-finest-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/ae7/4bc967e9017a3c57fe02fae7/brooklyn-s-finest-poster.jpg">http://cf1.themoviedb.org/backdrops/ae7/4bc967e9017a3c57fe02fae7/brooklyn-s-finest-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/ae3/4bc967e8017a3c57fe02fae3/brooklyn-s-finest-poster.jpg">http://cf1.themoviedb.org/backdrops/ae3/4bc967e8017a3c57fe02fae3/brooklyn-s-finest-original.jpg</thumb></fanart></details>
13:55:14 T:5636 M:2043416576 DEBUG: scraper: GetHDTrailersnet480p returned <details><url function="Parse480pTrailer">http://www.hd-trailers.net/blog/?s="Brooklyn%27s%20Finest%20%28Theatrical%20Trailer%29%22</url></details>
13:55:14 T:5636 M:2043416576 DEBUG: FileCurl::Open(0644F168) http://www.hd-trailers.net/blog/?s="Brooklyn%27s%20Finest%20%28Theatrical%20Trailer%29%22
13:55:15 T:5636 M:2047098880 WARNING: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 22
13:55:15 T:5636 M:2047098880 ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
13:55:15 T:5636 M:2047098880 DEBUG: FileCurl::Close(0644F168) http://www.hd-trailers.net/blog/?s="Brooklyn%27s%20Finest%20%28Theatrical%20Trailer%29%22
13:55:15 T:5636 M:2047098880 ERROR: ADDON::CScraper::Run: Unable to parse web site
13:55:15 T:5636 M:2047098880 DEBUG: VideoInfoScanner: Adding new item to moviesConfusedmb://qnap/video/Brooklyns Finest (2009)/BDMV/index.bdmv
13:55:15 T:5636 M:2047098880 DEBUG: Mysql Start transaction
13:55:15 T:5636 M:2047098880 DEBUG: Mysql execute: insert into path (idPath, strPath, strContent, strScraper) values (NULL,'smb://qnap/video/Brooklyns Finest (2009)/BDMV/','','')
13:55:15 T:5636 M:2047098880 ERROR: SQL: The table does not exist
Query: select idFile from files where strFileName like 'index.bdmv' and idPath=2
13:55:15 T:5636 M:2047098880 ERROR: CVideoDatabase::AddFile unable to addfile ()
13:55:15 T:5636 M:2047098880 DEBUG: Mysql commit transaction
13:55:15 T:5636 M:2047098880 ERROR: SQL: The table does not exist
Query: select count(1) from tvshow
13:55:15 T:5636 M:2047098880 ERROR: CVideoDatabase::HasContent failed
13:55:15 T:5636 M:2047098880 ERROR: SQL: The table does not exist
Query: select count(1) from musicvideo
13:55:15 T:5636 M:2047098880 ERROR: CVideoDatabase::HasContent failed
Reply
#2
I'm not sure if this is what is causing your issue, but it looks like your XBMC HD-Trailers.net plug-in is out of date. It's still querying the old URL.
Reply
#3
I can't find it in the addon manager., so I can't update or disable it. But I've completely removed and reinstalled XBMC 10.0, emptied the xbmc.video database and tried with a tvshow, only the actor, genre and paths get filled and it seems to miss things in the paths:

idPath strPath strContent strScraper strHash scanRecursive useFolderNames strSettings noUpdate exclude
1 smb://qnap/recordings/ tvshows metadata.tvdb.com F538855DB37C0EB00017B4F77F8E84FA 0 0 <settings><setting id="absolutenumber" value="fals... 0 0

11:11:42 T:1772 M:2259132416 DEBUG: VideoInfoScanner: Adding new item to tvshowsConfusedmb://qnap/recordings/Dexter/
11:11:42 T:1772 M:2259132416 DEBUG: Mysql Start transaction
11:11:42 T:1772 M:2259124224 ERROR: SQL: The table does not exist
Query: select tvshowlinkpath.idShow from path,tvshowlinkpath where path.strPath like 'smb://qnap/recordings/Dexter/' and path.idPath=tvshowlinkpath.idPath
11:11:42 T:1772 M:2259124224 ERROR: CVideoDatabase::AddTvShow (smb://qnap/recordings/Dexter/) failed
11:11:42 T:1772 M:2259120128 DEBUG: Mysql execute: insert into genre (idGenre, strGenre) values( NULL, 'Action and Adventure')
11:11:42 T:1772 M:2259120128 DEBUG: Mysql execute: insert into genre (idGenre, strGenre) values( NULL, 'Drama')
11:11:42 T:1772 M:2259120128 ERROR: SQL: The table does not exist
Query: select idStudio from studio where strStudio like 'Showtime'
11:11:42 T:1772 M:2259116032 ERROR: CVideoDatabase::AddToTable (Showtime) failed
11:11:42 T:1772 M:2259116032 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Michael C. Hall','<thumb>http://thetvdb.com/banners/actors/70947.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=1 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Julie Benz','<thumb>http://thetvdb.com/banners/actors/77841.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=2 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Julia Stiles','<thumb>http://thetvdb.com/banners/actors/220571.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=3 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Jennifer Carpenter','<thumb>http://thetvdb.com/banners/actors/70948.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=4 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Keith Carradine','<thumb>http://thetvdb.com/banners/actors/78124.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=5 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'C.S. Lee','<thumb>http://thetvdb.com/banners/actors/77844.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=6 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Christina Robinson','<thumb>http://thetvdb.com/banners/actors/77843.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=7 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'James Remar','<thumb>http://thetvdb.com/banners/actors/77842.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=8 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Lauren Vélez','<thumb>http://thetvdb.com/banners/actors/70951.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=9 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'David Zayas','<thumb>http://thetvdb.com/banners/actors/70950.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=10 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Erik King','<thumb>http://thetvdb.com/banners/actors/70949.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=11 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Jimmy Smits','<thumb>http://thetvdb.com/banners/actors/196731.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=12 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Jaime Murray','<thumb>http://thetvdb.com/banners/actors/196721.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=13 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'John Lithgow','<thumb>http://thetvdb.com/banners/actors/130301.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=14 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 DEBUG: Mysql execute: insert into actors (idActor, strActor, strThumb) values( NULL, 'Desmond Harrington','<thumb>http://thetvdb.com/banners/actors/111691.jpg</thumb>')
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=15 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=1 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=2 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=3 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
11:11:42 T:1772 M:2259111936 ERROR: SQL: The table does not exist
Query: select * from actorlinktvshow where idActor=4 and idShow=-1
11:11:42 T:1772 M:2259111936 ERROR: CVideoDatabase::AddLinkToActor failed
Reply
#4
Solved, the video database encoding should be Latin-1 and not the default UTF8.
Reply

Logout Mark Read Team Forum Stats Members Help
Scraping movies to MYSQL database fails.0