2012-07-20, 07:23
(2012-07-13, 08:12)deh2k7 Wrote: Liking the news music scrapers, fine work! I am seeing some weird, intermittent issues when scraping, however.
For things like genre, years active, i have the artist scraper set to allmusic. For many artists this seems to work fine, but many others I'm not getting the information scraped. I verified on the allmusic site the the fields were populated, but the scraper seems to have issues getting the information consistently.
I'm seeing a ton of the these messages while scraping:
Code:00:14:55 T:5848 ERROR: ADDON::CScraper::Run: Unable to parse web site
00:14:56 T:668 WARNING: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 22
00:14:56 T:668 ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
When I saw a ton, I mean 100s-1000s in the log. What does the above mean?
Olympia - still seeing the error messages above, and they seem to correspond to a failed attempt to scrape an artist. I enabled debugging, wiped my music DB, and then rescraped and am able to reprove the issue when scraping with Universal Artist scraper. So far, I have not noticed any issues with albums, but I've been focused on artists.The issue is intermittent and doesn't seem to occur on the same artists; it does occur regularly, but the artists on which it occurs seems to be random as far as I can tell.
Here's an excerpt from the debug log (sorry pastebin was acting up on me tonite):
Code:
00:31:54 T:4288 DEBUG: MUSIC_INFO::CMusicInfoScanner::DoScan Scanning dir 'M:\Billy Joel\' as not in the database
00:31:54 T:4288 DEBUG: MUSIC_INFO::CMusicInfoScanner::DoScan Scanning dir 'M:\Billy Joel\extrafanart\' as not in the database
00:31:54 T:4288 DEBUG: MUSIC_INFO::CMusicInfoScanner::DoScan Scanning dir 'M:\Billy Joel\Greatest Hits, Vols. 1 & 2 (1973-1985)\' as not in the database
00:31:54 T:4288 INFO: Creating album thumb from memory: special://masterprofile/Thumbnails/Music/e/e6528036.tbn
00:31:55 T:4804 DEBUG: Thread MUSIC_GRABBER::CMusicInfoScraper start, auto delete: 0
00:31:55 T:4804 DEBUG: ADDON::CScraper::FindArtist: Searching for 'Billy Joel' using Universal Artist Scraper scraper (file: 'C:\Users\XBMC\AppData\Roaming\XBMC\addons\metadata.artists.universal', content: 'artists', version: '2.1.1')
00:31:55 T:4804 DEBUG: scraper: CreateArtistSearchUrl returned <url>http://search.musicbrainz.org/ws/2/artist/?fmt=xml&query=artist:"Billy%20Joel"&limit=100</url>
00:31:55 T:4804 DEBUG: FileCurl::Open(0EC8DCDC) http://search.musicbrainz.org/ws/2/artist/?fmt=xml&query=artist:"Billy%20Joel"&limit=100
00:31:55 T:4804 WARNING: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 22
00:31:55 T:4804 ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
00:31:55 T:4804 ERROR: ADDON::CScraper::Run: Unable to parse web site
00:31:55 T:4804 DEBUG: Thread MUSIC_GRABBER::CMusicInfoScraper 4804 terminating
00:31:55 T:888 DEBUG: Thread MUSIC_GRABBER::CMusicInfoScraper start, auto delete: 0
00:31:55 T:888 DEBUG: ADDON::CScraper::FindAlbum: Searching for 'Billy Joel - Greatest Hits, Vols. 1 & 2 (1973-1985)' using Universal Album Scraper scraper (path: 'C:\Users\XBMC\AppData\Roaming\XBMC\addons\metadata.album.universal', content: 'albums', version: '1.3.1')
00:31:55 T:888 DEBUG: scraper: CreateAlbumSearchUrl returned <url>http://search.musicbrainz.org/ws/2/release/?fmt=xml&query=release:"Greatest%20Hits%2c%20Vols%2e%201%20%26%202%20%281973%2d1985%29"%20AND%20artist:"Billy%20Joel"</url>
00:31:55 T:888 DEBUG: FileCurl::Open(0EC8DDE0) http://search.musicbrainz.org/ws/2/release/?fmt=xml&query=release:"Greatest%20Hits%2c%20Vols%2e%201%20%26%202%20%281973%2d1985%29"%20AND%20artist:"Billy%20Joel"
00:31:56 T:888 WARNING: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 22
00:31:56 T:888 ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
00:31:56 T:888 ERROR: ADDON::CScraper::Run: Unable to parse web site
00:31:56 T:888 DEBUG: Thread MUSIC_GRABBER::CMusicInfoScraper 888 terminating
[
I had a large number of artists come up like this in my most recent attempt, but again it doesn't seem to always be the same artists.
Thanks in advance for all of the help (and a great scraper)!