2014-04-04, 17:50
@chemieboy: I presume you are telling TvTunes to search massively and automatically download best match? This could be tricky with very big libraries besides being extremely inaccurate due to so many occurrences of possible themes for each movie/tv show name. It could even generate an automatic remote URL disconnection due to so many consecutive scrape requests*. If there is a sudden URL disconnection (or internet issue) the script WILL throw error as a natural consequence and that is expected, and you will just have to retry later until it works. I strongly encourage you to search and fetch your themes on a video-by-video basis. Anyway, could you please:
1) Provide a full debug log that shows when you fire up XBMC; we are missing aprox. 300 lines at the beginning here. This is important to see if XBMC is loading anything that may be incompatible.
2) Could you please select in TvTunes config panel 'Always add additional themes (no overwrite)' then press OK and go to any movie you like and press TvTunes button and search for themes and download. Tell us if single video download works and submit that debug log too please.
========================================================
(*): TvTunes scraper is a little smart thing indeed; it doesn't just search for the movie/tv show name once, that approach would retrieve so much "rock when actually we want only the precious metals"; it currently searches for the title 11 times applying filters by means of using each time a different appendix. These appendixes refer to possible music themes related only to soundtracks. This is with the purpose of displaying for the users only the tracks related to movies/tv shows, and it works very well. So if you have a very big library, I believe the remote URL won't be too happy about so many consecutive searches and may become unresponsive. I personally believe that, whilst it was OK during the period in which TvTunes only handled tv shows and only had televisiontunes.com as search engine, the 'automatic massive search option' should not exist anymore, at least for the time being, because:
1) Soundtracks do not have an online indexing home as posters or fanarts do via IMDB or TMDB correlated to the movie/tv show they belong to, therefore automatic matches take a lot of search now that the ability to search within a much wider database for both, tv shows and movies, has entered the arena.
2) Each soundtrack album could have many tracks and/or versions, therefore it is likely the search process will retrieve many themes, and the automatic match will pick just one of them, that could easily not be the most representative and actually could be the wrong one. On top of this, one has to consider that via goear.com we have a huge database of music tracks which can't be compared to that of televisiontunes.com in any way, which adds more results per search. It also has the possibility to choose quality of download, which we aren't able to take advantage of (not yet) if we do an 'automatic match and fetch', so this could easily end up getting a very low quality outcome whilst there could be actually HQ themes available. This is why there is a way to listen to those tracks that are likely to be the ones the user is looking for before telling TvTunes to fetch them.
3) All this puts, at the same time, a huge overload on the online database's search engine, that could result in facing a permanent block for all of us if we did try to search for our themes automatically. Posters and fanarts for instance are indexed and linked to a TMDB ID or IMDB ID already, thus requiring only one scrape request. Back in November, I proposed to the team at TMDB the addition of a soundtrack tag that could hold URLs links. This way one could tell TvTunes to use the option of scraping TMDB for these soundtrack links and fetch the tunes directly, thus simplifying the process of fetching for music themes and turning it into a very precise one step process, but they said they weren't interested in this data at the moment; nonetheless I believe this could change if more than one soul asks for it.
4) It throws errors with certain appendixes containing international characters whilst searching massively (the error doesn't happen when searching on a video-by video basis, however the appendix was removed for both type of search), and to avoid them these appendixes had to be removed from tvtunes_scraper.py in the mean time, thus losing a fair amount of themes that could be retrieved and, in certain cases, the only ones that could be retrieved by the search. It isn't perfect, as you see, nevertheless TvTunes is at its highest quality ever so far.
1) Provide a full debug log that shows when you fire up XBMC; we are missing aprox. 300 lines at the beginning here. This is important to see if XBMC is loading anything that may be incompatible.
2) Could you please select in TvTunes config panel 'Always add additional themes (no overwrite)' then press OK and go to any movie you like and press TvTunes button and search for themes and download. Tell us if single video download works and submit that debug log too please.
========================================================
(*): TvTunes scraper is a little smart thing indeed; it doesn't just search for the movie/tv show name once, that approach would retrieve so much "rock when actually we want only the precious metals"; it currently searches for the title 11 times applying filters by means of using each time a different appendix. These appendixes refer to possible music themes related only to soundtracks. This is with the purpose of displaying for the users only the tracks related to movies/tv shows, and it works very well. So if you have a very big library, I believe the remote URL won't be too happy about so many consecutive searches and may become unresponsive. I personally believe that, whilst it was OK during the period in which TvTunes only handled tv shows and only had televisiontunes.com as search engine, the 'automatic massive search option' should not exist anymore, at least for the time being, because:
1) Soundtracks do not have an online indexing home as posters or fanarts do via IMDB or TMDB correlated to the movie/tv show they belong to, therefore automatic matches take a lot of search now that the ability to search within a much wider database for both, tv shows and movies, has entered the arena.
2) Each soundtrack album could have many tracks and/or versions, therefore it is likely the search process will retrieve many themes, and the automatic match will pick just one of them, that could easily not be the most representative and actually could be the wrong one. On top of this, one has to consider that via goear.com we have a huge database of music tracks which can't be compared to that of televisiontunes.com in any way, which adds more results per search. It also has the possibility to choose quality of download, which we aren't able to take advantage of (not yet) if we do an 'automatic match and fetch', so this could easily end up getting a very low quality outcome whilst there could be actually HQ themes available. This is why there is a way to listen to those tracks that are likely to be the ones the user is looking for before telling TvTunes to fetch them.
3) All this puts, at the same time, a huge overload on the online database's search engine, that could result in facing a permanent block for all of us if we did try to search for our themes automatically. Posters and fanarts for instance are indexed and linked to a TMDB ID or IMDB ID already, thus requiring only one scrape request. Back in November, I proposed to the team at TMDB the addition of a soundtrack tag that could hold URLs links. This way one could tell TvTunes to use the option of scraping TMDB for these soundtrack links and fetch the tunes directly, thus simplifying the process of fetching for music themes and turning it into a very precise one step process, but they said they weren't interested in this data at the moment; nonetheless I believe this could change if more than one soul asks for it.
4) It throws errors with certain appendixes containing international characters whilst searching massively (the error doesn't happen when searching on a video-by video basis, however the appendix was removed for both type of search), and to avoid them these appendixes had to be removed from tvtunes_scraper.py in the mean time, thus losing a fair amount of themes that could be retrieved and, in certain cases, the only ones that could be retrieved by the search. It isn't perfect, as you see, nevertheless TvTunes is at its highest quality ever so far.
) so the normalization could just be integrated seamlessly by having the themes immediately Replaygained when they are fetched. All super automatic!
