Kodi Community Forum
Release TMDb TV Show scraper (Python - Default Matrix Scraper) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-03

Apologies, it's been a while since I've posted.

Also seeing some weird behaviour in combination with TextureCache wich I use to reload incomplete show metadata.

If I do a show like this
Code:
C:\GitHub\KodiTextureCache>python "C:\GitHub\KodiTextureCache\texturecache.py" qax tvshows "andre" debugon @xbmc.host=192.168.2.51
Season   [Ontdek de Ruimte met André Kuipers, Season 1      ]: WARN (missing poster)
TVShow   [Ontdek de Ruimte met André Kuipers                ]: FAIL (zero rating), WARN (missing banner, local not found)
Rescanning directory: smb://HYPERV/Data/Kids/TV/Ontdek de Ruimte met André Kuipers (2015)...
Updating library: New tvshowid   2832 [Angry Birds Toons]
Updating library: New episodeid 49748 [Angry Birds Toons S01E01 (Aflevering 1)]
Updating library: New episodeid 49748 [Angry Birds Toons S01E01 (Aflevering 1)]
Updating library: New episodeid 49749 [Angry Birds Toons S01E02 (Aflevering 2)]
Updating library: New episodeid 49749 [Angry Birds Toons S01E02 (Aflevering 2)]
Updating library: New episodeid 49750 [Angry Birds Toons S01E03 (Aflevering 3)]
Updating library: New episodeid 49750 [Angry Birds Toons S01E03 (Aflevering 3)]
Updating library: New episodeid 49751 [Angry Birds Toons S01E04 (Aflevering 4)]
Updating library: New episodeid 49751 [Angry Birds Toons S01E04 (Aflevering 4)]
Updating library: New episodeid 49752 [Angry Birds Toons S01E05 (Aflevering 5)]
Updating library: New episodeid 49752 [Angry Birds Toons S01E05 (Aflevering 5)]
Updating library: New tvshowid   2833 [Ontdek de Ruimte met André Kuipers]
It will fetch Angry Birds Toons which I don't have.

The reason for this is that the plugin gets called with Show title Season 01 instead of the actual show name, not sure if this is fixable from this end since textureCache has been abandoned
Debug log: https://paste.kodi.tv/elunejuzom.kodi


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-03

@Rouzax

Both your logs are useless. The first doesn't have debug enabled and is a snippet, the second is 28 lines long and tells me nothing. FULL LOGS ONLY


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-01-04

(2023-01-03, 15:15)Rouzax Wrote: Have been using this scraper for a long time but it seems to get slower and slower.
Running Kodi 19.4 on a Vero 4k+.
Have a large TV show collection and each time I do Update Library it will scan for about 30 minutes.
Is that normal?

Seeing a lot of warnings and errors in the log during a scan

[huge dump of log removed by moderator and new link provided below]

https://paste.kodi.tv/owesihepix.kodi
We can't do anything with a snippet of a log file, especially one that doesn't have debug logging enabled.  We need a complete debug log that is from Kodi startup right through the issue you are having.  Without the debugging there isn't enough information to troubleshoot, and without the full log there isn't the context needed to understand what you're system is doing.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-07

Sorry took a while, wanted to start with a clean new database to be sure this is not something because of me.
Scan time did improve, but I'm getting an error during scan.
https://paste.kodi.tv/mafucecadi.kodi

Will also create a debug log of the weird behaviour with Texture Cache and refreshing a season which will search for a show title "Season 01" and then finding Angry Birds Toons all the time.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-07

(2023-01-07, 10:36)Rouzax Wrote: Scan time did improve, but I'm getting an error during scan.
Can you post your tvshow.nfo file for Disney Animated Shorts. Post to Kodi Paste Site


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-07

Sure, here you go.
It's created a while back when tvdb was still open.
https://paste.kodi.tv/dotuyopaca

Since tmdb does not have this equivalent but all shorts as a separate movie I really don't want to use that Smile


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-07

(2023-01-07, 11:10)Rouzax Wrote: Sure, here you go.
It's created a while back when tvdb was still open.
Thanks. Just as I thought. This must be quite an old nfo file so the episodeguide is wrong...
xml:
<episodeguide>
<url cache="auth.json" post="yes">https://api.thetvdb.com/login?{"apikey":"d99c8e7dac2307355af4ab88720a6c32","id":78988}|Content-Type=application/json</url>
</episodeguide>
Also, TVDB has this show, but TheMovieDB does not, and you are using TheMovieDB scraper. So double whammy.

If you have nfo files for all your episodes then delete those lines from your nfo file. Refresh the nfo file back into the library. Then the rest of the episodes should scan in.
If you don't, and need to scrape some episodes, then change scrapers to TVDB v4 and Refresh the tv show. See the below link for more info.

Any nfo file that has that type of episodeguide will no longer work.
Read more here... https://forum.kodi.tv/showthread.php?tid=370489


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-07

Okay, have purchased a yearly license to TinyMediaManager and have recreated the TVDB show nfo files
Still gives an error while scanning and is unable to add show info

show.nfo
https://paste.kodi.tv/baxoqaceki

episode.nfo
https://paste.kodi.tv/exagalisuf

EDIT:
Think this might be due to: https://www.tinymediamanager.org/blog/new-episodeguide-format/

EDIT2:
Even with the option enabled it does not work

Current tvshow.nfo
https://paste.kodi.tv/bitemetabo

Current episode.nfo
https://paste.kodi.tv/emitibisap

How can I just let it scan the NFO files?


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-07

New post to keep it logical Smile

Current tvshow.nfo
https://paste.kodi.tv/zuforiciwi

And episode.nfo
https://paste.kodi.tv/uhefenulex

I go to Video -> Files -> folder of show and do Info -> Refresh -> Refresh all: Yes -> Refresh from Internet: No
Debug log:
https://paste.kodi.tv/otomikewap.kodi


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-07

(2023-01-07, 14:39)Rouzax Wrote: Current tvshow.nfo
https://paste.kodi.tv/zuforiciwi
Thats wrong. Still the old episodeguide.

(2023-01-07, 14:39)Rouzax Wrote: Debug log:
https://paste.kodi.tv/otomikewap.kodi
Still the same error because nothing you have done has changed anything.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-07

(2023-01-07, 19:13)Karellen Wrote:
(2023-01-07, 14:39)Rouzax Wrote: Current tvshow.nfo
https://paste.kodi.tv/zuforiciwi
Thats wrong. Still the old episodeguide.

(2023-01-07, 14:39)Rouzax Wrote: Debug log:
https://paste.kodi.tv/otomikewap.kodi
Still the same error because nothing you have done has changed anything.

Managed to fix it.
Needed to disable the episodeguide option in TMM, this will remove the episodeguide from tvshow.nfo
Afterwards TMM, will still fetch the TVDB id from TVDB but will also pull the TMDB id from TVDB but that is a nonexistent id since TMDB has removed the TV series info from Disney animated shorts but the old id is still listed on TVDB

So after manually removing all ids from tvshow.nfo and the episode.nfo it scanned into the library.

Hope it makes sense what I'm trying to explain


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-07

(2023-01-07, 19:29)Rouzax Wrote: Managed to fix it.
Needed to disable the episodeguide option in TMM, this will remove the episodeguide from tvshow.nfo
Sounds good.
As long as you have nfo files for all your episodes, then the episodeguide is not needed.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-07

(2023-01-07, 19:54)Karellen Wrote:
(2023-01-07, 19:29)Rouzax Wrote: Managed to fix it.
Needed to disable the episodeguide option in TMM, this will remove the episodeguide from tvshow.nfo
Sounds good.
As long as you have nfo files for all your episodes, then the episodeguide is not needed.

Yeah, but only removing episode guide was not enough, I tested that as well.
Thanks for your help.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - cscott1 - 2023-01-11

Hello, six days ago I started scraping my library for a new skin that required a fresh install of kodi. The skin had a few supported addons in the repository so I downloaded them all thinking the more the better well this was not the case. I downloaded the Tubed addon and I get an error message when playing trailers from YouTube. I have the YouTube addon as well with my personal api and it works flawlessly. I came to find out that when I started scraping my library with the TMDb TV show scraper I had Tubed selected, by default I'm guessing over YouTube as the addon to play trailers. So now is there an easy way to change the default YouTube player for trailers for my entire TV library without having to to rescrape everything? It takes well over a week to scrape my library and I have been working on setting up all my preferred fanarts as shows have finished scraping. Does changing the preferred trailer addon to YouTube change the default player for my entire tv show library or only the shows that are scraped going forward? If it is the latter is there a way to rescrape only the preferred trailer player addon and not all the metadata and fanarts and the like?

@anxdpanic


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-01-12

(2023-01-11, 14:32)cscott1 Wrote: Hello, six days ago I started scraping my library for a new skin that required a fresh install of kodi. The skin had a few supported addons in the repository so I downloaded them all thinking the more the better well this was not the case. I downloaded the Tubed addon and I get an error message when playing trailers from YouTube. I have the YouTube addon as well with my personal api and it works flawlessly. I came to find out that when I started scraping my library with the TMDb TV show scraper I had Tubed selected, by default I'm guessing over YouTube as the addon to play trailers. So now is there an easy way to change the default YouTube player for trailers for my entire TV library without having to to rescrape everything? It takes well over a week to scrape my library and I have been working on setting up all my preferred fanarts as shows have finished scraping. Does changing the preferred trailer addon to YouTube change the default player for my entire tv show library or only the shows that are scraped going forward? If it is the latter is there a way to rescrape only the preferred trailer player addon and not all the metadata and fanarts and the like?
I think the thing that will cause you the smallest amount of work is to export the entire library as NFO files.  Update the NFO files using some kind of global search and replace to change the YouTube URL to the Tubed URL, delete everything from the library, and then reimport it.  Someone would need to verify that process will leave you with your preferred fanart and stuff though.  If it won't, the only other option I can think of might be to adjust the database directly, and that will require some DB-fu that not everyone has.

I think that was a really long way of saying, there is no easy way.  There are just ways that may be less hard depending on your skillset.