Linux Local Info Only > Either it's really slow or the UI feedback feels that way
#1
First, Great to see the forums are back up! Great work team!!!!

[running Kodi in Libreelec v11 with a networked MariaDB for data storage]

When using Sonarr/Radarr for scraping object info into nfo files stored with the object, the UI seems to freeze.

It always starts as if it is going to check for new items but sits at 0% for about 60 seconds or more. Then it rapidly starts to count up the % progress.

But then it will freeze again, return to zero % and bounce around, showing different progress %. Then stop as if it's finished.

This is very different from the TVDB and TMDB scraping process, which starts almost immediately, and the UI feedback is pretty clear about what is happening (ie, what matching object it has found, TV or Movie).

Have there been any recent reviews of the 'Local Data Only' scripting that enables this?
Reply
#2
@AGLyons

NFO files from Sonarr, Radarr, SickBeard and others are generic "one fits all" and are known to be problematic when used with Kodi as they are not fully Kodi compatible.
Post the contents of a movie, tvshow and episode nfo file to Kodi Paste Site and provide the three links, and I can check their status.
Also a Debug Log will be helpful

I would suggest doing away with those nfo files and either letting Kodi scrape them or use a dedicated Media Manager to create them
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#3
Movie: https://paste.kodi.tv/wahajunixo.kodi
Show: https://paste.kodi.tv/aqenakuhiq
Episode: https://paste.kodi.tv/tigebeyoku

debug log: https://we.tl/t-Ve4gf98SDO

Sorry for the debug log download. Pastebin wouldn't save

Image
Reply
#4
I've filed a ticket with the Radarr github about the image naming problems. Also, as you pointed out, some of the contents of the NFO files are off —namely, the images. The NFO file contains URLs for images, so Kodi goes and downloads them again rather than using the locally stored ones.

High hopes, but an existing ticket on the matter has been on the "Feature Request" list since 2020 (https://github.com/Radarr/Radarr/issues?...Aopen+5050).
Reply
#5
(2023-04-28, 00:01)AGLyons Wrote: Movie: https://paste.kodi.tv/wahajunixo.kodi
Show: https://paste.kodi.tv/aqenakuhiq
Episode: https://paste.kodi.tv/tigebeyoku
They are pretty good. Nothing in there that should cause problems.

I tried opening your Debug Log but I just keep being redirected to advertising sites then a blank page.
The message you encouontered usually means the file is too big. It should accept approx 15,000 lines, any more you should split it into two pastes
Or try https://pastebin.com/
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#6
I spun up my own pastebin for now.

https://pb.tld.family/?28da679391ddbe0e#...sJSUJi1CZb

The log was 19k lines.

It builds up fast in debug mode. I enabled it, restarted the system and tried a refresh. Once it finished, I turned off debug and pulled the log.
Reply
#7
(2023-04-28, 15:56)AGLyons Wrote: I spun up my own pastebin for now.

https://pb.tld.family/?28da679391ddbe0e#...sJSUJi1CZb
That's better, but you did not enable debug mode, so I can't see all the processes.

Some obvious errors though...
Lots of unix_err:'d' error : 'Permission denied' errors looking up your media folders
Lots of warning <general>: Create - unsupported protocol(image) in image:// jpg problems - I guess that is a Linux issue, it's hard to imagine why a jpg image is unsupported.
Lots of error <general>: DoWork - Direct texture file loading failed for image: for images.
Possibly a problem with your MySQL setup?? I won't be much help here, the combination of Linux and MySQL is not my area

Can you...
1. Provide a new log with debug mode enabled
2. Provide the contents of the tvshow.nfo file for TV/Invasion (2021) 404492/, pasted into your paste site
3. The nfo file for invasion s01e09.mkv also pasted
4. Do you have nfo files for all your episodes?
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#8
Hey @Karellen,

I sorted out the smb errors. I moved my entire library from one NAS to another. Took ages. The errors are remnants of the old location.

Some of the errors regarding images were an image slideshow screensaver that had an old DIR for pics. That was fixed. I also had a DIR for subtitle files (from the old days) that was invalid since the media move. So that's been fixed as well.

I took some queues from another thread regarding optimizations for the MariaDB server and added those. But my main concern is that it takes about 10 seconds for thumbs to show up when you go to the movies page. So I started going down the texturecache.py path again.

It appears to me that the majority of poster and fanart images are not being cached in the system. 

'texturecache.py jd movies' > Returns an XML list of the art associated with objects. My results are a mixed bag. Some are local resources -probably from prior to v18 as they refer to poster.jpg. Some are URLs

Code:

    "art": {
      "fanart": "image://smb://192.168.200.88/dvr/Flicks/Zog and the Flying Doctors (2021) 779611-tt11301374/fanart.jpg/",
      "icon": "image://DefaultVideo.png/",
      "poster": "image://smb://192.168.200.88/dvr/Flicks/Zog and the Flying Doctors (2021) 779611-tt11301374/poster.jpg/",
      "set.poster": "image://https://image.tmdb.org/t/p/original/mf4ycHg8wBs5vfJB4W01gqvhYXg.jpg/",
      "thumb": "image://video@smb://192.168.200.88/dvr/Flicks/Zog and the Flying Doctors (2021) 779611-tt11301374/Zog and the Flying Doctors (2021) HDTV-1080p - tt11301374 - h265 AAC.mp4/"
    },
    "file": "smb://192.168.200.88/dvr/Flicks/Zog and the Flying Doctors (2021) 779611-tt11301374/Zog and the Flying Doctors (2021) HDTV-1080p - tt11301374 - h265 AAC.mp4",
    "label": "Zog and the Flying Doctors",
    "movieid": 15211,
    "title": "Zog and the Flying Doctors"
  },
  {
    "art": {
      "fanart": "image://smb://192.168.200.88/dvr/Flicks/Zone 414 (2021) 675319-tt8545482/fanart.jpg/",
      "icon": "image://DefaultVideo.png/",
      "poster": "image://smb://192.168.200.88/dvr/Flicks/Zone 414 (2021) 675319-tt8545482/poster.jpg/",
      "thumb": "image://video@smb://192.168.200.88/dvr/Flicks/Zone 414 (2021) 675319-tt8545482/Zone 414 (2021) HDTV-1080p - tt8545482 - h265 AAC.mp4/"
    },
    "file": "smb://192.168.200.88/dvr/Flicks/Zone 414 (2021) 675319-tt8545482/Zone 414 (2021) HDTV-1080p - tt8545482 - h265 AAC.mp4",
    "label": "Zone 414",
    "movieid": 17249,
    "title": "Zone 414"
  },
  {
    "art": {
      "fanart": "image://smb://192.168.200.88/dvr/Flicks/Zoo Wars (2018) 531165-tt7575410/fanart.jpg/",
      "icon": "image://DefaultVideo.png/",
      "poster": "image://smb://192.168.200.88/dvr/Flicks/Zoo Wars (2018) 531165-tt7575410/poster.jpg/",
      "set.poster": "image://https://image.tmdb.org/t/p/original/7eCg1JOtvEv0Nu46LqiUgE1gajK.jpg/",
      "thumb": "image://video@smb://192.168.200.88/dvr/Flicks/Zoo Wars (2018) 531165-tt7575410/Zoo Wars (2018) HDTV-1080p - tt7575410 - x264 AAC.mp4/"
    },
    "file": "smb://192.168.200.88/dvr/Flicks/Zoo Wars (2018) 531165-tt7575410/Zoo Wars (2018) HDTV-1080p - tt7575410 - x264 AAC.mp4",
    "label": "Zoo Wars",
    "movieid": 17250,
    "title": "Zoo Wars"
  },


I've since learned that Milhouse has left the texturecache.py project, so it's not getting updated or maintained anymore. 

@Klojum, has there been any discussion on revisiting the database approach that Kodi is using? There seem to be some common problems that users are facing that could use some attention. That is what brought TextureCache into existence.

Looking at my MariaDB instance, there are multiple entries in the advisor that I think could be implemented in Kodi to enhance the performance. As well, the textures13.db being individual for each instance of Kodi on a network introduces sync problems between the heads since you're not supposed to sync that DB file automatically. I have ideas, maybe they are wrong as I don't have the full scope of how Kodi does its magic.

I don't mean to bash the Kodi team at all. I am extremely grateful for all the hard work that everyone has put in to build this platform! I just want to help make it better in the only ways I know how. With feedback and examples of problems.
Reply
#9
(2023-04-29, 16:50)AGLyons Wrote: I've since learned that Milhouse has left the texturecache.py project, so it's not getting updated or maintained anymore. 
Yep, that is correct.
Maybe you could give this new addon a try... https://forum.kodi.tv/showthread.php?tid=369984

Local artwork takes priority. If you have that, it will be scanned and displayed in Kodi when needed.
Artwork links are always scraped. It is just data, like the plot and actors. Just because they are there, does not mean they are used, especially if you have local artwork. In this case, think of those artwork links as a backup - If there is no local artwork, or the image is corrupt, then Kodi uses the artwork links.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#10
(2023-04-29, 21:33)Karellen Wrote: Local artwork takes priority. If you have that, ........ If there is no local artwork, or the image is corrupt, then Kodi uses the artwork links.

This is, of course, dependent on the filenames being formatted correctly. Which Radarr currently isn't doing and hasn't done so since Kodi v18 (2020).

https://github.com/Radarr/Radarr/issues/5050
Reply
#11
(2023-04-29, 21:44)AGLyons Wrote: https://github.com/Radarr/Radarr/issues/5050
Under image Step 9a, please read the section titled Movies are in separate folders that match the movie title... https://kodi.wiki/view/Adding_video_sources#Set_Content
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply

Logout Mark Read Team Forum Stats Members Help
Local Info Only > Either it's really slow or the UI feedback feels that way0