Kodi Community Forum
Release Universal Movie Scraper - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)



RE: Universal Movie Scraper - olympia - 2023-01-03

…and please let’s only troubleshoot UMS here. I can’t follow what is for UMS and what is for TMDB.


RE: Universal Movie Scraper - junitodx - 2023-01-05

(2023-01-03, 20:30)olympia Wrote: …and please let’s only troubleshoot UMS here. I can’t follow what is for UMS and what is for TMDB.

Sorry, was a little busy. Here is an updated log file. Using UMS with zh selected in the artwork section and only scraping the one movie:
https://controlc.com/2a9fbf01


RE: Universal Movie Scraper - olympia - 2023-01-08

(2023-01-05, 01:32)junitodx Wrote: Sorry, was a little busy. Here is an updated log file. Using UMS with zh selected in the artwork section and only scraping the one movie:
https://controlc.com/2a9fbf01

I see the following poster scraped first in the log (line 3950): https://image.tmdb.org/t/p/w500/kQYHGm9RF9Ni5dQ9XOQ2h4CsGm.jpg
This seems to be the Chinese poster what is available at tmdb, so I am confused now. Are You looking for something else?


RE: Universal Movie Scraper - junitodx - 2023-01-09

You are correct. It does look like it is pulling the correct posters now. Not sure why it didn't seem to be working for me before but all good now. I do appreciate you both taking the time to take a look,


RE: Universal Movie Scraper - oliviergregoire - 2023-01-14

Would it be possible to add on option in the preferred poster language of TMDB to search for the original language? So whatever the country the movie is from, you'd always get the original country poster.


RE: Universal Movie Scraper - MidnightWatcher - 2023-01-18

Tried re-scraping a folder of movies last night with a newly updated install to Nexus 20 Final on my nVidia Shield. It seemed to scrape everything fine, however the movie titles are blank, even though the clear logo and poster of each are correct. Anybody else have this issue?


RE: Universal Movie Scraper - jcea - 2023-01-18

Same here. Some movies are been scraped as an empty ("") title for the last few days. I am using IMDB and Spanish titles.


RE: Universal Movie Scraper - tom_nito - 2023-01-19

I'm having the same issue on Windows. It scrapes the titles properly maybe 10% of the time, but 90% of the time, the titles are blank. And it either works and scrapes the titles for the entire scan, or all of them are blank.


RE: Universal Movie Scraper - Karellen - 2023-01-19

Could someone please post a Debug Log that captures the missing title issue.
thanks.


RE: Universal Movie Scraper - jcea - 2023-01-21

The problem seems to be that IMDB has changed the "Also Known As" page to use AJAX, requiring multiple requests. Check , for example, https://www.imdb.com/title/tt11128440/releaseinfo . To get the spanish title, you need to click in the "more" link. This is a change in the IMDB behaviour.

Also, when multiple titles are provided for a country (in Spain we have several regional languages), before we got something like

Spain (Catalonian title) TITLE

While now it has changed to

Spain TITLE (catalonian title)

The relevant log is this:
Quote:2023-01-21 02:52:43.071 T:1627    DEBUG <general>: scraper: GetIMDBAKATitlesById returned <details><url cache="tt11128440-releaseinfo.html" function="ParseIMDBAKATitles">https://www.imdb.com/title/tt11128440/releaseinfo/|accept-language=en-us</url></details>
2023-01-21 02:52:43.071 T:1627    DEBUG <general>: CurlFile:TonguearseAndCorrectUrl() adding custom header option 'accept-language: en-us'
2023-01-21 02:52:43.071 T:1627    DEBUG <general>: CurlFile::Open(0xb739f5d8) https://www.imdb.com/title/tt11128440/releaseinfo/
2023-01-21 02:52:43.995 T:1627    DEBUG <general>: Get: Using "UTF-8" charset for HTML "https://www.imdb.com/title/tt11128440/releaseinfo/|accept-language=en-us"
2023-01-21 02:52:44.180 T:1627    DEBUG <general>: scraper: ParseIMDBAKATitles returned <details><title></title></details>

Notice the returned title is empty.


RE: Universal Movie Scraper - DiMag - 2023-01-21

Does UMS no longer scrape ratings (RT, MC) in Nexus? (v20.0, freshly installed on Windows 10 64bit.)


RE: Universal Movie Scraper - Angelinas - 2023-01-21

(2023-01-21, 11:44)DiMag Wrote: jceaDoes UMS no longer scrape ratings (RT, MC) in Nexus? (v20.0, freshly installed on Windows 10 64bit.)

metadata.universal v5.5.12 have strange issue..

when I scrape single folder with single movie all  working...but when scrape folder with more movie folder in that folder.
resultat are:

missing
ListItem.Label
ListItem.Title
ListItem.RatingAndVotes(metacritic)

Image is test for first time scrape folder with 3 movie
- clean database
- UMS scrape folder with 3 movie (missing titke)
- UMS scrape movie folder only with "Avengers Infinity War (2018)" title is ok


Image

edit:
@jcea find problem for v5.5.12
when change titlesource on themoviedb.org all working


RE: Universal Movie Scraper - DiMag - 2023-01-21

The reason I posted the question is not my trying to scrape ratings with UMS. In Kodi 20 (at least), this is not even included in the settings!

From your answer I gather that the problem obtains even if the option is included in the settings, but is solved if TMDB (rather than IMDB) is used for movie title search.

I must also assume that you are on Matrix?


RE: Universal Movie Scraper - Angelinas - 2023-01-21

Behaves the same ..in Matrix and Nexus.

Rating is included in the settings
Image

Most important thing is to change Addon settings from setings/addon not call setings from DialogSettings.xml

not from here...this way of changing not write in settings.xml......thats Kodi bug
Image


RE: Universal Movie Scraper - DiMag - 2023-01-21

How silly of me to suppose that it is a Matrix/Nexus thing. I did a quick installation of 19.5 and then installed UMS (v5.5.12) from the official repository. No ratings available.

It seems that some time in the very recent past the ability of UMS to scrape ratings not just from IMDB, TMDB and trakt.tv (which provide aggregated audience ratings, weighted only in the case of IMDB) but also from RT and MC (which provide aggregated critics reviews) have been dropped from UMS.

If so, there is no more reason to prefer UMS over the updated TMDB. Aggregated audience ratings are just not reliable enough; and if they are not weighted (which as aforementioned only IMDB's are) they are not reliable at all.

My question then is, do skins like Amber which provide RT and MC ratings information get it by way of one of the many skin helper addons available? And does this extra info get written to the library (so that it can be exported to the .nfo file)?