+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
Universal Movie Scraper - olympia - 2020-05-28
It's not the scrappper. Kodi core is doing this and passing over the title and year to the scrappper addon.
No solution is possibe on the side of core, as cleanstring is ditching everything to the right of the match.
You could handle this on the scraper level though. If your file naming is really perfectly folllowing your own rules.
... But this will be your own scrappper then and you will need to redo on every update.
My personal opinion is that every ocd about file names is insane. It doesn't matter in Kodi. However if you really want to punish yourself with thus, then having the year before the director definitely sounds more sane with one step
RE: Universal Movie Scraper help - tralaralara - 2020-06-14
Hello
this probably has been asked before, but I haven't been able to find an answer in this thread.
Basically, I was first scrapping using the TMDB scraper, but figured that there's lots of movies that are not listed there so I switched to the Universal Movie Scraper, and I've set it to look for the info on IMDB. Although it is somehow pickier with the naming, it finds most of the movies correctly, in some of them I have to point to the specific listing on imdb using a link in an .nfo file
The problem is with some movies that are not listed in imdb, but are listed in TMDB instead. I tried using a link to the TMDB listing in an .nfo file , but it won't pick it up. What is the workaround to this? Can't it look in TMDB via link, even if I've set IMDB as the main scraping source?
Thanks so much in advance
RE: Universal Movie Scraper - Litcube - 2020-06-14
Hi! I just thought I'd bring to your attention a bug in this scraper and the original TMDB scraper. It seems to have issues with MPAA ratings where the python version does not. Details here:
https://forum.kodi.tv/showthread.php?tid=355164
RE: Universal Movie Scraper - Tobby - 2020-07-30
(2020-05-16, 04:07)Karellen Wrote:(2020-05-15, 17:42)Tobby Wrote: Wonder what Karellen's done that we've missed.Nothing special.
Installed the update, enabled the landscape setting at the Source level, scraped Star Wars The Rise of Skywalker (2019) and Captain America Civil War (2016) and checked the display in Aura skin. Landscape images were displayed.
Hi, @Karellen. Since the automatic scraping of landscape images works for you I was wondering if you could have a look at my debug log and see if you see anything weird that would explain why it doesn't on mine. I have the same phenomenon on both my machines. One Windows 7 PC and one Nvidia Shield TV. Would be much appreciated.
https://paste.kodi.tv/ramunimepe.kodi
The landscape setting at source level is indeed enabled.
The movie I'm scraping in the debug log is Atlantis - The Lost Empire
RE: Universal Movie Scraper - Karellen - 2020-07-30
(2020-07-30, 15:36)Tobby Wrote: Since the automatic scraping of landscape images works for you I was wondering if you could have a look at my debug log and see if you see anything weird that would explain why it doesn't on mineThe landscape image is being scraped. I can see it on line 2619. It also scrapes fine for me.
Do you have <arttype>landscape</arttype> set in your advancedsettings.xml file? It would explain why it is being scraped but not used.
RE: Universal Movie Scraper - Tobby - 2020-07-30
(2020-07-30, 22:38)Karellen Wrote:(2020-07-30, 15:36)Tobby Wrote: Since the automatic scraping of landscape images works for you I was wondering if you could have a look at my debug log and see if you see anything weird that would explain why it doesn't on mineThe landscape image is being scraped. I can see it on line 2619. It also scrapes fine for me.
Do you have <arttype>landscape</arttype> set in your advancedsettings.xml file? It would explain why it is being scraped but not used.
Thanks for responding. Huh, what do you know. Weird that it doesn't apply then.
Nothing like that in my xml, but I'll paste it here anyway.
https://paste.kodi.tv/kocotafome
RE: Universal Movie Scraper - Karellen - 2020-07-30
(2020-07-30, 23:02)Tobby Wrote: Nothing like that in my xml, but I'll paste it here anyway.Ok, that is the problem. You need to add the artwork type you want Kodi to use. Check the movie page here... https://kodi.wiki/view/Movie_artwork
You also need to add it for tv shows, episodes, music, music videos.
RE: Universal Movie Scraper - Tobby - 2020-07-30
(2020-07-30, 23:12)Karellen Wrote:(2020-07-30, 23:02)Tobby Wrote: Nothing like that in my xml, but I'll paste it here anyway.Ok, that is the problem. You need to add the artwork type you want Kodi to use. Check the movie page here... https://kodi.wiki/view/Movie_artwork
You also need to add it for tv shows, episodes, music, music videos.
Thank you yet again. I didn't know you had to do that.
RE: Universal Movie Scraper - Karellen - 2020-07-31
(2020-07-30, 23:49)Tobby Wrote: Thank you yet again. I didn't know you had to do that.Sure no problems.
FYI this is my file so you can see how it is set up... https://paste.kodi.tv/acazibocaz
All this changes for v19. Many users were being caught out by this requirement, so the plan is to nominate the artwork in your Kodi settings, and if you don't nominate anything it will default to a standard list. But that is a while off yet.
RE: Universal Movie Scraper - Tobby - 2020-07-31
(2020-07-31, 00:00)Karellen Wrote:(2020-07-30, 23:49)Tobby Wrote: Thank you yet again. I didn't know you had to do that.Sure no problems.
FYI this is my file so you can see how it is set up... https://paste.kodi.tv/acazibocaz
All this changes for v19. Many users were being caught out by this requirement, so the plan is to nominate the artwork in your Kodi settings, and if you don't nominate anything it will default to a standard list. But that is a while off yet.
Thank you, but I got it working.
Oh, that's great. Kodi really is getting more and more user friendly by the day. Especially on Android updating the advancedsettings.xml is a bit of a hassle, so any settings moving in to the UI is excellent.
RE: Universal Movie Scraper - snyft - 2020-08-18
Would it be possible to add worldwide selection for titles? I have used USA / International for a long time and some foreign movie titles have changed.
For example Ichi the Killer is now Koroshiya 1.
RE: Universal Movie Scraper - amf1 - 2020-10-15
Hey there,
I'm having several issues with UMS, and I'm hoping someone here can help. I'm using UMS 5.4.0 on Kodi 18.7.
1. Changing "Get Plot From" from "IMDb" to "IMDb Outline" gives me a broken / empty description. I'd ultimately like it to use the short description that IMDb shows at the top of the page, as this usually has fewer spoilers. (Actually, this is what prompted me to try switching from the default scraper to UMS - the default scraper shows spoilers for the movie with alarming frequency in the plot description.)
2. TMDB sourced posters rarely (never?) work. In the logs, I see many lines like the following:
ERROR: CCurlFile::Stat - Failed: Failure when receiving data from the peer(56) for
http://image.tmdb.org/t/p/original/weVXMD5QBGeQil4HEATZqAkXeEc.jpg
But this link works in a web browser on the same network. I also have not noticed problems (beyond a few dead posters here and there) with the TMDB scraper, which is presumably getting its posters from TMDB.
3. When both IMDb and TMDB posters are enabled, UMS does not "fall back" to the working IMDb poster when the TMDB posters don't load. It gives up and shows me a blank poster instead.
I can open this poster image in a web browser, however, which proves that something's going wrong with the plugin.
More generally, if anyone knows a reasonable solution to the issue of wanting to read basic information about what a movie's about, without getting spoiled on it, I'd love to hear it. TMDB seems to suffer from this issue more frequently than IMDb, so I'd like to switch to the latter, but there doesn't seem to be any way to get the outline at the top of the page (see 1). That is, for Terminator 2, I'd like the description to simply read "A cyborg, identical to the one who failed to kill Sarah Connor, must now protect her teenage son, John Connor, from a more advanced and powerful cyborg."
RE: Universal Movie Scraper - amf1 - 2020-10-15
I don't seem to be able to edit my post, but also
4. Even though I disabled TMDB posters in the settings because of issue 3, they still sometimes appear in the list, thereby breaking posters.
In general, I've done my best to confirm that these are real issues: I've deleted everything from the library and had it rescan, and so on. Hasn't helped.
RE: Universal Movie Scraper - Karellen - 2020-10-15
(2020-10-15, 15:21)amf1 Wrote: 2. TMDB sourced posters rarely (never?) work. In the logs, I see many lines like the following:Current issues at TMDB... https://forum.kodi.tv/showthread.php?tid=357709
ERROR: CCurlFile::Stat - Failed: Failure when receiving data from the peer(56) for
http://image.tmdb.org/t/p/original/weVXM...AkXeEc.jpg
(2020-10-15, 15:21)amf1 Wrote: 3. When both IMDb and TMDB posters are enabled, UMS does not "fall back" to the working IMDb poster when the TMDB posters don't load. It gives up and shows me a blank poster instead.Related to previous issue.
I can open this poster image in a web browser, however, which proves that something's going wrong with the plugin.
(2020-10-15, 15:31)amf1 Wrote: 4. Even though I disabled TMDB posters in the settings because of issue 3, they still sometimes appear in the list, thereby breaking posters.Related to previous.
You need to wait until TheMovieDB resolve the issues they are having with Cloudflare. It looks like they have but it will take quite a few hours before caches are purged.
RE: Universal Movie Scraper - amf1 - 2020-10-16
(2020-10-15, 22:11)Karellen Wrote:(2020-10-15, 15:21)amf1 Wrote: 2. TMDB sourced posters rarely (never?) work. In the logs, I see many lines like the following:Current issues at TMDB... https://forum.kodi.tv/showthread.php?tid=357709
ERROR: CCurlFile::Stat - Failed: Failure when receiving data from the peer(56) for
http://image.tmdb.org/t/p/original/weVXM...AkXeEc.jpg
(2020-10-15, 15:21)amf1 Wrote: 3. When both IMDb and TMDB posters are enabled, UMS does not "fall back" to the working IMDb poster when the TMDB posters don't load. It gives up and shows me a blank poster instead.Related to previous issue.
I can open this poster image in a web browser, however, which proves that something's going wrong with the plugin.
Thanks for the information. I don't believe 3 is just the TMDB issue, however. Surely, if a poster fails to load, Kodi should fall back to a working poster rather than showing me nothing at all?
Also, do you have any suggestions for issue 1? I don't seem to be able to get nice short descriptions from any source I've tried. In particular, "IMDb Outline" gives an empty description for every movie I've tried scraping with it. I'd really like to avoid the sort of long descriptions that often contain spoilers.
I'm thinking I may have to write my own script to scrape descriptions from Letterboxd. They seem to usually use TMDb descriptions, but in several cases I've checked, they modified the description to remove spoilers. (Letterboxd doesn't have a public API at present, so unfortunately my work couldn't be released as an add-on). Obviously I'd like to avoid this work if possible.