+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
RE: Universal Movie Scraper - scoochie78 - 2022-03-13
Gotcha. That is too bad. Thanks for the explanation.
RE: Universal Movie Scraper - willemd - 2022-03-20
I noticed that since a while, the scraper doesn't return genres for some of my non-US films. For all American / English language films the genres turn out OK.
For example: https://www.imdb.com/title/tt9911196
This is a Dutch movie. On the IMDb web page it shows Comedy and Drama as genres. When Kodi scrapes the movie, I get no genres. (I have set the scraper to use IMDb for genres.)
Here is a log: https://pastebin.com/7jisJbzy
I refreshed the movie info at 11:13.40
Is this a bug? Did I make a mistake in the setup?
RE: Universal Movie Scraper - olympia - 2022-03-21
(2022-03-20, 12:28)willemd Wrote: Is this a bug? Did I make a mistake in the setup?
A bug, probably due to a change on IMDb. I was trying to address this in metadata.common.imdb.com v3.2.5.
Please test once it gets available in the repo.
RE: Universal Movie Scraper - willemd - 2022-03-21
(2022-03-21, 09:56)olympia Wrote:(2022-03-20, 12:28)willemd Wrote: Is this a bug? Did I make a mistake in the setup?
A bug, probably due to a change on IMDb. I was trying to address this in metadata.common.imdb.com v3.2.5.
Please test once it gets available in the repo.
Thanks, that fixed it!
RE: Universal Movie Scraper - Verberzerk - 2022-04-26
Hi olympia,
Thanks for keeping this scraper up to date.
It seems that, since last Saturday, it no longer scrapes the plot from IMDB.
Can you please confirm and (even better) fix this? Or is it something I can fix myself through the settings?
Thanks!
Description is no longer parsing correctly for any movie added/refreshed - At2010 - 2022-04-26
Hello.
For the past few days the Universal Movie Scraper no longer enters the Plot Summary/Description for any movie added or refreshed. The Plot Outline is ok.
Windows 10 pro x64
Kodi 19.4.0
TMDB v 5.2.6
TMDB python v 1.6.2+matrix.1 (system installed python 3.10.1)
Universal v 5.5.8
debug log: mamusazebi.kodi (paste)
Thank you for any help.
RE: Universal Movie Scraper - At2010 - 2022-04-26
Possible fix to metadata.common.imdb.com/imdb.xml
I coudn't figure out how to show & lt; and & gt; without a space. There shouldn't be a spaces, but this post kept chainging them to < and > which would be incorrect.
xml:<ParseIMDBPlot dest="5">
<RegExp input="$$2" output="<details>\1</details>" dest="5">
<RegExp input="$$1" output="<plot>\1</plot>" dest="2">
<expression fixchars="1" trim="1">storyline-plot-summary"& gt;& lt;div class="ipc-html-content ipc-html-content--base"& gt;& lt;div class="ipc-html-content-inner-div"& gt;(.*)?& lt;span style=</expression>
</RegExp>
<RegExp input="$$1" output="<plot>\1</plot>" dest="2">
<expression fixchars="1" trim="1"><h2>Storyline</h2>\s+<div\sclass="inline\scanwrap">\s+<p>\s+<span>(.*?)</span></expression>
</RegExp>
<expression noclean="1" />
</RegExp>
</ParseIMDBPlot>
RE: Universal Movie Scraper - At2010 - 2022-04-27
Expression fix for the previous possible fix. Includes the case where the author of the plot may or may not be present.
<expression fixchars="1" trim="1">storyline-plot-summary"><div class="ipc-html-content ipc-html-content--base"><div class="ipc-html-content-inner-div">(.*?)(?:<span style=.*?)?</div></div><div class="ipc-overflowText-overlay"</expression>
RE: Universal Movie Scraper - Sunflux - 2022-04-29
Is a fix for this current issue going to be pushed through?
RE: Universal Movie Scraper - Karellen - 2022-04-29
(2022-04-29, 03:19)Sunflux Wrote: Is a fix for this current issue going to be pushed through?You need to wait for @olympia to look at the issue. He hasn't been around for a few days.
Why not test the change kindly provided by @At2010 and confirm that it works?
RE: Universal Movie Scraper - Sunflux - 2022-04-29
Okay, okay, putting me to work here. It seems to work (both with and without plot author names), but to match prior formatting I would probably do the following:
<expression fixchars="1" trim="1">storyline-plot-summary"><div\sclass="ipc-html-content\sipc-html-content--base"><div\sclass="ipc-html-content-inner-div">(.*?)(?:<span.*?)?</div></div><div\sclass="ipc-overflowText-overlay"</expression>
RE: Universal Movie Scraper - olympia - 2022-04-29
Many thanks guys for looking and even fixing the issue. Makes my life much easier
Sunflux suggested fix has been pushed to the repo at v3.2.6
RE: Universal Movie Scraper - Sekt0r - 2022-04-30
(2022-04-29, 13:32)olympia Wrote: Many thanks guys for looking and even fixing the issue. Makes my life much easier
Sunflux suggested fix has been pushed to the repo at v3.2.6
Not sure if it's just me but I'm still not getting the Plot, using the updated IMDB Scraper Library 3.2.6.
Tried with new movies and refreshing the existing.
RE: Universal Movie Scraper - At2010 - 2022-05-04
The 3.2.6 did not work for me either. I edited the same expression but truncated some off the end and it works ok now.
<expression fixchars="1" trim="1">storyline-plot-summary"><div\sclass="ipc-html-content\sipc-html-content--base"><div\sclass="ipc-html-content-inner-div">(.*?)(?:<span.*?)?</div></div><div</expression>
RE: Universal Movie Scraper - Verberzerk - 2022-05-04
Thanks, At2010,
Your fix works for me as well.
Refreshing existing movies doesn't show the plot, but removing them from the library and rescraping does.