+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
RE: [Release] Universal Movie Scraper - Voyager - 2013-02-10
Hi Olympia.
I have noticed that contrary to the (now broken) IMDB scraper, the Universal scraper does not bring back matches of the following types:
- "TV Mini-Series" e.g. http://akas.imdb.com/title/tt0074006/
- "TV Series" e.g. http://akas.imdb.com/title/tt0826760
- "TV Short" e.g. http://akas.imdb.com/title/tt0897387
Note, for the type, it's important to look at the 'suffix' on the http://akas.imdb.com/find?q=... search page, in order to know what string gets matched in the regex. It is sometimes different from what you see on the detail page for the item...
In order to fix the issue, I updated the regular expression on line 55 in universal.xml as follows:
Code:
<expression repeat="yes" noclean="1,2"><td\sclass="result_text">\s<a\shref="/title/([t0-9]*)/[^>]*>(?:&#x22;)?([^<]*?)(?:&#x22;)?</a>\s*(?:\([IV]+\) )?\([^\(]*?([0-9]{4})[^\)]*\)\s(?:\(TV Movie\)\s|\(TV Special\)\s|\(TV Series\)\s|\(TV Mini-Series\)\s|\(TV Short\)\s|\(TV Episode\)\s|\(Video\)\s|\(Short\)\s)?<</expression>Any chance this gets updated in a future version?
RE: [Release] Universal Movie Scraper - olympia - 2013-02-10
(2013-02-10, 04:29)mortstar Wrote: I see you added the option to have RT Critic's Consensus as Plot source. Is there any chance you could add the option to have IMDb Outline as Plot? This is what I manually edit the scraper to do on each update. I really dislike the spoiler filled full-length IMDb plots.
Thanks for the continued great work on this scraper Universal. I know you get lot of moaning on this thread, but just to let you know that your work, and the rest of Team XBMC, is really appreciated.
Added at v2.3.0
(2013-02-10, 20:16)francovilar Wrote: Some of my movies are being scraped without year:
http://xbmclogs.com/show.php?id=34589
on of them is "Dictator (2012)"
using latest version and I use moviedb for almost everything.
Fixed at v2.3.0
RE: [Release] Universal Movie Scraper - olympia - 2013-02-10
(2013-02-09, 14:30)Maetrik Wrote: Well i compared the xmls and tried to copy things over, but had no luck.
Many thx for the possibility to set taglines to none in newest version, i guess i'll have to move to Frodo within the next weeks as my beloved Universal Scraper will not be the only addon which will be supported very slow for Eden versions from now on
Eden has just synced with Frodo
RE: [Release] Universal Movie Scraper - jaymez_11 - 2013-02-11
I have tried to add the add-on and it seems the install is not in the repository
here is my logfile.
http://pastebin.com/KrGGSiwY
when I go to my browser and type the link: http://mirrors.xbmc.org/addons/frodo/metadata.universal/metadata.universal-2.2.0.zip it returns it not found. I updated to the latest install today of Frodo - not sure if this is the problem. I am an admin on the computer so it can't be permissions
I searched this thread but I apologize if this has been solved. This is my first attempt at this stuff.
RE: [Release] Universal Movie Scraper - mortstar - 2013-02-11
Thanks for adding the IMDb Outline as plot option. Unfortunately it doesn't seem to work quite right. I'm guessing because the common.imdb functions are hardcoded to respond with <details><outline> or <details><plot> - it also seems to run IMDbPlot even though my settings are:
Outline - RT Critic's
Plot - IMDb Outline
I think this is because the expression is not exclusive so the scraper does find 'IMDb' in the option 'IMDb Outline' - so the full plot gets returned as well. Here's a debug log http://xbmclogs.com/show.php?id=34710
RE: [Release] Universal Movie Scraper - olympia - 2013-02-11
errr, that was me being stupid and your are right in both of your observations.
Implemented properly in v2.3.1.
RE: [Release] Universal Movie Scraper - M@rc - 2013-02-11
(2013-02-11, 01:01)jaymez_11 Wrote: I have tried to add the add-on and it seems the install is not in the repository
here is my logfile.
http://pastebin.com/KrGGSiwY
when I go to my browser and type the link: http://mirrors.xbmc.org/addons/frodo/metadata.universal/metadata.universal-2.2.0.zip it returns it not found. I updated to the latest install today of Frodo - not sure if this is the problem. I am an admin on the computer so it can't be permissions
I searched this thread but I apologize if this has been solved. This is my first attempt at this stuff.
I had the same issue yesterday, must have been something wrong with the server, because today I managed to download and install Universal Scraper.
RE: [Release] Universal Movie Scraper - olympia - 2013-02-11
Unfortunatelly you will always be facing with this situation when you have a brand new installation and in case add-ons have been updated, but the mirrors didn't fully sync yet.
RE: [Release] Universal Movie Scraper - gulp - 2013-02-11
Hi, is in your plan to release a metadata.common for Universal Scraper?
I used metadata.common.imdb.com (now broken) to scrape some info from IMDB within metadata.movieplayer.it scraper, but now i can't access IMDB data
I've tried to make an interface to add movieplayer.it to Universal Scraper, but my skills are not enough
RE: [Release] Universal Movie Scraper - olympia - 2013-02-11
metadata.common.imdb.com is not broken. Universal Scraper uses exactly this library to scrape data from IMDb as well.
RE: [Release] Universal Movie Scraper - Voyager - 2013-02-11
(2013-02-10, 22:16)Voyager Wrote: Hi Olympia.
I have noticed that contrary to the (now broken) IMDB scraper, the Universal scraper does not bring back matches of the following types:These items are ripped as ISOs and in my movie library.
- "TV Mini-Series" e.g. http://akas.imdb.com/title/tt0074006/
- "TV Series" e.g. http://akas.imdb.com/title/tt0826760
- "TV Short" e.g. http://akas.imdb.com/title/tt0897387
Note, for the type, it's important to look at the 'suffix' on the http://akas.imdb.com/find?q=... search page, in order to know what string gets matched in the regex. It is sometimes different from what you see on the detail page for the item...
In order to fix the issue, I updated the regular expression on line 55 in universal.xml as follows:
Code:<expression repeat="yes" noclean="1,2"><td\sclass="result_text">\s<a\shref="/title/([t0-9]*)/[^>]*>(?:&#x22;)?([^<]*?)(?:&#x22;)?</a>\s*(?:\([IV]+\) )?\([^\(]*?([0-9]{4})[^\)]*\)\s(?:\(TV Movie\)\s|\(TV Special\)\s|\(TV Series\)\s|\(TV Mini-Series\)\s|\(TV Short\)\s|\(TV Episode\)\s|\(Video\)\s|\(Short\)\s)?<</expression>
Any chance this gets updated in a future version?
bump
RE: [Release] Universal Movie Scraper - olympia - 2013-02-11
No chance
RE: [Release] Universal Movie Scraper - Voyager - 2013-02-11
(2013-02-11, 16:55)olympia Wrote: No chance
thanks for the answer. Could you elaborate on why not?
RE: [Release] Universal Movie Scraper - olympia - 2013-02-11
Because it mess up the search results like hell. If I wanted to have them in, then I would've had to create that fuzzy regexp to exclude them. The recent inclusion of shorts is actually also have a bad impact on the search accuracy. Thinking about remove it again.
RE: [Release] Universal Movie Scraper - Voyager - 2013-02-11
ok, I understand. Is there any way to make this optional? I.e. turn it off by default for initial scraping, then allow the user to turn it on, so that the remaining stuff (like the ones from the examples, the shorts etc.) can also be scraped in a second round when they were missed or incorrectly matched first time ?