Kodi Community Forum
Release Universal Movie Scraper - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)



RE: [Release] Universal Movie Scraper - agentclark - 2013-02-04

hey,

i was wondering if there is a way to use the scraper from command line.

Thx Agent


RE: [Release] Universal Movie Scraper - olympia - 2013-02-04

(2013-02-04, 00:08)Maetrik Wrote: Issues with Eden (always add a nfo file with link to imdb.com in it within movie folder before scraping):

Scraper is set to get title from IMDb in german language, but most of the time the english title is set and the german one is set as original title. Seems this is swapped. Also genre is missing completely. This did not happen the last months, so i guess both issues came up with imdb site changes.

These are all OK now with Frodo. Eden support will now going to be very slowish...


RE: [Release] Universal Movie Scraper - RandyMcH - 2013-02-05

Am I doing something wrong, i get cannot connect to remote server all the time. this has been ongoing for days

:-(


[Release] Universal Movie Scraper - francovilar - 2013-02-06

most of the movies don't have year. Using themoviedb search and most settings from the same source only title from imdb - USa intrrnational. Can be replicated or needs a debug log?


RE: [Release] Universal Movie Scraper - olympia - 2013-02-06

No, I cannot reproduce this on my end.


RE: [Release] Universal Movie Scraper - steviex - 2013-02-06

Hello i am using xbmc frodo with the universal scraper and now i have a question. Does the scraper not more recognize Urls in the nfo files anymore. I got thousands of movies with .nfo files containing a url to ofdb.de
Now i have the problem that the OFDB scraper doesn't exist anymore and the universal scraper ignores this urls. Will there come a update in the next time so that URLs to the OFDB are recognized? Or which URLS does the universal scraper recognize now?


RE: [Release] Universal Movie Scraper - olympia - 2013-02-06

Universal Scraper did never recognize ofdb links, nor ever will.
It recognizes IMDb URLs.

...and do you think it does help if you are ignoring my question in the other thread?


RE: [Release] Universal Movie Scraper - steviex - 2013-02-06

Hy thanks for the Information so i will use IMDB links in the future. I didn't get a Message that you Sent me a question...sorry Sad


RE: [Release] Universal Movie Scraper - fnc1 - 2013-02-06

olympia

Maybe you can help out with this... On frodo xbmcbuntu
I added a new source a dir on my nfs server and went to scan for new content and received the following error message:
"Unable to connect to remote server Would you like to continue scanning?"

If this is answered or there is a fix somewhere else could you point me to where...

Here is the relevant portion of the log file... I noticed that it was looking for the icon in the dir:
/home/user1/.xbmc/addons/metadata.universal/icon.png
But that dir does not exist?

These are the dirs i have:

metadata.album.universal metadata.common.impa.com metadata.common.port.hu script.rss.editor
metadata.artists.universal metadata.common.last.fm metadata.common.theaudiodb.com script.xbmc.audio.mixer
metadata.common.allmusic.com metadata.common.movieposterdb.com metadata.musicvideos.theaudiodb.com
metadata.common.fanart.tv metadata.common.musicbrainz.org packages
metadata.common.imdb.com metadata.common.ofdb.de script.netflix_icon

and the log file:

15:43:12 T:2751458112 ERROR: DVDFileSeekForce - ignored size of file indicated in UDF
15:44:07 T:2874145600 ERROR: Previous line repeats 84 times.
15:44:07 T:2874145600 NOTICE: Thread Background Loader start, auto delete: false
15:45:48 T:3007678272 NOTICE: Previous line repeats 13 times.
15:45:48 T:3007678272 ERROR: Control 18 in window 10129 has been asked to focus, but it can't
15:45:54 T:2603993920 ERROR: Unable to lookup host: ''
15:46:22 T:3007678272 ERROR: Texture manager unable to load file: /home/user1/.xbmc/addons/metadata.universal/icon.png
15:46:39 T:2380446528 ERROR: Previous line repeats 3 times.
15:46:39 T:2380446528 NOTICE: Thread CVideoInfoScanner start, auto delete: false
15:46:39 T:2874145600 NOTICE: Thread Background Loader start, auto delete: false
15:46:39 T:2380446528 NOTICE: VideoInfoScanner: Starting scan ..
15:46:41 T:2380446528 WARNING: failed to load scraper XML
15:46:48 T:2380446528 WARNING: No information found for item 'nfs://192.168.1.104/export/Media/Movies/DVD_iso/21.iso', it won't be added to the library.
15:46:48 T:2380446528 WARNING: failed to load scraper XML
15:48:10 T:3007678272 NOTICE: NFS is idle. Closing the remaining connections.
15:48:48 T:2380446528 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 02:08
15:48:48 T:2380446528 NOTICE: Thread Jobworker start, auto delete: true
15:48:48 T:2699062080 NOTICE: Thread Background Loader start, auto delete: false
15:48:54 T:2699062080 NOTICE: Thread CVideoInfoScanner start, auto delete: false
15:48:54 T:2699062080 NOTICE: VideoInfoScanner: Starting scan ..
15:48:55 T:2699062080 WARNING: failed to load scraper XML
15:49:01 T:2699062080 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:06
15:49:01 T:2699062080 NOTICE: Thread Background Loader start, auto delete: false
15:50:28 T:3007678272 NOTICE: NFS is idle. Closing the remaining connections.
15:51:48 T:2380446528 NOTICE: Thread CVideoInfoScanner start, auto delete: false
15:51:48 T:2380446528 NOTICE: VideoInfoScanner: Starting scan ..
15:51:50 T:2380446528 WARNING: failed to load scraper XML
15:51:53 T:2380446528 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:04
15:51:53 T:2380446528 NOTICE: Thread Jobworker start, auto delete: true
15:51:53 T:2699062080 NOTICE: Thread Background Loader start, auto delete: false

Also I just installed this maybe 5-10 mins ago... I thought I might try to uninstall and reinstall the addon....

Went to System > Settings > Add-ons > Enabled Add-ons > Movie Information > Universal Scraper

But The only option now is 'Change Log' everything else is greyed out (Configure, Update, Uninstall, Disable Rollback)


[Release] Universal Movie Scraper - francovilar - 2013-02-07

(2013-02-06, 12:57)olympia Wrote: No, I cannot reproduce this on my end.

Sorry had some .info files don't know how... Deleted them and will try again. Thank you


RE: [Release] Universal Movie Scraper - SorryGoFish - 2013-02-07

(2012-12-22, 10:12)realjobe Wrote: I was wondering about that "TV-Series" not being included in the searchresults, understanding that this a movie scrapper, but there are also cases that IMDB has the hit, not TheTVDB. e.g. http://www.imdb.com/title/tt1295036/. This is a full length movie, based on Family Guy TV-Series.
Also http://www.imdb.com/title/tt1118511/


I added the TV-Series & TV Short criteria to UniversalScrapper, and now the search also gets TV-Series from IMDB

metadata.universal/universal.xml
Line 54.

Code:
<RegExp input="$$4" output="&lt;entity&gt;&lt;title&gt;\2&lt;/title&gt;&lt;year&gt;\3&lt;/year&gt;&lt;url cache=&quot;\1-main.html&quot;&gt;http://akas.imdb.com/title/\1/&lt;/url&gt;&lt;id&gt;\1&lt;/id&gt;&lt;/entity&gt;" dest="5+">
<expression repeat="yes" noclean="1,2">&lt;td\sclass=&quot;result_text&quot;&gt;\s&lt;a\shref=&quot;/title/([t0-9]*)/[^&gt;]*&gt;(?:&amp;#x22;)?([^&lt;]*?)(?:&amp;#x22;)?&lt;/a&gt;\s*(?:\([IV]+\) )?\([^\(]*?([0-9]{4})[^\)]*\)\s(?:\(TV Movie\)\s|\(Video\)\s|\(TV Series\)\s|\(TV Short\)\s)?&lt;</expression>
</RegExp>

(2012-12-23, 10:48)olympia Wrote: Olivia? Huhh? Wink

I will definitely not put it in as odds are pretty high that this would end up in many false positive hit during bulk scraping. This is because there are many similar titles for TV series and Movies, even from the same year, so XBMC might pick the wrong one.


I've manually added .nfo files with the proper IMDB URL for a few TV Movies (e.g. http://www.imdb.com/title/tt0430926/). The information gets scraped properly, but the year comes out as 0. (Note the year string on the site is "TV 2005").

Is this a change you can make to the scraper, or should I just go ahead and add the year to my .nfo files?

Thanks a lot.





RE: [Release] Universal Movie Scraper - olympia - 2013-02-07

You don't need to add .nfo file for TV movies. Universal Scraper will scrape TV movies just in itself.
I will look into fixing the year.


RE: [Release] Universal Movie Scraper - SorryGoFish - 2013-02-07

(2013-02-07, 22:25)olympia Wrote: You don't need to add .nfo file for TV movies. Universal Scraper will scrape TV movies just in itself.
I will look into fixing the year.

Okay, great. Thanks.


RE: [Release] Universal Movie Scraper - Nizolai - 2013-02-08

(2013-02-02, 20:44)pcjco Wrote: I wonder if there is not again a problem when retrieving genre (using IMDB or TMDB in the Universal Movie Scraper settings)
"Genre" are empty since 2 days.
Only me ?

TMDB addon is retrieving the info.

I'm not getting any genre either. Frodo and Universal scraper vers. 2.1.9.

Do i have to do anything custom to scrape the genre part.

Thanks for a super nice add-on btw.


RE: [Release] Universal Movie Scraper - Maetrik - 2013-02-08

(2013-02-04, 17:42)olympia Wrote:
(2013-02-04, 00:08)Maetrik Wrote: Issues with Eden (always add a nfo file with link to imdb.com in it within movie folder before scraping):

Scraper is set to get title from IMDb in german language, but most of the time the english title is set and the german one is set as original title. Seems this is swapped. Also genre is missing completely. This did not happen the last months, so i guess both issues came up with imdb site changes.

These are all OK now with Frodo. Eden support will now going to be very slowish...

Well, just tested Frodo and guess what. German title is still not grabbed from IMDb. What does "very slowish" mean? Weeks? Months? There are different reasons why i am not happy with Frodo so i'd like to keep Eden as long as i can.