Kodi Community Forum
Release Universal Movie Scraper - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)



RE: [Release] Universal Scraper - ailean - 2012-12-26

Apologies if this has been covered somewhere but I've not had any luck searching/browsing for an answer. I've just upgraded all my boxes to frodo and due to the issues with the IMDB addon I'm trying out the Universal one, however either there's some changes in frodo or a difference in the way this scaper scans means I no longer pick up the correct films.
Due to having a lot of anime and other foreign films I'd found the best way to be able to accurately rescan my library was to use a VIDEO_TS.NFO file in the directory with the ISO image, I add the url for the exact movie in IMDB to this file and the title tags if I want an english name or info on the version (directors cut etc).
However this file seems to be ignored now and it looks like it's just guessing based on the ISO file name, most of mine are the original DVD volume title alas.
I'd really prefer not to have to change my entire file system again if this is fixable and for many reasons I won't be moving away from DVD ISO rips.
Currently my layout is;
<source>\
<genre>\
<movie name>\
<dvd vol name>.iso
VIDEO_TS.nfo

And the NFO file containing at least;
http://www.imdb.com/title/<imdb id>/

Help please! Smile


RE: [Release] Universal Scraper - M@rc - 2012-12-26

(2012-12-25, 22:51)olympia Wrote: I don't find them with IMDb web search either, how could the scraper find them then?
You can enter the imdb id in the search dialog though and then the scraper will find them.

Odd that even IDMb can't find these titles even though they're there. Thanks for the tip on the imdb number, didn't think of that Smile


RE: [Release] Universal Scraper - scudlee - 2012-12-26

(2012-12-26, 13:28)M@rc Wrote:
(2012-12-25, 22:51)olympia Wrote: I don't find them with IMDb web search either, how could the scraper find them then?
You can enter the imdb id in the search dialog though and then the scraper will find them.

Odd that even IDMb can't find these titles even though they're there. Thanks for the tip on the imdb number, didn't think of that Smile

It's because IMDB considers them "Adult" titles, if you login on the site and enable adult titles, the searches work.


RE: [Release] Universal Scraper - M@rc - 2012-12-26

(2012-12-26, 13:49)scudlee Wrote:
(2012-12-26, 13:28)M@rc Wrote:
(2012-12-25, 22:51)olympia Wrote: I don't find them with IMDb web search either, how could the scraper find them then?
You can enter the imdb id in the search dialog though and then the scraper will find them.

Odd that even IDMb can't find these titles even though they're there. Thanks for the tip on the imdb number, didn't think of that Smile

It's because IMDB considers them "Adult" titles, if you login on the site and enable adult titles, the searches work.

Oh is that how that works, I figured it might have been something like that.


RE: [Release] Universal Scraper - spmckenz - 2012-12-26

I'm having a bit of trouble with my library in general and I'm not sure if it's because I'm doing something wrong with this add-on. I'm trying to add a source of about 600 movies, but when I do maybe 10 % don't actually scrape any data besides the title. Movies have no synopsis or cast data, and they don't separate into movie sets either. I'm using the default settings but I'm not sure if I'm missing something obvious. ThemovieDB scraper is also installed but on the add source screen I have The universal scraper highlighted. Any suggestions?


RE: [Release] Universal Scraper - calculus - 2012-12-26

(2012-12-23, 13:18)adelphia Wrote: I'm having issues installing Universal Scraper. When I try to install it briefly flashes "Downloading 0%" and then returns to the Add-Ons screen without being downloaded/installed. Is this currently offline with the release of FrodoRC2? I am still using Eden although I'm thinking of upgrading to FrodoRC2. I want to try Unuiversal Scraper out as I'm fed up using United States (MPAA) certification on my films and want to get the UK ones. However, if I set the default scraper of TMDB to en/gb I get GERMAN certifications!

EDIT: OK, finally got it to install, but now this is also showing GERMAN as per http://en.wikipedia.org/wiki/Freiwillige_Selbstkontrolle_der_Filmwirtschaft certification - the images are certainly not the UK BBFC http://en.wikipedia.org/wiki/British_Board_of_Film_Classification ones. Wonder if this is a SKIN issue rather than a scraper one?

Adelphia,

How did you manage to the Universal scraper installed. I am seeing the exact same problem as you.


RE: [Release] Universal Scraper - olympia - 2012-12-26

(2012-12-26, 19:16)spmckenz Wrote: I'm having a bit of trouble with my library in general and I'm not sure if it's because I'm doing something wrong with this add-on. I'm trying to add a source of about 600 movies, but when I do maybe 10 % don't actually scrape any data besides the title. Movies have no synopsis or cast data, and they don't separate into movie sets either. I'm using the default settings but I'm not sure if I'm missing something obvious. ThemovieDB scraper is also installed but on the add source screen I have The universal scraper highlighted. Any suggestions?

Debug log would tell.


RE: [Release] Universal Scraper - olympia - 2012-12-26

(2012-12-26, 13:13)ailean Wrote: Apologies if this has been covered somewhere but I've not had any luck searching/browsing for an answer. I've just upgraded all my boxes to frodo and due to the issues with the IMDB addon I'm trying out the Universal one, however either there's some changes in frodo or a difference in the way this scaper scans means I no longer pick up the correct films.
Due to having a lot of anime and other foreign films I'd found the best way to be able to accurately rescan my library was to use a VIDEO_TS.NFO file in the directory with the ISO image, I add the url for the exact movie in IMDB to this file and the title tags if I want an english name or info on the version (directors cut etc).
However this file seems to be ignored now and it looks like it's just guessing based on the ISO file name, most of mine are the original DVD volume title alas.
I'd really prefer not to have to change my entire file system again if this is fixable and for many reasons I won't be moving away from DVD ISO rips.
Currently my layout is;
<source>\
<genre>\
<movie name>\
<dvd vol name>.iso
VIDEO_TS.nfo

And the NFO file containing at least;
http://www.imdb.com/title/<imdb id>/

Help please! Smile

You either need a movie.nfo or a 'dvd vol name.nfo' in the movie folder instead of VIDEO_TS.nfo. I am not sure where did you get this naming convention from, nor about how did this work in any pre-frodo release.


RE: [Release] Universal Scraper - olympia - 2012-12-26

(2012-12-25, 22:53)tinybutstrong Wrote: hey olympia thanks for adding BR in options. Though you did a small mistake here, BR means Brazil, right? In Brazil we speak Portuguese (PT in list), so BR should be added only to certification country list, not in other language options like for title.

Other question, the scraper (not sure) isn't saving crew for some movies, for example movie Dredd:

http://api.themoviedb.org/3/movie/49049/casts?api_key=CHANGE_TO_YOUR_API_KEY_HERE&language=pt *change the api key*

returns:

Code:
"crew": [
    {
      "id": 43141,
      "name": "Pete Travis",
      "department": "Directing",
      "job": "Director",
      "profile_path": null
    },
    {
      "id": 57653,
      "name": "Carlos Ezquerra",
      "department": "Writing",
      "job": "Writer",
      "profile_path": null
    },
    {
      "id": 2036,
      "name": "Alex Garland",
      "department": "Writing",
      "job": "Screenplay",
      "profile_path": null
    }
  ]

But the field director still blank here. Any idea or it is my system?

Thanks again.

EDIT:

Sorry for info above about TMDB, I'm using IMDBFULL for crew info in options, anyway it should return right information, no? the info is on IMDB:

http://www.imdb.com/title/tt1343727/

Should be fixed by now.


RE: [Release] Universal Scraper - spmckenz - 2012-12-27

Here's a log. I started xbmc, scanned for a movie that hasn't been scrapping right (30 Days of Night) and then exited after it had been found and added to the library. Still no synopsis or cast info. Please let me know if I'm doing something wrong in generating the log, thanks!


RE: [Release] Universal Scraper - olympia - 2012-12-27

Where is the log? Smile


RE: [Release] Universal Scraper - ailean - 2012-12-27

(2012-12-26, 22:19)olympia Wrote:
(2012-12-26, 13:13)ailean Wrote: Apologies if this has been covered somewhere but I've not had any luck searching/browsing for an answer. I've just upgraded all my boxes to frodo and due to the issues with the IMDB addon I'm trying out the Universal one, however either there's some changes in frodo or a difference in the way this scaper scans means I no longer pick up the correct films.
Due to having a lot of anime and other foreign films I'd found the best way to be able to accurately rescan my library was to use a VIDEO_TS.NFO file in the directory with the ISO image, I add the url for the exact movie in IMDB to this file and the title tags if I want an english name or info on the version (directors cut etc).
However this file seems to be ignored now and it looks like it's just guessing based on the ISO file name, most of mine are the original DVD volume title alas.
I'd really prefer not to have to change my entire file system again if this is fixable and for many reasons I won't be moving away from DVD ISO rips.
Currently my layout is;
<source>\
<genre>\
<movie name>\
<dvd vol name>.iso
VIDEO_TS.nfo

And the NFO file containing at least;
http://www.imdb.com/title/<imdb id>/

Help please! Smile

You either need a movie.nfo or a 'dvd vol name.nfo' in the movie folder instead of VIDEO_TS.nfo. I am not sure where did you get this naming convention from, nor about how did this work in any pre-frodo release.
Yay! Smile
Thank you, although I'd tried movie.nfo before and it was ignored I'd not tried dvdvolname.nfo (doh) and this seems to work okay (at least on a test with one dvd). I'll start doing some renaming and get back to ripping a few hundred more DVDs over the holidays. Sleepy
I would have picked up the VIDEO_TS.nfo method from some wiki/forum post somewhere (about a year ago) and it has worked fine with Eden and the IMDB addon, it was probably the first thing that worked so I'd used it since. I use a different method for TV series ISOs with the TVDB scraper.
Thanks again for the swift response!



RE: [Release] Universal Scraper - gpiccon - 2012-12-27

Any news here and in that bug?


(2012-04-27, 00:06)tinybutstrong Wrote: Found a bug I think.

I'm using TMDB PT lang for title, plot and genres.

Movie tested: http://www.themoviedb.org/movie/78299-n-o-se-preocupe-nada-vai-dar-certo | http://www.imdb.com/title/tt2106575/
Local folder name: Nao.Se.Preocupe.Nada.Vai.Dar.Certo.480p.BRRip.XviD (need to input manually, since XBMC doesn't support ã char, send 'se preocupe, nada vai dar certo' to get right movie).

Only poster is added. Title, plot and genres are blank.

Some debug log info: http://pastebin.com/ULQaLxj5

Can you confirm issue?

Thanks, I hope this scraper become default one in near future.




RE: [Release] Universal Scraper - olympia - 2012-12-27

(2012-12-27, 19:11)gpiccon Wrote: Any news here and in that bug?

hmmm?


RE: [Release] Universal Scraper - Mbee - 2012-12-29

Universal Scraper doesn't seem to figure out "original title" searches within IMDB.
Basically, anything with non-standard (non US) characters fails to scrape. That means nearly all 'foreign films' but also US titles that have special characters.
A "unable to connect to remote server" message pops up instead of giving the user an option to chose the correct title - what's the deal with that?

here's a small samples of movies that don't scrape.

The Lion King 1½ - (US)
http://www.imdb.com/title/tt0318403/

Bröderna Lejonhjärta - (SWEDISH)
http://www.imdb.com/title/tt0075790/

Astérix aux jeux olympiques - (FRENCH)
http://www.imdb.com/title/tt0463872/

Löggulíf - (ICELANDIC)
http://www.imdb.com/title/tt0241696/

Yes, replacing the "original title" with the "translated" crap titles works - but that would defy the purpose of this new scraper as a replacement for the old IMDB scraper, which scraped the original titles just fine.

...or is there a hidden setting somewhere in "universal scraper" that allows for origninal title searches?

cheers!