[Release] Universal Movie Scraper

**olympia** · 2012-04-24 15:15

I was playing around with this for a while now and am about to release a new scraper, called 'Universal Scraper'.

Features:

Currently it supports 3 sites: IMDb, TMDb, Trakt.tv and Rotten Tomatoes
You can select for almost (if not all) major fields on a per field basis that from which of the above site you want the info for this particular field

Grab it from the Team-XBMC official addon repository.

pecinko · 2012-04-24 15:41

Looks great will try it out when I get home. Not sure about certification prefix option and I don't think it should be pre-filled by default, but that's just my opinion.

**olympia** · 2012-04-24 16:23

I am sure about it. Default Confluence skin requires this prefix to display US certifications.
Otherwise this is a scraper for pro users.

pecinko · 2012-04-24 18:51

Ok, I don't qualify in that case.

**olympia** · 2012-04-24 21:41

I was not saying you're not amongst the pros Smile

I meant those who doesn't know what this setting is about should stay away from it.

Spongeroberto · 2012-04-25 19:52

Looks interesting!

Is there a plan to add this for shows as well?

mortstar · 2012-04-25 22:02

Is there a reason why IMDB thumbs are not optional? They are pretty much the worst source

**olympia** · 2012-04-25 22:20

(2012-04-25 22:02)mortstar Wrote: Is there a reason why IMDB thumbs are not optional? They are pretty much the worst source

Good point, that's a leftover approach from the IMDb scraper to have this as a last resort.
This is not needed here, I will change.

tinybutstrong · 2012-04-26 23:21

Maybe add support for IMDb internacional sites?

List: IMDb Germany| IMDb Italy| IMDb Spain| IMDb France| IMDb Portugal

Very useful to pick translated genres and sometimes plot. TMDB is always outdated, specially non english content.

tinybutstrong · 2012-04-27 00:06

Found a bug I think.

I'm using TMDB PT lang for title, plot and genres.

Movie tested: http://www.themoviedb.org/movie/78299-n-...-dar-certo | http://www.imdb.com/title/tt2106575/
Local folder name: Nao.Se.Preocupe.Nada.Vai.Dar.Certo.480p.BRRip.XviD (need to input manually, since XBMC doesn't support ã char, send 'se preocupe, nada vai dar certo' to get right movie).

Only poster is added. Title, plot and genres are blank.

Some debug log info: http://pastebin.com/ULQaLxj5

Can you confirm issue?

Thanks, I hope this scraper become default one in near future.

pecinko Member+ Posts: 3,017 Joined: Dec 2008 Reputation: 27 Location: Prague / Belgrade	2012-04-24 15:41 Post: #2 Looks great will try it out when I get home. Not sure about certification prefix option and I don't think it should be pre-filled by default, but that's just my opinion. My skins: Quartz Amber
	find quote

olympia Team-XBMC Member Posts: 2,381 Joined: May 2008 Reputation: 30	2012-04-24 16:23 Post: #3 I am sure about it. Default Confluence skin requires this prefix to display US certifications. Otherwise this is a scraper for pro users. ASUS P5N7A-VM - Intel C2D E7300 - 2GB RAM - Silverstone GD02 Black - MS MCE Remote - Patriot Warp 32GB SSD Drive
	find quote

pecinko Member+ Posts: 3,017 Joined: Dec 2008 Reputation: 27 Location: Prague / Belgrade	2012-04-24 18:51 Post: #4 Ok, I don't qualify in that case. My skins: Quartz Amber
	find quote

olympia Team-XBMC Member Posts: 2,381 Joined: May 2008 Reputation: 30	2012-04-24 21:41 Post: #5 I was not saying you're not amongst the pros I meant those who doesn't know what this setting is about should stay away from it. ASUS P5N7A-VM - Intel C2D E7300 - 2GB RAM - Silverstone GD02 Black - MS MCE Remote - Patriot Warp 32GB SSD Drive
	find quote

Spongeroberto Junior Member Posts: 4 Joined: Apr 2012 Reputation: 0	2012-04-25 19:52 Post: #6 Looks interesting! Is there a plan to add this for shows as well?
	find quote

mortstar Senior Member Posts: 250 Joined: Aug 2010 Reputation: 3	2012-04-25 22:02 Post: #7 Is there a reason why IMDB thumbs are not optional? They are pretty much the worst source (This post was last modified: 2012-04-25 22:03 by mortstar.)
	find quote

tinybutstrong Senior Member Posts: 192 Joined: Sep 2010 Reputation: 0	2012-04-26 23:21 Post: #9 Maybe add support for IMDb internacional sites? List: IMDb Germany\| IMDb Italy\| IMDb Spain\| IMDb France\| IMDb Portugal Very useful to pick translated genres and sometimes plot. TMDB is always outdated, specially non english content. (This post was last modified: 2012-04-27 05:06 by tinybutstrong.)
	find quote