Release - MyMovies.it scraper (Italian)

  Thread Rating:
  • 2 Votes - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
muttley:bd Offline
Senior Member
Posts: 184
Joined: Oct 2008
Reputation: 0
Thumbs Up  MyMovies.it scraper (Italian)
Post: #1
Latest release: v2.1.0 - date: 19.04.2014.
  • If you would like contribute to the projects, feel free to do: fork, pull-request, issues, etc...
  • ...or if you want help but don't understand "scraper programming", you can offer me a coffee or a beer: [Image: btn_donate_LG.gif][Image: _donate__by_bad_blood.gif]

Thanks for support to: Davide aka kiwi

Latest update is on the official addons repository => Automatic update Nod

You can also download from here https://drive.google.com/folderview?id=0...aring#list for manual update.

Source avviable: https://github.com/elbowz/mymovies-xbmc-scraper

Note: if the scraper is very slow, disable setting tagged with "(slow)".

Bug: For Frodo users there are some problems with films posters download. There is a thread http://forum.xbmc.org/showthread.php?tid=145656 and a open ticket https://github.com/xbmc/xbmc/pull/1885 for solve xbmc bug (thanks to jmarshall). (FIXED with final release of Frodo)

Changelog:

Code:
[B]2.1.0[/B]
- Better (i hope) search for fan art and imdb info (use imdb.aka for search)
- Include and use metadata.common.imdb.com
- Migrate source on GitHub (https://github.com/elbowz/mymovies-xbmc-scraper)

[B]2.0.4[/B]
- Fixed GetMovieTrailer for retrive italian trailer. (Issue 15: Alcuni trailer sono in inglese...)

[B]2.0.3[/B]
- Set mymovies.it internal search as default. Added <forum>, <website> and <source> tags for new xbmc addon section (addons.xbmc.org)

[B]2.0.2[/B]
- Added mymovies.it internal search, this option is activable in setting (thanks to mario.diraimondo for the patch - see issue 13)

[B]2.0.1[/B]
- Fixed trailer: Update regex for change in some films pages
- Added setting category: For more user-friendly scraper settings

[b]2.0.0[/b]
- Fixed fanart: GetTMDBFanartByIdChain url function to chain fuction (stefano85 request)

[b]1.1.9[/b]
- Added imdb id, not visible in film info but needed for trakt plugin (Tmac12 request)

[b]1.1.8[/b]
- Fixed regex: GetSearchResults (for change in google search report)

[b]1.1.7[/b]
- Added User Agent for error: "unable to connect to remote server"

[b]1.1.6[/b]
- Fixed regex: GetSearchResults, ParseImdbData (rating)

[b]1.1.5[/b]
- Fixed regex: trailer

[b]1.1.4[/b]
- Added base scale (vote/10) in direct vote, critics and the public. Proposed on forum.xbmc.org
- Now direct vote, critics and the public is only visible as "outline", beacuse studio and mpaa not present in mymovies are get from imdb.
- Some minor fix

[b]1.1.3[/b]
- Fixed regex: title, trailer, runtime
- Added original title
- Search imdb id form google...not perfect but i hope better.
- Import info from IMDB (vote, mpaa, studio, top250). Deactivable from settings.

[b]1.1.2[/b]
- Fixed regex: rating and trailer
- Fixed url cache

[b]1.1.1[/b]
- Change default films search url: [url]http://www.google.it/search?q=film_name+site:mymovies.it[/url]
- Fixed trailer problem. The first and only issue reported on code.google.com ;)
- Fixed search problem. Reported on forum.xbmc.org

[b]1.1.0[/b]
- Fixed problem for long title
- Added support for new title (asterix votes)
- Used tag <rating max="*">
- Fixed problem with single poster in low res
- Fixed trailer
- Fixed TMDB FanART
- Improved append varius stuff to plot

[b]1.0.6[/b]
- Aggiunto il supporto a XBMC 10.5 (addons system)
- Fixed trailer
- Riorganizzato il menù configurazione

...i hope mymoives.it don't change graphic soon!!

!! PLEASE TEST AND REPORT ANY PROBLEMS AND SUGGESTIONS !!!

Enjoy!

Deprecated versions:

Latest update for XBMC 9.11 and XBMC4Xbox: download from here (update 18.07.10):
http://muttley.eb2a.com/2010/xbmc4xbox-s...-18-07-10/ (italian page)

Note: XBMC4xbox version would be also work on 9.11...if anyone can try, i don't have 9.11 version, and report some problem Smile

Old Info: scraper settings, install and other stuff:
http://muttley.eb2a.com/2009/xbmc-scrape...movies-it/ (italian page)

Alternative for 9.11: thanks to sipontino for this alternative version, always for mymovies.it (update 22.07.10):
http://www.mediafire.com/file/ke260ea1e5...20SiPo.xml
(This post was last modified: 2014-09-19 19:47 by muttley:bd.)
find quote
sipontino Offline
Junior Member
Posts: 35
Joined: Dec 2008
Reputation: 0
Post: #2
Many thanks muttley, great work!! Big Grin
I'm testing now!!

Fantastico!!
find quote
muttley:bd Offline
Senior Member
Posts: 184
Joined: Oct 2008
Reputation: 0
Thumbs Down  drats!
Post: #3
the graphic is changed again !! AngryAngry

I don't think to rewrite again in this moment...
(This post was last modified: 2009-09-22 23:25 by nicoli_k.)
find quote
sipontino Offline
Junior Member
Posts: 35
Joined: Dec 2008
Reputation: 0
Post: #4
Hi Mutt, i try rewrite a simple scraper for mymovies (working with last graphic :stareSmile
I need some little help with movie thumbs, they won't work.
Can you take a little watch?

download

Thanks grazie mille!
PS
Le regex dei getdetails funzionano ma la struttura credo differisca dalla tua versione,
se riesci a carpire qualcosa per la tua versione ben venga!
(dopo verrei anke implementare le fanart come hai fatto nell'ultima
versione ma per ora è troppo per me)
(This post was last modified: 2009-09-22 21:53 by sipontino.)
find quote
mkortstiege Offline
Team-XBMC Developer
Posts: 2,918
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #5
Once there's a updated and working scraper please create a new trac ticket and attach the scraper so we can push it to SVN. Thanks.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
muttley:bd Offline
Senior Member
Posts: 184
Joined: Oct 2008
Reputation: 0
Post: #6
Quote:I need some little help with movie thumbs, they won't work.
Can you take a little watch?

mhhh... do you want one poster (thumb) or multi posters?!
I ask this because i see that you get page: http://www.mymovies.it/poster/?id= but don't use repeat in tag expression Confused

I don't test your scraper, but the graphic is out 2 days ago!! Shocked
Also my scraper get any information but not all (have problem with rating, plot, outline,...)

Quote:Once there's a updated and working scraper please create a new trac ticket and attach the scraper so we can push it to SVN. Thanks
it's not ready Sad
find quote
sipontino Offline
Junior Member
Posts: 35
Joined: Dec 2008
Reputation: 0
Post: #7
Infact mymovies still change....maybe it's better wait. Oo
Thx again matt
find quote
mkortstiege Offline
Team-XBMC Developer
Posts: 2,918
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #8
Please create the ticket and attach what you have so far. I'm quite sure we can get it complete with working thumbs.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
sipontino Offline
Junior Member
Posts: 35
Joined: Dec 2008
Reputation: 0
Post: #9
Hello Mutt,
mi spieghi due cose please??

In output che vul dire mettere un buffer?
<url function="GetMovieThumbs">http://www.mymovies.it/poster/?id=$$2</url>

<url cache="$$2-fullcredits.html" function="AppendToPlot">http://www.mymovies.it/cast/?id=$$2</url>

Poi l'utlima cosa

Quando chiamo una funzione custom (passandogli la stinga della pagina htlm)
in quale buffer viene caricata?...cosa metto come imput nella funzione custom?

Tutti sti strippi pechè non mi sembra venga cachata la pagina che passo alla custon func. da nessuna parte.

Se non ti scoccia magari mandami un pm con il tuo msn

Ciauzz e grazie
find quote
mkortstiege Offline
Team-XBMC Developer
Posts: 2,918
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #10
Please respect the forum rules. English only.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
muttley:bd Offline
Senior Member
Posts: 184
Joined: Oct 2008
Reputation: 0
Post: #11
sipontino Wrote:Hello Mutt,
mi spieghi due cose please??

In output che vul dire mettere un buffer?
<url function="GetMovieThumbs">http://www.mymovies.it/poster/?id=$$2</url>

<url cache="$$2-fullcredits.html" function="AppendToPlot">http://www.mymovies.it/cast/?id=$$2</url>

it's very simple, $$2 will be substitute with the content of buffer 2.

in this example:
http://www.mymovies.it/poster/?id=$$2
you have in $$2 the film's key, in my scraper it's the film's id:
http://www.mymovies.it/poster/?id=733 (for Alien)

sipontino Wrote:Poi l'utlima cosa

Quando chiamo una funzione custom (passandogli la stinga della pagina htlm)
in quale buffer viene caricata?...cosa metto come imput nella funzione custom?

Tutti sti strippi pechè non mi sembra venga cachata la pagina che passo alla custon func. da nessuna parte.

The source code of the url page passed to the custom function is in $$1 Laugh

it's all write here: http://wiki.xbmc.org/?title=HOW-TO_Write...s_guide%29

Ciao!

Quote: I'm quite sure we can get it complete with working thumbs

the problem is not thumbs, the problem is that mymoive's layout is changes (again) about 1 week ago
When i have a few free time i would update the scraper...but now i don't have time...
find quote
sipontino Offline
Junior Member
Posts: 35
Joined: Dec 2008
Reputation: 0
Post: #12
Hi, i've created a ticket and submitted scraper;
i've omitted fanarts part cause i can't get it work.

Bye all and good work Big Grin
find quote
muttley:bd Offline
Senior Member
Posts: 184
Joined: Oct 2008
Reputation: 0
Post: #13
Quote:Hi, i've created a ticket and submitted scraper;

But it's not my scraper, isn't it?! Confused
find quote
sipontino Offline
Junior Member
Posts: 35
Joined: Dec 2008
Reputation: 0
Post: #14
No Mattley, i'm neewbie .... i'm not able to create a scraper like yours.
This is very simple, with only some functions

Here is the code:

CODE

I can't deny that i take inspiration from your scraper....but is first time that
i write one.

Thanks

PS Matt if u want to modify it and add fanarts please do it, feel free to rich the mymovies.it scraper.

Now im trying to do a scraper for moviplayer.it, if you want to collaborate with me i'm very glad!!
(This post was last modified: 2009-10-01 11:12 by sipontino.)
find quote
muttley:bd Offline
Senior Member
Posts: 184
Joined: Oct 2008
Reputation: 0
Post: #15
Quote:No Mattley, i'm neewbie .... i'm not able to create a scraper like yours.

Your Scraper work, i can't say the same of mine Laugh

I have see another problem with mymovies.it, the new films have another url:

old link:
RockNRolla -> http://www.mymovies.it/dizionario/recens...p?id=55522
new link:
Uomini che odiano le donne -> http://www.mymovies.it/film/2009/uominic...noledonne/

the problem is not for Search or Detail, but for GetCast, GetTrailer, etc custom function, beacuse also this url change:

old link:
RockNRolla Trailer -> http://www.mymovies.it/trailer/?id=55522
new link:
Uomini che odiano le donne Trailer -> http://www.mymovies.it/film/2009/uominic...e/trailer/

the problem is that old films have old url, new film have new url...how can resolve this problem?! anyone have some ideas?!
find quote
Post Reply