Creating Music Video scraper

  Thread Rating:
  • 1 Votes - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
vdrmidas Offline
Junior Member
Posts: 3
Joined: Jan 2012
Reputation: 0
Post: #11
Thank you for developing the scraper. Yahoo finds 27 out of 83 music vids whereas your lastFM scraper finds 82! Finally i can play the vids now in party mode though i do not understand at all why party mode is limited to db entries... Unfortunately on the other hand the scraper doesnt correctly fill the db. There is absolutely no information Smile No titles no artists no additional info. I have tested under Debian with a recent pre eden git snapshot as well as under xp with the stable release. This might be due to the fact that pastebin is not the best to paste code. I had to manually remove newlines which i hopefully did correctly. But it may be a source of evil Wink Could you maybe attach a zipped addon dir here?

I will subscribe to this thread. Do not hesitate, i'll have an exam at the end of next week Wink

greets

midas
find quote
RizThon Offline
Junior Member
Posts: 11
Joined: Jan 2012
Reputation: 0
Post: #12
Glad to know it's useful to someone else than just me!

I uploaded the zipped addon-ified scraper http://www.mediafire.com/?n3yc8g1u20qjjqi and tried it in XBMC 10.1 and 11 beta 1 on Win7. Please test if it works fine on XP and Debian. If there's no problem I'll ask the scraper to be added to the XBMC repo.

FYI:
I added the plot tag (#1 from previous post
I fixed the encoding issue (#2 from previous post)
find quote
RizThon Offline
Junior Member
Posts: 11
Joined: Jan 2012
Reputation: 0
Post: #13
Concerning #3 from previous post, it indeed looks like XBMC doesn't run the artist and album addons for music videos. But if that info is available (ie retrieved previously through the music), it will be available for the music videos (at least backdrop and artist image).

I don't know how the code is done, but shouldn't it be quite simple to run the artist and album addons for the music videos also? Should I add it to the bug tracker (looks like no one asked for that yet)?
find quote
sialivi Offline
Posting Freak
Posts: 946
Joined: Dec 2008
Reputation: 7
Location: Sweden
Post: #14
Great work. Works much better than the old scrapers.
find quote
Tarkules Offline
Junior Member
Posts: 3
Joined: Nov 2011
Reputation: 0
Post: #15
RizThon Wrote:Glad to know it's useful to someone else than just me!

I uploaded the zipped addon-ified scraper http://www.mediafire.com/?n3yc8g1u20qjjqi and tried it in XBMC 10.1 and 11 beta 1 on Win7. Please test if it works fine on XP and Debian. If there's no problem I'll ask the scraper to be added to the XBMC repo.

FYI:
I added the plot tag (#1 from previous post
I fixed the encoding issue (#2 from previous post)


Great work mate!
Thank you very much for the efforts, you solved a very annoying problem for me Smile

CHEERS !
find quote
cliffx Offline
Junior Member
Posts: 41
Joined: Feb 2012
Reputation: 0
Post: #16
RizThon Wrote:Concerning #3 from previous post, it indeed looks like XBMC doesn't run the artist and album addons for music videos. But if that info is available (ie retrieved previously through the music), it will be available for the music videos (at least backdrop and artist image).

I don't know how the code is done, but shouldn't it be quite simple to run the artist and album addons for the music videos also? Should I add it to the bug tracker (looks like no one asked for that yet)?

Great work, i always thought that music videos was the less developed characteristic in xbmc. I added my music videos and it worked as expected.
find quote
Madlib Offline
Junior Member
Posts: 13
Joined: Jan 2011
Reputation: 0
Post: #17
Awesome! works perfectly for my music videos!

Thanks!
find quote
TItanKing Offline
Junior Member
Posts: 6
Joined: Mar 2012
Reputation: 0
Post: #18
Hi Guys, thanks for this, out of 10GB's music videos, the default music video scraper founds a mere 2 videos. I hope this will also solve my problem. If not, I am thinking of writing a generic scraper that if all else fails it returns results from what it has in the URL adding only generic details info. This is just so that the video appears in the Library so smart playlists can find it.

I have the same problem with old documentaries, there is no info on it anywhere, so now it is simply not available in my library. And with me running PseudoTV it is pretty much useless.
(This post was last modified: 2012-04-02 09:36 by TItanKing.)
find quote
TItanKing Offline
Junior Member
Posts: 6
Joined: Mar 2012
Reputation: 0
Post: #19
Just to let you all know, 90% of my music videos was scraped with this great little lastfm scraper, opposed to the only 1% with the default Yahoo music scraper.
(This post was last modified: 2012-04-03 09:35 by TItanKing.)
find quote
sam_1421 Offline
Junior Member
Posts: 17
Joined: Apr 2012
Reputation: 0
Post: #20
Thanks for making this addon!

I tried adding support for fanart downloading from htbackdrops.com, but I miserably failed. I'm completely lost :/ But I don't think I'm too far from the solution. Can someone help me out with this? I think it would be really great to have fanarts with our music videos!

Here is my XML : http://pastebin.com/mkBwTBtD

Thanks!
find quote