[Release] TheAudioDb.com Music Video Scraper

  Thread Rating:
  • 3 Votes - 3 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
« Next Oldest | Next Newest»
olympia Offline
Team-XBMC Member
 Posts: 2,381
Joined: May 2008
Reputation: 30
2012-07-14 20:40 Post: #1
[Image: mvids.png]

Music Video Scraper

Source: http://www.theaudiodb.com ([Image: mvid.png] links)

Status: Working

Notes: The scraper ONLY supports music video files with the naming convention: 'artist - track'.
-> Note the dash and the space between and after!!!
As being said it will not work perfectly, but I do hope it does the most...

See more about theaudiodb.com in this thread: http://forum.xbmc.org/showthread.php?tid=134260

Adding Music Videos
Sign up and log in on http://www.theaudiodb.com site and search for the track. Or navigate through artist name >> album >> Track.
Then edit the track details and enter a youtube link (preferably vevo) into the correct text box.
Also add some music video screenshots if you like.
(This post was last modified: 2013-03-27 13:15 by zag.)
find quote
Domin Offline
Junior Member
 Posts: 10
Joined: Nov 2010
Reputation: 0
Location: Denmark
2012-08-04 12:14 Post: #2
I get the following error trying to scrape for videos:

Code:
11:51:36 T:139888797792064   DEBUG: ------ Window Init (DialogVideoScan.xml) ------
11:51:36 T:139888797792064    INFO: Loading skin file: DialogVideoScan.xml
11:51:36 T:139888057890560  NOTICE: Thread CVideoInfoScanner start, auto delete: false
11:51:36 T:139888057890560  NOTICE: VideoInfoScanner: Starting scan ..
11:51:36 T:139888797792064   DEBUG: LIRC: Update - NEW at 6250789:160 0 KEY_OK_UP devinput (KEY_OK_UP)
11:51:56 T:139888797792064   DEBUG: SECTION:UnloadDelayed(DLL: special://xbmcbin/system/ImageLib-x86_64-linux.so)
11:51:56 T:139888797792064   DEBUG: Unloading: ImageLib-x86_64-linux.so
11:51:59 T:139888440289024   DEBUG: Thread Jobworker 139888440289024 terminating (autodelete)
11:52:14 T:139888057890560   DEBUG: VideoInfoScanner: Scanning dir '/storage/MVID/MVID1/' as not in the database
11:52:18 T:139888057890560   DEBUG: VideoInfoScanner: No (new) information was found in dir /storage/MVID/MVID1/
11:52:18 T:139888057890560   DEBUG: VideoInfoScanner: Scanning dir '/storage/MVID/MVID1/(sensation_2003_black_edition)-megamix_2003_black_edition_(dvdrip_svcd_2003)__kazan-mv/' as not in the database
11:52:18 T:139888057890560   DEBUG: ExcludeFileOrFolder: File '/storage/MVID/MVID1/(sensation_2003_black_edition)-megamix_2003_black_edition_(dvdrip_svcd_2003)__kazan-mv/Sample/' excluded. (Matches exclude rule RegExp:'[!-._ \\/]sample[-._ \\/]')
11:52:18 T:139888057890560   DEBUG: VideoInfoScanner: No (new) information was found in dir /storage/MVID/MVID1/(sensation_2003_black_edition)-megamix_2003_black_edition_(dvdrip_svcd_2003)__kazan-mv/
11:52:18 T:139888057890560   DEBUG: VideoInfoScanner: Scanning dir 'rar://%2fstorage%2fMVID%2fMVID1%2f%28sensation%5f2003%5fblack%5fedition%29%2dmegamix%5​f2003%5fblack%5fedition%5f%28dvdrip%5fsvcd%5f2003%29%5f%5fkazan%2dmv%2f%28sensat​ion%5f2003%5fblack%5fedition%29%2dmegamix%5f2003%5fblack%5fedition%5f%28dvdrip%5​fsvcd%5f2003%29%5f%5fkazan%2dmv%2erar/' as not in the database
11:52:18 T:139888057890560   ERROR: Parse: Could not find scraper function NfoUrl
11:52:18 T:139888057890560   DEBUG: FindMovie: Searching for '(sensation 2003 black edition) megamix 2003 black edition' using TheAudioDb.com for Music Videos scraper (path: '/storage/.xbmc/addons/metadata.musicvideos.theaudiodb.com', content: 'musicvideos', version: '1.0.0')
11:52:18 T:139888057890560   ERROR: Run: Unable to parse web site
11:52:18 T:139888057890560    INFO: Loading skin file: DialogYesNo.xml
11:52:18 T:139888797792064   DEBUG: ------ Window Init (DialogYesNo.xml) ------

The scanning then stops and says the server is unavailable and i can then press yes to continue scanning, if i press yes it will do the same again, and if i press no it will just quit.

Hope this can be fixed, and thanks for working on an mvid plugin ;-)

Regards
Domin
Regards
Domin

ASRock ION 330HT / Raspberry PI
(This post was last modified: 2012-08-04 12:30 by Domin.)
find quote
RiotGrrl Offline
Junior Member
 Posts: 4
Joined: Sep 2012
Reputation: 0
2012-09-25 22:28 Post: #3
The scraper doesn't match any songs with a hyphen in.
eg. Placebo - Infra-red, Gorillaz - 19-2000, Nirvana - Heart-shaped Box, etc.

I've tried just about everything - omitting the hyphen, a double hyphen "--", a space, underscore, etc - but nothing works. Is there a wildcard character that i could use to search?

Would appreciate any help, I can't find any threads that solve this.
find quote
clackerdacker Offline
Donor
 Posts: 101
Joined: Jul 2008
Reputation: 0
Location: Sydney, Australia
2012-11-07 07:30 Post: #4
(2012-08-04 12:14)Domin Wrote:  I get the following error trying to scrape for videos:

Code:
11:52:18 T:139888057890560   ERROR: Run: Unable to parse web site
11:52:18 T:139888057890560    INFO: Loading skin file: DialogYesNo.xml
11:52:18 T:139888797792064   DEBUG: ------ Window Init (DialogYesNo.xml) ------

The scanning then stops and says the server is unavailable and i can then press yes to continue scanning, if i press yes it will do the same again, and if i press no it will just quit.

Hope this can be fixed, and thanks for working on an mvid plugin ;-)

Regards
Domin

Same here. Any clues?
find quote
zag Online
Team-XBMC Member
 Posts: 795
Joined: Oct 2007
Reputation: 7
Location: UK
2013-01-16 18:50 Post: #5
Quote:Correctly matched 1 of 24 music videos to its artist. Doesn't like dashes, searching "B.o.B." results in an "unable to connect to remote server" error.

Olympia could you take a look at these issues maybe? The dash thing is a big problem as it effects lots of searches.

Code:
http://www.theaudiodb.com/api/v1/json/1/searchtrack.php?s=placebo&t=Infra-red

Works so it must be scraper problem.

The issue with B.o.B is that there is an extra fullstop at the end of the users search string. It shouldn't cause a server error though.

Code:
http://www.theaudiodb.com/api/v1/json/1/searchtrack.php?s=b.o.b.&t=arena
HTPC - XBMC Frodo, MCE remote, 40gb intel ssd, core i5, 4gb ram | Storage - 2 x qnap 8tb 419p+ NAS | Display Samsung 46" LCD + Acer HD projector
Kitchen - Wall Mounted Motorola Xoom tablet | Mobile - Ipad 2 | My setup pics
[Image: widget]
(This post was last modified: 2013-01-16 18:58 by zag.)
find quote
skypichat Offline
Junior Member
 Posts: 27
Joined: Dec 2008
Reputation: 0
Location: France
2013-01-20 13:16 Post: #6
Hello,
Possible to read ID3 tag from MP4 files ?
The scrapper disconnect if the name contain "__ without "-"
XBMC 12 (Frodo), DVBViewer 5.0 (Recording Service 1.23.1) , Windows 7 32, EventGhost
CPU: P4 Q9550, RAM: 4 Go DDR II @1066 GPU: NVidia 9800GT
HDD SSD: 2x64 Raid 0 SSD Crucial M4 4x 500 Go 2.5" HDD
TUNERS: Hauppauge WinTv Nova-T DVB-T and IPTV
REMOTES: Simple remote Hauppauge with USB-UIRT recever + Windows Phone 7.5 XBMC Remote
find quote
zag Online
Team-XBMC Member
 Posts: 795
Joined: Oct 2007
Reputation: 7
Location: UK
2013-01-21 10:30 Post: #7
(2013-01-20 13:16)skypichat Wrote:  Hello,
Possible to read ID3 tag from MP4 files ?
The scrapper disconnect if the name contain "__ without "-"

This is a metadata scraper, it doesn't read ID3 tags.

Try checking the database with sqlite to see how its been added to xbmc
HTPC - XBMC Frodo, MCE remote, 40gb intel ssd, core i5, 4gb ram | Storage - 2 x qnap 8tb 419p+ NAS | Display Samsung 46" LCD + Acer HD projector
Kitchen - Wall Mounted Motorola Xoom tablet | Mobile - Ipad 2 | My setup pics
[Image: widget]
find quote
n1md4 Online
Senior Member
 Posts: 203
Joined: Nov 2012
Reputation: 4
2013-01-26 15:13 Post: #8
Hi. I've added this today, and get the same error:

Code:
13:07:53 T:774605632  NOTICE: Previous line repeats 2 times.
13:07:53 T:774605632  NOTICE: Thread CVideoInfoScanner start, auto delete: false
13:07:53 T:774605632  NOTICE: VideoInfoScanner: Starting scan ..
13:07:53 T:774605632   ERROR: Run: Unable to parse web site
13:07:55 T:774605632 WARNING: No information found for item '/home/xbmc/videos/music/Charlene Soraia/Ghost.mkv', it won't be added to the library.
13:07:55 T:774605632   ERROR: Run: Unable to parse web site
13:07:57 T:774605632 WARNING: No information found for item '/home/xbmc/videos/music/Linkin Park/Meteora.mkv', it won't be added to the library.
13:07:57 T:774605632   ERROR: Run: Unable to parse web site
13:07:59 T:774605632 WARNING: No information found for item '/home/xbmc/videos/music/The Chemical Brothers/Block Rockin Beats.mkv', it won't be added to the library.
13:07:59 T:774605632  NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:05
XBMC Ubuntu minimal | Universal Scraper | ALA | TPB AFK
find quote
olympia Offline
Team-XBMC Member
 Posts: 2,381
Joined: May 2008
Reputation: 30
2013-01-26 15:40 Post: #9
you need ' - ' between the artist and the track.
find quote
n1md4 Online
Senior Member
 Posts: 203
Joined: Nov 2012
Reputation: 4
2013-01-26 15:51 Post: #10
Wizard! You're right, working now.
XBMC Ubuntu minimal | Universal Scraper | ALA | TPB AFK
find quote
Post Reply
Contact Us | XBMC Home | Return to Top | Return to Content | Lite (Archive) Mode | RSS Syndication