XBMC Community Forum
MvScraper - Printable Version

+- XBMC Community Forum (http://forum.xbmc.org)
+-- Forum: Help and Support (/forumdisplay.php?fid=33)
+--- Forum: Supplementary Tools for XBMC (/forumdisplay.php?fid=116)
+--- Thread: MvScraper (/showthread.php?tid=109694)

Pages: 1 2


MvScraper [Updated 21.09.11 v0.3] [Scrape Musicvideo - Generate NFO,SQL] - lilfire - 2011-09-08 20:24

MvScraper

Since the MTV scraper does not work anymore and yahoo scarper are not stable, I decided to develop my own scraper, MvScraper.
It's still in an early version and contains probably some bugs.

[Image: MvScraper.png]



Appreciate any feedback. Suggestions for new functionality are welcome.

Features
Scrape info from musicvdb.com.
Scrape thumb from Yahoo.
Output to Nfo.
Update Mysql database.
Generate Thumb from videofiles.
Download Thumb from Yahoo to tbn file.
Upload genearated thumb to smb or ftp.
Scrape multiple simultaneous videos.


Known bugs:

None

Known limitations:

None

Change Log:

07.02,2012 v0.4
Added Amazone Scraper
Added Freedb Scraper
Prioritize scrapers
Merge NFO
Increased max number of scraper

21.09.2011 v0.3
Added support to scrape multiple simultaneous videos
Added logo
Fix Bug:Crash on wrong filename
Added progressbar
Add support for more filename variants.
  • Artist_-_Titel
  • Artist - Titel
  • Artist.-.Titel
  • Artist-Titel
  • 01_-_Artist_-_Titel
  • 01 - Artist - Titel
  • 01.-.Artist.-.Titel
  • 01-Artist-Titel
  • Try spliting om whitespace
Added support for error logs(Debuge)
Setup file

13.09.2011 v0.2
Added extension settings
Added support for folder structure(\Music Videos\Artist - Title\whatever.ext)
Split Logic and GUI, GUI is updated
Added log to GUI
Added tooltip

08.09.2011 v0.1
Release


ToDo:

Add more scrappers
Specifies the number of seconds in the movie thumb should will be generated

Requirements:
.Net 4.0

Download:

Current
MvScraper v0.4

Old
MvScraper v0.3
MvScraper v0.2
MvScraper v0.1





[Image: btn_donateCC_LG.gif]

Source code will be released no later than version 1.0


- ECEC - 2011-09-08 21:01

I pointed this to my music video folder, which contains nicely formatted folder names and pretty dumb internet-scene type names in the individual folders. After configuring the settings I hit generate and it's been "working.." for awhile. I've only got around 50 music videos, and it's been running for at least an hour or so.

Should I do anything else, or let it do it's thing?


- lilfire - 2011-09-08 21:08

Sorry. Forgot to mention that it currently is only supported files in the same folder with the name: Artist - Title.

Can you give me your folder tree? Then I try to get immplementert support for it in the next version.

Will try to separate the GUI in a separate thread for the next version so you can see prossesen


- Vampirebat - 2011-09-08 22:07

this outputs to the same folder your scraping i assume since there isn't a setting to assign an output folder?
i ask cause ive left it running for maybe 20 mins or so thus far and it doesn't seem to be doing anything.

win xp 32 SP 3
files are all in the same folder and formatted as follows.
Trapt - Headstrong.mp4

all mp4


- lilfire - 2011-09-08 22:23

My mistake again. The first time I publish a program. I forgot to add the settings for the file extension, MP4 is not hardcoded in. It only support avi and mpg at the moment, heck that i forgot that. Wil fix it in the next version. I will try to get the new version out next week.


- ECEC - 2011-09-08 22:26

My folder structure looks like:

\Music Videos\Artist - Title\whatever.ext


- lilfire - 2011-09-08 22:32

Okey. I wil immplementert support for it in the next version.


- lilfire - 2011-09-13 22:10

Version 0.2 is out. Check it out Wink


- ECEC - 2011-09-13 23:53

lilfire Wrote:Version 0.2 is out. Check it out Wink

So this time it worked, but it only worked for two music videos out of the bunch. What kind of info do you need from me to troubleshoot?


- lilfire - 2011-09-14 08:54

If you can give me the exact folder name, and name of the files in the folder, for 5 videos that it didn't work for.