MvScraper

lilfire · 2011-09-08 20:24

MvScraper

Since the MTV scraper does not work anymore and yahoo scarper are not stable, I decided to develop my own scraper, MvScraper.
It's still in an early version and contains probably some bugs.

[Image: MvScraper.png]

Appreciate any feedback. Suggestions for new functionality are welcome.

Features
Scrape info from musicvdb.com.
Scrape thumb from Yahoo.
Output to Nfo.
Update Mysql database.
Generate Thumb from videofiles.
Download Thumb from Yahoo to tbn file.
Upload genearated thumb to smb or ftp.
Scrape multiple simultaneous videos.

Known bugs:

None

Known limitations:

None

Change Log:

07.02,2012 v0.4
Added Amazone Scraper
Added Freedb Scraper
Prioritize scrapers
Merge NFO
Increased max number of scraper

21.09.2011 v0.3
Added support to scrape multiple simultaneous videos
Added logo
Fix Bug:Crash on wrong filename
Added progressbar
Add support for more filename variants.

Artist_-_Titel
Artist - Titel
Artist.-.Titel
Artist-Titel
01_-_Artist_-_Titel
01 - Artist - Titel
01.-.Artist.-.Titel
01-Artist-Titel
Try spliting om whitespace

Added support for error logs(Debuge)
Setup file

13.09.2011 v0.2
Added extension settings
Added support for folder structure(\Music Videos\Artist - Title\whatever.ext)
Split Logic and GUI, GUI is updated
Added log to GUI
Added tooltip

08.09.2011 v0.1
Release

ToDo:

Add more scrappers
Specifies the number of seconds in the movie thumb should will be generated

Requirements:
.Net 4.0

Download:

Current
MvScraper v0.4

Old
MvScraper v0.3
MvScraper v0.2
MvScraper v0.1

Source code will be released no later than version 1.0

ECEC · 2011-09-08 21:01

I pointed this to my music video folder, which contains nicely formatted folder names and pretty dumb internet-scene type names in the individual folders. After configuring the settings I hit generate and it's been "working.." for awhile. I've only got around 50 music videos, and it's been running for at least an hour or so.

Should I do anything else, or let it do it's thing?

lilfire · 2011-09-08 21:08

Sorry. Forgot to mention that it currently is only supported files in the same folder with the name: Artist - Title.

Can you give me your folder tree? Then I try to get immplementert support for it in the next version.

Will try to separate the GUI in a separate thread for the next version so you can see prossesen

Vampirebat · 2011-09-08 22:07

this outputs to the same folder your scraping i assume since there isn't a setting to assign an output folder?
i ask cause ive left it running for maybe 20 mins or so thus far and it doesn't seem to be doing anything.

win xp 32 SP 3
files are all in the same folder and formatted as follows.
Trapt - Headstrong.mp4

all mp4

lilfire · 2011-09-08 22:23

My mistake again. The first time I publish a program. I forgot to add the settings for the file extension, MP4 is not hardcoded in. It only support avi and mpg at the moment, heck that i forgot that. Wil fix it in the next version. I will try to get the new version out next week.

ECEC · 2011-09-08 22:26

My folder structure looks like:

\Music Videos\Artist - Title\whatever.ext

lilfire · 2011-09-08 22:32

Okey. I wil immplementert support for it in the next version.

lilfire · 2011-09-13 22:10

Version 0.2 is out. Check it out Wink

ECEC · 2011-09-13 23:53

lilfire Wrote:Version 0.2 is out. Check it out

So this time it worked, but it only worked for two music videos out of the bunch. What kind of info do you need from me to troubleshoot?

lilfire · 2011-09-14 08:54

If you can give me the exact folder name, and name of the files in the folder, for 5 videos that it didn't work for.

lilfire Junior Member Posts: 10 Joined: Sep 2011 Reputation: 0	2011-09-08 21:08 Post: #3 Sorry. Forgot to mention that it currently is only supported files in the same folder with the name: Artist - Title. Can you give me your folder tree? Then I try to get immplementert support for it in the next version. Will try to separate the GUI in a separate thread for the next version so you can see prossesen
	find quote

Vampirebat Donor Posts: 154 Joined: Feb 2009 Reputation: 0	2011-09-08 22:07 Post: #4 this outputs to the same folder your scraping i assume since there isn't a setting to assign an output folder? i ask cause ive left it running for maybe 20 mins or so thus far and it doesn't seem to be doing anything. win xp 32 SP 3 files are all in the same folder and formatted as follows. Trapt - Headstrong.mp4 all mp4
	find quote

lilfire Junior Member Posts: 10 Joined: Sep 2011 Reputation: 0	2011-09-08 22:23 Post: #5 My mistake again. The first time I publish a program. I forgot to add the settings for the file extension, MP4 is not hardcoded in. It only support avi and mpg at the moment, heck that i forgot that. Wil fix it in the next version. I will try to get the new version out next week.
	find quote

ECEC Fan Posts: 374 Joined: Sep 2007 Reputation: 0	2011-09-08 22:26 Post: #6 My folder structure looks like: \Music Videos\Artist - Title\whatever.ext
	find quote

lilfire Junior Member Posts: 10 Joined: Sep 2011 Reputation: 0	2011-09-08 22:32 Post: #7 Okey. I wil immplementert support for it in the next version.
	find quote

lilfire Junior Member Posts: 10 Joined: Sep 2011 Reputation: 0	2011-09-13 22:10 Post: #8 Version 0.2 is out. Check it out
	find quote

ECEC Fan Posts: 374 Joined: Sep 2007 Reputation: 0	2011-09-13 23:53 Post: #9 lilfire Wrote:Version 0.2 is out. Check it out So this time it worked, but it only worked for two music videos out of the bunch. What kind of info do you need from me to troubleshoot?
	find quote

lilfire Junior Member Posts: 10 Joined: Sep 2011 Reputation: 0	2011-09-14 08:54 Post: #10 If you can give me the exact folder name, and name of the files in the folder, for 5 videos that it didn't work for.
	find quote