+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Music Video Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=304)
+----- Thread: Release TheAudioDb.com Music Video Scraper (/showthread.php?tid=136105)
RE: [Release] TheAudioDb.com Music Video Scraper - zag - 2015-09-27
Yep, the mvid scraper hits all your music so every user can send tens of thousands of requests.
RE: [Release] TheAudioDb.com Music Video Scraper - daske9r3 - 2015-09-28
@zag That's an impressive amount of requests. Thanks for the explanation.
RE: [Release] TheAudioDb.com Music Video Scraper - Gadget43 - 2015-09-28
(2015-09-26, 23:44)zag Wrote: theaudiodb Api is disabled for a few days, the amount of requests is getting ridiculous (4 million this month alone) and I'm reaching the bandwidth limit of theaudiodb hosting.
I'll take a look on Monday about making it more efficient.
First off, REALLY Awesome set up by the way.
Love the QNAP boxes, but here in S.A. (Despite the fact that the government will swear blind we are a 1st world nation) a QNAP device starts at around R4000-00 - R40000 which is a huge chunk of change for me, so I went with 2 x HP Proliant Micro servers https://plus.google.com/117344414444879140483/posts/fGfAMxC5VKr , flashed the ROM so that it now takes 5 x 4 TB Seagate Surveilance HDD's in each one (Still busy migrating to the 4TB's but have 6 already, so only 4 x 4 left to go) and it runs off a 32GB memory stick that I installed XBMC (Probably not the best to use as a File server, but it never lets me down unlike the numerous NAS and file server software I have tried). 55" Hisense Smart Edge lit 3D flat pannel (Which in my opinion, is one of the best displays I have ever bought), and a Asus Fusion E350M deluxe all in one motherboard in a Mini-Itx case as my XBMC box in my lounge. All in all, it works fantastic, but nothing as elaborate as your setup of course, LoL.
Secondly, do you have any idea when theaudiodb will be working again? Just thought I would ask, because I actually haven't had XBMC/Kodi scraping my newly added music videos now for about a week and a half, which actually had me checking to see if there was something awry with my setup. No pain if it is down for a while, at least now I know it isn't to do with the setup thanks to your post I happened to find
Gadget..
RE: [Release] TheAudioDb.com Music Video Scraper - zag - 2015-09-29
Yes it will be back on the 1st October when the bandwidth limit resets.
You can check the status here
http://www.theaudiodb.com
RE: [Release] TheAudioDb.com Music Video Scraper - Gadget43 - 2015-09-29
(2015-09-29, 10:57)zag Wrote: Yes it will be back on the 1st October when the bandwidth limit resets.
You can check the status here
http://www.theaudiodb.com
Awesome, thanks
RE: [Release] TheAudioDb.com Music Video Scraper - speckz - 2015-10-01
The site now has: We'll be back 5th October when the bandwidth limit resets!
RE: [Release] TheAudioDb.com Music Video Scraper - zag - 2015-10-01
Yep few days later than planned as Sunday is our biggest day for requests. 7 million hits that night alone!
RE: [Release] TheAudioDb.com Music Video Scraper - zag - 2015-10-02
Just in case anyone doesn't realize the user-base of Kodi
RE: [Release] TheAudioDb.com Music Video Scraper - peter0123 - 2015-10-02
ähh.. how much pay you for this hosting package?
own root server? cost? country?
This limit is
Kodi Team write to much Scrapping Info only for AudioDB.com. (Universal...)
You need more money or a better data-center.
Or a better solution, no one see the cost, only a button for paypal. take amazon and post the costs to buy traffic and ...
to take off the service is very.... 10000 people ask it self, why the scrapper hang..
RE: [Release] TheAudioDb.com Music Video Scraper - peter0123 - 2015-10-02
or give other people a change,, 1:1 Copy to make a second service!
RE: [Release] TheAudioDb.com Music Video Scraper - Poetic-Soul - 2015-10-05
Well it looks like it still is down. The website is up but I still can't scrape my Music Videos. Any idea how much longer before a solution will be available?
RE: [Release] TheAudioDb.com Music Video Scraper - zag - 2015-10-05
(2015-10-05, 15:31)Poetic-Soul Wrote: Well it looks like it still is down. The website is up but I still can't scrape my Music Videos. Any idea how much longer before a solution will be available?
Try again
RE: [Release] TheAudioDb.com Music Video Scraper - Poetic-Soul - 2015-10-05
Seems good now thanks.
RE: [Release] TheAudioDb.com Music Video Scraper - daske9r3 - 2015-10-06
Found this bug http://trac.kodi.tv/ticket/15635 regarding the problem, so added this information to the bug
Unable to scrape "Destiny's Child - Jumpin', Jumpin'".
I just get the dialog in which to change the search string, so it's like the search functionality is broken with this input.
Filename: Destiny's Child - Jumpin', Jumpin'.mkv
This is the output:
Code:
13:03:57 T:1970192384 DEBUG: ------ Window Init (DialogProgress.xml) ------
13:03:58 T:1604318272 NOTICE: Thread VideoInfoDownloader start, auto delete: false
13:03:58 T:1604318272 DEBUG: FindMovie: Searching for 'destiny's child - jumpin', jumpin'' using TheAudioDb.com for Music Videos scraper (path: '/storage/.kodi/addons/metadata.musicvideos.theaudiodb.com', content: 'musicvideos', version: '1.2.7')
13:03:58 T:1604318272 DEBUG: scraper: CreateSearchUrl returned <url>http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/searchtrack.php?s=destiny\'s%20child&t=jumpin\'2c%20jumpin\'</url>
13:03:58 T:1604318272 DEBUG: CurlFile::Open(0x10f8e7e0) http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/searchtrack.php?s=destiny\'s%20child&t=jumpin\'2c%20jumpin\'
13:03:58 T:1604318272 INFO: easy_aquire - Created session to http://www.theaudiodb.com
13:03:58 T:1604318272 DEBUG: Get: Using content of "http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/searchtrack.php?s=destiny\'s%20child&t=jumpin\'2c%20jumpin\'" as binary or text with "UTF-8" charset
13:03:58 T:1604318272 DEBUG: scraper: GetSearchResults returned <results sorted="yes"></results>
13:03:58 T:1604318272 DEBUG: FindMovie: Searching for 'destiny's child - jumpin', jumpin'' using TheAudioDb.com for Music Videos scraper (path: '/storage/.kodi/addons/metadata.musicvideos.theaudiodb.com', content: 'musicvideos', version: '1.2.7')
13:03:58 T:1604318272 DEBUG: scraper: CreateSearchUrl returned <url>http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/searchtrack.php?s=destiny\'s%20child&t=jumpin\'2c%20jumpin\'</url>
13:03:58 T:1604318272 DEBUG: CurlFile::Open(0x10f8e7e0) http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/searchtrack.php?s=destiny\'s%20child&t=jumpin\'2c%20jumpin\'
13:03:58 T:1604318272 DEBUG: Get: Using content of "http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/searchtrack.php?s=destiny\'s%20child&t=jumpin\'2c%20jumpin\'" as binary or text with "UTF-8" charset
13:03:58 T:1604318272 DEBUG: scraper: GetSearchResults returned <results sorted="yes"></results>
13:03:58 T:1604318272 DEBUG: Thread VideoInfoDownloader 1604318272 terminatingThe URL "http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/searchtrack.php?s=destiny\'s%20child&t=jumpin\'2c%20jumpin\'" when entered into Firefox, returns the following:
Code:
{"track":[{"strDebugTime":"0 Secconds"}]}If I on the other hand change the URL (remove the backslashes and add the missing % in front of the "2c") to "http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/searchtrack.php?s=destiny's%20child&t=jumpin'%2c%20jumpin'" it returns correct result.
So it seems that not escaping apostrophes and adding the % sign to the URL encoding of the comma makes the query return a correct result.
What can be done to make this be correctly identified? I'm guessing the search algorithm (in the Kodi addon) needs to be fixed as I've tried various searches with or without the ' and , characters to identify a workaround but with no luck.
RE: [Release] TheAudioDb.com Music Video Scraper - Mr Dumbass - 2015-10-08
Can anyone confirm if it's back now?