Help with a new Korean Music Scraper? - Printable Version +- Kodi Community Forum (https://forum.kodi.tv) +-- Forum: Development (https://forum.kodi.tv/forumdisplay.php?fid=32) +--- Forum: Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=60) +--- Thread: Help with a new Korean Music Scraper? (/showthread.php?tid=47231) |
Help with a new Korean Music Scraper? - kimp93 - 2009-03-20 This is my third scraper. this time, I'm trying to make a music scraper. However, I don't even get search results. Here is a debug log that may relevant. Code: 23:50:03 T:668 M:154071040 DEBUG: FileCurl::Open(0012D844) http://music.search.cyworld.com/cymusic/search.html?query=Gee%20%28The%20First%20Mini%20Album%29&v=1 full debug log link to music scraper If I put same address in web browser, it works all right. XBMC don't seem to get anything after that. I tried scrap.exe after change couple of tags to run. It seems to work Ok. It makes all xml properly. I don't know why XBMC don't. I don't think it a bug in XBMC, since other music scrapers work. Please give me some idea. Thanks Young-cho - spiff - 2009-03-20 hi, since i don't read korean it's hard for me to locate the source where you found the form. i suspect you might need to post the form, not submit - kimp93 - 2009-03-20 I really appreciate your comment. I was totally lost. I did tried "post" and it does not seem to work. After your comment, I look at html more carefully. From http://music.search.cyworld.com/cymusic/search.html [HTML]<script type="text/javascript" src="http://music.cyworld.com/common/cybgm_snb_script.asp?query=&v=1"></script> [/HTML] From http://music.cyworld.com/common/cybgm_snb_script.asp [HTML] + ' <form name="search" id="search" autocomplete="off" action="http://music.search.cyworld.com/cymusic/search.html">' + ' <p id="selectTxt" onclick="ct_toggle();">전체</p>' + " <input type=\"text\" class=\"text\" name=\"query\" id=\"query\" onclick=\"ac_toggle(this);\" maxlength=\"100\" onKeyPress=\"if( event.keyCode == 13 ) { go_search(); return false; }\" title=\"검색어 입력\" value=\"\" onblur=\"toggleSearchBar(0);\" onfocus=\"toggleSearchBar(1);\" />" + ' <input type="button" class="btn" title="검색" onclick="go_search();" />' + ' </form>[/HTML] I don't know much about java script. Based on this, they don't seem to use post. After the form. there are more java probably for ajax auto-completion which I'm not sure it matter though. - kimp93 - 2009-05-15 Now I gave up on previous music scraper. So I made a new one that I familiar with. I'm trying to scrape same site as movie scraper (DAUM) that I made before. However same thing are happening as before. I can not get search result. Here is a part of the scraper Code: <CreateAlbumSearchUrl dest="3"> Here is a debug log Code: 14:22:09 T:3828 M:232128512 DEBUG: thread start, auto delete: 0 Once again, I could get search result with the URL in debug log from firefox. Since same kind of movie scraper daum.xml work ok, I don't know why same site with similar search URL don't work in music scraper. http://music.daum.net/search/album.do?query=Gee%20%28The%20First%20Mini%20Album%29 If anything need to solve the problem, please let me know. Here is a link to the scraper and a sample. download |