What makes a site easy to scrape? (I'm starting a site) - Printable Version +- Kodi Community Forum (https://forum.kodi.tv) +-- Forum: Development (https://forum.kodi.tv/forumdisplay.php?fid=32) +--- Forum: Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=60) +--- Thread: What makes a site easy to scrape? (I'm starting a site) (/showthread.php?tid=124795) |
What makes a site easy to scrape? (I'm starting a site) - hrotti - 2012-03-06 I'm Icelandic and therefore a lot of my music doesn't scrape well. I've spent an awful lot of time on getting my audio library looking good, by manually creating artist posters and fanart. I don't have a clue about writing a scraper but figure I could do my part by uploading all my images and tagging etc. Then when I've got a reasonably large database i'd either try to modify an existing scraper or get some other Icelander to write a scraper. So the question is: what would make a site easy to scrape? - jmarshall - 2012-03-06 An API (i.e. a search interface that returns easily parsed results). - darkscout - 2012-03-06 An API that returns JSON or XML. - hrotti - 2012-03-06 thanks guys - Martijn - 2012-03-06 Just a note you can share your covers/cdart on http://fannart.tv if they are also listed on http://musicbrainz.org/ |