Kodi Community Forum
What makes a site easy to scrape? (I'm starting a site) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Development (https://forum.kodi.tv/forumdisplay.php?fid=32)
+--- Forum: Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=60)
+--- Thread: What makes a site easy to scrape? (I'm starting a site) (/showthread.php?tid=124795)



What makes a site easy to scrape? (I'm starting a site) - hrotti - 2012-03-06

I'm Icelandic and therefore a lot of my music doesn't scrape well. I've spent an awful lot of time on getting my audio library looking good, by manually creating artist posters and fanart. I don't have a clue about writing a scraper but figure I could do my part by uploading all my images and tagging etc. Then when I've got a reasonably large database i'd either try to modify an existing scraper or get some other Icelander to write a scraper.

So the question is: what would make a site easy to scrape?


- jmarshall - 2012-03-06

An API (i.e. a search interface that returns easily parsed results).


- darkscout - 2012-03-06

An API that returns JSON or XML.


- hrotti - 2012-03-06

thanks guys Smile


- Martijn - 2012-03-06

Just a note you can share your covers/cdart on http://fannart.tv if they are also listed on http://musicbrainz.org/