What makes a site easy to scrape? (I'm starting a site)

hrotti · 2012-03-06 02:26

I'm Icelandic and therefore a lot of my music doesn't scrape well. I've spent an awful lot of time on getting my audio library looking good, by manually creating artist posters and fanart. I don't have a clue about writing a scraper but figure I could do my part by uploading all my images and tagging etc. Then when I've got a reasonably large database i'd either try to modify an existing scraper or get some other Icelander to write a scraper.

So the question is: what would make a site easy to scrape?

**jmarshall** · 2012-03-06 04:30

An API (i.e. a search interface that returns easily parsed results).

darkscout · 2012-03-06 05:31

An API that returns JSON or XML.

hrotti · 2012-03-06 11:31

thanks guys Smile

**Martijn** · 2012-03-06 13:10

Just a note you can share your covers/cdart on http://fannart.tv if they are also listed on http://musicbrainz.org/

jmarshall Team-XBMC Developer Posts: 24,523 Joined: Oct 2003 Reputation: 138	2012-03-06 04:30 Post: #2 An API (i.e. a search interface that returns easily parsed results). Always read the XBMC online-manual, FAQ and search the forum before posting. Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules. For troubleshooting and bug reporting please make sure you read this first.
	find quote

darkscout Posting Freak Posts: 2,148 Joined: Jul 2008 Reputation: 12	2012-03-06 05:31 Post: #3 An API that returns JSON or XML. Code: GRANT ALL PRIVILEGES ON `xbmc_%`.* TO 'xbmc'@'%'; IF you have a mysql problem, find one of the 4 dozen threads already open.
	find quote

hrotti Junior Member Posts: 13 Joined: Aug 2009 Reputation: 0	2012-03-06 11:31 Post: #4 thanks guys
	find quote