What makes a site easy to scrape? (I'm starting a site)

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
hrotti Offline
Junior Member
Posts: 13
Joined: Aug 2009
Reputation: 0
Post: #1
I'm Icelandic and therefore a lot of my music doesn't scrape well. I've spent an awful lot of time on getting my audio library looking good, by manually creating artist posters and fanart. I don't have a clue about writing a scraper but figure I could do my part by uploading all my images and tagging etc. Then when I've got a reasonably large database i'd either try to modify an existing scraper or get some other Icelander to write a scraper.

So the question is: what would make a site easy to scrape?
find quote
jmarshall Offline
Team-XBMC Developer
Posts: 25,688
Joined: Oct 2003
Reputation: 169
Post: #2
An API (i.e. a search interface that returns easily parsed results).

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.


[Image: badge.gif]
find quote
darkscout Offline
Posting Freak
Posts: 2,145
Joined: Jul 2008
Reputation: 12
Post: #3
An API that returns JSON or XML.

[Image: aeKO.jpeg]
Code:
GRANT ALL PRIVILEGES ON `xbmc_%`.* TO 'xbmc'@'%';
IF you have a mysql problem, find one of the 4 dozen threads already open.
find quote
hrotti Offline
Junior Member
Posts: 13
Joined: Aug 2009
Reputation: 0
Post: #4
thanks guys Smile
find quote
Martijn Offline
Team-XBMC
Posts: 10,272
Joined: Jul 2011
Reputation: 154
Location: Dawn of time
Post: #5
Just a note you can share your covers/cdart on http://fannart.tv if they are also listed on http://musicbrainz.org/

Always read the XBMC online-manual, FAQ and search the forums before posting.
Do NOT e-mail Team-XBMC members asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting, make sure you read this first

For your mediacenter artwork go to
[Image: fanarttv.png]
find quote