[Music Scraper] An alternative, like ex. discogs.com, musicbrainz.org, or amazon.com?

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
Gamester17 Offline
Team-XBMC Forum Moderator
Posts: 10,595
Joined: Sep 2003
Reputation: 9
Location: Sweden
Post: #11
Wikipedia.org does not use a unified standard which is a must for a scraper to work.

amazon.com could work as a source as they use a standard for all their pages.

Nod

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
find quote
xb2iris Offline
Skilled Skinner
Posts: 586
Joined: Jun 2008
Reputation: 0
Location: London, UK
Post: #12
cool... cool... amazon is pretty wicked as well... by the way, you look a lot like fred durst... hmmm...
find quote
Jeroen Offline
Skilled Skinner
Posts: 1,882
Joined: Feb 2008
Reputation: 4
Location: The Netherlands
Post: #13
http://www.discogs.com/
I use a plugin for this site in the Foobar mediaplayer on my desktop pc, it literally finds everything I throw at it.
find quote
steve1977 Offline
Posting Freak
Posts: 1,577
Joined: Dec 2006
Reputation: 0
Post: #14
Thanks for all your replies. Both last.fm and amazon.com work well also in China. Would be awesome if the world of XBMC would see on of these scrapers in the future!!!

Many thanks again and best regards!!!

Server: Asus Sabertooth Z77 | Intel Core i5 3.4 GHz | 12 GB DDR3 | 256 GB SSD, 40 TB (1 x 4 TB, 6 x 3TB, 9 x 2 TB)
HTPC 1: Apple Mac Mini (mid-2011) | Intel Core i5 2.5 GHz | 4GB DDR3 | 500 GB
HTPC 2: Apple Mac Mini (mid-2007) | Intel Core 2 Duo 2.0 GHz | 4 GB DDR2 | 16 GB SSD
find quote
theuni Offline
Team-XBMC Communication Manager
Posts: 1,090
Joined: Oct 2007
Reputation: 2
Location: Atlanta, Ga, USA
Post: #15
There's also an API for the site, maybe worth looking at:

http://www.discogs.com/help/api

TheUni
find quote
Gamester17 Offline
Team-XBMC Forum Moderator
Posts: 10,595
Joined: Sep 2003
Reputation: 9
Location: Sweden
Post: #16
rwparris2 Wrote:I'm started working on a Last.FM Scraper

Is it true that LastFM limit your query to one per second? If so then lookup with LastFM would take a very long time if you have a lot of songs.
TeknoJnky Wrote:
Quote:All web services here are for non-commercial use only under the Creative Commons Attribution-NonCommercial-ShareAlike License. If you want to use these services in a commercial context you must contact partners at last dot fm first to get a seperate license.

You can query last.fm 1 per second, averaged over an hour. Which is 3600 requests per hour. Normally your only making one request every 3 to 6 minutes (song length).

The xml feeds and other info @ http://www.audioscrobbler.net/data/webservices/
Though the cool thing about LastFM is that you could also grab additional information such as information about and picture of the artist, though for that you might have to request XBMC's skinning-engine to be extended for first, so tthat is off-topic for this thread.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
find quote
spiff Offline
Grumpy Bastard Developer
Posts: 12,187
Joined: Nov 2003
Reputation: 82
Post: #17
seeing we never grab info for songs online (apart from the track listing of an album), that really is not an issue

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
find quote
Kyusaku Offline
Junior Member
Posts: 10
Joined: Oct 2008
Reputation: 0
Post: #18
I would love a Last.fm scraper, Allmusic keeps scraping the wrong artist info. Because actually a good amount of my collection are Japanese indie bands.(most of which have Last.fm listings. )
find quote
Gamester17 Offline
Team-XBMC Forum Moderator
Posts: 10,595
Joined: Sep 2003
Reputation: 9
Location: Sweden
Thumbs Up  Two people started working on LastFM scapers! Post: #19
LastFM scrapers in development if progress, see here if you like to help:
http://forum.xbmc.org/showthread.php?tid=38379
and
http://forum.xbmc.org/showthread.php?tid=39028

Wink

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
find quote
azido Offline
Posting Freak
Posts: 1,881
Joined: Nov 2008
Reputation: 1
Location: Stuttgart, Germany
Post: #20
theuni Wrote:There's also an API for the site, maybe worth looking at:

http://www.discogs.com/help/api

TheUni

it would be extremely cool to use discogs as a scraping source. as far as i can see they've have a standarized output and hellofalot of informations.

man i wish i could be skilled enough to write a scraper for it. allmusic keeps adding the complete wrong informations to my albums since it may choose a "hit" by the first matching target it sees. at least when doing autoupdate for the music database.
find quote