Dammit.....AllMusic.com (AMG) seems to have stopped scrapers..

**DDDamian** · 2012-01-21 09:18

With the help of a friend much more gifted than I, we found a solution to retreive artist bio & album info from AllMusic again (the best scraper IMHO).

1. Copy the raw script from the link below:
http://pastebin.com/sTRfsTpF

2. Paste it into a text file with Wordpad or a text/XML editor of your choice.

3. Save the file to \\special\addons\metadata.common.allmusic.com\allmusic.xml

4. Click yes to overwrite the existing file.

If you need help locating your \\special directory see here
http://wiki.xbmc.org/index.php?title=Userdata

Voila! The scraper will pull the data again. Credit to a better Python coder than I Cool

john6555 · 2012-01-21 13:05

DDDamian Wrote:With the help of a friend much more gifted than I, we found a solution to retreive artist bio & album info from AllMusic again (the best scraper IMHO).

1. Copy the raw script from the link below:
http://pastebin.com/sTRfsTpF

2. Paste it into a text file with Wordpad or a text/XML editor of your choice.

3. Save the file to \\special\addons\metadata.common.allmusic.com\allmusic.xml

4. Click yes to overwrite the existing file.

If you need help locating your \\special directory see here
http://wiki.xbmc.org/index.php?title=Userdata

Voila! The scraper will pull the data again. Credit to a better Python coder than I

Very cool, thanks! Too bad re-scraping is a such a pain. Is there any better way than to delete all sources, clean library, and then re-add and re-scan everything?

john6555 · 2012-01-21 13:43

Unfortunately still not scraping. Sad

EDIT: Nevermind... got it working, see 2 posts down.

Using Eden beta 1, Aeon MQ 3 1.2.1, Win7 x64.

**DDDamian** · 2012-01-21 18:51

@john6555 - Re-check, there is a subtle difference and it is functional. Don't forget to refresh the info.

Please note that this enables retrieval of publically viewable info for private library archival purposes and not for any commercial gain, concepts both entrenched in fair usage in many countries. I should make clear that it was a private inititiative to modify open-source code for that purpose, and was not prompted nor provided by Team XBMC. I'll add the discalimer that if this does not meet the concept of fair usage in your jurisdiction please do not make use of the code provided by my friend. Any potential user of the modification should consult their local laws and practices. If you have confirmed this to be within the realm of free use in your jurisdiction be aware that you do this at your sole discretion and on your own initiative.

john6555 · 2012-01-21 19:29

DDDamian Wrote:@john6555 - Re-check, there is a subtle difference and it is functional. Don't forget to refresh the info.

You are correct, it is slightly different, I'm not sure why the first time WinMerge said they are identical!

I did get it working, but I had to modify the allmusic.xml in the Program Files folder on Windows in addition to the \\special directory one.

Thanks a million!

**DDDamian** · 2012-01-21 19:41

john6555 Wrote:You are correct, it is slightly different, I'm not sure why the first time WinMerge said they are identical!

I did get it working, but I had to modify the allmusic.xml in the Program Files folder on Windows in addition to the \\special directory one.

Thanks a million!

You're welcome Wink

Please be sure you have read what I posted above. This is a private modification I'm providing a link to, and is in no way part of the official XBMC releases.

Mman · 2012-01-21 22:52

@DDDamian: This allows me to scrap, but for some odd reason, if an artist's bio has a link to another artist in the first line it instead scrapes that artist's page (ie, http://allmusic.com/artist/the-strokes-p478260 gives me info about Buddy Holly instead of The Strokes).

**DDDamian** · 2012-01-21 23:04

Mman Wrote:@DDDamian: This allows me to scrap, but for some odd reason, if an artist's bio has a link to another artist in the first line it instead scrapes that artist's page (ie, http://allmusic.com/artist/the-strokes-p478260 gives me info about Buddy Holly instead of The Strokes).

Interesting!? I see the page you're referring to - will check some of mine and see if I can duplicate. Just so you know - I'm not very experienced in Python so I can't guarantee a solution.

EDIT: I can confirm that's happening - will dig a little deeper....

**DDDamian** · 2012-01-22 22:19

DDDamian Wrote:EDIT: I can confirm that's happening - will dig a little deeper....

Pushed a fix - your scraper should auto-update if you are using a recent build.

Can you confirm it's working correctly now? In your test example mine's good now.

john6555 · 2012-01-23 00:39

DDDamian Wrote:Pushed a fix - your scraper should auto-update if you are using a recent build.

Can you confirm it's working correctly now? In your test example mine's good now.

What version is the fixed scraper? Don't think mine has updated yet...

john6555 Junior Member Posts: 16 Joined: Jan 2012 Reputation: 0	2012-01-21 13:43 Post: #23 Unfortunately still not scraping. EDIT: Nevermind... got it working, see 2 posts down. Using Eden beta 1, Aeon MQ 3 1.2.1, Win7 x64. (This post was last modified: 2012-01-21 19:30 by john6555.)
	find quote

Mman Junior Member Posts: 23 Joined: Dec 2009 Reputation: 0	2012-01-21 22:52 Post: #27 @DDDamian: This allows me to scrap, but for some odd reason, if an artist's bio has a link to another artist in the first line it instead scrapes that artist's page (ie, http://allmusic.com/artist/the-strokes-p478260 gives me info about Buddy Holly instead of The Strokes).
	find quote

john6555 Junior Member Posts: 16 Joined: Jan 2012 Reputation: 0	2012-01-23 00:39 Post: #30 DDDamian Wrote:Pushed a fix - your scraper should auto-update if you are using a recent build. Can you confirm it's working correctly now? In your test example mine's good now. What version is the fixed scraper? Don't think mine has updated yet...
	find quote